Dharmendra S. Modha photo

Project Pages


Contact Information

Dharmendra S. Modha
IBM Fellow; Chief Scientist - Brain-inspired Computing
Senior Manager - Cognitive Computing; IBM Research - Almaden


Cognitive Computing

  • Real-time Scalable Cortical Computing at 46 Giga Synaptic OPS/Watt with 100x Speeup in Time-to-Solution and 100,000x Reduction in Energy-to-Soution, Supercomputing 2014.  Link
  • Paul A. Merolla, John V. Arthur, Rodrigo Alvarez-Icaza, Andrew Cassidy, Filipp Akopyan, Jun Sawada, Bryan Jackson, Nabil Imam, Chen Guo, Yutaka Nakamura, Bernard Brezzo, Ivan Vo, Steven K. Esser, Rathinakumar Appuswamy, Brian Taba, Arnon Amir, Myron D. Flickner, William P. Risk, Rajit Manohar, and Dharmendra S. Modha, A million spiking-neuron integrated circuit with scalable communication network and interface, Science, 8 August 2014. Link
  • Benjamin Shaw, Aaron Cox, Paula Besterman, Jason Minyard, Camillo Sassano, Rodrigo Alvarez-Icaza, Alexander Andreopoulos, Rathinakumar Appuswamy, Andrew Cassidy, Shyamal Chandra, Pallab Datta, Emmett Mcquinn, William Risk, and Dharmendra S. Modha, "Cognitive Computing Commercialization: Boundary Objects for Communication," 3rd International Conference on Integration of Design, Engineering, and Management for Innovation, Porto, Portugal, 4-6th September 2013.
    PDF
  • Steve K. Esser, Alexander Andreopoulos, Rathinakumar Appuswamy, Pallab Datta, Davis Barch, Arnon Amir, John Arthur, Andrew Cassidy, Myron Flickner, Paul Merolla, Shyamal Chandra, Nicola Basilico, Stefano Carpin, Tom Zimmerman, Frank Zee, Rodrigo Alvarez-Icaza, Jeffrey A. Kusnitz, Theodore M. Wong, William P. Risk, Emmett McQuinn, Tapan K. Nayakz, Raghavendra Singh, and Dharmendra S. Modha, "Cognitive Computing Systems: Algorithms and Applications for Networks of Neurosynaptic Cores," Proceedings of the International Joint Conference on Neural Networks in Dallas, TX, August 2013.
    PDF
  • Arnon Amir, Pallab Datta, William P. Risk, Andrew S. Cassidy, Jeffrey A. Kusnitz, Alexander Andreopoulos, Theodore M. Wong, Myron Flickner, Rodrigo Alvarez-Icaza, Emmett McQuinn, Ben Shaw, Norm Pass, and Dharmendra S. Modha, "Cognitive Computing Programming Paradigm: A Corelet Language for Composing Networks of Neurosynaptic Cores," Proceedings of the International Joint Conference on Neural Networks in Dallas, TX, August 2013.
    PDF
  • Andrew S. Cassidy, Paul Merolla, John V. Arthur, Steve K. Esser, Bryan Jackson, Rodrigo Alvarez-Icaza, Pallab Datta, Jun Sawada, Theodore M. Wong, Vitaly Feldman, Arnon Amir, Daniel Ben-Dayan Rubin, Filipp Akopyan, Emmett McQuinn, William P. Risk, and Dharmendra S. Modha, "Cognitive Computing Building Block: A Versatile and Efficient Digital Neuron Model for Neurosynaptic Cores," Proceedings of the International Joint Conference on Neural Networks in Dallas, TX, August 2013.
    PDF
  • Bryan L. Jackson, Bipin Rajendran, Gragory S. Corrado, Matthew Breitwisch, Geoffrey W. Burr, Roger Cheek, Kailash Gopalakrishnan, Simone Raoux, Charles T. Rettner, Alvaro Padilla, Alex G. Schrott, Rohit S. Shenoy, Bulent N. Kurdi, Chung H. Lam, Dharmendra S. Modha, "Nanoscale electronic synapses using phase change devices," ACM Journal on Emerging Technologies in Computing Systems (JETC), May 2013
    PDF
  • N. Imam N, T. A. Cleland, R. Manohar, P. A. Merolla, J. V. Arthur, F. Akopyan, and D. S. Modha, "Implementation of olfactory bulb glomerular-layer computations in a digital neurosynaptic core", Front. Neurosci. 6:83, 2012.
    Abstract

  • Theodore M. Wong, Robert Preissl, Pallab Datta, Myron Flickner, Raghavendra Singh, Steven K. Esser, Emmett McQuinn, Rathinakumar Appuswamy, William P. Risk, Horst D. Simon, and Dharmendra S. Modha, 1014, "IBM Research Report", RJ 10502, November 13, 2012.
    PDF

  • Robert Preissl, Theodore M. Wong, Pallab Datta, Myron Flickner, Raghavendra Singh, Steven K. Esser, William P. Risk, Horst D. Simon, and Dharmendra S. Modha, "Compass: A Scalable Simulator for an Architecture for Cognitive Computing", IEEE SC 2012. Best Paper Finalist (six selected out of 472 submissions).
    PDF

  • John V. Arthur, Paul A. Merolla, Filipp Akopyan, Rodrigo Alvarez-Icaza, Andrew Cassidy, Shyamal Chandra, Steven K. Esser, Nabil Imam, William Risk, Daniel Rubin, Rajit Manohar, and Dharmendra S. Modha, "Building Block of a Programmable Neuromorphic Substrate: A Digital Neurosynaptic Core", International Joint Conference on Neural Networks, June 2012.
    PDF
  • Nabil Imam, Filipp Akopyan, John Arthur, Paul Merolla, Rajit Manohar, Dharmendra S Modha, "A Digital Neurosynaptic Core Using Event-Driven QDI Circuits", ASYNC 2012: IEEE International Symposium on Asynchronous Circuits and Systems, May 2012. Best Paper.
    PDF
  • Paul Merolla, John Arthur, Filipp Akopyan, Nabil Imam, Rajit Manohar, and Dharmendra S. Modha, "A Digital Neurosynaptic Core using Embedded Crossbar Memory with 45pJ per spike in 45nm", IEEE Custom Integrated Circuits Conference, September 2011.
    PDF
  • Jae-sun Seo, Bernard Brezzo, Yong Liu, Benjamin D. Parker, Steven K. Esser, Robert K. Montoye, Bipin Rajendran, Jose A. Tierno, Leland Chang, Dharmendra S. Modha, and Daniel J. Friedman, "A 45nm CMOS Neuromorphic Chip with a Scalable Architecture for Learning in Networks of Spiking Neurons", IEEE Custom Integrated Circuits Conference, September 2011.
    PDF
  • Dharmendra S. Modha, Rajagopal Ananthanarayanan, Steven K. Esser, Anthony Ndirango, Anthony J. Sherbondy, Raghavendra Singh, "Cognitive Computing", Communications of the ACM, vol.54, no.8, p.62-71, 2011.
  • Dharmendra S. Modha and Raghavendra Singh, "Network Architecture of the Long Distance Pathways in the Macaque Brain", Proceedings of the National Academy of the Sciences USA, 2010.
    PDF (Main Paper) | Supporting Information
  • Steven K. Esser, Anthony Ndirango, Dharmendra S. Modha, "Binding Sparse Spatiotemporal Patterns in Spiking Computation", International Joint Conference on Neural Networks, July 18-23, 2010, Barcelona, Spain.
    PDF
  • Rajagopal Ananthanarayanan, Steven K. Esser, Horst D. Simon, and Dharmendra S. Modha, "The Cat is Out of The Bag: Cortical Simulations with 10^9 neurons and 10^13 synapses", Supercomputing 09: Proceedings of the ACM/IEEE SC2009 Conference on High Performance Networking and Computing, Nov 14-20, 2009, Portland, OR. ACM Gordon Bell Prize.
    PDF
  • Anthony J. Sherbondy, Rajagopal Ananthanrayanan, Robert F. Dougherty, Dharmendra S. Modha, and Brian A. Wandell, "Think Global, Act Local; Projectome Estimation with BlueMatter", Proceedings of MICCAI 2009, Lecture Notes in Computer Science, Imperial College, London, 20-24 September 2009.
    PDF
  • Anthony J. Sherbondy, Rajagopal Ananthanrayanan, Robert F. Dougherty, Brian A. Wandell, and Dharmendra S. Modha, "BlueMatter: Optimal estimation of long range white matter fascicle networks using diffusion tensor imaging", HBM: Human Brain Mapping, 2009, San Francisco, CA.
    PDF
  • Dharmendra S. Modha, "A Conceptual Cortical Surface Atlas", PLoS ONE 4(6): e5693. doi:10.1371/journal.pone.0005693
    PDF
  • Rajagopal Ananthanarayanan and Dharmendra S. Modha, "Anatomy of a Cortical Simulator", Supercomputing 07: Proceedings of the ACM/IEEE SC2007 Conference on High Performance Networking and Computing, November 10-16, 2007, Reno, NV, USA
    PDF

  • James S. Albus, George A. Bekey, John H. Holland, Nancy G. Kanwisher, Jeffrey L. Krichmar, Mortimer Mishkin, Dharmendra S. Modha, Marcus E. Raichle, Gordon M. Shepherd, and Giulio Tononi, "A Proposal for a Decade of the Mind Initiative" Science [Letter], Vol 317, Issue 5843, 7 September 2007:1321.
    PDF
  • Raghavendra Singh and Dharmendra S. Modha, "Interactive Visualization and Graph Analysis of CoCoMac's Brain Parcellation and White Matter Connectivity Data", SfN: 2007: Society for Neuroscience Nov 3, 2007.
  • Rajagopal Ananthanarayanan and Dharmendra S. Modha, "Scaling, Stability, and Synchronization in Mouse-sized (and Larger) Cortical Simulations", CNS*2007: Sixteenth Annual Computational Neuroscience Meeting, Toronto, Canada July 8-12 2007. [Also appears as IBM Research Report RJ 10405, 2/14/2007.]
    PDF
  • James Frye, Rajagopal Ananthanarayanan, and Dharmendra S. Modha, "Towards real-time, mouse-scale cortical simulations," CoSyNe: Computational and Systems Neuroscience, Salt Lake City, Utah, Feb 22-25, 2007. [Also appears as IBM Research Report RJ 10404, 2/5/2007.]
    PDF

Lossy Compression

  • Dharmendra S. Modha and Narayana P. Santhanam, "Making the Correct Mistakes," Data Compression Conference (DCC 06), Snowbird, Utah, March 29-31, 2006.
    PDF
  • Dharmendra S. Modha and Daniela Pucci de Farias, "Finite-state Rate-distortion for Individual Sequences," in Proceedings of 2004 IEEE International Symposium on Information Theory, Chicago, IL, June 27-July 2, 2004.
    PDF | PDF of PRESENTATION
  • Dharmendra S. Modha, "Art of Making Errors: A Quadratic-time, Sequential, Adaptive Algorithm for Lossy Compression," IBM Research Report RJ 10286, February 19, 2003.
    PDF
  • Dharmendra S. Modha, "Codelet Parsing: Quadratic-time, Sequential, Adaptive Algorithms for Lossy Compression," Data Compression Conference (DCC 03), pp. 223-232, Snowbird, Utah, March 24-27, 2003.
    ABSTRACT | PDF

Caching Algorithms

Text & Web Clustering

  • Arindam Banerjee, Inderjit Dhillon, Joydeep Ghosh, Srujana Merugu, and Dharmendra S. Modha, "A Generalized Maximum Entropy Approach to Bregman Co-clustering and Matrix Approximation," Journal of Machine Learning Research, 8 (Aug):1919--1986, 2007.
    PDF
  • Deepayan Chakrabarti, Spiros Papadimitriou, Dharmendra S. Modha, and Christos Faloutsos, "Fully Automatic Cross-Associations," The Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 04), Seattle, Washington, August 22-25, 2004.
    PDF
  • Arindam Banerjee, Inderjit S. Dhillon, Joydeep Ghosh, Srujana Merugu, and Dharmendra S. Modha, "A Generalized Maximum Entropy Approach to Bregman Co-Clustering with Matrix Approximation," The Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 04), Seattle, Washington, August 22-25, 2004.
    PDF
  • Inderjit S. Dhillon, Subramanyam Mallela, and Dharmendra S. Modha, "Information-theoretic Co-Clustering," The Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 03), Washington, DC, August 24-27, 2003 (also appears as The University of Texas at Austin, Department of Computer Science, Technical Report TR-03-12, April 2003).
    POSTSCRIPT | PDF | ABSTRACT
  • Dharmendra S. Modha and W. Scott Spangler, "Feature Weighting in k-Means Clustering," Machine Learning, vol. 52, no. 3, pp. 217-237, 2003.
    POSTSCRIPT
  • Dharmendra S. Modha and W. Scott Spangler, "Clustering Hypertext with Applications to Web Searching," Proceedings of the ACM Hypertext 2000 Conference, San Antonio, TX, May 30-June 3, 2000 (also appears as IBM Research Report RJ 10160 (95035), October 7, 1999).
    POSTSCRIPT | PDF | SEE SAMPLE QUERIES
  • Inderjit S. Dhillon and Dharmendra S. Modha, "Concept Decompositions for Large Sparse Text Data using Clustering," Machine Learning, vol. 42, no. 1, pp. 143-175, January 2001 (also appears as IBM Research Report RJ 10147 (95022), July 8, 1999).
    POSTSCRIPT
  • Inderjit S. Dhillon and Dharmendra S. Modha, "A Data-clustering Algorithm on Distributed Memory Multiprocessors," Proceedings of Large-scale Parallel KDD Systems Workshop, ACM SIGKDD, August 15-18, 1999 (also appears Large-Scale Parallel Data Mining, Lecture Notes in Artificial Intelligence, Volume 1759, pp. 245-260, 2000)..
    POSTSCRIPT

Low-Density Parity Check Codes

  • Jorge Campello and Dharmendra S. Modha, "Extended Bit-Filling and LDPC Code Design," GLOBECOM 2001, San Antonio, Texas, November 25-29, 2001.
    PDF | POSTSCRIPT
  • Jorge Campello, Dharmendra S. Modha, and Sridhar Rajagopalan, "Designing LDPC Codes Using Bit-Filling," Proceedings of the IEEE ICC 2001, Helsinki, Finland, June 11-15, 2001.
    PDF

Quantum Coding & Information Theory

  • Isaac L. Chuang and Dharmendra S. Modha, "Reversible Arithmetic Coding for Quantum Data Compression," IEEE Transactions on Information Theory, vol. 46, no. 3, pp. 1104-1116, May 2000.
    POSTSCRIPT | PDF

Constraint Codes (Modulation Codes)

  • Larry Stockmeyer and Dharmendra S. Modha, "Links Between Complexity Theory and Constrained Block Coding," IEEE Transactions on Information Theory, vol. 48, no. 1, pp. 59--88, January 2002 (An abridged version appears in Proc. 16th IEEE Conf. on Computational Complexity, June 2001).
    POSTSCRIPT | PDF | PDF (Extended Abstract)
  • Roy D. Cideciyan, Evangelos Eleftheriou, Brian H. Marcus, Dharmendra S. Modha, "Maximum Transition Run Codes for Generalized Partial-Response Channels," IEEE Journal on Selected Areas in Communications, vol. 19, no. 4, April 2001.
    PDF
  • Dharmendra S. Modha and Brian H. Marcus, "Art of Constructing Low-complexity Encoders/decoders for Constrained Block Codes," IEEE Journal on Selected Areas in Communications, vol. 19, no. 4, April 2001.
    POSTSCRIPT | PDF

Data Visualization

  • Inderjit S. Dhillon, Dharmendra S. Modha and W. Scott Spangler, "Class Visualization of High-dimensional Data with Applications," Computational Statistics and Data Analysis , vol. 41, pp. 59-90, 2002.
    POSTSCRIPT | FREE SOFTWARE
  • Inderjit S. Dhillon, Dharmendra S. Modha and W. Scott Spangler, "Visualizing Class-structure of High-dimensional Data," Proc. 30th Symp. Interface: Computer Science & Statistics, January 1998.
    POSTSCRIPT | FREE SOFTWARE

Function & Density Estimation using Neural Nets

  • Dharmendra S. Modha and Elias Masry, "Prequential and Cross-validated Regression Estimation," Machine Learning, vol. 33, no. 1, October 1998.
  • Dharmendra S. Modha and Elias Masry, "A Prequential Approach to Regression Estimation," in Proceedings of 1997 International Symposium on Information Theory, Ulm, Germany, June 29-July 4, 1997.
    POSTSCRIPT
  • Dharmendra S. Modha and Elias Masry, "Rate of Convergence in Density Estimation using Neural Networks," Neural Computation, vol. 8, no. 5, pp. 1107-1122, July 1996.
  • Dharmendra S. Modha and Elias Masry, "Density Estimation using Neural Networks," in Proceedings of Thirty-Third Annual Allerton Conference on Communication, Control, and Computing, Monticello, IL, p. 529-534, October 4-6, 1995.
  • Dharmendra S. Modha and Yeshaiahu Fainman, "A Learning Law for Density Estimation," IEEE Transactions on Neural Networks, vol. 5, no. 3, pp. 519-523, May 1994.
  • Dharmendra S. Modha and Robert Hecht-Nielsen, "Multilayer Functionals," in Mathematical Approaches to Neural Networks, J. G. Taylor, Ed., pp. 235-260, Amsterdam: North-Holland, 1993.

Time Series Prediction

  • Dharmendra S. Modha and Elias Masry, "Memory-Universal Prediction Of Stationary Random Processes," IEEE Transactions on Information Theory, January 1998.
    POSTSCRIPT | PDF
  • Dharmendra S. Modha and Elias Masry, "Minimum Complexity Regression Estimation with Weakly Dependent Observations," IEEE Transactions on Information Theory, vol. 42, November 1996.
    POSTSCRIPT | PDF
  • Dharmendra S. Modha and Elias Masry, "Universal, Nonlinear, Mean-square Prediction of Markov Processes," in Proceedings of 1995 International Symposium on Information Theory, Whistler, British Columbia, Canada, September 17-22, 1995.
  • Dharmendra S. Modha and Elias Masry, "Minimum Complexity Regression Estimation with Weakly Dependent Observations," in Proceedings of IEEE-IMS Workshop on Information Theory and Statistics, Alexandria, VA, November 1994.

 

v

v

 

 

v

v

v

v