Klindt, D, O’Neill, C, Reizinger, P, Maurer, H, Miolane, N (January 2026) A unifying framework from neural superposition to sparse interpretable codes. Nature Machine Intelligence, 8 (7). pp. 1025-1037. ISSN 2522-5839
Abstract
Understanding how information is represented in neural networks is a fundamental challenge in both neuroscience and artificial intelligence. Despite their nonlinear computations, ample evidence suggests that neural networks encode features in superposition, meaning that systems linearly represent more concepts than they have neurons. This observation opens the door to extracting interpretable representations from otherwise opaque networks, but a principled account of why superposition arises and how it can be exploited has been lacking. Here we synthesize insights from identifiability theory, compressed sensing and quantitative interpretability research to propose a unified perspective on this phenomenon. Our synthesis yields a three-step framework: identifiability theory establishes that neural networks trained for classification recover latent features up to linear mixing, compressed sensing provides guarantees for disentangling these features via sparse coding, and interpretability metrics grounded in behavioural tasks assess whether the extracted features align with human-interpretable concepts. By bridging theoretical neuroscience, representation learning and interpretability research, our framework connects longstanding questions about neural coding in biological systems with modern efforts in artificial intelligence transparency, and highlights open problems at their intersection.
| Item Type: | Paper |
|---|---|
| Subjects: | neurobiology |
| CSHL Authors: | |
| Communities: | CSHL labs > Klindt lab |
| SWORD Depositor: | CSHL Elements |
| Depositing User: | CSHL Elements |
| Date: | 1 January 2026 |
| Date Deposited: | 30 Jul 2026 12:39 |
| Last Modified: | 30 Jul 2026 12:39 |
| Related URLs: | |
| URI: | https://repository.cshl.edu/id/eprint/42276 |
Actions (login required)
 |
Administrator's edit/view item |