Issa, Habon, Liu, Sunny, Ballé, Jona, Klindt, David (September 2026) High-dimensional population codes reveal interpretable and diverse features underlying visual perception. bioRxiv. ISSN 2692-8205 (Submitted)
Abstract
Despite large-scale recordings, neuroscience has identified representations for only a small fraction of visual features distinguishable by humans. This is increasingly attributed to mixed selectivity, where individual neurons respond to multiple stimuli, requiring population-level readouts of human-recognizable (‘interpretable’) representations. To identify interpretable representations at scale, we 1) computationally extract population codes from macaque electrophysiology datasets spanning V4 and IT cortex and vision models and 2) introduce an automated method to measure representation interpretability and diversity, then isolate a set of unique, meaningful features encoded by neurons versus populations. Across datasets, populations represent more interpretable, diverse features than neurons. This advantage grows with the number of sampled neurons and image diversity. Finally, we demonstrate through targeted ablations that interpretable representations play a causal role in downstream behavior. Overall, our framework enables a more comprehensive account of the features represented across biological and artificial visual systems and their contributions to visual perception.
| Item Type: | Paper |
|---|---|
| Subjects: | organism description > animal behavior organism description > animal behavior > visual |
| CSHL Authors: | |
| Communities: | CSHL Post Doctoral Fellows CSHL labs > Klindt lab |
| SWORD Depositor: | CSHL Elements |
| Depositing User: | CSHL Elements |
| Date: | 11 September 2026 |
| Date Deposited: | 18 Sep 2026 15:06 |
| Last Modified: | 18 Sep 2026 15:06 |
| Related URLs: | |
| URI: | https://repository.cshl.edu/id/eprint/42314 |
Actions (login required)
 |
Administrator's edit/view item |