Cheese3D enables sensitive detection and analysis of whole-face movement in mice

Daruwalla, Kyle, Nozal Martin, Irene, Zhang, Linghua, Naglič, Diana, Frankel, Andrew, Rasgaitis, Catherine, Zhao, Rubin, Zhang, Xinyan, Ahmad, Zainab, Borniger, Jeremy C, Hou, Xun Helen (April 2026) Cheese3D enables sensitive detection and analysis of whole-face movement in mice. Nature Neuroscience. ISSN 1097-6256 (Public Dataset)

[thumbnail of 10.1038.s41593-026-02262-8.pdf] PDF
10.1038.s41593-026-02262-8.pdf - Published Version
Available under License Creative Commons Attribution.

Download (19MB)

Abstract

Facial expressions and movements, from a subtle and ephemeral grimace to vigorous and rapid chewing, offer direct insights into the moment-to-moment changes of neural and physiological processes. Mice, with discernible facial responses and evolutionarily conserved mammalian facial movement control circuits, provide an ideal model in which to unravel the link between facial movement and underlying states. However, existing frameworks lack the spatial or temporal resolution to sensitively track all movements of the mouse face because of its small and conical form factor. We introduce Cheese3D, a computer vision system that captures high-speed 3D motion of the entire mouse face (including ears, eyes, whisker pad and jaw, covering both sides of the face), using a calibrated six-camera array. The interpretable framework extracts dynamics of anatomically meaningful 3D facial features in absolute world units at sub-mm precision. The precise face-wide motion data generated by Cheese3D provides clear insights, as shown by proof-of-principle experiments predicting anesthetic depth from changing facial patterns, inferring tooth and muscle anatomy from fast ingestion motions across the entire face, measuring minute differences in movements evoked by brainstem stimulation and relating neural activity to spontaneous facial movements, including expressive features only measurable in 3D (for example, angles of ear motion). Cheese3D can serve as a discovery tool that renders subtle mouse facial movements as a highly interpretable readout of otherwise hidden processes.

Item Type: Paper
Subjects: organism description > animal
organism description > animal behavior
organism description > animal > mammal
organism description > animal > mammal > rodent > mouse
organism description > animal > mammal > rodent
CSHL Authors:
Communities: CSHL labs > Borniger lab
CSHL labs > Hou lab
CSHL Post Doctoral Fellows
Undergraduate Research Program
SWORD Depositor: CSHL Elements
Depositing User: CSHL Elements
Date: 27 April 2026
Date Deposited: 28 Apr 2026 12:37
Last Modified: 28 Apr 2026 12:37
Related URLs:
Dataset ID:
  • https://doi.org/10.5281/zenodo.18508087
URI: https://repository.cshl.edu/id/eprint/42180

Actions (login required)

Administrator's edit/view item Administrator's edit/view item