A 3D whole-face movement analysis system to uncover underlying physiology in mice

Daruwalla, Kyle, Martin, Irene Nozal, Frankel, Andrew, Naglic, Diana, Ahmad, Zainab, Hou, Xun Helen (May 2024) A 3D whole-face movement analysis system to uncover underlying physiology in mice. bioRxiv. (Submitted)

[thumbnail of 2024.05.07.593051v1.full.pdf] PDF
2024.05.07.593051v1.full.pdf - Submitted Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (5MB)

Abstract

Synchronous movements of the entire face, from chewing to grimacing, offer significant insights into internal physiological processes. Mice, with discernible facial responses and evolutionarily conserved mammalian facial movement control circuits, provide an ideal model to unravel the link between facial movement and internal physiological states in mammals. However, existing frameworks lack the spatial or temporal resolution to track motion of the entire mouse face, due to its small and conical form factor. We introduce Cheese3D, a computer vision system that first captures high-speed 3D motion of the entire mouse face (including ears, eyes, whisker pad, jaw, while covering both sides of the face) using a calibrated six-camera array. The interpretable framework extracts dynamics of anatomically-meaningful 3D facial features in absolute world units at sub-millimeter precision. The precise face-wide motion data generated by Cheese3D provides clear physiological insights, as shown by proof-of-principle experiments predicting time under anesthetic from subtle facial patterns, and inferring tooth and muscle anatomy from fast chewing motions. Cheese3D can serve as a discovery tool that renders facial movements highly interpretable as a readout of otherwise hidden internal states.

Item Type: Paper
Subjects: organism description > animal
organism description > animal behavior
organism description > animal > mammal
organism description > animal > mammal > rodent > mouse
organism description > animal > mammal > rodent
CSHL Authors:
Communities: CSHL labs > Hou lab
SWORD Depositor: CSHL Elements
Depositing User: CSHL Elements
Date: 8 May 2024
Date Deposited: 09 May 2024 19:25
Last Modified: 09 May 2024 19:25
Related URLs:
URI: https://repository.cshl.edu/id/eprint/41543

Actions (login required)

Administrator's edit/view item Administrator's edit/view item