A 3D whole-face movement analysis system to uncover underlying physiology in mice

Daruwalla, Kyle, Martin, Irene Nozal, Frankel, Andrew, Naglic, Diana, Ahmad, Zainab, Hou, Xun Helen (May 2024) A 3D whole-face movement analysis system to uncover underlying physiology in mice. bioRxiv. (Submitted)

PDF 2024.05.07.593051v1.full.pdf - Submitted Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (5MB)

Abstract

Synchronous movements of the entire face, from chewing to grimacing, offer significant insights into internal physiological processes. Mice, with discernible facial responses and evolutionarily conserved mammalian facial movement control circuits, provide an ideal model to unravel the link between facial movement and internal physiological states in mammals. However, existing frameworks lack the spatial or temporal resolution to track motion of the entire mouse face, due to its small and conical form factor. We introduce Cheese3D, a computer vision system that first captures high-speed 3D motion of the entire mouse face (including ears, eyes, whisker pad, jaw, while covering both sides of the face) using a calibrated six-camera array. The interpretable framework extracts dynamics of anatomically-meaningful 3D facial features in absolute world units at sub-millimeter precision. The precise face-wide motion data generated by Cheese3D provides clear physiological insights, as shown by proof-of-principle experiments predicting time under anesthetic from subtle facial patterns, and inferring tooth and muscle anatomy from fast chewing motions. Cheese3D can serve as a discovery tool that renders facial movements highly interpretable as a readout of otherwise hidden internal states.

Item Type:	Paper
Subjects:	organism description > animal organism description > animal behavior organism description > animal > mammal organism description > animal > mammal > rodent > mouse organism description > animal > mammal > rodent
CSHL Authors:	Hou, Helen Daruwalla, Kyle Nozal Martin, Irene Frankel, Andrew Naglic, Diana Ahmad, Zainab
Communities:	CSHL labs > Hou lab
SWORD Depositor:	CSHL Elements
Depositing User:	CSHL Elements
Date:	8 May 2024
Date Deposited:	09 May 2024 19:25
Last Modified:	09 May 2024 19:25
Related URLs:	Publisher
URI:	https://repository.cshl.edu/id/eprint/41543

Actions (login required)

Administrator's edit/view item