Zhou, Jessica, Rizzo, Kaeli, Christensen, Trevor, Tang, Ziqi, Koo, Peter K (2026) Distilling the Knowledge of Ensembles for Uncertainty-Aware Genomic Deep Learning. Methods in Molecular Biology, 3058. pp. 319-337. ISSN 1064-3745
Abstract
While deep neural networks have revolutionized predictive modeling in regulatory genomics, challenges persist in ensuring the reliability of their predictions and understanding model decision-making processes. This chapter introduces DEGU (Distilling Ensembles for Genomic Uncertainty-aware models), a model-training framework that integrates ensemble learning with knowledge distillation to enhance the robustness and explainability of genomic deep learning predictions. DEGU distills the distribution of predictions from an ensemble of models into a single student model, capturing both the ensemble's average predictions and the variability across models, which represents epistemic uncertainty. Additionally, DEGU can estimate aleatoric uncertainty by modeling variability across experimental replicates. Through applications across diverse functional genomic prediction tasks, we demonstrate that DEGU-trained models achieve ensemble-level performance in a single model, exhibit improved generalization to out-of-distribution sequences, provide more consistent mechanistic explanations through attribution analysis, and generate calibrated uncertainty estimates. These advances position DEGU as a practical framework for developing trustworthy and robust deep learning applications in genomics research.
| Item Type: | Paper |
|---|---|
| Subjects: | bioinformatics bioinformatics > genomics and proteomics |
| CSHL Authors: | |
| Communities: | CSHL labs > Koo Lab CSHL Post Doctoral Fellows School of Biological Sciences > Publications |
| SWORD Depositor: | CSHL Elements |
| Depositing User: | CSHL Elements |
| Date: | 2026 |
| Date Deposited: | 04 Sep 2026 13:34 |
| Last Modified: | 04 Sep 2026 13:34 |
| Related URLs: | |
| URI: | https://repository.cshl.edu/id/eprint/42307 |
Actions (login required)
 |
Administrator's edit/view item |