Cross-species modeling of plant genomes at single nucleotide resolution using a pre-trained DNA language model

Zhai, Jingjing, Gokaslan, Aaron, Schiff, Yair, Berthel, Ana, Liu, Zong-Yan, Miller, Zachary R, Scheben, Armin, Stitzer, Michelle C, Romay, M Cinta, Buckler, Edward S, Kuleshov, Volodymyr (June 2024) Cross-species modeling of plant genomes at single nucleotide resolution using a pre-trained DNA language model. bioRxiv. (Public Dataset) (Submitted)

PDF 10.1101.2024.06.04.596709.pdf - Submitted Version Available under License Creative Commons Attribution Non-commercial. Download (849kB)

Abstract

Understanding the function and fitness effects of diverse plant genomes requires transferable models. Language models (LMs) pre-trained on large-scale biological sequences can learn evolutionary conservation, thus expected to offer better cross-species prediction through fine-tuning on limited labeled data compared to supervised deep learning models. We introduce PlantCaduceus, a plant DNA LM based on the Caduceus and Mamba architectures, pre-trained on a carefully curated dataset consisting of 16 diverse Angiosperm genomes. Fine-tuning PlantCaduceus on limited labeled Arabidopsis data for four tasks involving transcription and translation modeling demonstrated high transferability to maize that diverged 160 million years ago, outperforming the best baseline model by 1.45-fold to 7.23-fold. PlantCaduceus also enables genome-wide deleterious mutation identification without multiple sequence alignment (MSA). PlantCaduceus demonstrated a threefold enrichment of rare alleles in prioritized deleterious mutations compared to MSA-based methods and matched state-of-the-art protein LMs. PlantCaduceus is a versatile pre-trained DNA LM expected to accelerate plant genomics and crop breeding applications.

Item Type:	Paper
Subjects:	bioinformatics bioinformatics > quantitative biology organism description > plant
CSHL Authors:	Scheben, Armin
Communities:	CSHL labs > Siepel lab
SWORD Depositor:	CSHL Elements
Depositing User:	CSHL Elements
Date:	10 June 2024
Date Deposited:	01 Jul 2024 18:12
Last Modified:	01 Jul 2024 18:12
Related URLs:	Publisher
Dataset ID:	https://huggingface.co/datasets/kuleshovgroup/Angiosperm_16_genomes
URI:	https://repository.cshl.edu/id/eprint/41592

Actions (login required)

Administrator's edit/view item