TheBioCollection: Unified Pre-Training Scale LLM Corpus for Biology
However, existing biological resources, such as molecular databases, protein repositories, genomic annotations, single-cell atlases, and pathway databases, are scattered across heterogeneous formats and remain unorganized into a cohesive corpus for language model training. We present TheBioCollection, a 52.6B-token pre-training-scale corpus that converts these disparate resources into a unified, training-ready form spanning small molecules, proteins, genomic sequences, cells, and pathways. Beyond consolidating existing data, TheBioCollection enriches each record with tool-computed biological properties and introduces new instruction tasks for capabilities that current corpora barely cover.
- ▪However, existing biological resources, such as molecular databases, protein repositories, genomic annotations, single-cell atlases, and pathway databases, are scattered across heterogeneous formats and remain unorganized into a cohesive co
- ▪We present TheBioCollection, a 52.6B-token pre-training-scale corpus that converts these disparate resources into a unified, training-ready form spanning small molecules, proteins, genomic sequences, cells, and pathways.
- ▪Beyond consolidating existing data, TheBioCollection enriches each record with tool-computed biological properties and introduces new instruction tasks for capabilities that current corpora barely cover.
Opening excerpt (first ~120 words) tap to expand
Quantitative Biology > Quantitative Methods arXiv:2607.08803 (q-bio) [Submitted on 9 Jul 2026] Title:TheBioCollection: Unified Pre-Training Scale LLM Corpus for Biology Authors:Hyunjin Seo, Hyeon Hwang, Gyubok Lee, Jay Shin, Jimin Park, Taesoo Kim, Sanghoon Lee, Hongjoon Ahn, Sungjun Han, Sangwon Jung View a PDF of the paper titled TheBioCollection: Unified Pre-Training Scale LLM Corpus for Biology, by Hyunjin Seo and 9 other authors View PDF HTML (experimental) Abstract:The push toward large language models for biology (BioLM) has created a need for training corpora that can endow models with a genuine understanding of biology.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at arXiv cs.AI.
Discussion
0 commentsMore from arXiv cs.AI
