genomicBERT: A Light-weight Foundation Model for Genome Analysis using Unigram Tokenization and Specialized DNA Vocabulary
Tyrone Chen, Naima Vahab, Navya Tyagi…·Sonika Tyagi
This paper introduces genomicBERT, a lightweight genome analysis model that improves efficiency and performance through specialized DNA vocabulary and tokenization, validated across diverse case studies.