bioRxivBioinformaticsPreprint
Protein Language Models: Learning From Evolution, Designing Beyond It
Maurice BrenneriD, Julius SchlensokiD, Alexander P.iD, Robert SchmirleriD, Michael HeinzingeriD
Abstract
Protein language models (PLMs) have transformed our ability to learn from evolutionary sequence space, but protein engineering ultimately asks a different question: not what evolution selected, but what we should build next. Zero-shot likelihoods therefore provide useful, but not universal, measures of fitness and can misalign with engineering objectives. Experimental supervision redirects these priors towards properties of interest, enabling target-specific prediction and closed-loop optimization. PLMs thereby complement structure-based design: structural methods provide geometric control, while PLMs integrate experimental feedback to optimize functional and developability properties. Realizing this potential requires evaluation beyond retrospective predictive accuracy, towards extrapolation, multi-objective optimization, and prospective experimental success. We argue for recurring competitions combining scalable predictive benchmarks with prospective experimental challenges. Ultimately, progress should be measured not by predicting existing experiments, but by enabling successful new ones.
- assay: protein sequence
- research focus: protein design
- research focus: benchmarking
- approach: deep learning
- approach: statistical model
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Protein Language Model Fitness Is a Matter of Preference
Cade Gordon, Amy X. Lu, Pieter Abbeel·bioRxiv·Oct 3, 2024
- Simple baselines rival protein language models in dense combinatorial protein landscapes
Itay Talpir, Sarel Jacob Fleishman·bioRxiv·May 8, 2026
- Likelihood-based fine-tuning of protein language models for few-shot fitness prediction and design
Alex Hawkins‐Hooker, Shikha Surana, … Paul Duckworth·bioRxiv·May 28, 2024
- Pretrained protein language models choose between sequence novelty and structural completeness
Arjuna M. Subramanian, Zachary A. Martinez, Matt W. Thomson·bioRxiv·Oct 1, 2025
- InstructPLM: Aligning Protein Language Models to Follow Protein Structure Instructions
Jiezhong Qiu, Junde Xu, … Guangyong Chen·bioRxiv·Apr 17, 2024
- Structure-informed Language Models Are Protein Designers
Zaixiang Zheng, Yifan Deng, … Quanquan Gu·bioRxiv·Feb 3, 2023