Evidence-resolved benchmarks separate biological context recognition from direct-partner specificity in protein interaction models
Hansen ChengiD, Chengyu SuniD, Chuan YeiD, Chenyang WuiD, Dongyu ZhaoiD
Abstract
Sequence-based models enable scalable protein-protein interaction (PPI) prediction, but whether high scores identify direct physical partners or broader biological compatibility remains unclear. Here we show that biological-context recognition and direct-partner specificity are separable prediction capabilities. We introduce ProtNegDB (http://protnegdb.bjmu.edu.cn/), an evidence-resolved resource distinguishing experimentally supported non-binding from coordinate-verified noncontact within PDB biological assemblies. Using context-matched benchmarks, we find that five sequence-based predictors show limited ability to distinguish direct partners from noncontacting members of the same assembly, whereas PLM-Interact readily ranks both above unrelated proteins. Representation analyses reveal that adaptation to PPI prediction can strengthen biological-context encoding without yielding transferable direct-contact specificity. AlphaFold3 shows greater, though still incomplete, direct-partner resolution, suggesting that explicit multimer modeling can help refine partner specificity. In PLM-Interact, negatives defined by reconstituted direct-binding, cellular binary/proximity and co-complex assays occupy distinct score regimes. Across independent datasets and multiple models, experimental direct non-binding and assembly noncontact further show reproducible, model-dependent scoring patterns. High sequence-based PPI scores should not be interpreted as direct-interface probabilities. Mechanistically interpretable evaluation instead requires explicit consideration of interaction-evidence semantics and partner specificity.
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- A Corporative Language Model for Protein-Protein Interaction, Binding Affinity, and Interface Contact Prediction
Jun Liu, Hungyu Chen, Yang Zhang·Nature CommunicationsPeer-reviewed·Mar 10, 2026
- PLM-interact: extending protein language models to predict protein-protein interactions
Dan Liu, Francesca Young, … Ke Yuan·bioRxiv·Nov 5, 2024
- SPPIDER-seq: Sequence-based partner-aware predictor of protein-protein interaction sites
Aleksey Porollo, Om Jadhav, … Jichao Chen·BioinformaticsPeer-reviewed·Jun 13, 2026
- Explainable protein-protein binding affinity prediction via fine-tuning protein language models
Harshit Singh, RAJEEV KUMAR SINGH, … Rohan Gorantla·bioRxiv·Jun 11, 2026
- ProfPPIdb: pairs of physical protein-protein interactions predicted for entire proteomes
Linh Tran, Tobias Hamp, Burkhard Rost·PLoS ONEPeer-reviewed·Jul 18, 2018
- Constructed Negatives Shape the Evaluation of Sequence-Based Protein--Protein Interaction Models
Enzo Durand, Sergei Grudinin, … Élodie Laine·bioRxiv·Oct 15, 2026