AF2Rank Revisited: Reproducing AlphaFold-Based Structure Evaluation and a Hypothesis for Context-Aware Refinement (CAR-AF)
Abstract
Protein structure prediction has undergone transformative advancements with AlphaFold2 achieving near-experimental accuracy across extensive protein datasets. This study reproduces and validates the AF2Rank pipeline, which utilizes AlphaFolds intrinsic confidence metrics--predicted Local Distance Difference Test (pLDDT) and predicted Template Modeling score (pTM)--to evaluate and rank decoy protein structures without dependence on multiple sequence alignments (MSAs). The pipeline was implemented locally using the Rosetta decoy dataset, overcoming reproducibility challenges such as software dependency conflicts, residue indexing inconsistencies, and system-level execution issues. This framework successfully enabled high-confidence evaluation of over 1000 decoys for a benchmark target (1a32), with ongoing expansion to 133 protein targets. Notably, we discovered that AlphaFold confidence metrics encode protein-specific "fingerprints," enabling reverse classification of structures to their source proteins. Our XGBoost-based classifier achieved 61.5% accuracy across 133 distinct protein targets, substantially exceeding random chance (0.75%). Feature importance analysis revealed that traditional energy functions (Rosetta normalized score, 26%) and derived interaction features (pLDDT-pTM ratio, 16%) provide the strongest discriminative power, suggesting AlphaFold metrics capture meaningful biological and structural information beyond generic quality assessment. Building upon this foundation, a novel hypothesis is introduced: Context-Aware Refinement of AlphaFold Predictions (CAR-AF). This approach postulates that AlphaFold-predicted structures may be further improved through refinement in the presence of their native binding partners--such as receptors or ligands--thereby producing conformations that are both structurally and functionally enhanced. The proposed methodology comprises four stages: generation of initial predictions via AlphaFold, structural modeling of relevant binding partners, docking of predicted proteins into these biological contexts, and refinement of the resulting complexes using molecular modeling tools such as Rosetta or HADDOCK. Structural and energetic metrics including TM-score, RMSD, and binding energy will be used to assess potential improvements in predictive quality.
02 /Specification & Classification
Click any tag to browse matching papersReproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Benchmarking Peptide Structure Prediction with AlphaFold2
A. Gulsevin, J. Meiler·bioRxiv·Feb 17, 2022
- Distance-AF: Modifying Predicted Protein Structure Models by Alphafold2 with User-Specified Distance Constraints
Yuanyuan Zhang, Zicong Zhang, … Daisuke Kihara·Communications BiologyPeer-reviewed·Sep 30, 2025
- Improvement of protein tertiary and quaternary structure predictions using the ReFOLD4 refinement method and the AlphaFold2 recycling process
Recep Adiyaman, Nicholas S. Edmunds, … Liam James McGuffin·bioRxiv·Dec 6, 2022
- Dissecting AlphaFolds Capabilities with Limited Sequence Information
Jannik Adrian Gut, Thomas Lemmin·bioRxiv·Mar 14, 2024
- Enhanced antibody-antigen structure predictionfrom molecular docking using AlphaFold2
Francis Gaudreault, Christopher R. Corbeil, Traian I. Sulea·Scientific ReportsPeer-reviewed·Sep 13, 2023
- Enhancing protein structure prediction accuracy by prioritizing important residues using protein language models
Yu Liu, Boming Kang, … Qinghua Cui·Communications BiologyPeer-reviewed·Sep 8, 2026