Sign in
Genetic & Genomic MedicinemedRxiv
Preprint

PrimateAI-3D outperforms AlphaMissense in real-world cohorts

David A. ParryiD, Tom Bosc, Tobias Hamp, Petko P. FizieviD, Abhishek SharmaiD, Irfahan KassamiD, Jeremy F. McRaeiD, Kyle Kai‐How FarhiD

Abstract

Accurately predicting the impact of genetic variants is essential for interpreting genomic data, yet no consensus exists on how to measure classifier performance. We prepared the most comprehensive set of benchmarks to date and applied them to the recently published models PrimateAI-3D and AlphaMissense. PrimateAI-3D outperforms AlphaMissense on rare-disease cohort and biobank benchmarks, indicating that performance on clinical databases or in vitro assays does not reliably generalize to real-world cohorts.

PDFDOI

02 /Specification & Classification

Click any tag to browse matching papers

Reproducibility ledger

Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.

Sign in to file a reproducibility report.