Evaluating large language models in biomedical data science challenges through a classroom experiment
Huifang Ma, Zhicheng Ji, Tara Al-Hashimy, Austin Allen, Nan Cen, Orlando Chen, Yongyin Chen, Yutian Chen, Tong Cheng, Yueqi Gu, Bing Ji, Xiaohui Jiang, Fengnan Li, P J Li, Yueshan Liang, , Y. Zhang
This study evaluates large language models' ability to solve biomedical data science challenges using a classroom experiment on Kaggle, finding they produce competitive results despite not topping leaderboards.
Proceedings of the National Academy of Sciences · Dec 11, 2025Peer-reviewedBioinformatics