ProLigGPT: a language model for protein-targeted ligand design free from structural constraints
Yuesen Li, Chengyi Gao, Xin Gang SongiD, Wang XiangyuiD, Yungang XuiD, Suxia HaniD
Abstract
The deep-learning language model offers promising approaches to molecular design. However, existing models typically exhibit one or more of the following limitations: structural constraints, confinement to a single task, and lack of cross-domain capability (e.g., protein-to-ligand generation). Inspired by GPT's success in language modeling, we introduce ProLigGPT, a seq2seq autoregressive model based on GPT-2 and trained on ~1.9 million protein-ligand pairs without 3D structures. ProLigGPT supports tasks including de novo ligand generation and scaffold-based molecular design for target proteins. Benchmarking against three state-of-the-art structure-based models across eight representative target proteins, ProLigGPT demonstrated superior performance on comprehensive metrics. Through systematic evaluations of ProLigGPT's interpretability, we find that ProLigGPT uses the full protein sequence to generate target-aware ligands, unlike pocket-based strategies that depend only on residues near the binding site. Applying ProLigGPT to Pl3Kalpha; inhibitor design successfully yielded inhibitors with a novel scaffold and inhibitors derived from a known scaffold, demonstrating that ProLigGPT can reach beyond the boundaries of known chemical space. Finally, we validated the generalization ability of ProLigGPT on Target T1, which lacks a crystal structure and known inhibitors, confirming that ProLigGPT can design inhibitors solely from sequence information. These findings highlight the promise of language models in designing ligands for target proteins free from structural constraints, offering a flexible and scalable framework for exploring vast chemical spaces in drug discovery.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 51
- Assay
- Research Focus
- Approach
Abstract summary
Claude Opus 5.5 · xhigh effort · 18 Oct 2026 · from the abstract · CC BY-NC-ND 4.0
A GPT-2 retrained from scratch on protein-ligand binding data, with a BPE tokenizer redesigned for proteins and ligands, is proposed for generating ligands against a target protein.
Finding ligands for a given protein means searching a vast chemical space, and the generative adversarial networks used for this can collapse onto a narrow set of outputs. The authors argue that an autoregressive language model trained on protein-ligand pairs, maximising conditional probability under back-propagation, is a more stable route to candidate molecules.
Key results
ClaimedThe design change at the centre of the work is a chemistry-specific tokenizer plus full retraining, not fine-tuning of an off-the-shelf language model.
The stock GPT-2 tokenizer is dropped for one built with byte pair encoding to suit protein and ligand representations, and the model is trained from scratch on protein-ligand binding data; no generation benchmarks, docking scores or held-out evaluation appear in the abstract. · Abstract
ClaimedAutoregressive training is argued to avoid the mode collapse that can affect generative adversarial networks applied to drug design.
The argument rests on the training objective (maximising conditional probability, optimised by back-propagation) being more stable; no comparison against a GAN baseline is reported. · Abstract
ClaimedThe authors expect the approach to transfer to other tasks and to shorten ligand design cycles.
Presented as following from the design philosophy of the model; the abstract reports no efficiency measurement, hit rate, or result on any additional task. · Abstract
Methods, data and reproducibility
GPT-2 is adapted for ligand design: the original tokenizer is discarded in favour of one built with the byte pair encoding (BPE) algorithm for protein and ligand input, and the model is then trained from scratch on protein-ligand binding data, maximising conditional probability via back-propagation, so it can propose molecules for a specified protein.
- Protein-ligand binding data used for training, described only as a substantial amount with no source named
- Methods & tools
- DrugGPT, GPT-2, byte pair encoding (BPE)
Limitations (2)
- No evaluation is reported anywhere in the abstract: no metrics on generated molecules, no docking or binding results, no baseline comparison, so every advantage claimed rests on argument rather than measurement. · noted in this summary
- The training corpus is described only qualitatively, without source, size or accession, so the chemical and target coverage of the model cannot be judged. · noted in this summary
Who should read:Read this if you build generative models for ligand design and want the case for an autoregressive GPT-2 formulation with a tokenizer rebuilt for molecules and proteins.
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- ProtoBind-Diff: A Structure-Free Diffusion Language Model for Protein Sequence-Conditioned Ligand Design
Lukia Mistryukova, Vladimir D. Manuylov, … Peter O. Fedichev·bioRxiv·Jun 16, 2025
- De novo design of ligand binding proteins using large language models alone
Nam Hyeong Kim, A. Katherine Hatstat, … William F. DeGrado·bioRxiv·Sep 3, 2026
- Generalise or Memorise? Benchmarking Ligand-Conditioned Protein Generation from Sequence-Only Data
Alex Vicente, L Dornfeld, … Noelia Ferruz·bioRxiv·Mar 11, 2026
- Language models generalize beyond natural proteins
Robert Verkuil, Ori Kabeli, … Alexander W. Rives·bioRxiv·Dec 21, 2022
- Structure-informed Language Models Are Protein Designers
Zaixiang Zheng, Yifan Deng, … Quanquan Gu·bioRxiv·Feb 3, 2023
- Efficient Generation of Protein Pockets with PocketGen
Zaixi Zhang, Wan Xiang Shen, … Marinka Žitnik·Nature Machine IntelligencePeer-reviewed·Nov 15, 2024