Sign in
BioinformaticsbioRxiv
Preprint

ProLigGPT: a language model for protein-targeted ligand design free from structural constraints

Yuesen Li, Chengyi Gao, Xin Gang SongiD, Wang XiangyuiD, Yungang XuiD, Suxia HaniD

Abstract

The deep-learning language model offers promising approaches to molecular design. However, existing models typically exhibit one or more of the following limitations: structural constraints, confinement to a single task, and lack of cross-domain capability (e.g., protein-to-ligand generation). Inspired by GPT's success in language modeling, we introduce ProLigGPT, a seq2seq autoregressive model based on GPT-2 and trained on ~1.9 million protein-ligand pairs without 3D structures. ProLigGPT supports tasks including de novo ligand generation and scaffold-based molecular design for target proteins. Benchmarking against three state-of-the-art structure-based models across eight representative target proteins, ProLigGPT demonstrated superior performance on comprehensive metrics. Through systematic evaluations of ProLigGPT's interpretability, we find that ProLigGPT uses the full protein sequence to generate target-aware ligands, unlike pocket-based strategies that depend only on residues near the binding site. Applying ProLigGPT to Pl3Kalpha; inhibitor design successfully yielded inhibitors with a novel scaffold and inhibitors derived from a known scaffold, demonstrating that ProLigGPT can reach beyond the boundaries of known chemical space. Finally, we validated the generalization ability of ProLigGPT on Target T1, which lacks a crystal structure and known inhibitors, confirming that ProLigGPT can design inhibitors solely from sequence information. These findings highlight the promise of language models in designing ligands for target proteins free from structural constraints, offering a flexible and scalable framework for exploring vast chemical spaces in drug discovery.

PDFDOI
Structured summary ↓

02 /Specification & Classification

Click any tag to browse matching papers

Abstract summary

Verified abstract synthesis

Claude Opus 5.5 · xhigh effort · 18 Oct 2026 · from the abstract · CC BY-NC-ND 4.0

A GPT-2 retrained from scratch on protein-ligand binding data, with a BPE tokenizer redesigned for proteins and ligands, is proposed for generating ligands against a target protein.

Finding ligands for a given protein means searching a vast chemical space, and the generative adversarial networks used for this can collapse onto a narrow set of outputs. The authors argue that an autoregressive language model trained on protein-ligand pairs, maximising conditional probability under back-propagation, is a more stable route to candidate molecules.

Key results

  1. ClaimedThe design change at the centre of the work is a chemistry-specific tokenizer plus full retraining, not fine-tuning of an off-the-shelf language model.

    The stock GPT-2 tokenizer is dropped for one built with byte pair encoding to suit protein and ligand representations, and the model is trained from scratch on protein-ligand binding data; no generation benchmarks, docking scores or held-out evaluation appear in the abstract. · Abstract

  2. ClaimedAutoregressive training is argued to avoid the mode collapse that can affect generative adversarial networks applied to drug design.

    The argument rests on the training objective (maximising conditional probability, optimised by back-propagation) being more stable; no comparison against a GAN baseline is reported. · Abstract

  3. ClaimedThe authors expect the approach to transfer to other tasks and to shorten ligand design cycles.

    Presented as following from the design philosophy of the model; the abstract reports no efficiency measurement, hit rate, or result on any additional task. · Abstract

Methods, data and reproducibility

GPT-2 is adapted for ligand design: the original tokenizer is discarded in favour of one built with the byte pair encoding (BPE) algorithm for protein and ligand input, and the model is then trained from scratch on protein-ligand binding data, maximising conditional probability via back-propagation, so it can propose molecules for a specified protein.

  • Protein-ligand binding data used for training, described only as a substantial amount with no source named
Methods & tools
DrugGPT, GPT-2, byte pair encoding (BPE)
Limitations (2)
  • No evaluation is reported anywhere in the abstract: no metrics on generated molecules, no docking or binding results, no baseline comparison, so every advantage claimed rests on argument rather than measurement. · noted in this summary
  • The training corpus is described only qualitatively, without source, size or accession, so the chemical and target coverage of the model cannot be judged. · noted in this summary

Who should read:Read this if you build generative models for ligand design and want the case for an autoregressive GPT-2 formulation with a tokenizer rebuilt for molecules and proteins.

Reproducibility ledger

Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.

Sign in to file a reproducibility report.

Similarity Map
SelectedSame fieldCross-field
THISMistryukova '25Kim '26Vicente '26Verkuil '22Zheng '23Zhang '24
83% semantic matchBiophysics
Lukia Mistryukova, Vladimir D. Manuylov, Konstantin Avchaciov+1 more·bioRxiv·Jun 16, 2025· 2 citations