pathCLIP: Detection of Genes and Gene Relations from Biological Pathway Figures through Image-Text Contrastive Learning
F. He, K. Liu, Z. Yang, Y. Chen, R. Hammer, D. Xu, M. Popescu
The paper introduces pathCLIP, a system that identifies genes and gene relations from biological pathway figures using image-text contrastive learning, outperforming single-modality approaches.
bioRxiv · Oct 31, 2023Pathology