Hiring in life sciences? Share your open positions with our professional community. Read more Close

Advertisement

LitGene: an interpretable transformer model integrating text and ontology for gene representation learning.

Created on 16 Nov 2026

Authors

Oladimeji Macaulay, Ala Jararweh, David Arredondo, Luis E Tafoya, Shrey Poshiya, Yue Hu, Olufunmilola M Oyebamiji, Yanfu Zhang, Christopher I Amos, Kushal Virupakshappa, Avinash Sahu

Published in

Nature communications. Volume 17. Issue 1. Oct 16, 2026. Epub Oct 16, 2026.

Abstract

Representation learning in genomics often relies on sequence, expression, and network data, thereby overlooking a wealth of insights in the scientific literature. Here, we present LitGene, an interpretable transformer-based model that refines gene representations by integrating unstructured textual information with Gene Ontology annotations through contrastive learning. In evaluations across eight benchmark tasks for protein properties, LitGene achieves competitive accuracy and exhibits zero-shot prediction of GO terms, KEGG pathways, and gene-disease associations. LitGene identified ANGPTL6 as a potential candidate gene for idiopathic pulmonary fibrosis (IPF), supported by its differential expression in independent IPF samples, illustrating LitGene's utility for hypothesis generation. A SHAP-based interpretability tool highlights text features influencing predictions, while an automated literature-grounding framework provides corroborating support where available. Our results suggest that integrating textual and genetic information may help reduce biases associated with under-studied genes. The model is released as open-source code, along with a publicly accessible web interface at https://litgene.cs.unm.edu/ , which allows users to submit gene names, disease names, drug names, or custom text (e.g., publication abstracts) to obtain evidence-based predictions of related biomedical entities.

PMID:
43035455
Bibliographic data and abstract were imported from PubMed on 16 Nov 2026.

Read full publication at:
Please sign in to see all details.

Advertisement

Stats

  • Community rating n/a 0 votes
  • Reviewers' rating n/a 0 votes
  • Your rating

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

  • Recommendations n/a n/a positive of 0 vote(s)
  • Views 4
  • Comments 0

Recommended by

  • No recommendations yet.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.

Advertisement