Deep Learning for Diagnosing Patients with Rare Genetic Diseases

There are over 7,000 unique rare diseases, some of which affecting 3,500 or fewer patients in the US. Due to clinicians’ limited experience with such diseases and the considerable heterogeneity of their clinical presentations, many patients with rare genetic diseases remain undiagnosed. While artificial intelligence has demonstrated success in assisting diagnosis, its success is usually contingent on the availability of large labeled datasets.

Here, we present SHEPHERD, a deep learning approach for multi-faceted rare disease diagnosis. SHEPHERD is guided by existing knowledge of diseases, phenotypes, and genes to learn novel connections between a patient’s clinico-genomic information and phenotype and gene relationships. We train SHEPHERD exclusively on simulated patients and evaluate on a cohort of 465 patients representing 299 diseases (79% of genes and 83% of diseases are represented in only a single patient) in the Undiagnosed Diseases Network. SHEPHERD excels at several diagnostic facets: performing causal gene discovery (causal genes are predicted at rank = 3.52 on average), retrieving “patients-like-me” with the same gene or disease, and providing interpretable characterizations of novel disease presentations.

SHEPHERD demonstrates the potential of artificial intelligence to accelerate the diagnosis of rare disease patients and has implications for the use of deep learning on medical datasets with very few labels.

Rare diseases affect 300-400 million people worldwide, yet each disease has a very low prevalence, affecting no more than 50 per 100,000 individuals. Due to their low prevalence, most front-line clinicians lack experience with the disorders, resulting in many specialty referrals and expensive clinical workups for patients across multiple years and institutions. Furthermore, patients with the same disorder can present variable symptoms, disease severity, and age of onset. These challenges make rare disease diagnosis extremely difficult; approximately 70% of individuals seeking a diagnosis and up to half of the suspected Mendelian conditions remain undiagnosed.

Given a set of phenotypes describing a patient’s clinical presentation, SHEPHERD performs a multi-faceted patient diagnosis to identify causal genes, retrieve “patients-like-me” with the same causal gene or disease, or provide interpretable characterizations of novel disease presentations. SHEPHERD assists in the rare disease diagnosis at multiple points:

  • to find similar patients after the patient’s clinical workup,
  • to identify candidate genes after genome sequencing analysis or in conjunction with the clinical case review, and
  • to characterize the patient’s disease and find other patients with the same causal gene or disease.

Overview of SHEPHERD

SHEPHERD is first deep learning approach for individualized diagnosis of rare genetic diseases. It provides multi-faceted diagnosis of patients with rare genetic conditions. SHEPHERD operates at multiple points throughout the rare disease diagnosis process to perform causal gene discovery, retrieve “patients-like-me” with similar conditions, and provide interpretable names for novel disease presentations.

To overcome the limitations of supervised AI, SHEPHERD performs label-efficient training via knowledge-grounded metric learning, a deep learning paradigm uniquely suited for diagnostic analyses where patient diagnostic labels are incredibly scarce. This capability is achieved by projecting patient phenotypes in an embedding space whose geometry is optimized by the broader knowledge of phenotypes and genes.

When a new patient arrives, SHEPHERD projects the patient into the embedding space such that the patient is close to their most promising causal gene and disease and other patients with the same gene or disease. Using this embedding space for prediction, SHEPHERD nominates a patient’s genes and diseases even when no other patients are diagnosed with the same disease.

Evaluation on external patient cohorts

We evaluate SHEPHERD on an external cohort of patients in the Undiagnosed Diseases Network (UDN), a nationwide US study with 12 clinical sites that diagnose patients with rare, difficult to diagnose genetic conditions. SHEPHERD identifies the correct causal gene in 40% of patients spanning 16 disease areas.

Further, we show that SHEPHERD produces models with strong predictive performance across disease areas, clinical sites, and diagnosis years, successfully mitigating data mismatches between patient groups and pointing to SHEPHERD’s ability to minimize model performance gaps between patient groups.

SHEPHERD also generates meaningful patient representations that capture patient similarity and enable retrieval of “patients-like-me” with similar genetic conditions. Finally, our analyses demonstrate that SHEPHERD can nominate the correct diagnosis for patients with novel genetic diseases and provide interpretable characterizations of novel disease presentations.

Publication

Deep Learning for Diagnosing Patients with Rare Genetic Diseases
Emily Alsentzer*, Michelle M. Li*, Shilpa N. Kobren, Undiagnosed Diseases Network, Isaac S. Kohane and Marinka Zitnik
In Review 2023 [medRxiv]

* Equal Contribution

@article{alsentzer2022deep,
  title={Deep learning for diagnosing patients with rare genetic diseases},
  author={Alsentzer, Emily and Li, Michelle M and Kobren, Shilpa N and Undiagnosed Diseases Network and Kohane, Isaac S and Zitnik, Marinka},
  journal={medRxiv},
  pages={2022--12},
  url={https://www.medrxiv.org/content/10.1101/2022.12.07.22283238},
  year={2022},
  publisher={Cold Spring Harbor Laboratory Press}
}

Data availability

Datasets are available for download via Harvard Dataverse. To maintain the directory structure while downloading the files, make sure to select all files and download in the original format. We provide the following datasets for training SHEPHERD:

  • Rare disease knowledge graph
  • Disease-split train and validation sets for simulated patients
  • A cohort of MyGene2 patients

While the UDN dataset cannot be released in its entirety due to privacy concerns, anonymized UDN data has been deposited in dbGaP (accession phs001232) and PhenomeCentral. Phenotypes and causal variants and genes related to UDN diagnoses are shared publicly in ClinVar.

Code availability

Pytorch implementation of SHEPHERD is available in the GitHub repository.

We also provide an interactive demo to explore SHEPHERD’s predictions through a visual interface in the HuggingFace Space.

Authors

Latest News

Feb 2024:   Kaneb Fellowship and Dean’s Innovation Award

Feb 2024:   NSF CAREER Award

The lab receives the NSF CAREER Award for our research in geometric deep learning to facilitate algorithmic and scientific advances in therapeutics.

Jan 2024:   AI's Prospects in Nature Machine Intelligence

We discussed AI’s 2024 prospects with Nature Machine Intelligence, covering LLM progress, multimodal AI, multi-task agents, and how to bridge the digital divide across communities and world regions.

Jan 2024:   Combinatorial Therapeutic Perturbations

New paper introducing PDGrapher for combinatorial prediction of chemical and genetic perturbations using causally-inspired neural networks.

Nov 2023:   Next Generation of Therapeutics Commons

Oct 2023:   Structure-Based Drug Design

Geometric deep learning has emerged as a valuable tool for structure-based drug design, to generate and refine biomolecules by leveraging detailed three-dimensional geometric and molecular interaction information.

Oct 2023:   Graph AI in Medicine

Graph AI models in medicine integrate diverse data modalities through pre-training, facilitate interactive feedback loops, and foster human-AI collaboration, paving the way to clinically meaningful predictions.

Sep 2023:   New papers accepted at NeurIPS

Sep 2023:   Future Directions in Network Biology

Excited to share our perspectives on current and future directions in network biology.

Aug 2023:   Scientific Discovery in the Age of AI

Jul 2023:   PINNACLE - Contextual AI protein model

PINNACLE is a contextual AI model for protein understanding that dynamically adjusts its outputs based on biological contexts in which it operates. Project website.

Jun 2023:   Our Group is Joining the Kempner Institute

Excited to join Kempner’s inaugural cohort of associate faculty to advance Kempner’s mission of studying the intersection of natural and artificial intelligence.

Jun 2023:   Welcoming a New Postdoctoral Fellow

An enthusiastic welcome to Shanghua Gao who is joining our group as a postdoctoral research fellow.

Jun 2023:   On Pretraining in Nature Machine Intelligence

May 2023:   Congratulations to Ada and Michelle

Congrats to PhD student Michelle on being selected as the 2023 Albert J. Ryan Fellow and also to participate in the Heidelberg Laureate Forum. Congratulations to PhD student Ada for being selected as the Kempner Institute Graduate Fellow!

Apr 2023:   Universal Domain Adaptation at ICML 2023

New paper introducing the first model for closed-set and universal domain adaptation on time series accepted at ICML 2023. Raincoat addresses feature and label shifts and can detect private labels. Project website.

Apr 2023:   Celebrating Achievements of Our Undergrads

Undergraduate researchers Ziyuan, Nick, Yepeng, Jiali, Julia, and Marissa are moving onto their PhD research in Computer Science, Systems Biology, Neuroscience, and Biological & Medical Sciences at Harvard, MIT, Carnegie Mellon University, and UMass Lowell. We are excited for the bright future they created for themselves.

Apr 2023:   Welcoming a New Postdoctoral Fellow

An enthusiastic welcome to Tianlong Chen, our newly appointed postdoctoral fellow.

Apr 2023:   New Study in Nature Machine Intelligence

New paper in Nature Machine Intelligence introducing the blueprint for multimodal learning with graphs.

Mar 2023:   Precision Health in Nature Machine Intelligence

New paper with NASA in Nature Machine Intelligence on biomonitoring and precision health in deep space supported by artificial intelligence.

Zitnik Lab  ·  Artificial Intelligence in Medicine and Science  ·  Harvard  ·  Department of Biomedical Informatics