Deep Learning for Diagnosing Patients with Rare Genetic Diseases

There are over 7,000 unique rare diseases, some of which affecting 3,500 or fewer patients in the US. Due to clinicians’ limited experience with such diseases and the considerable heterogeneity of their clinical presentations, many patients with rare genetic diseases remain undiagnosed. While artificial intelligence has demonstrated success in assisting diagnosis, its success is usually contingent on the availability of large labeled datasets.

Here, we present SHEPHERD, a deep learning approach for multi-faceted rare disease diagnosis. SHEPHERD is guided by existing knowledge of diseases, phenotypes, and genes to learn novel connections between a patient’s clinico-genomic information and phenotype and gene relationships. We train SHEPHERD exclusively on simulated patients and evaluate on a cohort of 465 patients representing 299 diseases (79% of genes and 83% of diseases are represented in only a single patient) in the Undiagnosed Diseases Network. SHEPHERD excels at several diagnostic facets: performing causal gene discovery (causal genes are predicted at rank = 3.52 on average), retrieving “patients-like-me” with the same gene or disease, and providing interpretable characterizations of novel disease presentations.

SHEPHERD demonstrates the potential of artificial intelligence to accelerate the diagnosis of rare disease patients and has implications for the use of deep learning on medical datasets with very few labels.

Rare diseases affect 300-400 million people worldwide, yet each disease has a very low prevalence, affecting no more than 50 per 100,000 individuals. Due to their low prevalence, most front-line clinicians lack experience with the disorders, resulting in many specialty referrals and expensive clinical workups for patients across multiple years and institutions. Furthermore, patients with the same disorder can present variable symptoms, disease severity, and age of onset. These challenges make rare disease diagnosis extremely difficult; approximately 70% of individuals seeking a diagnosis and up to half of the suspected Mendelian conditions remain undiagnosed.

Given a set of phenotypes describing a patient’s clinical presentation, SHEPHERD performs a multi-faceted patient diagnosis to identify causal genes, retrieve “patients-like-me” with the same causal gene or disease, or provide interpretable characterizations of novel disease presentations. SHEPHERD assists in the rare disease diagnosis at multiple points:

  • to find similar patients after the patient’s clinical workup,
  • to identify candidate genes after genome sequencing analysis or in conjunction with the clinical case review, and
  • to characterize the patient’s disease and find other patients with the same causal gene or disease.

Overview of SHEPHERD

SHEPHERD is first deep learning approach for individualized diagnosis of rare genetic diseases. It provides multi-faceted diagnosis of patients with rare genetic conditions. SHEPHERD operates at multiple points throughout the rare disease diagnosis process to perform causal gene discovery, retrieve “patients-like-me” with similar conditions, and provide interpretable names for novel disease presentations.

To overcome the limitations of supervised AI, SHEPHERD performs label-efficient training via knowledge-grounded metric learning, a deep learning paradigm uniquely suited for diagnostic analyses where patient diagnostic labels are incredibly scarce. This capability is achieved by projecting patient phenotypes in an embedding space whose geometry is optimized by the broader knowledge of phenotypes and genes.

When a new patient arrives, SHEPHERD projects the patient into the embedding space such that the patient is close to their most promising causal gene and disease and other patients with the same gene or disease. Using this embedding space for prediction, SHEPHERD nominates a patient’s genes and diseases even when no other patients are diagnosed with the same disease.

Evaluation on external patient cohorts

We evaluate SHEPHERD on an external cohort of patients in the Undiagnosed Diseases Network (UDN), a nationwide US study with 12 clinical sites that diagnose patients with rare, difficult to diagnose genetic conditions. SHEPHERD identifies the correct causal gene in 40% of patients spanning 16 disease areas.

Further, we show that SHEPHERD produces models with strong predictive performance across disease areas, clinical sites, and diagnosis years, successfully mitigating data mismatches between patient groups and pointing to SHEPHERD’s ability to minimize model performance gaps between patient groups.

SHEPHERD also generates meaningful patient representations that capture patient similarity and enable retrieval of “patients-like-me” with similar genetic conditions. Finally, our analyses demonstrate that SHEPHERD can nominate the correct diagnosis for patients with novel genetic diseases and provide interpretable characterizations of novel disease presentations.


Deep Learning for Diagnosing Patients with Rare Genetic Diseases
Emily Alsentzer*, Michelle M. Li*, Shilpa N. Kobren, Undiagnosed Diseases Network, Isaac S. Kohane and Marinka Zitnik
In Review 2023 [medRxiv]

* Equal Contribution

  title={Deep learning for diagnosing patients with rare genetic diseases},
  author={Alsentzer, Emily and Li, Michelle M and Kobren, Shilpa N and Undiagnosed Diseases Network and Kohane, Isaac S and Zitnik, Marinka},
  publisher={Cold Spring Harbor Laboratory Press}

Data availability

Datasets are available for download via Harvard Dataverse. To maintain the directory structure while downloading the files, make sure to select all files and download in the original format. We provide the following datasets for training SHEPHERD:

  • Rare disease knowledge graph
  • Disease-split train and validation sets for simulated patients
  • A cohort of MyGene2 patients

While the UDN dataset cannot be released in its entirety due to privacy concerns, anonymized UDN data has been deposited in dbGaP (accession phs001232) and PhenomeCentral. Phenotypes and causal variants and genes related to UDN diagnoses are shared publicly in ClinVar.

Code availability

Pytorch implementation of SHEPHERD is available in the GitHub repository.

We also provide an interactive demo to explore SHEPHERD’s predictions through a visual interface in the HuggingFace Space.


Latest News

Apr 2024:   Biomedical AI Agents

Mar 2024:   Efficient ML Seminar Series

We started a Harvard University Efficient ML Seminar Series. Congrats to Jonathan for spearheading this initiative. Harvard Magazine covered the first meeting focusing on LLMs.

Mar 2024:   UniTS - Unified Time Series Model

UniTS is a unified time series model that can process classification, forecasting, anomaly detection and imputation tasks within a single model with no task-specific modules. UniTS has zero-shot, few-shot, and prompt learning capabilities. Project website.

Mar 2024:   Weintraub Graduate Student Award

Michelle receives the 2024 Harold M. Weintraub Graduate Student Award. The award recognizes exceptional achievement in graduate studies in biological sciences. News Story. Congratulations!

Mar 2024:   PocketGen - Generating Full-Atom Ligand-Binding Protein Pockets

PocketGen is a deep generative model that generates residue sequence and full-atom structure of protein pockets, maximizing binding to ligands. Project website.

Feb 2024:   SPECTRA - Generalizability of Molecular AI

Feb 2024:   Kaneb Fellowship Award

The lab receives the John and Virginia Kaneb Fellowship Award at Harvard Medical School to enhance research progress in the lab.

Feb 2024:   NSF CAREER Award

The lab receives the NSF CAREER Award for our research in geometric deep learning to facilitate algorithmic and scientific advances in therapeutics.

Feb 2024:   Dean’s Innovation Award in AI

Jan 2024:   AI's Prospects in Nature Machine Intelligence

We discussed AI’s 2024 prospects with Nature Machine Intelligence, covering LLM progress, multimodal AI, multi-task agents, and how to bridge the digital divide across communities and world regions.

Jan 2024:   Combinatorial Therapeutic Perturbations

New paper introducing PDGrapher for combinatorial prediction of chemical and genetic perturbations using causally-inspired neural networks.

Nov 2023:   Next Generation of Therapeutics Commons

Oct 2023:   Structure-Based Drug Design

Geometric deep learning has emerged as a valuable tool for structure-based drug design, to generate and refine biomolecules by leveraging detailed three-dimensional geometric and molecular interaction information.

Oct 2023:   Graph AI in Medicine

Graph AI models in medicine integrate diverse data modalities through pre-training, facilitate interactive feedback loops, and foster human-AI collaboration, paving the way to clinically meaningful predictions.

Sep 2023:   New papers accepted at NeurIPS

Sep 2023:   Future Directions in Network Biology

Excited to share our perspectives on current and future directions in network biology.

Aug 2023:   Scientific Discovery in the Age of AI

Jul 2023:   PINNACLE - Contextual AI protein model

PINNACLE is a contextual AI model for protein understanding that dynamically adjusts its outputs based on biological contexts in which it operates. Project website.

Jun 2023:   Our Group is Joining the Kempner Institute

Excited to join Kempner’s inaugural cohort of associate faculty to advance Kempner’s mission of studying the intersection of natural and artificial intelligence.

Zitnik Lab  ·  Artificial Intelligence in Medicine and Science  ·  Harvard  ·  Department of Biomedical Informatics