ICML 2026

SPATIA: Multimodal Generation and Prediction of Spatial Cell Phenotypes

Author Affiliations
1Department of Biomedical Informatics, Harvard Medical School, Boston, MA
2Department of Computer Science, University of North Carolina, Chapel Hill, NC
3Massachusetts Institute of Technology, Cambridge, MA
4Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University, Cambridge, MA
5Broad Institute of MIT and Harvard, Cambridge, MA
6Harvard Data Science Initiative, Cambridge, MA
*Equal contribution Corresponding author

Abstract

Understanding how cellular morphology, gene expression, and spatial context jointly shape tissue function is a central challenge in biology. Image-based spatial transcriptomics technologies now provide high-resolution measurements of cell images and gene expression profiles, but existing methods typically analyze these modalities in isolation or at limited resolution. We address the problem by introducing SPATIA, a multi-level generative and predictive model that learns unified, spatially aware representations by fusing morphology, gene expression, and spatial context from the cell to the tissue level. SPATIA also incorporates a novel spatially conditioned generative framework for modeling target-state morphology distributions under observed biological transition families. Specifically, we propose a confidence-aware flow matching objective that reweights weak optimal-transport pairs based on uncertainty. We further apply morphology-profile alignment to encourage biologically meaningful image generation, enabling the modeling of microenvironment-dependent phenotypic transitions. We assembled a multi-scale dataset consisting of 25.9 million cell-gene pairs across 17 tissues. We benchmark SPATIA against 18 models across 12 tasks, spanning categories such as phenotype generation, annotation, clustering, gene imputation, and cross-modal prediction. SPATIA achieves improved performance over state-of-the-art models, improving generative fidelity by 8% and predictive accuracy by up to 3%.

Overview of SPATIA
Overview of SPATIA.

Method Overview

  • Hierarchical multi-level architecture: We introduce SPATIA, a multimodal model that integrates morphology, gene expression, and spatial coordinates through a hierarchical attention design. It aggregates information from local cellular neighborhoods to global tissue structure, explicitly capturing spatial context at multiple levels.
  • Spatially conditioned generative modeling: We develop a conditional flow-matching module for modeling morphology changes under perturbations, conditioned on both intrinsic cell states and extrinsic spatial niches. Using optimal transport to align distributions, we simulate realistic phenotypic transitions (e.g., DCIS to invasive) without requiring paired pre-post perturbation data.
  • Large-Scale Benchmarking: We validate SPATIA on MIST, a curated assembly of 25.9M cells from 74 sources. Experiments on 12 predictive and generative tasks demonstrate that SPATIA outperforms 18 existing models, improving generative fidelity by 8% over state-of-the-art models and yielding predictive gains of up to 3% in zero-shot transfer and biomarker classification.
SPATIA model architecture
Overview of the SPATIA model architecture.
Multi-level spatial context and training data
Multi-level spatial context and training data across cellular neighborhoods and tissue niches.

Results

SPATIA qualitative and quantitative results
Qualitative and quantitative results across predictive and generative tasks.

BibTeX

@article{kong2025spatia,
  title={Spatia: Multimodal model for prediction and generation of spatial cell phenotypes},
  author={Kong, Zhenglun and Qiu, Mufan and Boesen, John and Lin, Xiang and Yun, Sukwon and Chen, Tianlong and Kellis, Manolis and Zitnik, Marinka},
  journal={ArXiv},
  pages={arXiv--2507},
  year={2025}
}