bioRxivBioinformaticsPreprint
Multiscale harmonization, semantic integration, and immersive exploration of single-cell data in support of novel biological insights
Andreas BueckleiD, Chenchen ZhuiD, Alex Y. H. WongiD, Archibald EnninfuliD, Miao YangiD, Negin FarzadiD, Maria HaugeiD, Courteney MattisoniD, Nick SloaniD, Jason A. MaresiD, Xing ChengiD, Bruce W. HerriD, Juhi KhareiD, Yash Ramesh KumariD, Keyur ParekhiD, Siddhi Chavan, Paean LubyiD, Ushma J. PateliD, Yashvardhan JainiD, John W. HickeyiD, Gary D. BaderiD, Hemali P. PhatnaniiD, Vilas MenoniD, Rong FaniD, Peter Karl SorgeriD, , Katy BörneriD
Abstract
Single-cell atlassing efforts like the Human BioMolecular Atlas Program (HuBMAP) and Cellular Senescence Network (SenNet) produce multiscale datasets across the healthy, adult, human body but are typically explored on 2D screens with limited 3D affordances, even though understanding cell location within tissue, organ, and body requires spatial reasoning across many orders of magnitude. The Human Reference Atlas (HRA) provides standard terminologies and a Common Coordinate Framework (CCF) for harmonizing this data spatially and semantically. Building on the HRA Organ Gallery in virtual reality (VR), we present "HRA: Powers of Ten," which integrates, harmonizes, and visualizes biological data from these efforts in VR using a Multiscale Elevator System that lets users descend, like riding an elevator through an inverted skyscraper, from a whole body view of 81 reference organs to datasets across 5 organs (lymph node, brain, large intestine, small intestine, liver), 5 assay types (CODEX, Visium, v-CyCIF, Xenium, SBF-SEM), and 4 spatial scales. Shared by Data Providers, these VR scenes enable biological insights into senescence patterns, cellular neighborhoods, 3D tissue reconstruction, and subcellular liver architecture. A standard operating procedure supports adding further datasets. Freely available on the Meta Store to over 20 million headsets, the application, data, code are open-source.
- organism: human
- assay: spatial transcriptomics
- assay: proteomics
- assay: imaging
- research focus: software / tool
- research focus: database / resource
- approach: experimental assay
In-depth summary
Claude Opus 5.5 · xhigh effort · 8 Nov 2026 · from the full text of version 3 (30 Sept 2026) · CC BY 4.0
A free Meta Quest virtual reality app harmonizes CODEX, Visium, Xenium, volumetric immunofluorescence and electron microscopy data from 5 organs into 4 scale levels using the Human Reference Atlas.
Atlas data from HuBMAP (Human BioMolecular Atlas Program) and SenNet (Cellular Senescence Network) are mostly viewed in 2D, yet placing a cell in tissue, organ and body spans many orders of magnitude. The authors note that commercial anatomy apps lack whole-body-to-cellular data exploration and that earlier multiscale viewers are mostly genomic or limited organ-level prototypes; this work extends the Human Reference Atlas (HRA) Organ Gallery from whole body down to subcellular data from 5 assays.
Key results
ShownEight scenes, each from a different Data Provider, are reached through a Multiscale Elevator System. Each floor shrinks the user by one order of magnitude, from a whole-body scene down to 100-micron cell groups, and each scene marks where its dataset came from in the body using its HRA registration.
Levels: 10^0 (1 meter), 10^-2 (1 centimeter), 10^-3 (1 millimeter), 10^-4 (100 microns). Organs: lymph node, brain, large and small intestine, liver. Assays: CODEX, Visium, volumetric cyclic immunofluorescence (v-CyCIF), Xenium, serial block-face scanning electron microscopy (SBF-SEM). Start scene: 81 HRA v2.5 organs, 2,762 tissue blocks, 13,344 datasets, 1,021 donors, 54 providers. · Introduction; Insights from VR; hra-whole_body-hra-1_meter-10_0; Extraction Site Component
ShownMaking the data run on standalone headsets took mesh decimation and data subsampling. The large intestine v-CyCIF scene was cut from about 6 million to about 3 million polygons. It still ran without significant frame-rate drops, although it stayed above Meta's polygon budget.
Meta recommends 400-600 draw calls and 1.3-1.8 million polygons in view (Quest 3/3S). A decimation factor of 0.05 kept ~5% of each confocal mesh. Xenium polyp: model cut ~41% from 1.6 million to 942,436 polygons. All 29 layers would total 2.32 million cells, so only layer 16 (18,285 cells, 20,919 RNA molecules) is shown, rendered within 300 (cells) and 100 microns (RNA) of the user. · Mesh optimization and performance considerations; Performance; Visualization; Performance metrics for Meta Quest VR headsets
SuggestedIn a light-sheet v-CyCIF crop of human large intestine, most of ~200 CD8+ conventional T cells appear to touch TUBB3+ enteric nerves directly, and some seem to migrate toward the lumen. In VR, users can pull cells apart and color them by properties such as volume or sphericity.
This is a qualitative observation from one crop, with no counts, distances or statistics. A Blender Python script matched each 3D cell to its quantification-table row: it first aligned on a shared reference cell, then required position within 3.0 scene units and volume within 20%. The Data Provider validated the mapping. · hubmap-large_intestine-wong-100_microns-10_4; hubmap-large_intestine-wong-100_microns-10_4
SuggestedA CODEX small-intestine region is shown as 4 stacked layers (cell type, neighborhood, community, tissue unit), linked by a selection cylinder and an alluvial diagram. The tissue-unit layer matches known intestinal histology from mucosa to muscularis externa.
Dataset HBM573.SWGH.988: 3,252 cells shown at 4 levels. Above the cell-type level, cells are grouped by neighbor composition over increasingly broad ranges. The selection cylinder counts selected cells per layer, and the alluvial diagram links the layers. CD4+ and CD8+ T cells in distinct multicellular settings are described without quantification. · hubmap-small_intestine-miao-100_microns-10_4; hubmap-small_intestine-miao-100_microns-10_4
ShownA 3D spike plot shows 8 senescence hallmark scores as lines above or below Visium spots from the dorsolateral prefrontal cortex of a 74-year-old female donor. It is presented as a way to generate hypotheses about senescence microenvironments.
4,992 spots (55-micron diameter, 100-micron spacing) carry 39,936 hallmark values. A mean/variance filter reduces the plot to 1,576 lines for 197 spots. A gallery of 10 plotly 2D plots gives scatter graphs that each show one hallmark, plus 2 auxiliary graphs showing which spots get lines and where they sit on the Visium grid. The paper reports no specific spatial pattern. · sennet-brain-phatnani-1_millimeter-10_3; sennet-brain-phatnani-1_millimeter-10_3; 3D spike plot; 2D plots
Methods, data and reproducibility
Datasets were preprocessed (Blender decimation, Fiji and MeshLab mesh conversion, CSV ingestion into Unity ScriptableObjects) and built into Unity 2022.3 scenes for standalone Meta Quest headsets. Each scene sits on an elevator level set by its order of magnitude and is linked to its HRA-registered extraction site. A standard operating procedure (SOP) defines the roles and data formats for adding datasets.
- HRA v2.5 3D reference organs with registered tissue blocks (whole-body start scene) · human · n = 81 organs; 2,762 tissue blocks; 13,344 datasets; 1,021 donors
- CODEX lymph node dataset from an 86-year-old male donor (SenNet) · human · n = 36,964 cells, 16 cell types · SNT832.RKFV.643
- Visium slide of dorsolateral prefrontal cortex from a 74-year-old female donor (SenNet) · human · n = 4,992 spots · SNT873.QHZM.365
- CODEX small intestine tissue region (HuBMAP) · human · n = 3,252 cells · HBM573.SWGH.988
- v-CyCIF large intestine volumes: a light-sheet crop (CD8, TUBB3) and a confocal dataset (CD8, CD31, Claudin-7, TUBB3) · human · n = ~200 CD8+ T cells in the light-sheet crop
- Xenium serial sections of a pre-cancerous large intestine polyp, reconstructed in 3D with Space-map (HuBMAP) · human · n = 29 serial sections; layer 16: 18,285 cells, 20,919 RNA molecules · HBM896.ZPRW.239
- SBF-SEM TIFF stacks of the liver periportal region (portal vein, bile duct, hepatocyte organelles), caudate lobe (CIFAR) · human · n = 3 TIFF files; approximately fifty segmented hepatocytes
- Methods & tools
- Unity 2022.3, XR Interaction Toolkit 2.6, Blender, Microscopy Nodes, Fiji, MeshLab, Space-map, plotly, Figma, HRA API, Registration User Interface (RUI), Cell Ontology (CL)
- Code
- https://github.com/cns-iu/hra-organ-gallery-in-vrhttps://github.com/cns-iu/hra-organ-gallery-in-vr-preprocessing
- Data & accessions
- https://github.com/cns-iu/hra-organ-gallery-supporting-informationhttps://cns-iu.github.io/hra-organ-gallery-supporting-informationhttps://humanatlas.io/3d-reference-libraryhttps://3d.nih.gov/collections/hrahttps://data.sennetconsortium.org/https://portal.hubmapconsortium.org/
- Software & environment
- Unity 2022.3 with XR Interaction Toolkit 2.6. Data are cached as ScriptableObjects so the app runs offline. Supports Meta Quest 2, 3, 3S and Pro. The SOP uses Jupyter Notebooks, Python and Blender, with no versions given.
- Experimental conditions
- Targets standalone Meta Quest headsets (Meta Quest 3, ~2k pixels per eye), checked against Meta's guidance of 400-600 draw calls and 1.3-1.8 million polygons in view. No development hardware or build times are reported.
- Reproducibility gaps
- The SOP is cited, but the text prints no direct link to it. The v-CyCIF large intestine and SBF-SEM liver data have no printed accession. OME-ZARR processing is documented in the SOP but not included in this release.
Limitations (6)
- The reported insights are qualitative examples. No controlled study compared VR against 2D tools for accuracy, speed or task performance. · stated by the authors
- Eight scenes are a small sample of HRA data, and the datasets differ widely in size and preprocessing, so the workflow may not transfer to other tissues, diseases or assays. · stated by the authors
- Reliance on Meta Quest hardware limits adoption at institutions without VR equipment, and users may experience motion sickness or headset fatigue. · stated by the authors
- Each scene needs coordinated Data Provider, Designer, Developer and Lead roles plus 3D modeling skill (e.g., Blender preprocessing of SBF-SEM data), which limits scaling beyond expert teams. · stated by the authors
- Users see heavily reduced data: the Xenium polyp scene shows 1 of 29 layers with the ingest script set to 1/64th of cells, and the confocal meshes keep ~5% of their polygons. · noted in this summary
- Some details conflict within the text. The spike-plot filter is given as low mean/high variance in Methods but high mean/low variance in the Fig. 5 legend, and the small-intestine sample origin is given as both duodenum and proximal jejunum. · noted in this summary
Read this if you build viewers for multiplexed tissue imaging or spatial assays and want a documented example, with code and an SOP, of placing multi-assay human tissue data across scales in standalone VR.
- Citations
- 1
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- The HRA Organ Gallery Affords Immersive Superpowers for Building and Exploring the Human Reference Atlas with Virtual Reality
Andreas Bueckle, Catherine Qing, … Katy Börner·Frontiers in BioinformaticsPeer-reviewed·Apr 27, 2023
- Bridging Biomedical Atlas Ecosystem: Cross-Atlas Alignment And Scalable Tissue Specimen Registration
Yashvardhan Jain, Bhargav Desai, … Katy Börner·bioRxiv·Aug 22, 2026
- Human BioMolecular Atlas Program (HuBMAP): 3D Human Reference Atlas Construction and Usage
Katy Börner, Philip D. Blood, … Vilas Menon·Nature MethodsPeer-reviewed·Mar 13, 2025
- hECA: the cell-centric assembly of a cell atlas
Sijie Chen, Yanting Luo, … Xuegong Zhang·iSciencePeer-reviewed·Apr 28, 2022
- AtlasMap: enabling low-cost, map-style exploration of million-cell single-cell atlases
Zhou-Geng Xu, Hao-Chen Xue, … Jiawei Wang·bioRxiv·Jan 16, 2026
- Tissue Registration and Exploration User Interfaces in support of a Human Reference Atlas
Katy Börner, Andreas Bueckle, … Griffin M. Weber·Communications BiologyPeer-reviewed·Dec 13, 2022