Trust-Aware Sequence-to-Function Modelling in Regulatory Genomics
Abdulmujeeb T. OnawoleiD, Sulaimon BasiruiD, Musafau Oloyede SanniiD, Monsuru Aiyedun, Ridwan SulaimoniD
Abstract
Objective: Sequence-to-function models increasingly predict regulatory activity, such as chromatin accessibility, directly from DNA sequence, and are used to interpret non-coding genetic variation. Standard accuracy metrics, computed over a held-out set of genomic regions, do not establish whether an individual prediction remains reliable once the input sequence departs from that set, nor whether a model's attribution-based explanation is biologically grounded rather than coincidental. We develop and evaluate RegTrust-XAI, a trust-aware framework separating these questions using three inference-time signals: ensemble consensus, motif-grounded attribution coherence, and applicability-domain distance. Methods: A five-model convolutional ensemble was trained on 517,790 K562 ATAC-seq windows and evaluated on a held-out chromosome test set (chr8/chr9, n = 42,844). Consensus, coherence, and applicability-domain distance were each tested against prediction error, alongside complementary sequence-novelty analyses and validation against an independent lentiMPRA reporter assay and saturation-mutagenesis MPRA data at the PKLR promoter. Results: The ensemble reached Spearman {rho} = 0.782, with skill of 0.328 over a constant-value null predictor. High-consensus predictions (Scenarios A+B) were consistently enriched for lower error than low-consensus predictions (Scenarios C+D), and attribution coherence further separated error within the high-consensus population (mean absolute error 0.396 versus 0.435, p = 9.6e-10). Applicability-domain distance showed a monotonic error gradient across six distance bands. A 4-mer composition-divergence metric was negatively associated with error and anti-correlated with applicability-domain distance, so composition-based and model-relevant novelty are not equivalent. Attribution transfer to lentiMPRA was assay- and subgroup-dependent, and predicted allele-substitution effects correlated with measured saturation-mutagenesis effects at the PKLR promoter at both 24 h and 48 h ({rho} = 0.227 and 0.235). Motif-specific perturbation further showed that regulatory attributions were strongly context-dependent, with more than 90% of multi-instance motif modules exhibiting superadditive joint effects. Conclusions: Prediction reliability, explanation validity, and sequence novelty are related but distinct properties of a sequence-to-function model. Evaluating each explicitly gives a more complete basis for deciding when to act on a prediction than accuracy alone.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Organism
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Does ensembling improve feature attributions from sequence-to-activity models?
Alexandra Maslova, Maxwell W. Libbrecht·bioRxiv·Jul 13, 2026
- Characterizing uncertainty in predictions of genomic sequence-to-activity models
Ayesha Bajwa, Ruchir Rastogi, … Nilah M. Ioannidis·bioRxiv·Dec 21, 2023
- Fourier-transform-based attribution priors improve the interpretability and stability of deep learning models for genomics
Alex M. Tseng, Avanti Shrikumar, Anshul Bharat Kundaje·bioRxiv·Jun 11, 2020
- The impact of different negative training data on regulatory sequence predictions
Louisa-Marie Krützfeldt, Max Schubach, Martin Kircher·PLoS ONEPeer-reviewed·Dec 1, 2020
- Uncertainty-aware genomic deep learning with knowledge distillation
Jessica Zhou, Kaeli Rizzo, … Peter K. Koo·npj Artificial IntelligencePeer-reviewed·Jan 7, 2026
- A comprehensive benchmark and guide for sequence-function interpretable deep learning models in genomics
Canzhuang Sun, Yu Sun, … Hebing Chen·bioRxiv·Jan 6, 2025