Rigorous (in)validation of ecological models
Abstract
The complexity of ecosystems poses a formidable challenge for confidently invalidating ecological models, as current practices struggle to distinguish model inadequacies from the confounding effects of unobserved biotic or abiotic factors. The prevailing inability to falsify models has resulted in an accumulation of models but not an accumulation of confidence. Here, we introduce a new approach rooted in queueing theory, termed the covariance criteria, that establishes a rigorous test for model validity based on covariance relationships between observable quantities. These criteria set a high bar for models to pass by specifying necessary conditions that must hold regardless of unobserved factors. We demonstrate the broad applicability and discriminatory power of the covariance criteria by applying them to three long-standing challenges in ecological theory: resolving competing models of predator-prey functional responses, disentangling ecological and evolutionary dynamics in systems with rapid evolution, and detecting the often-elusive influence of higher-order species interactions. Across these diverse case studies, the covariance criteria consistently rule out inadequate models, while building strong confidence in those that provide strategically useful approximations. The covariance criteria approach is mathematically rigorous, computationally efficient, and often non-parametric, making it immediately applicable to existing data and models.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 6
- FWCI
- 4.60
- Field percentile
- top 4%
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- The architecture and design of ecological null models
Joshua Ladau·bioRxiv·Sep 27, 2017
- Label invariance: a guiding principle for ecological models
Theo L. Gibbs, Onofrio Mazzarisi, … Chuliang Song·bioRxiv·Jul 15, 2025
- Evaluating species distribution models with discrimination accuracy is uninformative for many applications
D. L. Warren, N. J. Matzke, T. L. Iglesias·bioRxiv·Jun 27, 2019
- Geometric complexity and the information-theoretic comparison of functional-response models
M. Novak, D. B. Stouffer·bioRxiv·Jul 31, 2021
- Ecosystem models of Lake Victoria (East Africa): exploring the sensitivity of ecosystem effects of fishing to model choice
Vianny Natugonza, Cameron Ainsworth, … Gunnar Stefansson·bioRxiv·Dec 6, 2018
- EcoEvoApps: Interactive Apps for Theoretical Models in Ecology and Evolutionary Biology
R. M. McGuire, K. T. Hayashi, … G. S. Kandlikar·bioRxiv·Jun 18, 2021