bioRxivBioengineeringPreprint
Composite Biofidelity: Addressing Metric Degeneracy in Biomechanical Model Validation and Machine Learning Loss Design
Amruta Koshe, Ehsan Sobhani-Tehrani, Kian JalaleddiniiD, Hamid MotallebzadehiD
Abstract
Spectral similarity is often judged with a single metric such as RMSE, yet this can be misleading: physically different errors can produce similar scores. This is a critical limitation for computational biomechanics, where spectral agreement underpins both model validation and machine-learning loss design. Here, we develop a multi-metric framework for objective spectral biofidelity and test whether it better captures meaningful disagreement across complex frequency-domain responses. We evaluated 12 complementary similarity metrics, including CORA and ISO/TS 18571, using controlled spectral perturbations that mimic common real-world deviations such as resonance shifts, localized spikes, and broadband tilts. We then applied the framework to an SBI-tuned finite-element middle-ear model to assess convergence with training dataset size and robustness to measurement noise across repeated stochastic runs. No single metric performed reliably across all distortion types. Shape-based metrics tracked resonance morphology but could miss vertical scaling, whereas MaxError remained important for narrowband anomalies that smoother metrics underweighted. CORA and ISO 18571 did not consistently outperform simpler metrics. Rank aggregation using Borda count provided a robust consensus across metrics, enabling objective identification of training-data saturation and noise thresholds beyond which similarity rankings became unstable. These results show that spectral biofidelity cannot be reduced to a single norm. A multi-metric consensus provides a clearer and more physically meaningful basis for comparing experimental and simulated spectra, and offers a more defensible foundation for data-fidelity terms in physics-informed and simulation-based machine learning.
- research focus: benchmarking
- research focus: synaptic & neural circuits
- research focus: chromatin & epigenetic regulation
- approach: statistical model
- Citations
- 1
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Composite Certainty: Addressing Metric Degeneracy in Parameter Inference for Model-Based Diagnostics
Amruta Koshe, Ehsan Sobhani Tehrani, … Hamid Motallebzadeh·bioRxiv·May 13, 2026
- The unbiased estimation of the fraction of variance explained by a model
Dean A. Pospisil, Wyeth Bair·PLoS Computational BiologyPeer-reviewed·Aug 4, 2021
- From Simulations to Inference: Using Machine Learning to Tune Patient-Specific Finite-Element Models of the Middle Ear Towards Objective Diagnosis
Hamid Motallebzadeh, Michael Deistler, … Sunil Puria·Scientific ReportsPeer-reviewed·Nov 3, 2025
- Beyond accuracy: Measures for assessing machine learning models, pitfalls and guidelines
Richard Dinga, Brenda W.J.H. Penninx, … André F. Marquand·bioRxiv·Aug 22, 2019
- Mind the gap: performance metric evaluation in brain-age prediction
Ann‐Marie G. de Lange, Melis Anatürk, … James Howard Cole·Human Brain MappingPeer-reviewed·Mar 21, 2022
- Moving towards more holistic machine learning-based approaches for classification problems in animal studies
Charlotte Christensen, André C. Ferreira, … Damien Roger Farine·Animal BehaviourPeer-reviewed·Nov 19, 2025