bioRxivPharmacology & ToxicologyPreprint
From exact gradients to exact standard errors: third- and fourth-order sensitivities for the Laplacian population likelihood family
Hidde van de BeekiD, Massinissa BeldjennaiD, Matthew L. FidleriD, Laura B. ZwepiD, J. G. Coen van HasseltiD
Abstract
Asymptotic standard errors for the parameters of a nonlinear mixed effects model fitted by Laplacian estimation, first-order conditional estimation (FOCE), or FOCE with interaction (FOCEI) require the observed (Fisher) information, the negative second derivative of the population objective at the optimum. The gradient of this objective can be computed exactly from sensitivity equations, but the observed information is still formed by finite differencing, which is less accurate, step-size dependent, and requires empirical Bayes reoptimization. These perturbed individual optimization problems can fail even after a successful fit. Our objectives are to (1) extend the exact-gradient sensitivity framework by one differentiation and give the observed information of the Laplacian population likelihood family in closed form and (2) illustrate covariance calculation without further empirical Bayes optimization in a case example. Writing the objective as a data term plus the log-determinant of the inner Hessian, the population Hessian splits so that the data term reuses second-order sensitivities, whereas the log determinant term requires third-order sensitivities for FOCE/FOCEI and fourth-order sensitivities for the full Laplacian method. We illustrate this on a two-compartment oral model with first-order absorption fitted to simulated data. The analytic covariance involves no differencing step and uses the fitted empirical Bayes estimates without reoptimization, avoiding this source of covariance-step failure. Implemented for FOCE/FOCEI in the open-source R package nlmixr2, the construction provides exact, reproducible standard errors for the approximate likelihood, limited by numerical solution accuracy and conditioning. This supports more dependable confidence intervals, identifiability assessment, and uncertainty propagation.
- Citations
- 0
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Optimization and uncertainty analysis of ODE models using second order adjoint sensitivity analysis
Paul L. Stapor, Fabian Fröhlich, Jan Hasenauer·BioinformaticsPeer-reviewed·Apr 12, 2018
- Likelihood Approximation Networks (LANs) for Fast Inference of Simulation Models in Cognitive Neuroscience
Alexander Fengler, Lakshmi Narasimhan Govindarajan, … Michael J. Frank·eLifePeer-reviewed·Apr 6, 2021
- Likelihood-ratio test statistic for the finite-sample case in nonlinear ordinary differential equation models
Christian Tönsing, Bernhard Steiert, … Clemens Kreutz·PLoS Computational BiologyPeer-reviewed·Sep 22, 2023
- Flexible and efficient simulation-based inference for models of decision-making
Jan Boelts, Jan-Matthis Lueckmann, … Jakob H. Macke·eLifePeer-reviewed·Jul 27, 2022
- Hierarchical Bayesian Modelling of Interoceptive Psychophysics
Arthur S. Courtin, Jesper Fischer Ehmsen, … Micah Allen·bioRxiv·Aug 27, 2025
- Parameter estimation and identifiability in a neural population model for electro-cortical activity
Agus Hartoyo, Peter J. Cadusch, … Damien G. Hicks·PLoS Computational BiologyPeer-reviewed·May 30, 2019