Model-averaged regression coefficients have a straightforward interpretation using causal conditioning
Abstract
Model-averaged partial regression coefficients have been criticized for averaging over a set of models with coefficients that have different meanings from model to model. This criticism arises because statisticians since Fisher believe that the meaning of a coefficient in a regression model arises from probabilistic conditioning (P (Y |X)) and that coefficients are mere descriptors of conditional association (or \"differences in conditional means\"). Because this association parameter is conditional on a specific set of covariates, the parameter for a predictor varies from model to model. The coefficients in many applied regression models, however, take their meaning from causal conditioning (P (Y |do(X))) and these coefficients estimate causal effect parameters (or simply, causal effects or Average Treatment Effects). Causal effect parameters are also differences in conditional expectations, but the event conditioned on is not the set of covariates in a regression model but a hypothetical intervention. Because an effect parameter for a predictor takes its meaning from causal and not probabilistic conditioning, it is the same from model to model, and an averaged coefficient has a straightforward interpretation as an estimate of a causal effect. But, because the effect parameter is the same from model to model, the estimates of the parameter will generally be biased. By contrast, with probabilistic conditioning, the coefficients are consistent estimates of their parameter in every model. Confounding and omitted variable bias, which are central to explanatory modeling, are meaningless in regression modeling as mere description.
02 /Specification & Classification
Click any tag to browse matching papers- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Correlation Detection with and without the Theories of Conditionals: A model update of Hattori & Oaksford (2007)
T. Takahashi, K. Oyo, … K. Higuchi·bioRxiv·Nov 19, 2019
- CoCoA: Conditional Correlation Models with Association Size
Danni Tu, Bridget W. Mahony, … Russell Taki Shinohara·BiostatisticsPeer-reviewed·Aug 8, 2022
- Multiple Confounders Correction with Regularized Linear Mixed Effect Models, with Application in Biological Processes
Haohan Wang, Jingkang Yang·IEEE International Conference on Bioinformatics and Biomedicine (BIBM)Peer-reviewed·Dec 1, 2016
- Re-expressing coefficients from regression models for inclusion in a meta-analysis
Matthew W. Linakis, Cynthia B. Van Landingham, … Matthew P. Longnecker·BMC Medical Research MethodologyPeer-reviewed·Jan 8, 2024
- partR2: Partitioning R2 in generalized linear mixed models
Martin A. Stoffel, Shinichi Nakagawa, Holger Schielzeth·PeerJPeer-reviewed·May 25, 2021
- Cross-Lagged Panel Model in Medical Research: A Cautionary Note
S. Usami, N. Todo, K. Murayama·bioRxiv·Dec 3, 2018