Efficient Game-Theoretic Explanations for Tree-Based Ensembles via Owen Values
Abstract
AO_SCPLOWBSTRACTC_SCPLOWShapley-value-based explanations, notably SHAP (SHapley Additive exPlanations), have gained prominence as a principled game-theoretic framework for local explanations and global feature importance. While exact Shapley value computation is exponential in feature count, TreeExplainer exploits the recursive structure of decision trees to achieve polynomial-time computation for tree-based ensembles. In many scientific applications, however, features are naturally organized into a priori groups reflecting domain knowledge, requiring explanations both across and within groups. The Owen value extends the Shapley value through a two-stage allocation rule that incorporates group structure while preserving fairness properties; yet, efficient algorithms for its computation remain limited. In this paper, we propose exact and Monte Carlo algorithms for computing Owen values in tree-based ensembles by combining hierarchy-guided group aggregation with tree-aware dynamic programming. The exact algorithm computes Owen values without sampling under the path-dependent characteristic function, which approximates the conditional expectation, whereas the Monte Carlo algorithm provides a scalable approximation that is unbiased for any prespecified sampling budget and converges almost surely as the sampling budget increases. We also provide global importance measures and visualization tools for structured, multi-resolution explanations. The proposed algorithms and tools are collectively referred to as TreeOwen. Through simulation experiments, we demonstrate the numerical accuracy and substantial computational gains of TreeOwen. We illustrate its practical utility using immunotherapy metagenomic data, showing how microbial genera (groups) and species (features) contribute to patient recovery.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Assay
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Understanding binary classifier model structure based on Shapley feature interaction patterns
Boyang Zhao·bioRxiv·Mar 29, 2021
- RFEX: Simple Random Forest Model and Sample Explainer for non-Machine Learning experts
Dragutin Petković, A. Alavi, … Sabiha H Barlaskar·bioRxiv·Oct 25, 2019
- Interpretable machine learning with tree-based Shapley additive explanations: application to metabolomics datasets for binary classification
Olatomiwa O. Bifarin·PLoS ONEPeer-reviewed·May 4, 2023
- REM: An Integrative Rule Extraction Methodology for Explainable Data Analysis in Healthcare
Zohreh Shams, Botty Dimanov, … Píetro Lió·bioRxiv·Jan 22, 2021
- treeheatr: an R package for interpretable decision tree visualizations
Trang T. Le, Jason H. Moore·BioinformaticsPeer-reviewed·Jul 18, 2020
- Tree-weighting for multi-study ensemble learners
Maya Ramchandran, Prasad Patil, Giovanni Parmigiani·Pacific Symposium on Biocomputing (PSB)Peer-reviewed·Nov 27, 2019