The Confidence-Noise Confidence-Boost (CNCB) model of confidence rating data
Abstract
Over the last decade, different approaches have been proposed to interpret confidence rating judgments obtained after perceptual decisions. One very popular approach is to compute meta-d which is a global measure of the sensibility to discriminate the confidence rating distributions for correct and incorrect perceptual decisions. Here, we propose a generative model of confidence based on two main parameters, confidence noise and confidence boost, that we call CNCB model. Confidence noise impairs confidence judgements above and beyond how sensory noise affects perceptual sensitivity. The confidence boost parameter reflects whether confidence uses the same information that was used for perceptual decisions, or some new information. This CNCB model offers a principled way to estimate a confidence efficiency measure that is a theory-driven alternative to the popular M-ratio. We then describe two scenarios to estimate the confidence boost parameter, one where the experiment uses more than two confidence levels, the other where the experiment uses more than two stimulus strengths. We also extend the model to continuous confidence ratings and describe how a non-linear mapping can be estimated between objective and subjective confidence probabilities. Altogether, the CNCB model should help interpret confidence rating data at a deeper level. This manuscript is accompanied by a toolbox that will allow researchers to estimate all the parameters of the CNCB model in confidence ratings datasets. Some examples of re-analyses of previous datasets are provided in the Appendix. Author SummaryAfter each perceptual decision, humans have the ability to rate how confident they are that their decision is correct. While there is a growing number of models that attempt to explain how confidence judgments are built, there are very few objective measures of the sensitivity of these confidence judgments. We offer here a measure of confidence efficiency whose interpretation is simple. It takes a value of zero when participants are unable to evaluate the validity of their perceptual decision, a value of one when participants use the same information for their perceptual decision and their confidence judgment, and a value larger than one when participants use information for their confidence judgment that was not used for their perceptual decision. This measure of confidence efficiency is based on a generative model called CNCB that has two main parameters, confidence noise and confidence boost. These parameters again have a simple interpretation, and we show under which circumstances they can be estimated on their own. Finally, we extend the model to continuous confidence ratings.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 1
- FWCI
- 0.57
- Field percentile
- top 39%
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Confidence as a noisy decision reliability estimate
Z. M. Boundy-Singer, C. M. Ziemba, R. L. Goris·bioRxiv·Dec 17, 2021
- Dual strategies in human confidence judgments
Andrea Bertana, Андрей Анатольевич Четвериков, … Janneke F. M. Jehee·Journal of VisionPeer-reviewed·May 19, 2021
- A low-dimensional approximation of optimal confidence
P. Le Denmat, T. Verguts, K. Desender·PLOS Computational BiologyPeer-reviewed·Jul 24, 2024
- Modality Independent or Modality Specific? Common Computations Underlie Confidence Judgements in Visual and Auditory Decisions
Rebecca K. West, William John Harrison, … David K. Sewell·PLoS Computational BiologyPeer-reviewed·Jul 14, 2023
- Natural statistics support a rational account of confidence biases
Taylor W. Webb, Kiyofumi Miyoshi, … Hakwan C. Lau·Nature CommunicationsPeer-reviewed·Jul 6, 2023
- A robust measure of metacognitive sensitivity and confidence criteria
Derek Henry Arnold, Mitchell Clendinen, … Kielan Yarrow·bioRxiv·Sep 12, 2023