Cerebellum-Inspired Kernel for Robust OOD Detection
Abstract
Detecting novel stimuli is a fundamental neural function, yet its machine learning counterpart--out-of-distribution (OOD) detection--remains challenging, with models often making overconfident predictions on unseen inputs. Inspired by the strong pattern-separation capabilities of cerebellum-like circuits, we introduce a cerebellum-inspired kernel with an efficient closed-form implementation. Combining random Gaussian projection with Top-k sparsification, the kernel reshapes similarities in high-dimensional space to enhance separability between in-distribution (ID) and OOD samples. On OpenOOD benchmarks, our kernel consistently improves multiple baseline methods, and pairing it with the energy score achieves performance comparable to or exceeding current state-of-the-art approaches. The closed-form design also avoids the high computational cost of large-expansion explicit mapping. These results demonstrate the generality and potential of cerebellar kernels for OOD detection and other tasks requiring efficient pattern separation under limited computational resources.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 0
- Research Focus
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- The representational geometry of out-of-distribution generalization in primary visual cortex and artificial neural networks
Zeyuan Ye, Ralf Weßel·bioRxiv·Apr 23, 2025
- How well do models of visual cortex generalize to out of distribution samples?
Yifei Ren, Pouya Bashivan·PLoS Computational BiologyPeer-reviewed·May 31, 2024
- Invariant Object Representation Based on Principle of Maximum Dependence Capturing
Rishabh Raj, Dar Dahlen, … C. Ron Yu·bioRxiv·Jan 13, 2021
- Invariant Odor Recognition with ON-OFF Neural Ensembles
Srinath Nizampatnam, Lijun Zhang, … Baranidharan Raman·Proceedings of the National Academy of SciencesPeer-reviewed·Jan 7, 2022
- Predictive coding model can detect novelty on different levels of representation hierarchy
T. Ed Li, Mufeng Tang, Rafał Bogacz·bioRxiv·Jun 10, 2024
- Predicting stimulus representations in the visual cortex using computational principles.
Agustín Lage‐Castellanos, Federico De Martino·bioRxiv·Jul 30, 2019