A neuromorphic model of active vision shows how spatiotemporal encoding in lobula neurons can aid pattern recognition in bees
HaDi MaBouDiiD, Mark G. RoperiD, Marie GuiraudiD, Mikko JuusolaiD, Lars ChıttkaiD, James A. R. MarshalliD
Abstract
Bees' remarkable visual learning abilities make them ideal for studying active information acquisition and representation. Here, we develop a biologically inspired model to examine how flight behaviours during visual scanning shape neural representation in the insect brain, exploring the interplay between scanning behaviour, neural connectivity, and visual encoding efficiency. Incorporating non-associative learning, adaptive changes without reinforcement, and exposing the model to sequential natural images during scanning, we obtain results that closely match neurobiological observations. Active scanning and non-associative learning dynamically shape neural activity, optimising information flow and representation. Lobula neurons, crucial for visual integration, self-organise into orientation-selective cells with sparse, decorrelated responses to orthogonal bar movements. They encode a range of orientations, biased by input speed and contrast, suggesting co-evolution with scanning behaviour to enhance visual representation and support efficient coding. To assess the significance of this spatiotemporal coding, we extend the model with circuitry analogous to the mushroom body, a region linked to associative learning. The model demonstrates robust performance in pattern recognition, implying a similar encoding mechanism in insects. Integrating behavioural, neurobiological, and computational insights, this study highlights how spatiotemporal coding in the lobula efficiently compresses visual features, offering broader insights into active vision strategies and bio-inspired automation.
02 /Specification & Classification
Click any tag to browse matching papers- Citations
- 7
- FWCI
- 2.73
- Field percentile
- top 9%
- Approach
Reproducibility ledger
Nobody has reported trying to reproduce this paper yet. Did you replicate an experiment or run the code? Your report saves the next lab a week.
Sign in to file a reproducibility report.
Related papers
- Automated video tracking and flight analysis show how bumblebees solve a pattern discrimination task using active vision
H. MaBouDi, M. Roper, … L. Chittka·bioRxiv·Mar 9, 2021
- Neurons from pre-motor areas to the Mushroom bodies can orchestrate latent visual learning in navigating insects.
Antoine Wystrach·bioRxiv·Mar 9, 2023
- Smell and Aftersmell: Fast Calcium Imaging Dynamics of Honey Bee Olfactory Coding
Marco Paoli, Antoine Wystrach, … Martín Giurfa·eLifePeer-reviewed·Feb 15, 2024
- Spatio-temporal Memory for Navigation in a Mushroom Body Model
- Neural computation underlying rapid learning and dynamic memory recall for sensori-motor control in insects.
Hannes Rapp, Martin Paul Nawrot·bioRxiv·Apr 5, 2020
- Scanning and active sampling behaviours emerge from conserved insect neural circuits
Cody A. Freas, Antoine Wystrach·eLifePeer-reviewed·Oct 6, 2026