CLEAR-FORCE: A reservoir computing framework for closed-loop brain stimulation

Abstract

Electrical stimulation of brain activity has emerged as a key therapeutic intervention for neurological diseases. The success of these approaches relies on precisely tuned stimulation parameters. A major challenge is that these parameters should ideally be adjusted in real-time based on changes in brain activity. Closed-loop controllers address this challenge by monitoring brain activity and adapting stimulation according to ongoing changes in neural dynamics. While machine learning has been helpful in this context, closed-loop controllers typically do not adapt in real-time to fluctuations in brain activity. Here, we propose a novel framework based on reservoir computing to train a closed-loop, real-time neural controller. This approach, termed CLEAR-FORCE, trains the output weights of a recurrent network based on a combination of target signals and feedback from brain activity. Two series of simulations were performed, where the controller was successful at (1) inducing neural oscillations in a population of spiking neurons and (2) suppressing pathological oscillations. This framework provides a promising avenue for the implementation of neural controllers in low-powered, real-time, and adaptive hardware that harnesses machine learning for the personalized treatment of brain disorders.