The Roboscope: Smart and Fast Microscopy for Generic Event-Driven Acquisition

Abstract

Automation of fluorescence microscopy is a challenge for capturing rare or transient events in biology and medicine. It relies on smart devices that integrate and interpret the observed data, and react to the targeted biological event. We report on the Roboscope, a novel autonomous microscope combining sequence interruption and deep learning integration, allowing generic event-driven acquisitions. This system distinguishes itself by its adaptability to various experiments, quick capture of dynamic events, and minimal data greediness - training with less than 100 images per class. The Roboscopes capability is demonstrated in non-synchronized cells by capturing the metaphase, a 20-minute event happening once per day or less. Conversely, double thymidine-block synchronisation, despite occurring during DNA replication, may perturb mitotic-spindle mechanics. The Roboscopes versatility and efficiency offer significant advancements to tackle the current challenges of cell biology, spreading out advanced microscopy methods to fundamental research as well as high content screening and precision medicine.