DeviceAgent: An autonomous multimodal AI agent for flexible bioelectronics

Abstract

The development of flexible bioelectronics remains a complex, multidisciplinary process that demands specialized expertise and labor-intensive efforts, limiting scalability, adaptability and accessibility. Here, we introduce DeviceAgent, an autonomous multimodal AI agent that integrates large language models (LLMs), vision-language models (VLMs), and domain-specific computational tools into a unified framework for bioelectronics research. Leveraging the emergent reasoning abilities of LLMs and VLMs, DeviceAgent enables zero and few-shot generalization, contextual learning, and flexible task execution across modalities. A multimodal context memory system orchestrates these capabilities, providing end-to-end support across the experimental pipeline-from high-level design objectives to fabrication protocol generation, visual defect inspection, and electrophysiological signal analysis, while maintaining human oversight at critical decision points. We demonstrate its capabilities through the development of stretchable mesh electronics for interfacing with human induced pluripotent stem cell-derived cardiomyocytes (hiPSC-CMs), a representative application involving complex device architectures, heterogeneous material nanofabrication, and electrophysiology analysis. DeviceAgent autonomously (1) generates customized bioelectronic layouts; (2) creates comprehensive fabrication protocols tailored to specific materials and processes; (3) identifies microscopic defects using visual reasoning; and (4) analyzes cardiac electrophysiological recordings in an interpretable manner. By embedding LLMs and VLMs within a structured, tool-augmented architecture, DeviceAgent establishes a scalable and accessible paradigm for AI-scientist collaboration in nanofabrication and bioelectronics research.