Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published March 17, 2023 | Supplemental Material + Submitted
Report Open

Decoding Motor Plans Using a Closed-Loop Ultrasonic Brain-Machine Interface

Abstract

Brain-machine interfaces (BMIs) can be transformative for people living with chronic paralysis. BMIs translate brain signals into computer commands, bypassing neurological impairments and enabling people with neurological injury or disease to control computers, robots, and more with nothing but thought. State-of-the-art BMIs have already made this future a reality in limited clinical trials. However, high performance BMIs currently require highly invasive electrodes in the brain. Device degradation limits longevity to about 5 years. Their field of view is small, restricting the number, and type, of applications possible. The next generation of BMI technology should include being longer lasting, less invasive, and scalable to sense activity from large regions of the brain. Functional ultrasound neuroimaging is a recently developed technique that meets these criteria. In this present study, we demonstrate the first online, closed-loop ultrasonic brain-machine interface. We used 2 Hz real-time functional ultrasound to measure the neurovascular activity of the posterior parietal cortex in two nonhuman primates (NHPs) as they performed memory-guided movements. We streamed neural signals into a classifier to predict the intended movement direction. These predictions controlled a behavioral task in real-time while the NHP did not produce overt movements. Both NHPs quickly succeeded in controlling up to eight independent directions using the BMI. Furthermore, we present a simple method to "pretrain" the BMI using data from previous sessions. This enables the BMI to work immediately from the start of a session without acquiring extensive additional training data. This work establishes, for the first time, the feasibility of an ultrasonic BMI and prepares for future work on a next generation of minimally invasive BMIs that can restore function to patients with neurological, physical, or even psychiatric impairments.

Additional Information

The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. We thank Kelsie Pejsa for assistance with animal care, surgeries, and training. We thank Claire Rabut and Lydia Lin for helpful discussions. We thank Krissta Passanante for her illustrations. W.S.G was supported by an NEI F30 (NEI F30 EY032799), the Josephine de Karman Fellowship, and the UCLA-Caltech MSTP (NIGMS T32 GM008042). S.L.N was supported by the Della Martin Foundation. This research was supported by the National Institute of Health BRAIN Initiative (grant 1R01NS123663-01 to R.A.A., M.G.S., and M.T.), the T&C Chen Brain-Machine Interface Center, and the Boswell Foundation (R.A.A.). Author Contributions. W.S.G., S.L.N., V.C., M.T., M.G.S., and R.A.A. conceived the study; S.L.N. established the fUS neuroimaging sequences and T.D., B.-F.O., F.S., and M.T. wrote the acquisition software for 2 Hz real-time fUS neuroimaging; W.S.G. and S.L.N. wrote the code for the fUS-BMI; W.S.G. trained the NHPs and acquired the data; W.S.G., S.L.N., and G.C performed the data processing and analysis; W.S.G. and S.L.N. drafted the manuscript with substantial contributions from M.G.S and R.A.A., and all authors edited and approved the final version of the manuscript. V.C., C.L., M.T., M.G.S., and R.A.A. supervised the research. Competing Interest Statement. B.-F.O. is an employee of Iconeus. T.D., B.-F.O., and M.T. are co-founders and shareholders of Iconeus, which commercializes ultrasonic neuroimaging scanners.

Attached Files

Submitted - 2022.11.10.515371v1.full.pdf

Supplemental Material - media-1.pdf

Files

media-1.pdf
Files (4.8 MB)
Name Size Download all
md5:849e0e5ef20d824644820c0138d4bc6d
966.5 kB Preview Download
md5:51060afb9f50c8f3dcc4e2db74d49ec0
3.8 MB Preview Download

Additional details

Created:
August 20, 2023
Modified:
December 22, 2023