Unlocking Non-Invasive Brain-to-Text
Jayalath, Dulhan, Landau, Gilad, Jones, Oiwi Parker
–arXiv.org Artificial Intelligence
Despite major advances in surgical brain-to-text (B2T), i.e. transcribing speech from invasive brain recordings, non-invasive alternatives have yet to surpass even chance on standard metrics. This remains a barrier to building a non-invasive brain-computer interface (BCI) capable of restoring communication in paralysed individuals without surgery. Here, we present the first non-invasive B2T result that significantly exceeds these critical baselines, raising BLEU by $1.4\mathrm{-}2.6\times$ over prior work. This result is driven by three contributions: (1) we extend recent word-classification models with LLM-based rescoring, transforming single-word predictors into closed-vocabulary B2T systems; (2) we introduce a predictive in-filling approach to handle out-of-vocabulary (OOV) words, substantially expanding the effective vocabulary; and (3) we demonstrate, for the first time, how to scale non-invasive B2T models across datasets, unlocking deep learning at scale and improving accuracy by $2.1\mathrm{-}2.3\times$. Through these contributions, we offer new insights into the roles of data quality and vocabulary size. Together, our results remove a major obstacle to realising practical non-invasive B2T systems.
arXiv.org Artificial Intelligence
May-20-2025
- Country:
- South America > Chile
- North America
- Canada (0.04)
- United States
- Kansas > Sheridan County (0.04)
- Utah > Salt Lake County
- Salt Lake City (0.04)
- Europe
- Austria > Vienna (0.14)
- Italy (0.04)
- United Kingdom > England
- Oxfordshire > Oxford (0.04)
- Genre:
- Research Report
- New Finding (1.00)
- Experimental Study (1.00)
- Research Report
- Industry:
- Health & Medicine > Therapeutic Area > Neurology (1.00)
- Technology: