Typing Reinvented: Towards Hands-Free Input via sEMG
Lee, Kunwoo, Sreedhar, Dhivya, Saraf, Pushkar, Lee, Chaeeun, Shapovalenko, Kateryna
–arXiv.org Artificial Intelligence
We explore surface electromyography (sEMG) as a non-invasive input modality for mapping muscle activity to keyboard inputs, targeting immersive typing in next-generation human-computer interaction (HCI). This is especially relevant for spatial computing and virtual reality (VR), where traditional keyboards are impractical. Using attention-based architectures, we significantly outperform the existing convolutional baselines, reducing online generic CER from 24.98% -> 20.34% and offline personalized CER from 10.86% -> 10.10%, while remaining fully causal. We further incorporate a lightweight decoding pipeline with language-model-based correction, demonstrating the feasibility of accurate, real-time muscle-driven text input for future wearable and spatial interfaces.
arXiv.org Artificial Intelligence
Nov-25-2025
- Country:
- Europe > Bulgaria
- Sofia City Province > Sofia (0.04)
- North America
- Mexico > Gulf of Mexico (0.04)
- United States > Pennsylvania
- Allegheny County > Pittsburgh (0.05)
- South America > Chile
- Europe > Bulgaria
- Genre:
- Research Report > New Finding (0.46)
- Industry:
- Health & Medicine (0.70)