Beyond Hearing: Learning Task-agnostic ExG Representations from Earphones via Physiology-informed Tokenization
Yoon, Hyungjun, Lee, Seungjoo, Wu, Yu Yvonne, Chen, Xiaomeng, Lu, Taiting, Liu, Freddy Yifei, Lee, Taeckyung, Cha, Hyeongheon, Zhao, Haochen, Zhao, Gaoteng, Lee, Sung-Ju, Mascolo, Cecilia, Chen, Dongyao, Qiu, Lili
–arXiv.org Artificial Intelligence
Electrophysiological (ExG) signals offer valuable insights into human physiology, yet building foundation models that generalize across everyday tasks remains challenging due to two key limitations: (i) insufficient data diversity, as most ExG recordings are collected in controlled labs with bulky, expensive devices; and (ii) task-specific model designs that require tailored processing (i.e., targeted frequency filters) and architectures, which limit generalization across tasks. To address these challenges, we introduce an approach for scalable, task-agnostic ExG monitoring in the wild. We collected 50 hours of unobtrusive free-living ExG data with an earphone-based hardware prototype to narrow the data diversity gap. At the core of our approach is Physiology-informed Multi-band Tokenization (PiMT), which decomposes ExG signals into 12 physiology-informed tokens, followed by a reconstruction task to learn robust representations. This enables adaptive feature recognition across the full frequency spectrum while capturing task-relevant information. Experiments on our new DailySense dataset-the first to enable ExG-based analysis across five human senses-together with four public ExG benchmarks, demonstrate that PiMT consistently outperforms state-of-the-art methods across diverse tasks.
arXiv.org Artificial Intelligence
Oct-27-2025
- Country:
- North America > United States (0.93)
- Genre:
- Research Report > New Finding (1.00)
- Industry:
- Health & Medicine
- Health Care Technology (1.00)
- Diagnostic Medicine (0.68)
- Therapeutic Area
- Neurology (1.00)
- Cardiology/Vascular Diseases (1.00)
- Health & Medicine
- Technology: