Goto

Collaborating Authors

 pronunciation


This exclusive Babbel offer is magnifique in any language

Mashable

Trending Now Say More Look Up In My Bag Mashable's Best: E-readers, robovacs, laptops, earbuds, smart home and more Mashable @Home Mashable Selects Top creators, ranked Gift Ideas For Everyone On Your List Creator Playbook AI at School Safety Net All Series The following content is brought to you by Mashable partners. If you buy a product featured here, we may earn an affiliate commission or other compensation. Deal pricing and availability subject to change after time of publication. Your next vacation might be months away, but your language-learning plans don't have to wait. Learning a new language isn't easy, but it also might not be as hard as some apps make it seem.


Pay once for Babbel and take your time learning 14 languages

Mashable

Look Up Say More Mashable's Best: E-readers, robovacs, laptops, earbuds, smart home and more Mashable @Home Trending Now Mashable Selects Top creators, ranked Gift Ideas For Everyone On Your List Creator Playbook In My Bag AI at School Safety Net All Series No need to rush lifetime access. The following content is brought to you by Mashable partners. If you buy a product featured here, we may earn an affiliate commission or other compensation. Deal pricing and availability subject to change after time of publication. Babbel lifetime access is only $134.99 (reg.


Get lifetime access to Babbel's complete 14-language lineup with this limited-time offer

Mashable

Look Up Back to School Mashable's Best: E-readers, robovacs, laptops, earbuds, smart home and more Mashable Selects Say More Trending Now Good Connection: Uplifting stories for a digital age Creator Playbook Switch Off Mashable Voices Safety Net Versus All Series Get lifetime access to Babbel's complete 14-language lineup with this limited-time offer Your next language is waiting. The following content is brought to you by Mashable partners. If you buy a product featured here, we may earn an affiliate commission or other compensation. Deal pricing and availability subject to change after time of publication. Through Sept. 10, new U.S. users can get a Babbel Lifetime Language Learning Subscription covering all 14 languages for $159 (reg.


CoreaSpeech: Korean Speech Corpus via Jamo-based Coreset Selection for Efficient and Robust Korean Speech Generation

Neural Information Processing Systems

While substantial advances have been achieved in TTS for languages such as English and Mandarin, Korean remains comparatively underrepresented due to the lack of rigorous preprocessing methods, systematically constructed datasets, a shortage of standardized Korean TTS benchmarks, and explicitly optimized models for Korean. To address these limitations, we propose a Korean-tailored data-refinement and coreset selection pipeline. It refines speech data and performs textual normalization especially for numerals and English terms, followed by a novel coreset selection strategy that leverages Jamo-based linguistic and phonological features unique to Korean. As a result, we release CoreaSpeech, an efficient and robust Korean speech corpus comprising 700 hours across 21,449 speakers. This refined core subset, evenly balanced across utterances ranging from 0 to 30 seconds, is derived from 2,058 hours of widely used Korean datasets. Building on this, we conducted extensive experiments via cross-lingual fine-tuning with our CoreaSpeech dataset. Furthermore, we introduce a new universal Korean TTS benchmark dataset including clean, noisy, and numeric subsets. Additionally, we demonstrate that our Korean-specific text normalization serves as a plug-and-play module, reliably improving performance regardless of the underlying TTS architecture.


E2E-VGuard: Adversarial Prevention for Production LLM-based End-To-End Speech Synthesis

Neural Information Processing Systems

Recent advancements in speech synthesis technology have enriched our daily lives, with high-quality and human-like audio widely adopted across real-world applications. However, malicious exploitation like voice-cloning fraud poses severe security risks. Existing defense techniques struggle to address the production large language model (LLM)-based speech synthesis. While previous studies have considered the protection for fine-tuning synthesizers, they assume manually annotated transcripts. Given the labor intensity of manual annotation, end-to-end (E2E) systems leveraging automatic speech recognition (ASR) to generate transcripts are becoming increasingly prevalent, e.g., voice cloning via commercial APIs.


69c754f571806bf15add18556ff39b4f-Supplemental-Conference.pdf

Neural Information Processing Systems

Similar to the previous analysis of XLSR-53 (Choi et al., 2021), the representations from the 1st layer of XLS-R are already clustered by each speaker while it is hard to distinguish the representations of thelatterlayerbyeachspeaker. HierSpeech-UVCTK+LibriTTS (20) 3.71 15.85 6.40 4.09 30.64Untranscribed text-to-speech We describe the results of the objective evaluation for speaker adaptationinTable11. Hence, the data augmentation for speech disentanglement is not necessaryinourmethod. Note that we fail to train the model with the representations from the 23th layer of XLS-R. We train Tacotron 2 with batch size of 256 for 100k steps.



A Critical Review of the Need for Knowledge-Centric Evaluation of Quranic Recitation

arXiv.org Artificial Intelligence

The art and science of Quranic recitation (Tajweed), a discipline governed by meticulous phonetic, rhythmic, and theological principles, confronts substantial educational challenges in today's digital age. Although modern technology offers unparalleled opportunities for learning, existing automated systems for evaluating recitation have struggled to gain broad acceptance or demonstrate educational effectiveness. This literature review examines this crucial disparity, offering a thorough analysis of scholarly research, digital platforms, and commercial tools developed over the past twenty years. Our analysis uncovers a fundamental flaw in current approaches that adapt Automatic Speech Recognition (ASR) systems, which emphasize word identification over qualitative acoustic evaluation. These systems suffer from limitations such as reliance on biased datasets, demographic disparities, and an inability to deliver meaningful feedback for improvement. Challenging these data-centric methodologies, we advocate for a paradigm shift toward a knowledge-based computational framework. By leveraging the unchanging nature of the Quranic text and the well-defined rules of Tajweed, we propose that an effective evaluation system should be built upon rule-based acoustic modeling centered on canonical pronunciation principles and articulation points (Makhraj), rather than depending on statistical patterns derived from flawed or biased data. The review concludes that the future of automated Quranic recitation assessment lies in hybrid systems that combine linguistic expertise with advanced audio processing. Such an approach paves the way for developing reliable, fair, and pedagogically effective tools that can authentically assist learners across the globe.


E2E-VGuard: Adversarial Prevention for Production LLM-based End-To-End Speech Synthesis

arXiv.org Artificial Intelligence

Recent advancements in speech synthesis technology have enriched our daily lives, with high-quality and human-like audio widely adopted across real-world applications. However, malicious exploitation like voice-cloning fraud poses severe security risks. Existing defense techniques struggle to address the production large language model (LLM)-based speech synthesis. While previous studies have considered the protection for fine-tuning synthesizers, they assume manually annotated transcripts. Given the labor intensity of manual annotation, end-to-end (E2E) systems leveraging automatic speech recognition (ASR) to generate transcripts are becoming increasingly prevalent, e.g., voice cloning via commercial APIs. Therefore, this E2E speech synthesis also requires new security mechanisms. To tackle these challenges, we propose E2E-VGuard, a proactive defense framework for two emerging threats: (1) production LLM-based speech synthesis, and (2) the novel attack arising from ASR-driven E2E scenarios. Specifically, we employ the encoder ensemble with a feature extractor to protect timbre, while ASR-targeted adversarial examples disrupt pronunciation. Moreover, we incorporate the psychoacoustic model to ensure perturbative imperceptibility. For a comprehensive evaluation, we test 16 open-source synthesizers and 3 commercial APIs across Chinese and English datasets, confirming E2E-VGuard's effectiveness in timbre and pronunciation protection. Real-world deployment validation is also conducted. Our code and demo page are available at https://wxzyd123.github.io/e2e-vguard/.


Data-efficient Targeted Token-level Preference Optimization for LLM-based Text-to-Speech

arXiv.org Artificial Intelligence

Aligning text-to-speech (TTS) system outputs with human feedback through preference optimization has been shown to effectively improve the robustness and naturalness of language model-based TTS models. Current approaches primarily require paired desirable and undesirable samples at the utterance level. However, such pairs are often limited in TTS output data, and utterance-level formulation prevents fine-grained token-level optimization needed for accurate pronunciation alignment. In this study, we propose TKTO that eliminates the need for paired data, enabling a more data-efficient training paradigm, and directly targets token-level units, automatically providing fine-grained alignment signals without token-level annotations. TKTO improves the challenging Japanese TTS accuracy by 39% and reduces CER by 54%, automatically assigning 12.8 times stronger reward to targeted tokens.