Optical Character Recognition
Optical Character Recognition and Transcription of Berber Signs from Images in a Low-Resource Language Amazigh
Corallo, Levi, Varde, Aparna S.
The Berber, or Amazigh language family is a low-resource North African vernacular language spoken by the indigenous Berber ethnic group. It has its own unique alphabet called Tifinagh used across Berber communities in Morocco, Algeria, and others. The Afroasiatic language Berber is spoken by 14 million people, yet lacks adequate representation in education, research, web applications etc. For instance, there is no option of translation to or from Amazigh / Berber on Google Translate, which hosts over 100 languages today. Consequently, we do not find specialized educational apps, L2 (2nd language learner) acquisition, automated language translation, and remote-access facilities enabled in Berber. Motivated by this background, we propose a supervised approach called DaToBS for Detection and Transcription of Berber Signs. The DaToBS approach entails the automatic recognition and transcription of Tifinagh characters from signs in photographs of natural environments. This is achieved by self-creating a corpus of 1862 pre-processed character images; curating the corpus with human-guided annotation; and feeding it into an OCR model via the deployment of CNN for deep learning based on computer vision models. We deploy computer vision modeling (rather than language models) because there are pictorial symbols in this alphabet, this deployment being a novel aspect of our work. The DaToBS experimentation and analyses yield over 92 percent accuracy in our research. To the best of our knowledge, ours is among the first few works in the automated transcription of Berber signs from roadside images with deep learning, yielding high accuracy. This can pave the way for developing pedagogical applications in the Berber language, thereby addressing an important goal of outreach to underrepresented communities via AI in education.
DRISHTI: Visual Navigation Assistant for Visually Impaired
Joshi, Malay, Shukla, Aditi, Srivastava, Jayesh, Rastogi, Manya
In today's society, where independent living is becoming increasingly important, it can be extremely constricting for those who are blind. Blind and visually impaired (BVI) people face challenges because they need manual support to prompt information about their environment. In this work, we took our first step towards developing an affordable and high-performing eye wearable assistive device, DRISHTI, to provide visual navigation assistance for BVI people. This system comprises a camera module, ESP32 processor, Bluetooth module, smartphone and speakers. Using artificial intelligence, this system is proposed to detect and understand the nature of the users' path and obstacles ahead of the user in that path and then inform BVI users about it via audio output to enable them to acquire directions by themselves on their journey. This first step discussed in this paper involves establishing a proof-of-concept of achieving the right balance of affordability and performance by testing an initial software integration of a currency detection algorithm on a low-cost embedded arrangement. This work will lay the foundation for our upcoming works toward achieving the goal of assisting the maximum of BVI people around the globe in moving independently.
DailyTalk: Spoken Dialogue Dataset for Conversational Text-to-Speech
Lee, Keon, Park, Kyumin, Kim, Daeyoung
The majority of current Text-to-Speech (TTS) datasets, which are collections of individual utterances, contain few conversational aspects. In this paper, we introduce DailyTalk, a high-quality conversational speech dataset designed for conversational TTS. We sampled, modified, and recorded 2,541 dialogues from the open-domain dialogue dataset DailyDialog inheriting its annotated attributes. On top of our dataset, we extend prior work as our baseline, where a non-autoregressive TTS is conditioned on historical information in a dialogue. From the baseline experiment with both general and our novel metrics, we show that DailyTalk can be used as a general TTS dataset, and more than that, our baseline can represent contextual information from DailyTalk. The DailyTalk dataset and baseline code are freely available for academic use with CC-BY-SA 4.0 license.
Fine-grained Emotional Control of Text-To-Speech: Learning To Rank Inter- And Intra-Class Emotion Intensities
Wang, Shijun, Guรฐnason, Jรณn, Borth, Damian
Nevertheless, the nuance of references might be difficult to be captured by these models State-of-the-art Text-To-Speech (TTS) models are capable (e.g. one sad and one depressed reference might produce of producing high-quality speech. The generated speech, the same synthesized speech), due to a mismatch between the however, is usually neutral in emotional expression, whereas content or speaker of the reference and synthesized speech, very often one would want fine-grained emotional control which implies the inflexible controllability of these models. of words or phonemes. Although still challenging, the first A better approach to achieve fine-grained controllable TTS models have been recently proposed that are able to emotional TTS is by manually assigning intensity labels (such control voice by manually assigning emotion intensity. Unfortunately, as strong or weak happiness) on words or phonemes, which due to the neglect of intra-class distance, the provides a flexible and efficient way to control the emotion intensity differences are often unrecognizable.
AI Voice Generator: Versatile Text to Speech Software
For years, creating good voice overs meant investing hundreds if not thousands of dollars in hiring voice artists, renting a recording studio to get the script recorded, investing in expensive recording equipment (if you are recording from home), and recruiting or outsourcing the entire project to an audio editor to mix the audio and produce a high-quality voiceover. Not to mention, the valuable hours dedicated to the entire process. Even after all this, the quality of the produced audio file may be subpar. What if there was an alternative to creating studio-quality voiceovers, and that too from the comfort of your own homes? Introducing Murf AI voice generator, which eliminates the entire process of generating voiceovers manually and enables you to quickly produce human-like voiceovers without any specialized hardware or professional. Leveraging advanced AI algorithms and deep learning, the realistic online voice generator tool allows you to convert text into natural-sounding speech, in a matter of just a few minutes.
Improving Inference Performance of Machine Learning with the Divide-and-Conquer Principle
Many popular machine learning models scale poorly when deployed on CPUs. In this paper we explore the reasons why and propose a simple, yet effective approach based on the well-known Divide-and-Conquer Principle to tackle this problem of great practical importance. Given an inference job, instead of using all available computing resources (i.e., CPU cores) for running it, the idea is to break the job into independent parts that can be executed in parallel, each with the number of cores according to its expected computational cost. We implement this idea in the popular OnnxRuntime framework and evaluate its effectiveness with several use cases, including the well-known models for optical character recognition (PaddleOCR) and natural language processing (BERT).
ClArTTS: An Open-Source Classical Arabic Text-to-Speech Corpus
Kulkarni, Ajinkya, Kulkarni, Atharva, Shatnawi, Sara Abedalmonem Mohammad, Aldarmaki, Hanan
At present, Text-to-speech (TTS) systems that are trained with high-quality transcribed speech data using end-to-end neural models can generate speech that is intelligible, natural, and closely resembles human speech. These models are trained with relatively large single-speaker professionally recorded audio, typically extracted from audiobooks. Meanwhile, due to the scarcity of freely available speech corpora of this kind, a larger gap exists in Arabic TTS research and development. Most of the existing freely available Arabic speech corpora are not suitable for TTS training as they contain multi-speaker casual speech with variations in recording conditions and quality, whereas the corpus curated for speech synthesis are generally small in size and not suitable for training state-of-the-art end-to-end models. In a move towards filling this gap in resources, we present a speech corpus for Classical Arabic Text-to-Speech (ClArTTS) to support the development of end-to-end TTS systems for Arabic. The speech is extracted from a LibriVox audiobook, which is then processed, segmented, and manually transcribed and annotated. The final ClArTTS corpus contains about 12 hours of speech from a single male speaker sampled at 40100 kHz. In this paper, we describe the process of corpus creation and provide details of corpus statistics and a comparison with existing resources. Furthermore, we develop two TTS systems based on Grad-TTS and Glow-TTS and illustrate the performance of the resulting systems via subjective and objective evaluations. The corpus will be made publicly available at www.clartts.com for research purposes, along with the baseline TTS systems demo.
Imaginary Voice: Face-styled Diffusion Model for Text-to-Speech
Lee, Jiyoung, Chung, Joon Son, Chung, Soo-Whan
The goal of this work is zero-shot text-to-speech synthesis, with speaking styles and voices learnt from facial characteristics. Inspired by the natural fact that people can imagine the voice of someone when they look at his or her face, we introduce a face-styled diffusion text-to-speech (TTS) model within a unified framework learnt from visible attributes, called Face-TTS. This is the first time that face images are used as a condition to train a TTS model. We jointly train cross-model biometrics and TTS models to preserve speaker identity between face images and generated speech segments. We also propose a speaker feature binding loss to enforce the similarity of the generated and the ground truth speech segments in speaker embedding space. Since the biometric information is extracted directly from the face image, our method does not require extra fine-tuning steps to generate speech from unseen and unheard speakers. We train and evaluate the model on the LRS3 dataset, an in-the-wild audio-visual corpus containing background noise and diverse speaking styles. The project page is https://facetts.github.io.
User-Centric Evaluation of OCR Systems for Kwak'wala
Rijhwani, Shruti, Rosenblum, Daisy, King, Michayla, Anastasopoulos, Antonios, Neubig, Graham
There has been recent interest in improving optical character recognition (OCR) for endangered languages, particularly because a large number of documents and books in these languages are not in machine-readable formats. The performance of OCR systems is typically evaluated using automatic metrics such as character and word error rates. While error rates are useful for the comparison of different models and systems, they do not measure whether and how the transcriptions produced from OCR tools are useful to downstream users. In this paper, we present a human-centric evaluation of OCR systems, focusing on the Kwak'wala language as a case study. With a user study, we show that utilizing OCR reduces the time spent in the manual transcription of culturally valuable documents -- a task that is often undertaken by endangered language community members and researchers -- by over 50%. Our results demonstrate the potential benefits that OCR tools can have on downstream language documentation and revitalization efforts.
Samsung's Bixby now supports text-to-speech in English calls
Last year, Samsung introduced a feature called "Text Call" for Bixby with One UI 5, which essentially transforms voice calls into written text and vice versa. It was initially available in Korean, but now the company has launched support for the feature in (US) English. The feature lets users answer calls by typing a message that Bixby will then read out loud to the caller. It can also transcribe what the caller says, making it a pretty useful tool for those hard of hearing or for anyone taking a call in a noisy environment. While Bixby has several voice options, Samsung is giving users the capability to personalize the voice it uses to answer calls.