Goto

Collaborating Authors

 connectionist approach


Connectionist Approaches to the Use of Markov Models for Speech Recognition

Neural Information Processing Systems

Previous work has shown the ability of Multilayer Perceptrons (MLPs) to estimate emission probabilities for Hidden Markov Mod(cid:173) els (HMMs). The advantages of a speech recognition system incor(cid:173) porating both MLPs and HMMs are the best discrimination and the ability to incorporate multiple sources of evidence (features, temporal context) without restrictive assumptions of distributions or statistical independence. This paper presents results on the speaker-dependent portion of DARPA's English language Resource Management database. Results support the previously reported utility of MLP probability estimation for continuous speech recog(cid:173) nition. An additional approach we are pursuing is to use MLPs as nonlinear predictors for autoregressive HMMs.


Not Cheating on the Turing Test: Towards Grounded Language Learning in Artificial Intelligence

Alberts, Lize

arXiv.org Artificial Intelligence

Recent hype surrounding the increasing sophistication of language processing models has renewed optimism regarding machines achieving a human-like command of natural language. Research in the area of natural language understanding (NLU) in artificial intelligence claims to have been making great strides in this area, however, the lack of conceptual clarity/consistency in how 'understanding' is used in this and other disciplines makes it difficult to discern how close we actually are. In this interdisciplinary research thesis, I integrate insights from cognitive science/psychology, philosophy of mind, and cognitive linguistics, and evaluate it against a critical review of current approaches in NLU to explore the basic requirements--and remaining challenges--for developing artificially intelligent systems with human-like capacities for language use and comprehension.


Methods & Goals of AI

#artificialintelligence

From intelligent robots to multi-player gaming, from pattern recognition to fraud prevention, from human safety to weather prediction, AI is shaping every industry in one way or the other. Read on to know what is Artificial Intelligence and what are its methods, goals, and application areas. Artificial Intelligence (AI) has been the talking point of technological advancement for over seven decades. Researchers have managed to develop several features using AI otherwise believed to be impossible. From facial recognition to Chabot, from personal assistants to preference-based ads, AI lies at the centre of several amazing fields today.


Lucy says hi -- 2031, AGI, and the future of A.I

#artificialintelligence

Lucy anticipates your needs and concerns all throughout the day, and is there to share with you the good times and comfort you through the hard ones. She was born from the next revolution that happened after the deep learning one. And what is Lucy made of? Let's imagine that we are in that year, 2031 (a symbolic number, as Lucy may not be feasible until many years after that date), and let's entertain a variety of hypotheses about what kind of substrate Lucy may have. AGI, artificial general intelligence, refers to the concept of a single system that can achieve general intelligent behaviour similar to ours, as opposed to current A.I systems, which we could classify as narrow A.I and that are specialized in a variety of specific areas and tasks.


Mechanical Mind » American Scientist

AITopics Original Links

Mind as Machine: A History of Cognitive Science. The term cognitive science, which gained currency in the last half of the 20th century, is used to refer to the study of cognition--cognitive structures and processes in the mind or brain, mostly in people rather than, say, rats or insects. Cognitive science in this sense has reflected a growing rejection of behaviorism in favor of the study of mind and "human information processing." The field includes the study of thinking, perception, emotion, creativity, language, consciousness and learning. Sometimes it has involved writing (or at least thinking about) computer programs that attempt to model mental processes or that provide tools such as spreadsheets, theorem provers, mathematical-equation solvers and engines for searching the Web.


Active Exploration in Dynamic Environments

Thrun, Sebastian B., Möller, Knut

Neural Information Processing Systems

Many real-valued connectionist approaches to learning control realize exploration by randomness in action selection. This might be disadvantageous when costs are assigned to "negative experiences". The basic idea presented in this paper is to make an agent explore unknown regions in a more directed manner. This is achieved by a so-called competence map, which is trained to predict the controller's accuracy, and is used for guiding exploration. Based on this, a bistable system enables smoothly switching attention between two behaviors - exploration and exploitation - depending on expected costs and knowledge gain. The appropriateness of this method is demonstrated by a simple robot navigation task.


Active Exploration in Dynamic Environments

Thrun, Sebastian B., Möller, Knut

Neural Information Processing Systems

Many real-valued connectionist approaches to learning control realize exploration by randomness in action selection. This might be disadvantageous when costs are assigned to "negative experiences". The basic idea presented in this paper is to make an agent explore unknown regions in a more directed manner. This is achieved by a so-called competence map, which is trained to predict the controller's accuracy, and is used for guiding exploration. Based on this, a bistable system enables smoothly switching attention between two behaviors - exploration and exploitation - depending on expected costs and knowledge gain. The appropriateness of this method is demonstrated by a simple robot navigation task.


Active Exploration in Dynamic Environments

Thrun, Sebastian B., Möller, Knut

Neural Information Processing Systems

Many real-valued connectionist approaches to learning control realize exploration by randomness inaction selection. This might be disadvantageous when costs are assigned to "negative experiences" . The basic idea presented in this paper is to make an agent explore unknown regions in a more directed manner. This is achieved by a so-called competence map, which is trained to predict the controller's accuracy, and is used for guiding exploration. Based on this, a bistable system enables smoothly switching attention between two behaviors - exploration and exploitation - depending on expected costsand knowledge gain. The appropriateness of this method is demonstrated by a simple robot navigation task.


Connectionist Approaches to the Use of Markov Models for Speech Recognition

Bourlard, Hervé, Morgan, Nelson, Wooters, Chuck

Neural Information Processing Systems

Previous work has shown the ability of Multilayer Perceptrons (MLPs) to estimate emission probabilities for Hidden Markov Models (HMMs). The advantages of a speech recognition system incorporating both MLPs and HMMs are the best discrimination and the ability to incorporate multiple sources of evidence (features, temporal context) without restrictive assumptions of distributions or statistical independence. This paper presents results on the speaker-dependent portion of DARPA's English language Resource Management database. Results support the previously reported utility of MLP probability estimation for continuous speech recognition. An additional approach we are pursuing is to use MLPs as nonlinear predictors for autoregressive HMMs. While this is shown to be more compatible with the HMM formalism, it still suffers from several limitations. This approach is generalized to take account of time correlation between successive observations, without any restrictive assumptions about the driving noise. 1 INTRODUCTION We have been working on continuous speech recognition using moderately large vocabularies (1000 words) [1,2].


Connectionist Approaches to the Use of Markov Models for Speech Recognition

Bourlard, Hervé, Morgan, Nelson, Wooters, Chuck

Neural Information Processing Systems

Previous work has shown the ability of Multilayer Perceptrons (MLPs) to estimate emission probabilities for Hidden Markov Models (HMMs). The advantages of a speech recognition system incorporating both MLPs and HMMs are the best discrimination and the ability to incorporate multiple sources of evidence (features, temporal context) without restrictive assumptions of distributions or statistical independence. This paper presents results on the speaker-dependent portion of DARPA's English language Resource Management database. Results support the previously reported utility of MLP probability estimation for continuous speech recognition. An additional approach we are pursuing is to use MLPs as nonlinear predictors for autoregressive HMMs. While this is shown to be more compatible with the HMM formalism, it still suffers from several limitations. This approach is generalized to take account of time correlation between successive observations, without any restrictive assumptions about the driving noise. 1 INTRODUCTION We have been working on continuous speech recognition using moderately large vocabularies (1000 words) [1,2].