The way we learn natural languages hasn't really changed for decades. We now have beautiful apps like Duolingo and Spaced Repetition software like Anki, but I'm talking about our fundamental approach. We still follow pre-defined curricula, and do essentially random exercises. Learning isn't personalized, and learning isn't driven by data. And I think there's a big opportunity to change that. With the unlimited supply of natural language data online, and with the advances in Natural Language Processing (NLP) techniques, shouldn't we be able to do something smarter?
The dream of building computers or robots that communicate like humans has been with us for many decades now. And if market trends and investment levels are any guide, it's something we would really like to have. MarketsandMarkets says the natural language processing (NLP) industry will be worth $16.07 billion by 2021, growing at a rate of 16.1 percent, and deep learning is estimated to reach $1.7 billion by 2022, growing at a CAGR of 65.3 percent between 2016 and 2022.
Likewise in 2007, scientists created a computer program called Chinook that cannot be beat at checkers. In earlier victories, the computer program "memorized" every potential move and mathematically calculated the odds of success for each. By using the "brute force" technique, the computer was able to quickly determine the outcome of every potential move and choosing the one that leads to success. Deep Blue processed 200 million board positions per second in determining its next move.