Media
[R] Independently Recurrent Neural Network (IndRNN): Building A Longer and Deeper RNN • r/MachineLearning
Recurrent neural networks (RNNs) have been widely used for processing sequential data. However, RNNs are commonly difficult to train due to the well-known gradient vanishing and exploding problems and hard to learn long-term patterns. Long short-term memory (LSTM) and gated recurrent unit (GRU) were developed to address these problems, but the use of hyperbolic tangent and the sigmoid action functions results in gradient decay over layers. Consequently, construction of an efficiently trainable deep network is challenging. In addition, all the neurons in an RNN layer are entangled together and their behaviour is hard to interpret.
Physicist Stephen Hawking dies at 76
LONDON – Stephen Hawking, Britain's most famous scientist, who dedicated his life to unlocking the secrets of the universe, has died at age 76. His children, Lucy, Robert and Tim, said in a statement carried by Britain's Press Association news agency on Wednesday: "We are deeply saddened that our beloved father passed away today. "He was a great scientist and an extraordinary man whose work and legacy will live on for many years." Born on Jan. 8, 1942 -- 300 years to the day after the death of the father of modern science, Galileo Galilei -- he believed science was his destiny. But fate also dealt Hawking a cruel hand. Crippled by amyotrophic lateral sclerosis (ALS), which attacks the nerves controlling voluntary movement, he spent most of his life in a wheelchair. Hawking defied predictions that he would only live for a few years, overcoming the debilitating effects of ALS on his mobility and speech that left him paralyzed and able to communicate only via a computer speech synthesiser. "I am quite often asked: how do you feel about having ALS?" he once wrote. "The answer is, not a lot.
[P] Deep Neural Network implemented in pure SQL over BigQuery • r/MachineLearning
Aw come on now, if you're going to implement this in a database: use the database. Store the weights and biases in a table, and use JOIN and GROUP BY operations to form the dot products. If you reformulate the inputs as a design matrix, you can store the weights and biases for each layer in a single table. In addition to making your code readable, this has the added benefit that the update operation can be implemented as a literal update (i.e. on the weights table) as opposed to running a pass through the network to output new weights which then need to be passed in directly to a new select statement. The way the author implemented it, it would be extremely expensive just on the client's bandwidth to run either a forward or backwards pass on a large model since you'd need to pass all of the parameters over the connection twice for a single update. The database should store and manage all the parameters.
Project news.bridge is good to go - News - Innovation - DW.COM
Making audiovisual/broadcasting content available in virtually any language – this is the goal of news.bridge, Since we already published a post on news.bridge To help you pick the right NLP ( natural language processing) tool for your tasks, we're also working on a benchmarking service. Last, but not least, there will be an editor to manually improve output -- because we all know that NLP hasn't reached perfection yet." The news.bridge consortium involves three other European partners (LETA, LIUM, Priberam) and is funded by Google's Digital News Initiative.
From Beethoven to bot-hoven: when machines start to write music
Is nothing safe from the reach of the machines? After replacing humans at repetitive tasks, beating them at games of skill, artificial intelligence is now making inroads into the arguably the last frontier: the creative arts. Ping An Technology, a subsidiary of China's second-largest life insurance company, has developed an award-winning computer algorithm that can generate original melodies after "studying" hundreds of pieces of piano music. But the company has no intention of stopping there. It is working towards using AI to create virtual singers and write original pop music based on individual tastes with a longer term goal of composing a symphony to potentially rival Beethoven. "Be it a Chinese version of break-up songs similar to Taylor Swift's style or a Shanghai accented voice that raps like Justin Bieber, with the upgrade of the AI music system we will be able to create whatever music you like as long as we know the genre and the type of singers you adore," said Xiao Jing, chief scientist of Ping An Technology.
[R] IcoRating: A Deep-Learning System for Scam ICO Identification • r/MachineLearning
After reading this research paper, I'd buy into an ICO for the IcoRating Coin for sure. But on a serious note, this is both well-timed and invaluable. While many people that invested around November (hopefully) learned their lesson on doing their own research and investigation into those same sources that your ML system analyzes (white paper, team member Linkden pages, Github repos, the website itself... etc), this is undoubtedly impressive work and should assist in analyzing the neverending onslaught of offerings going forward.
POLITICO Establishes Global AI Forum for Business Leaders and Policymakers with Accenture as Founding Partner
POLITICO Establishes Global AI Forum for Business Leaders and Policymakers with Accenture as Founding Partner First in series of AI summits will take place on March 19-20, 2018 in Brussels, Belgium BRUSSELS; March 8, 2018 – POLITICO, with Accenture Applied Intelligence as the founding partner, is launching a global artificial intelligence (AI) forum to help business leaders and government policymakers understand the impact of AI innovation and to inform responsible use of AI. As AI-based decisions have an increasing impact on human lives, the initiative aims to empower decision-makers to build a framework for governance in pivotal and unchartered territory. The initiative will hold a series of AI summits and roundtables in multiple cities in Europe and the US. The first AI Summit will take place on March 19-20, 2018 in Brussels, Belgium. Carlos Moedas, European Union Commissioner for Research Science and Innovation, and John Delaney, US Congressman and founder of the bipartisan AI Caucus, are two keynote participants of the event.
Maritz Motivation Solutions and HSBC Innovate with Artificial Intelligence in the Loyalty Sector
"This use of AI with HSBC's card program is one of the first in the loyalty sector and demonstrates that artificial intelligence and machine learning are the future of business," said Jesse Wolfersberger, senior director, decision sciences, Maritz Motivation Solutions. "We're going to witness more companies using AI to engage people in new and innovative ways. We are proud to have a proprietary AI system that makes loyalty programs smarter and more efficient and can result in significant operational cost savings for businesses." Maritz's AI algorithm, also known as machine learning, predicts the rewards a loyalty program member is likely to redeem over the next year. The AI then suggests a redemption category to promote to each member and calculates the percentage of clients likely to redeem in different categories.
The Rise of Dismal Science Fiction
Future Tense is a partnership of Slate, New America, and Arizona State University that examines emerging technologies, public policy, and society. After William Gibson coined the term cyberspace in his 1984 novel Neuromancer, it almost immediately entered our everyday vocabulary. A play on information theorist Norbert Wiener's idea of cybernetics, cyberspace became shorthand for the world inside our networked computers, that digital landscape where we met to chat, play games, and exchange intimate secrets. Today, cyber is part of our political language, too, used to describe everything from digital warfare to online intelligence gathering. What often gets forgotten about the origin story of this term is that Gibson wasn't just talking the future of computers, but of a world where tech corporations rule every aspect of our lives.
Apple HomePod, Amazon Echo, Google Home and more: We put 7 speakers to the test
For the last four weeks, I've been living in an Orwellian nightmare. One in which I have to watch every word I say because "they" are always listening. And by "they", I mean Alexa, Siri and Google. It seemed like a good idea - get seven smart speakers and test them in a real house to see how they affected our listening habits and daily routine. At times, they've been pretty helpful. If we're running low on biscuits, one of us can bark, "Hey Siri, add Hob Nobs to the shopping list" and a reminder appears on our phones.