Education
Machine Learning Automation: Beware of the Hype! - DZone Big Data
The general idea here is that the work done by a Machine Learning engineer can be automated, thus freeing potential users from the tyranny of needing to have specific expertise. Presumably, the ultimate goal of such automations is to make Machine Learning accessible to more people. After all, if a thing can be done automatically, that means anyone who can press a button can do it, right? I'm going to make a three-part argument here that "Machine Learning Automation" is really just a poor proxy for the true goal of making Machine Learning useable by anyone with data. Furthermore, I think the more direct path to that goal is via the combination of automation and interactivity that we often refer to in the software world as "abstraction". By understanding what constitutes a powerful Machine Learning abstraction, we'll be in a better position to think about the innovations that will really make Machine Learning more accessible.
Flawed plan
In 1960s and 70s Britain, immigrant ethnic minority children were dispersed across schools in the hope that it would help them integrate. The process saw children - largely of south Asian and African or Caribbean descent - being "bussed" out of their local areas to go to school. Eleven Local Area Authorities (LEAs) decided there should be no more than 30% of immigrants at any one school. It meant once that quota was reached, children were taken elsewhere. The process, which became known as "bussing", is now at the heart of a project in Bradford where Shabina Aslam is trying to trace children who, like herself, were sent to school away from where they lived.
Memory Augmented Neural Networks with Wormhole Connections
Gulcehre, Caglar, Chandar, Sarath, Bengio, Yoshua
Recent empirical results on long-term dependency tasks have shown that neural networks augmented with an external memory can learn the long-term dependency tasks more easily and achieve better generalization than vanilla recurrent neural networks (RNN). We suggest that memory augmented neural networks can reduce the effects of vanishing gradients by creating shortcut (or wormhole) connections. Based on this observation, we propose a novel memory augmented neural network model called TARDIS (Temporal Automatic Relation Discovery in Sequences). The controller of TARDIS can store a selective set of embeddings of its own previous hidden states into an external memory and revisit them as and when needed. For TARDIS, memory acts as a storage for wormhole connections to the past to propagate the gradients more effectively and it helps to learn the temporal dependencies. The memory structure of TARDIS has similarities to both Neural Turing Machines (NTM) and Dynamic Neural Turing Machines (D-NTM), but both read and write operations of TARDIS are simpler and more efficient. We use discrete addressing for read/write operations which helps to substantially to reduce the vanishing gradient problem with very long sequences. Read and write operations in TARDIS are tied with a heuristic once the memory becomes full, and this makes the learning problem simpler when compared to NTM or D-NTM type of architectures. We provide a detailed analysis on the gradient propagation in general for MANNs. We evaluate our models on different long-term dependency tasks and report competitive results in all of them.
The Fourth Transformation: How Augmented Reality & Artificial Intelligence Will Change Everything
Ten years from today, the center of our digital lives will no longer be the smart phone, but device that looks like ordinary eyeglasses: except those glasses will have settings for Virtual and Augmented Reality. What you really see and what is computer generated will be mixed so tightly together, that we won't really be able to tell what is real and what is illusion. Instead of touching and sliding on a mobile phone, we will make things happen by moving our eyes or by brainwaves. When we talk with someone or play an online game, we will see that person in the same room with us. We will be able to touch and feel her or him through haptic technology.
This Week in Machine Learning, 20 January 2017 โ Udacity Inc
Machine Learning is one of the most exciting fields in the world. Every week we discover something new, something amazing, something revolutionary. It's incredible, but it can also be overwhelming. That's why we created This Week in Machine Learning! Each week we publish a curated list of Machine Learning stories as a resource to help you keep pace with all these exciting developments.
Budget 2017: When Banks Turn To Robots To Man Their Branches
Artificial intelligence and automation are now considered to be amongst the biggest threats to job creation and industry voices across the board agree that so-called traditional jobs may soon cease to exist. According to Infosys' chief executive officer, Vishal Sikka, advances in technology removing a lot of mechanical and scripted jobs, besides many related to business process outsourcing, IT and IT infrastructure operations. But automation will also lead to creation of a new set of jobs, Sikka added. Around 20 crore middle class young people would have no jobs by 2025 if our education system doesn't keep pace with the changes in automation and technology, Mohandas Pai, the chairman of Manipal Global Education Services told BloombergQuint in an interview. And the level of automation is only going to get higher. Both ICICI and HDFC Bank say this is only the start, and there's a lot more to come.
Digital learning - Individual Adaptive Construction or Connected Sociโฆ
Attributes of Participatory Culture @TransformSoc (Henry Jenkins) โข Affiliations: online communities โข Expressions: new creative forms โข Collaborations: Problem-solving in teams โข Circulations: Shaping media flow Source: Confronting The Challenges Of Participatory Culture, by Henry Jenkins, MIT Press, 2009 31.
10 Most Important People in Artificial Intelligence in 2017
John McCarthy coined the term Artificial Intelligence in 1955. Since then, the AI industry at large has seen dramatic ups and downs -- progress and promise mixed with disappointment and disillusion. But now with the convergence of Megatrends on massive data, lightning fast processing speeds, and renewed competitive fever from the American MAFIA (Microsoft, Alphabet, Facebook, IBM, Amazon), AI is poised to cause disruption on a scale that could surpass the Internet itself. As we prepare for a wave of AI first companies (@sundarpichai) and AI natives (Ryan Hoover), every person in the innovation economy will need to understand how AI will (or will not) change their industry and their lives. These titans shape the conversation and have the most ability to move the entire AI industry.
Matrix Completion has No Spurious Local Minimum
Ge, Rong, Lee, Jason D., Ma, Tengyu
Matrix completion is a basic machine learning problem that has wide applications, especially in collaborative filtering and recommender systems. Simple non-convex optimization algorithms are popular and effective in practice. Despite recent progress in proving various non-convex algorithms converge from a good initial point, it remains unclear why random or arbitrary initialization suffices in practice. We prove that the commonly used non-convex objective function for \textit{positive semidefinite} matrix completion has no spurious local minima --- all local minima must also be global. Therefore, many popular optimization algorithms such as (stochastic) gradient descent can provably solve positive semidefinite matrix completion with \textit{arbitrary} initialization in polynomial time. The result can be generalized to the setting when the observed entries contain noise. We believe that our main proof strategy can be useful for understanding geometric properties of other statistical problems involving partial or noisy observations.
Robots and drones take over classrooms - BBC News
Classrooms are noticeably more hi-tech these days - interactive boards, laptops and online learning plans proliferate, but has the curriculum actually changed or are children simply learning the same thing on different devices? Some argue that the education this generation of children is receiving is little different from that their parents or even their grandparents had. But, in a world where artificial intelligence and robots threaten jobs, the skills that this generation of children need to learn are likely to be radically different to the three Rs that have for so long been the mainstay of education. The BBC went along to the Bett conference in London in search of different ways of teaching and learning. A stone's throw from the Excel, where Bett is held, stands a new school that is, according to its head Geoffrey Fowler, currently little more than a Portakabin.