Asia
A Regularized Framework for Sparse and Structured Neural Attention
Niculae, Vlad, Blondel, Mathieu
Modern neural networks are often augmented with an attention mechanism, which tells the network where to focus within the input. We propose in this paper a new framework for sparse and structured attention, building upon a smoothed max operator. We show that the gradient of this operator defines a mapping from real values to probabilities, suitable as an attention mechanism. Our framework includes softmax and a slight generalization of the recently-proposed sparsemax as special cases. However, we also show how our framework can incorporate modern structured penalties, resulting in more interpretable attention mechanisms, that focus on entire segments or groups of an input. We derive efficient algorithms to compute the forward and backward passes of our attention mechanisms, enabling their use in a neural network trained with backpropagation. To showcase their potential as a drop-in replacement for existing ones, we evaluate our attention mechanisms on three large-scale tasks: textual entailment, machine translation, and sentence summarization. Our attention mechanisms improve interpretability without sacrificing performance; notably, on textual entailment and summarization, we outperform the standard attention mechanisms based on softmax and sparsemax.
Eric Schmidt on AI: 'Trust me, these Chinese people are good'
Eric Schmidt, the executive chairman of Google parent company Alphabet, has warned that China is poised to overtake the US in the field of artificial intelligence (AI) if the US government doesn't act soon. Speaking at the Artificial Intelligence and Global Security Summit on Wednesday, the former Google CEO said: "Trust me, these Chinese people are good." He added: "They are going to use this technology for both commercial as well as military objectives with all sorts of implications." China published its AI strategy in July and said that it wanted to be the world leader in AI by 2030. "It's pretty simple," said Schmidt, who claims to have read the report.
Three concerns about granting citizenship to robot Sophia
I was surprised to hear that a robot named Sophia was granted citizenship by the Kingdom of Saudi Arabia. The announcement last week followed the Kingdom's commitment of US$500 billion to build a new city powered by robotics and renewables. One of the most honourable concepts for a human being, to be a citizen and all that brings with it, has been given to a machine. As a professor who works daily on making AI and autonomous systems more trustworthy, I don't believe human society is ready yet for citizen robots. To grant a robot citizenship is a declaration of trust in a technology that I believe is not yet trustworthy.
October 2017 fundings, acquisitions and IPOs
Mapbox, a Washington, DC and San Francisco provider of nav systems for car companies and others involved in autonomous vehicles, raised $164 million in a Series C round led by the SoftBank Vision Fund, with participation from existing investors including Foundry Group, DFJ Growth, DBL Partners, and Thrive Capital. "Location data is central and mission critical to the development of the world's most exciting technologies," said Rajeev Misra, who helps oversee SoftBank's Vision Fund. Element AI, a Canadian startup providing learning platform solutions for self-driving and advanced manufacturing, raised $135 CAD million (around $105 million) in a Series A round (in June) led by Data Collective, a SV-based venture capital firm, and included participation by Fidelity Investments Canada, National Bank of Canada, Intel Capital, and Real Ventures. Ninebot, the Chinese consumer products company that bought out Segway and raised $80 million in 2015, raised another $100 million in a Series C round from the SDIC Fund Management Co. and the China Mobile Fund. Horizon Robotics, another Chinese startup, raised $100 million in a Series A round led by Intel Capital with participation by Wu Capital, Morningside Venture Capital, Linear Venture, Hillhouse Capital and Harvest Investments.
Tradestreaming Preview
Artificial intelligence portends to change the way finance operates. This week's guest on the podcast is Zor Gorelov, the co-founder and CEO of Kasisto. Kasisto specializes in creating banking smart AI that can fundamentally transform the way banks and financial institutions connect with and serve with their customers. I sat down with Gorelev to find out more about how Kasisto is helping its partners to achieve scale without opening another branch location. Below are highlights, edited for clarity, from the episode.
China could soon overtake the US in AI development, former Google CEO says
During his talk at a tech summit organized by the Center for a New American Security (CNAS) on Wednesday, former Google CEO Eric Schmidt told his audience that it won't be long before China overtakes the United States in the development of advanced artificial intelligence (AI), according to a report by The Verge. Schmidt, who's now the executive chairman of Google's parent company Alphabet, said that while the U.S. would maintain its leading place in the next five years, China will be able to catch up "extremely quickly." "Trust me, these Chinese people are good," Schmidt pointed out. China has previously laid out plans to become the world leader in AI by 2030, as outlined in a government policy released in July of this year. "They are going to use this technology for both commercial and military objectives, with all sorts of implications," The Verge reports.
Stephen Hawking warns that robots could replace humans
A report by Human Rights Watch and the Harvard Law School International Human Rights Clinic calls for humans to remain in control over all weapons systems at a time of rapid technological advances. It says that requiring humans to remain in control of critical functions during combat, including the selection of targets, saves lives and ensures that fighters comply with international law. 'Machines have long served as instruments of war, but historically humans have directed how they are used,' said Bonnie Docherty, senior arms division researcher at Human Rights Watch, in a statement. 'Now there is a real threat that humans would relinquish their control and delegate life-and-death decisions to machines.' Some have argued in favor of robots on the battlefield, saying their use could save lives.
Humans Are Still Better Than AI at StarCraft--for Now
In the computer game StarCraft, humans still have an edge over artificial intelligence. That was clear on Tuesday after professional StarCraft player Song Byung-gu defeated four different bots in the first contest to pit AI systems against pros in live bouts of the game. One of the bots, dubbed "CherryPi," was developed by Facebook's AI research lab. The other bots came from Australia, Norway, and Korea. The contest took place at Sejong University in Seoul, Korea, which has hosted annual StarCraft AI competitions since 2010.
Machine Learning Vs. Artificial Intelligence: Unpacking Their Histories
Nand Kishor is the Product Manager of House of Bots. After finishing his studies in computer science, he ideated & re-launched Real Estate Business Intelligence Tool, where he created one of the leading Business Intelligence Tool for property price analysis in 2012. He also writes, research and sharing knowledge about Artificial Intelligence (AI), Machine Learning (ML), Data Science, Big Data, Python Language etc... ... Nand Kishor is the Product Manager of House of Bots. After finishing his studies in computer science, he ideated & re-launched Real Estate Business Intelligence Tool, where he created one of the leading Business Intelligence Tool for property price analysis in 2012. He also writes, research and sharing knowledge about Artificial Intelligence (AI), Machine Learning (ML), Data Science, Big Data, Python Language etc... Want to be a millionaire before you turn 25? Study artificial intelligence or machine learning 34158 views Google Artificial Intelligence'Alpha Go Zero' Just Pressed Reset On How To Learn 12204 views