Many current fears around AI and automation center around the idea that superintelligence could somehow "take over," turning streets around the globe into scenes from The Terminator. While there is much to be gained from discussing the safe development of AI, there's another more imminent danger: Autonomous weapons. On Friday, after three years of negotiations, the UN unanimously agreed to take action. At the Fifth Review Conference of the UN Convention on Certain Conventional Weapons, countries around the world agreed to begin formal discussions--which will take place for two weeks at the 2017 UN convention in Geneva--on a possible ban of lethal, autonomous weapons. Talks will begin in April or August, and 88 countries have agreed to attend.
"Whenever you are about to be oppressed, you have a right to resist oppression: whenever you conceive yourself to be oppressed, conceive yourself to have a right to make resistance, and act accordingly. In proportion as a law of any kind--any act of power, supreme or subordinate, legislative, administrative, or judicial, is unpleasant to a man, especially if, in consideration of such its unpleasantness, his opinion is, that such act of power ought not to have been exercised, he of course looks upon it as oppression: as often as anything of this sort happens to a man--as often as anything happens to a man to inflame his passions,--this article, for fear his passions should not be sufficiently inflamed of themselves, sets itself to work to blow the flame, and urges him to resistance. Submit not to any decree or other act of power, of the justice of which you are not yourself perfectly convinced. If a constable call upon you to serve in the militia, shoot the constable and not the enemy;--if the commander of a press-gang trouble you, push him into the sea--if a bailiff, throw him out of the window. If a judge sentence you to be imprisoned or put to death, have a dagger ready, and take a stroke first at the judge."
Decades of research in artificial intelligence (AI) have produced formidable technologies that are providing immense benefit to industry, government, and society. AI systems can now translate across multiple languages, identify objects in images and video, streamline manufacturing processes, and control cars. The deployment of AI systems has not only created a trillion-dollar industry that is projected to quadruple in three years, but has also exposed the need to make AI systems fair, explainable, trustworthy, and secure. Future AI systems will rightfully be expected to reason effectively about the world in which they (and people) operate, handling complex tasks and responsibilities effectively and ethically, engaging in meaningful communication, and improving their awareness through experience. Achieving the full potential of AI technologies poses research challenges that require a radical transformation of the AI research enterprise, facilitated by significant and sustained investment. These are the major recommendations of a recent community effort coordinated by the Computing Community Consortium and the Association for the Advancement of Artificial Intelligence to formulate a Roadmap for AI research and development over the next two decades.
"Please think forward to the year 2030. Analysts expect that people will become even more dependent on networked artificial intelligence (AI) in complex digital systems. Some say we will continue on the historic arc of augmenting our lives with mostly positive results as we widely implement these networked tools. Some say our increasing dependence on these AI and related systems is likely to lead to widespread difficulties. Our question: By 2030, do you think it is most likely that advancing AI and related technology systems will enhance human capacities and empower them? That is, most of the time, will most people be better off than they are today? Or is it most likely that advancing AI and related technology systems will lessen human autonomy and agency to such an extent that most people will not be better off than the way things are today? Please explain why you chose the answer you did and sketch out a vision of how the human-machine/AI collaboration will function in 2030.