Goto

Collaborating Authors

 felten


Multi-Objective Reinforcement Learning Based on Decomposition: A Taxonomy and Framework

arXiv.org Artificial Intelligence

Multi-objective reinforcement learning (MORL) extends traditional RL by seeking policies making different compromises among conflicting objectives. The recent surge of interest in MORL has led to diverse studies and solving methods, often drawing from existing knowledge in multi-objective optimization based on decomposition (MOO/D). Yet, a clear categorization based on both RL and MOO/D is lacking in the existing literature. Consequently, MORL researchers face difficulties when trying to classify contributions within a broader context due to the absence of a standardized taxonomy. To tackle such an issue, this paper introduces multi-objective reinforcement learning based on decomposition (MORL/D), a novel methodology bridging the literature of RL and MOO. A comprehensive taxonomy for MORL/D is presented, providing a structured foundation for categorizing existing and potential MORL works. The introduced taxonomy is then used to scrutinize MORL research, enhancing clarity and conciseness through well-defined categorization. Moreover, a flexible framework derived from the taxonomy is introduced. This framework accommodates diverse instantiations using tools from both RL and MOO/D. Its versatility is demonstrated by implementing it in different configurations and assessing it on contrasting benchmark problems. Results indicate MORL/D instantiations achieve comparable performance to current state-of-the-art approaches on the studied problems. By presenting the taxonomy and framework, this paper offers a comprehensive perspective and a unified vocabulary for MORL. This not only facilitates the identification of algorithmic contributions but also lays the groundwork for novel research avenues in MORL.


Alphabet's Project Amber uses AI to try to diagnose depression from brain waves

#artificialintelligence

X, Alphabet's experimental R&D lab, today detailed Project Amber, a now-disbanded project which aimed to make brain waves as easy to interpret as blood glucose. The goal was to develop objective measurements of depression and anxiety that could be used to support diagnoses, treatment, and therapies. An estimated 17.3 million adults in the U.S. have had at least one major depressive episode, according to the U.S. National Institutes of Health. Moreover, the percentage of adults in the U.S. experiencing serious thoughts of suicide increased 0.15% from 2016-2017 to 2017-2018 -- 460,000 more people than last year's dataset. Today's assessments mostly rely on conversations with clinicians or surveys like the PHQ-9 or GAD-7. The Amber team sought to marry machine learning techniques with electroencephalography (EEG) to measure telling electrical activity in the brain.


From math to meaning: Artificial intelligence blends algorithms and applications

#artificialintelligence

Artificial intelligence is already a part of everyday life. It helps us answer questions like "Is this email spam?" It identifies friends in online photographs, selects news stories based on our politics and helps us deposit checks via our phones -- if all somewhat imperfectly. But these applications are just the beginning. Through advances in computer science, researchers are creating new capabilities that have the potential to improve our lives in ways we have yet to imagine.


Artificial intelligence blends algorithms and applications

#artificialintelligence

Artificial intelligence is already a part of everyday life. It helps us answer questions like "Is this email spam?" It identifies friends in online photographs, selects news stories based on our politics and helps us deposit checks via our phones--if all somewhat imperfectly. But these applications are just the beginning. Through advances in computer science, researchers are creating new capabilities that have the potential to improve our lives in ways we have yet to imagine.


Experts tell Senate panel of AI's growing potential

#artificialintelligence

Artificial intelligence has tremendous potential for making sense of the big data that is inundating healthcare, creating actionable insights for clinicians. However, the breakthrough technology also brings with it challenges and risks for the industry. That's the consensus of AI experts who testified on Tuesday before the Senate Science, Commerce and Transportation Committee's Subcommittee on Communications, Technology, Innovation and the Internet. Edward Felten, professor of computer science and public affairs at Princeton University, told lawmakers that AI is already creating huge benefits in healthcare and that its potential will only grow as the technology advances. "AI is a key enabler of precision medicine," said Felten.


Can Government Keep Up with Artificial Intelligence? -- NOVA Next PBS

#artificialintelligence

When Amazon first debuted same-day delivery service in Boston, it seemed a promising alternative to poorly-stocked, overpriced, or low-quality supermarkets in neighborhoods like Roxbury. But the service didn't extend there, despite delivering to residents on all sides of Roxbury. Amazon was assailed for overlooking the comparatively lower-income Boston neighborhood, and the company, in its defense, said customer data and delivery logistics played into the decision. Amazon didn't overlook just Roxbury, either. According to a Bloomberg report, in Chicago, New York, Boston, Atlanta, and other cities, black residents were half as likely to live in same-day delivery areas as white residents, despite paying the same $99 membership fee. Today, data collected on individuals, when combined with artificially intelligent systems, are used for rolling out new services, populating newsfeeds, targeting advertisements, determining healthcare treatment plans, even levying court rulings.


Stephen Hawking calls for 'world government' to stop a robot uprising

Christian Science Monitor | Science

March 9, 2017 --Physicist Stephen Hawking may be a proponent of artificial intelligence, but he has also been outspoken about the potential challenges it creates. In a recent interview, he sounded a similar tone, and offered a solution that conservatives may find hard to accept. Speaking to The Times of London to commemorate being awarded the Honorary Freedom of the City of London, a title that was conferred on him on Monday, Professor Hawking expressed optimism for the future. He added, however, that he is concerned about artificial intelligence (AI), as well as other global threats. "We need to be quicker to identify such threats and act before they get out of control," Hawking said.


Stephen Hawking: We need a 'world government' to stop the rise of dangerous artificial intelligence

#artificialintelligence

Stephen Hawking is concerned about the rise of artificial intelligence. Physicist Stephen Hawking may be a proponent of artificial intelligence, but he has also been outspoken about the potential challenges it creates. In a recent interview, he sounded a similar tone, and offered a solution that conservatives may find hard to accept. Speaking to The Times of London to commemorate being awarded the Honorary Freedom of the City of London, a title that was conferred on him on Monday, Professor Hawking expressed optimism for the future. He added, however, that he is concerned about artificial intelligence (AI), as well as other global threats.


Obama White House's final tech recommendation: Invest in A.I.

#artificialintelligence

One of the most important things that the U.S. can do to improve economic growth is to invest in artificial intelligence, or A.I., said the White House, in a new report. A.I.-driven, intelligent systems have the potential to displace millions, such as truck drivers, from their jobs. But potential negative impacts can be offset by investments in education as well as by ensuring there is a safety net to help affected people, the White House argued, in what will likely be the Obama administration's final report on technology policy. Some of the report's recommendations, which include expanded unemployment help and access to healthcare, may be anathema to a Republican-controlled Congress with a focus on tax reductions and spending cuts. But this report -- "Artificial Intelligence, Automation, and the Economy" (PDF) -- which was in the works well before election day, also describes broader, technological-driven changes that will impact jobs and may pose issues for President-elect Donald Trump.


Obama White House's final tech recommendation: Invest in A.I.

#artificialintelligence

One of the most important things that the U.S. can do to improve economic growth is to invest in artificial intelligence, or A.I., said the White House, in a new report. A.I.-driven, intelligent systems have the potential to displace millions, such as truck drivers, from their jobs. But potential negative impacts can be offset by investments in education as well as by ensuring there is a safety net to help affected people, the White House argued, in what will likely be the Obama administration's final report on technology policy. Some of the report's recommendations, which include expanded unemployment help and access to healthcare, may be anathema to a Republican-controlled Congress with a focus on tax reductions and spending cuts. But this report -- "Artificial Intelligence, Automation, and the Economy" (PDF) -- which was in the works well before election day, also describes broader, technological-driven changes that will impact jobs and may pose issues for President-elect Donald Trump.