Goto

Collaborating Authors

 Education


Using Logical Specifications of Objectives in Multi-Objective Reinforcement Learning

arXiv.org Artificial Intelligence

A BSTRACT In the multi-objective reinforcement learning (MORL) paradigm, the relative importance of each environment objective is often unknown prior to training, so agents must learn to specialize their behavior to optimize different combinations of environment objectives that are specified post-training. These are typically linear combinations, so the agent is effectively parameterized by a weight vector that describes how to balance competing environment objectives. However, many real world behaviors require nonlinear combinations of objectives. Additionally, the conversion between desired behavior and weightings is often unclear. In this work, we explore the use of a language based on propositional logic with quantitative semantics-in place of weight vectors-for specifying nonlinear behaviors in an interpretable way. We use a recurrent encoder to encode logical combinations of objectives, and train a MORL agent to generalize over these encodings. We test our agent in several grid worlds with various objectives and show that our agent can generalize to many never-before-seen specifications with performance comparable to single policy baseline agents. We also demonstrate our agent's ability to generate meaningful policies when presented with novel specifications and quickly specialize to novel specifications. 1 I NTRODUCTION Reinforcement Learning (RL) is a method for learning behavior policies by maximizing expected reward through interactions with an environment. RL has grown in popularity as RL agents have excelled at increasingly complex tasks, including board games (Silver et al., 2016), video games (Mnih et al., 2015), robotic control (Haarnoja et al., 2018), and other high dimensional, complex tasks.


On Education AWS Certified Machine Learning Specialty: Full Practice Exam - CouponED

#artificialintelligence

It's arguably the toughest certification exam AWS offers, as it not only tests AWS-specific knowledge, but your practical experience in machine learning and deep learning in general. It's tough to know what to expect on the exam before going in. This practice exam offers a realistic, full-length simulation of what you can expect in the AWS MLS-C01 exam. It's a great test of your readiness before you decide to invest in the real exam, and a great way to see what sorts of topics the exam will touch on. We also include a 10-question warmup test that will give you a rough idea of your readiness in just a half an hour.


Commentary: A.I. Bias Isn't the Problem. Our Society Is

#artificialintelligence

On Wednesday, Sens. Ron Wyden and Cory Booker and Rep. Yvette Clarke introduced the Algorithmic Accountability Act, indicating policymakers' increasing concern that artificial intelligence is magnifying human bias in tools such as facial recognition, self-driving cars, customer service, marketing, and content moderation. While A.I. has incredible potential to improve our lives, the truth is that it is only capable of reflecting our societal problems right back at us. And because of that, we can't trust it to make important decisions that are susceptible to human prejudice. Even the most enlightened of humans have deep-seated biases. Difficult to identify, they are even harder to correct.


These self-employed jobs face highest risk of A.I. takeover - Futurity

#artificialintelligence

You are free to share this article under the Attribution 4.0 International license. Self-employed people who work in some of the most popular--but lowest paid--occupations have the greatest risk of losing their job to artificial intelligence, experts say. With both self-employment and AI investment on the rise, independent sales people, drivers, and agriculture and construction workers face the greatest danger of having their jobs computerized, because the work is routine and low in technical expertise. "Those who are self-employed just don't have the same access to AI resources that corporate employees do, which makes it difficult for them to keep up with these technological advancements," says Kate Bezrukova, associate professor of organization and human resources in the School of Management at the University at Buffalo. The researchers conducted a systematic review of every study to date on artificial intelligence and the self-employed, and compared those findings to their own research on groups and teams from more than 20 published studies across several work settings.


Spotlight Podcast: Security Automation is (and isn't) the Future of Infosec

#artificialintelligence

In this Spotlight Podcast, we speak with David Brumley, the Chief Executive Officer at the security firm ForAllSecure* and a professor of Computer Science at Carnegie Mellon University. Brumley is a noted expert on the use of machine learning and automation to cyber security problems. In this podcast, we talk about the growing demand for security automation tools and how the chronic cyber security talent shortage in North America and elsewhere is driving investment in automation. Every so often, a technology comes along that seems to perfectly capture the zeitgeist: representing all that is both promising and troubling about the future. In the 1960s, you think of plastic, which was a pillar of a massively expanding consumer culture in the United States that put "convenience" above all else.


The Future of Outsourced Accounting and Accounting Technology [Register for the Workshop] Midtown Manhattan Wednesday, October 16, 2019

#artificialintelligence

Joerg Joergensen is a senior finance and operating executive with extensive experience in financial management, strategy development, and driving operational improvements. Before joining Vic.ai as CFO, Joerg operated as a CFO in the advisory practice of a leading on-demand accounting and finance solution for startups and growing businesses, focusing primarily on the technology and services sector. In addition to degrees from the London School of Economics and London Business School, Joerg is a Columbia Business School graduate. Joshua Feinberg is a revenue growth-focused, digital marketing and sales strategist. Before joining the Vic.ai management team in 2018, for the better part of two decades, he consulted with marketing, sales, and channel teams in and around the SaaS, cloud services, managed services, data center, and hosting industries. As the son of a retired CPA and retail controller, Joshua got his first taste of accounting at age 10 when his dad insisted he keep an accounts receivable sub-ledger for his Star Ledger paper route.


A Step-by-Step Guide to Failing a Data Science Project

#artificialintelligence

Practicing data science and working with real-world data and business problems is rather different than, for instance, building data science projects in Python using toy datasets. While being a part of a data science team in an enterprise, one should expect many challenges, including messy data, lack of data, unclear goals, difficult communication with business managers who want quick results, model performance in production being very different from testing performance, etc. Therefore, to become a successful data scientist with a portfolio of outstanding projects, it is not enough to be good at coding and building machine learning models. One should further be able to approach a project strategically and consider many different factors, not only from the viewpoint of a data scientist but also from a business perspective. However, what if you are actually not interested in succeeding in data science? In that case, read carefully through the tips provided below.


The 5 best Amazon deals you can get this Wednesday

USATODAY - Tech Top Stories

Get the things you actually want like robot vacuums and French presses. If you make a purchase by clicking one of our links, we may earn a small share of the revenue. However, our picks and opinions are independent from USA Today's newsroom and any business incentives. The best way to celebrate the middle of the week is sifting through deals, in my humble option. I mean, there's no better feeling than scoring a great price on a product you were planning on buying anyway.


AI and Mixed Reality Drive Educational Gaming into 'Boom Phase' -- Campus Technology

#artificialintelligence

Artificial intelligence and mixed reality have driven demand in learning games around the world, according to a new report by Metaari. A five-year forecast has predicted that educational gaming will reach $24 billion by 2024, with a compound annual growth rate of 33 percent and a quadrupling of revenues. Metaari is an analyst firm that tracks advanced learning technology. In the report, the company defined game-based learning as a combination of "game play" -- some type of competition against oneself or others -- and a reward/penalty system for assessment to measure mastery of content. This is different from gamification, which uses game-like features such as badges and points "tacked onto traditional education content," noted analyst Sam Adkins.


BENEFITS OF LEARNING ANALYTICS IN EDUCATION - Life Learners Limited

#artificialintelligence

In the increasingly competitive and changing world, efficient education system that drives the human development in the country is the key to a nation's progress. The education providers-schools and higher learning institutions must focus on student success and design instruction that considers the individual differences of the learners. In recent years, learning analytics has emerged as a promising area of research that extracts useful information from educational databases to understand students' progress and performance. The term Learning Analytics is defined as the measurement, collection, analysis and reporting of information about learners and their contexts for the purposes of understanding and optimizing learning. As the amount of data collected from the teaching-learning process increases, potential benefits of learning analytics can be far reaching to all stakeholders in education including students, teachers, leaders and policy makers.