Goto

Collaborating Authors

 Personal Assistant Systems


Learning from Bandit Feedback: An Overview of the State-of-the-art

arXiv.org Machine Learning

In machine learning we often try to optimise a decision rule that would have worked well over a historical dataset; this is the so called empirical risk minimisation principle. In the context of learning from recommender system logs, applying this principle becomes a problem because we do not have available the reward of decisions we did not do. In order to handle this "bandit-feedback" setting, several Counterfactual Risk Minimisation (CRM) methods have been proposed in recent years, that attempt to estimate the performance of different policies on historical data. Through importance sampling and various variance reduction techniques, these methods allow more robust learning and inference than classical approaches. It is difficult to accurately estimate the performance of policies that frequently perform actions that were infrequently done in the past and a number of different types of estimators have been proposed. In this paper, we review several methods, based on different off-policy estimators, for learning from bandit feedback. We discuss key differences and commonalities among existing approaches, and compare their empirical performance on the RecoGym simulation environment. To the best of our knowledge, this work is the first comparison study for bandit algorithms in a recommender system setting.


Leveraging User Engagement Signals For Entity Labeling in a Virtual Assistant

arXiv.org Artificial Intelligence

Personal assistant AI systems such as Siri, Cortana, and Alexa have become widely used as a means to accomplish tasks through natural language commands. However, components in these systems generally rely on supervised machine learning algorithms that require large amounts of hand-annotated training data, which is expensive and time consuming to collect. The ability to incorporate unsupervised, weakly supervised, or distantly supervised data holds significant promise in overcoming this bottleneck. In this paper, we describe a framework that leverages user engagement signals (user behaviors that demonstrate a positive or negative response to content) to automatically create granular entity labels for training data augmentation. Strategies such as multi-task learning and validation using an external knowledge base are employed to incorporate the engagement annotated data and to boost the model's accuracy on a sequence labeling task. Our results show that learning from data automatically labeled by user engagement signals achieves significant accuracy gains in a production deep learning system, when measured on both the sequence labeling task as well as on user facing results produced by the system end-to-end. We believe this is the first use of user engagement signals to help generate training data for a sequence labeling task on a large scale, and can be applied in practical settings to speed up new feature deployment when little human annotated data is available.


Conversational AI : Open Domain Question Answering and Commonsense Reasoning

arXiv.org Artificial Intelligence

An intelligent system must be capable of performing automated reasoning as well as responding to the changing environment (for example, changing knowledge). To exhibit such an intelligent behavior, a machine needs to understand its environment as well be able to interact with it to achieve certain goals. For acting rationally, a machine must be able to obtain information and understand it. Knowledge Representation (KR) is an important step of automated reasoning, where the knowledge about the world is represented in a way such that a machine can understand and process. Also, it must be able to accommodate the changes about the world (i.e., the new or updated knowledge). Using the generated knowledge base about the world, an intelligent system should be able to do complex tasks like question-answering (QA), summarization, medical reasoning and many more.


New Yorkers get first official look at Google's Pixel 4:Tech giant promotes handset in Time Square

Daily Mail - Science & tech

Google has gone to new heights in order to promote its next-generation Pixel handset. Hanging atop the 49-story Marriott Marquis building in Time Square is an advertisement that gives the first official glimpse at a coral-colored Pixel 4. The promotion also encourages consumer to remind their Google Assistant about its hardware event, set to take place October 15th, where the phone will be unveiled. Hanging atop the Marriott Marquis building in Time Square is an ad that gives the first official glimpse of a coral-colored Pixel 4. The promotion also encourages consumer to remind their Google Assistant about its hardware event, where the phone will be unveiled The hardware event will take place in the Big Apple, where Google will reveal intricate details of its Pixel 4 and Pixel 4 XL โ€“ which are set to take on Apple's latest iPhone 11. Rumors have also suggested that Google could announce other devices, including new Google Home Speakers and a Pixelbook 2. Google posted cropped renders of two sleek black devices to its Twitter page. The images appear to show a square module on the back of the phone.


Harvey Mackay: Artificial intelligence a real factor in workforce

#artificialintelligence

It seems like artificial intelligence is taking over the world, leaving many of us non-techies feeling terrified. Yet when you stop to think about it, we all use artificial intelligence every day. When we Google something, use Siri on our smartphones or ask Alexa a question, we are using AI. Hollywood has certainly featured AI in many movies from "The Terminator" series to "Robocop" and "I, Robot." In "Minority Report," algorithms predict who is going to commit a crime, and the person is arrested before the crime can be committed.


Amazon's newest Echo is down to an incredible low price

USATODAY - Tech Top Stories

If you make a purchase by clicking one of our links, we may earn a small share of the revenue. However, our picks and opinions are independent from USA Today's newsroom and any business incentives. I'm calling it now folks--smart displays are the next big thing in the smart home arena of products. The Echo Show 5 for example, Amazon's latest gadget to hit the scene, combines the benefits of their voice assistant, Alexa, with on-screen visuals, which quite literally means hours of entertainment without you having to lift a finger. Amazon just knocked $25 off the price of the Echo Show 5--now available for a mere $64.99.


Amazon's newest Echo Dot is smaller than ever--but just as powerful

USATODAY - Tech Top Stories

Amazon has its own lineup of smart home devices, including a plethora of Alexa-enabled speakers that not only bring music into your home but can easily run all of your smart gadgets, too. We took a close look at the smallest of the bunch, the budget-friendly Echo Dot, which has a lot to offer despite its petite size. The Echo Dot is small, compact, and easily fits into your decor. The Echo Dot is the smaller sibling of Amazon's popular midrange smart speaker, the Echo. This third-generation model still rocks the circa-2017 design upgrade that's slightly more rotund than the model that came before, but it still won't take up a ton of room.


Microsoft Teams now supports Oracle digital assistant

#artificialintelligence

Oracle's digital assistant is now available in Microsoft Teams, the cloud hosting and services provider announced today. Oracle's AI assistant got several other updates today, including the ability to interact via voice commands, enterprise-grade security for voice recordings, and the ability to respond to more complex voice commands. The news was announced today at Oracle's OpenWorld conference in San Francisco. As part of the Microsoft Teams integration, Microsoft Teams and Office 365 users will be able to access Oracle enterprise bots from the Microsoft Teams App Store. "For enterprise customers, what we're enabling to do now is [that] they can easily try to use Microsoft Teams to collaborate with their employees and colleagues and so forth with Microsoft Teams," Oracle VP of AI and digital assistant Suhas Uliyar told VentureBeat in a phone interview.


Apple study suggests chattier users prefer chattier AI assistants

#artificialintelligence

How might you characterize the conversational style of a digital assistant like Siri? No matter your impression, it stands to reason that striking the wrong tone could dissuade users from engaging with it in the future. Perhaps that's why in a paper ("Mirroring to Build Trust in Digital Assistants") accepted to the Interspeech 2019 conference in Graz, Austria, researchers at Apple investigated a conversational assistant that considered users' preferred tones and mannerisms in its responses. They found that people's opinions of the assistant's likability and trustworthiness improved when it mirrored their degree of chattiness, and that the features necessary to perform the mirroring could be extracted from those people's speech patterns. "Long-term reliance on digital assistants requires a sense of trust in the assistant and its abilities. Therefore, strategies for building and maintaining this trust are required, especially as digital assistants become more advanced and operate in more aspects of people's lives," wrote the paper's coauthors.


5 components of emotional intelligence in a human-AI customer service

#artificialintelligence

Emotional intelligence is an essential skill in the customer service functions with the productivity and efficiency of the role is directly tied to the quality of conversations. The personal dynamics of emotionally cognisant customer service agents play an important role in empathetically resolving any queries or concerns, impacting customer churn and increasing brand loyalty by leaving customers with a positive impression of an organisation. However, rapid adoption of automation technology within customer-facing roles presents new challenges to organisations that want to harness its benefits, without impacting the service that it delivers to its customers. Already helping many companies increase customer service availability, reduce wait times and improve resolution rates, Gartner has predicted that a quarter of all customer service operations will use artificial intelligence (AI)-powered virtual assistants by 2020. In many organisations, this has resulted in the creation of a hybrid workforce of human and digital agents.