Since i understand that there are a lot of empirical results but not much theoretical results in reinforcement learning I wanted to ask you: what kind of theoretical RL question would you like being answered? Are convergence guarantees and rates of convergence fully covered for tabular algorithms?

Sheila McGee-Smith is a leading communications industry analyst and strategic consultant with a proven track record in new product development, competitive assessment, market research, and sales strategies for customer care solutions and services. Her insight helps enterprises and solution providers develop strategies to meet the escalating demands of today's consumer and business customers. It seems one cannot pick up a newspaper or magazine in 2018 without seeing a headline related to artificial intelligence (AI). In September 2018, The Wall Street Journal published a thought-provoking article, The Human Promise of the AI Revolution. Taking an opposite and certainly a more sensationalist approach, Newsweek had this headline in its Tech & Science section, Forget Terrorism, Climate Change and Pandemics: Artificial Intelligence is the Biggest Threat to Humanity.

The following is an interview with Daniel Wagner, ahead of the release of his new book, AI Supremacy: Winning in the Era of Machine Learning. Can you briefly explain the differences between artificial intelligence, machine learning, and deep learning? Artificial intelligence (AI) is the overarching science and engineering associated with intelligent algorithms, whether or not they learn from data. However, the definition of intelligence is subject to philosophical debate-even the terms algorithms can be interpreted in a wide context. This is one of the reasons why there is some confusion about what AI is and what is not, because people use the word loosely and have their own definition of what they believe AI is. People should understand AI to be a catch-all term for technology which tends to imply the latest advances in intelligent algorithms, but the context in how the phrase is used determines its meaning, which can vary quite widely. Machine learning (ML) is a subfield of AI that focuses on intelligent algorithms that can learn automatically (without being explicitly programmed) from data.

My daughter will be starting university and already has a more-than-adequate laptop for essay writing and Netflix. But rather than carry it to and from lectures all the time, we wondered if it would be worth investing in a tablet or smaller 2-in-1 laptop with a stylus for note taking. Or do you think it would be better to stick with a small screen laptop? There are two issues here that go well beyond product choice, and can only be decided by you and your daughter. The first is whether a change in circumstances – going to university – requires the adoption of a new technology, whether it be a tablet or stylus or both.

Could the answer to mobility problems one day be as easy as pulling on a pair of trousers? A research team led by Bristol University's Professor Jonathan Rossiter recently unveiled a prototype pair of robotic trousers that they hope could help some disabled people walk without other assistance. As an engineer who researches ways of helping people with spinal chord injuries move their limbs again, I'm acutely aware of how the loss of mobility can affect a person's quality of life, and how restoring that movement can help. Given the staggering number of people with disabilities (there are more than 6.5 million people with mobility problems in the UK alone) and our ageing population, devices that improve mobility could help a large segment of the population. Yet despite 50 years of research, this kind of technology has rarely been adopted outside the lab.

Eighteen teams were selected for the inaugural competition last year. To build their socialbots, the students combined state-of-the-art techniques with their own novel strategies in the areas of natural language understanding and conversational AI. This article reports on the research conducted over the 2017-2018 year. While the 20-minute grand challenge was not achieved in the first year, the competition produced several conversational agents that advanced the state of the art, that are interesting for everyday users to interact with, and that help form a baseline for the second year of the competition. We conclude with a summary of the human conversation have applicability in both work that we plan to address in the second year of professional and everyday domains. The first generation of such assistants -- Amazon's Alexa, Apple's Siri, Google The Alexa Prize competition received hundreds of Assistant, and Microsoft's Cortana -- have been applications from interested universities. After a focused on short, task-oriented interactions, such as detailed review of the applications, Amazon playing music or answering simple questions, as announced 12 sponsored and 6 unsponsored teams opposed to the longer free-form conversations that as the inaugural cohort for the Alexa Prize. The teams occur naturally in social and professional human that went live for the 2017 competition, listed alphabetically interaction. Conversational AI is the study of techniques by university, were DeisBot (Brandeis University), for creating software agents that can engage Magnus (Carnegie Mellon University), in natural conversational interactions with humans.

In 2018, FireEye – a company based in California – informed Facebook and Google about a large group of fake Iranian social media accounts that was running movements to control the U.S people. As a result, Facebook and Google identified them, along with fake YouTube channels and blogs, using back-end data and then removed them. "Right now, you know something's automated just by the sheer volume of content pushing out," Lee Foster, information operations manager at FireEye, says. "It's not possible for a human to do this, so it's clearly not organically created. Often you'll see automated retweeting of some list of accounts that just to boost out a message. But the situation is about to take a new turn, he claims, as Artificial Intelligence (AI) system that covers its automated heritage is available now. "Imagine having a capability out there that can automate the organic creation of original content effectively enough that it looks real, but you don't even have to have it operate or touch it," Foster says. "In the very near term, the evolution of AI and machine learning, combined with the increasing availability of big data, will begin to transform human communication and interaction in the digital space.

As a millennial, I wholeheartedly embrace the idea of existential dread. But I do find the idea that we might be able to "future-proof" our species--by, say, genetically engineering a smarter human population--somewhat reassuring. Though, as any science-fiction story centered around the idea of creating a "better" human race can tell us, there are innumerable potential pitfalls. Phil Torres describes some of these radical, real-life plans intended to save humanity from future disaster--and their potential for unintended consequences. Elsewhere on Future Tense, we've been covering both public and private surveillance.

Artificial Intelligence has in the past been the topic for many science fiction movies (think I, Robot and Star Wars), however, now science fiction is becoming a reality in front of our very eyes. Developing at a rate that no-one could have expected; it has never been as important for companies to understand AI technology and how it could be utilised to improve business efficiency and growth right across the globe. It has been a reality in many industries for quite a while now. Manufacturing companies have been using automated machines and processes for several years. The healthcare/ medical device industries are using and developing new'Smart' products all the time for treatment, diagnostic and testing purposes.

"Deepfake" is the name being given to videos created through artificially intelligent deep learning techniques. Also referred to as "face-swapping", the process involves inputting a source video of a person into a computer, and then inputting multiple images and videos of another person. The neural network then learns the movements and expressions of the person in the source video in order to map the other's image onto it to look as if they are carrying out the speech or act. This practice was first used extensively in the production of fake pornography in late 2017 – where the faces of famous female celebrities were swapped in. Research has consistently shown that pornography leads the way in technological adoption and advancement when it comes to communication technologies, from the Polaroid camera to the internet.