Genre
Risk-Averse Approximate Dynamic Programming with Quantile-Based Risk Measures
Jiang, Daniel R., Powell, Warren B.
In this paper, we consider a finite-horizon Markov decision process (MDP) for which the objective at each stage is to minimize a quantile-based risk measure (QBRM) of the sequence of future costs; we call the overall objective a dynamic quantile-based risk measure (DQBRM). In particular, we consider optimizing dynamic risk measures where the one-step risk measures are QBRMs, a class of risk measures that includes the popular value at risk (VaR) and the conditional value at risk (CVaR). Although there is considerable theoretical development of risk-averse MDPs in the literature, the computational challenges have not been explored as thoroughly. We propose data-driven and simulation-based approximate dynamic programming (ADP) algorithms to solve the risk-averse sequential decision problem. We address the issue of inefficient sampling for risk applications in simulated settings and present a procedure, based on importance sampling, to direct samples toward the "risky region" as the ADP algorithm progresses. Finally, we show numerical results of our algorithms in the context of an application involving risk-averse bidding for energy storage.
Flipboard on Flipboard
With Artificial Intelligence (AI) now being seen as an essential tool in various sectors, it is important for our generation to incorporate innovative dynamic learning needs into our global education system. But when cutting-edge sectors evolve at lightning pace, it is not always possible for traditional sectors to change at the same speed. My company, Gravity4, has been intensively exploring Deep Learning in our development lab to advance our understanding with the ad technology platforms. Recently, I did a mentorship series with the youth in a struggling education system. The fascination of all great things possible, through the cutting edge revolution of AI, bought much energy in the room.
IBM Watson's Chief Architect Talks Democratizing AI, Starting With Fifth Graders (EdSurge News)
Artificial intelligence (AI) systems can recognize your speech like Siri or identify images like Facebook, but these types of machine intelligences are built on statistical approximation, using loads of data to make educated guesses. Though statistical approximation was a significant technological advancement for devices, experts at Future Lab's AI Summit in New York City believe that it is time to expand the bounds of artificial intelligence--to democratize it--by "engineering knowledge." For Puri, that is the next level of AI--its ability to not only say what something is, but to reason and understand the intent of its being, to answer the'why' question. "Working with kids gives you grounding. They ask questions because they are not shy," says IBM Watson's Chief Architect, Dr. Ruchir Puri, in an interview with EdSurge.
Artificial Intelligence, Deep Learning, and Neural Networks Explained
Artificial intelligence (AI), deep learning, and neural networks represent incredibly exciting and powerful machine learning-based techniques used to solve many real-world problems. For a primer on machine learning, you may want to read this five-part series that I wrote. While human-like deductive reasoning, inference, and decision-making by a computer is still a long time away, there have been remarkable gains in the application of AI techniques and associated algorithms. The concepts discussed here are extremely technical, complex, and based on mathematics, statistics, probability theory, physics, signal processing, machine learning, computer science, psychology, linguistics, and neuroscience. That said, this article is not meant to provide such a technical treatment, but rather to explain these concepts at a level that can be understood by most non-practitioners, and can also serve as a reference or review for technical folks as well. The primary motivation and driving force for these areas of study, and for developing these techniques further, is that the solutions required to solve certain problems are incredibly complicated, not well understood, nor easy to determine manually.
9 key thoughts on how machine learning and deep learning will affect healthcare
Artificial intelligence is becoming more important in the healthcare space. Data gathering for machine learning and deep learning capabilities have immense possibilities to improve diagnostics, care pathway creation and reproducibility in surgical procedures to ultimately achieve better clinical outcomes. The technology can also assist physicians with generating reports and administrative responsibilities, giving them more time to spend with patients. Here, nine clinical care and health IT company executives discuss how they expect machine learning and deep learning to improve healthcare in the future. "Deep learning can impact wearables focused on specific conditions, like remote cardiac monitoring, at an individual level by indicating how to personalize algorithms according to one's particular biometric and patient data. The incorporation of machine learning can assist in the interpretations of the analysis of the unstructured data delivered from these medical-grade wearable devices. The initial analysis is typically provided by mathematical algorithms trained to detect anomalies in this data. Machine learning, combined with artificial intelligence, would then seek to perform an interpretation of such a report, just as a physician would, in order to save physician time. Such capabilities effectively reduce physician time, enabling them to focus on the most critical patients and streamline the care process."
The great British Brexit robbery: how our democracy was hijacked
"The connectivity that is the heart of globalisation can be exploited by states with hostile intent to further their aims.[โฆ] The risks at stake are profound and represent a fundamental threat to our sovereignty." "It's not MI6's job to warn of internal threats. It was a very strange speech. Was it one branch of the intelligence services sending a shot across the bows of another? Or was it pointed at Theresa May's government? Does she know something she's not telling us?" Senior intelligence analyst, April 2017 In June 2013, a young American postgraduate called Sophie was passing through London when she called up the boss of a firm where she'd previously interned. The company, SCL Elections, went on to be bought by Robert Mercer, a secretive hedge fund billionaire, renamed Cambridge Analytica, and achieved a certain notoriety as the data analytics firm that played a role in both Trump and Brexit campaigns. But all of this was still to come. London in 2013 was still basking in the afterglow of the Olympics. Britain had not yet Brexited. The world had not yet turned. "That was before we became this dark, dystopian data company that gave the world Trump," a former Cambridge Analytica employee who I'll call Paul tells me. "It was back when we were still just a psychological warfare firm." Was that really what you called it, I ask him. Psychological operations โ the same methods the military use to effect mass sentiment change.
ClickUp is Trello, JIRA, and Asana - Plus AI
PALO ALTO, Calif., May 6, 2017 /PRNewswire-iReach/ ClickUp, a revolutionary project management platform released today, boasts the best elements from popular project management platforms like Trello, JIRA, and Asana. However, unlike the competition Click Up is also using AI and machine learning to set a higher bar for what project management software can be. While deadlines and time estimates are never right, Clickup pours data into proprietary machine learning algorithms to reduce (and potentially eliminate) human error related to making project estimates. Since estimates of this nature are extremely challenging to predict, even marginal improvements in accuracy can be extraordinarily valuable for companies. Another key aspect of the tool is the way in which it leverages the best features of existing platforms to create a solution unlike anything seen previously.
Machine Learning - Stanford University Coursera
About this course: Machine learning is the science of getting computers to act without being explicitly programmed. In the past decade, machine learning has given us self-driving cars, practical speech recognition, effective web search, and a vastly improved understanding of the human genome. Machine learning is so pervasive today that you probably use it dozens of times a day without knowing it. Many researchers also think it is the best way to make progress towards human-level AI. In this class, you will learn about the most effective machine learning techniques, and gain practice implementing them and getting them to work for yourself.
Elon Musk reveals more about his plan to merge man and machine with Neuralink
Elon Musk is attempting to combat the rise of artificial intelligence with the launch of his latest venture, brain-computer interface company Neuralink. In an interview with Wait Buy Why, Musk has revealed some of the details about his latest venture. He has confirmed that he will be the CEO of Neuralink โ alongside the Tesla, and SpaceX leadership positions he already holds. Musk explained that the firm's goal is to turn cloud-based AI into an extension of the human brain. The company will aim to create (and bring to market) a product that can help those with severe brain injuries.
Data scientists compete to create cancer-detection algorithms
Data scientists are using machine learning to tackle lung cancer detection. Beginning in January, nearly 10,000 data scientists around the world competed in the Data Science Bowl to develop the most effective algorithm to help medical professionals detect lung cancer earlier and with better accuracy. In 2010, the National Lung Screening Trial showed that annual screening with low-dose computed tomography (CT) -- a scanner that uses computer-processed combinations of many X-ray images from different angles to generate high-contrast 3D images -- could reduce lung cancer deaths by 20 percent. While a breakthrough for early detection, the technology has also resulted in a relatively high rate of false positives compared with more traditional X-rays. An anonymized high-res lung scan from the NCI, which Data Science Bowls participants used when developing algorithms.