Goto

Collaborating Authors

 Deep Learning


Three ways data science is unbaking the cake

#artificialintelligence

It's a metaphor that illustrates how some things can't be undone and a pretty good life lesson besides. However, there's also genuine science behind this expression, referencing the irreversible chemical reactions that take place in the heat of an oven. Others might prefer the saying'nothing is impossible' and this is the kind of mindset data scientists need to have. Technologies like AI and deep learning are making the previously impossible possible - so try telling a data scientist that you can't do anything. Here are three ways data science is already doing the impossible.


Artificial intelligence boosts MRI detection of ADHD

#artificialintelligence

Deep learning, a type of artificial intelligence, can boost the power of MRI in predicting attention deficit hyperactivity disorder (ADHD), according to a study published in Radiology: Artificial Intelligence. Researchers said the approach could also have applications for other neurological conditions. The human brain is a complex set of networks. Advances in functional MRI, a type of imaging that measures brain activity by detecting changes in blood flow, have helped with the mapping of connections within and between brain networks. This comprehensive brain map is referred to as the connectome.


Disentanglement based Active Learning

arXiv.org Machine Learning

We propose Disentanglement based Active Learning (DAL), a new active learning technique based on query synthesis which leverages the concept of disentanglement. Instead of requesting labels from the human oracle, our method automatically labels majority of the datapoints, thus drastically reducing the human labelling budget in active learning. The proposed method uses Information Maximizing Generative Adversarial Nets (InfoGAN) to achieve the task where the active learner provides a feedback on the generation of InfoGAN based on which decision is taken about the datapoints to be queried. Results on two benchmark datasets demonstrate that DAL is able to achieve nearly fully supervised accuracy with fairly less labelling budget compared to existing active learning approaches.


DAmageNet: A Universal Adversarial Dataset

arXiv.org Machine Learning

It is now well known that deep neural networks (DNNs) are vulnerable to adversarial attack. Adversarial samples are similar to the clean ones, but are able to cheat the attacked DNN to produce incorrect predictions in high confidence. But most of the existing adversarial attacks have high success rate only when the information of the attacked DNN is well-known or could be estimated by massive queries. A promising way is to generate adversarial samples with high transferability. By this way, we generate 96020 transferable adversarial samples from original ones in ImageNet. The average difference, measured by root means squared deviation, is only around 3.8 on average. However, the adversarial samples are misclassified by various models with an error rate up to 90\%. Since the images are generated independently with the attacked DNNs, this is essentially zero-query adversarial attack. We call the dataset \emph{DAmageNet}, which is the first universal adversarial dataset that beats many models trained in ImageNet. By finding the drawbacks, DAmageNet could serve as a benchmark to study and improve robustness of DNNs. DAmageNet could be downloaded in http://www.pami.sjtu.edu.cn/Show/56/122.


Sepsis World Model: A MIMIC-based OpenAI Gym "World Model" Simulator for Sepsis Treatment

arXiv.org Machine Learning

Sepsis is a life-threatening condition caused by the body's response to an infection. In order to treat patients with sepsis, physicians must control varying dosages of various antibiotics, fluids, and vasopressors based on a large number of variables in an emergency setting. In this project we employ a "world model" methodology to create a simulator that aims to predict the next state of a patient given a current state and treatment action. In doing so, we hope our simulator learns from a latent and less noisy representation of the EHR data. Using historical sepsis patient records from the MIMIC dataset, our method creates an OpenAI Gym simulator that leverages a Variational Auto-Encoder and a Mixture Density Network combined with a RNN (MDN-RNN) to model the trajectory of any sepsis patient in the hospital. To reduce the effects of noise, we sample from a generated distribution of next steps during simulation and have the option of introducing uncertainty into our simulator by controlling the "temperature" variable. It is worth noting that we do not have access to the ground truth for the best policy because we can only evaluate learned policies by real-world experimentation or expert feedback. Instead, we aim to study our simulator model's performance by evaluating the similarity between our environment's rollouts with the real EHR data and assessing its viability for learning a realistic policy for sepsis treatment using Deep Q-Learning.


Artificial mental phenomena: Psychophysics as a framework to detect perception biases in AI models

arXiv.org Artificial Intelligence

Detecting biases in artificial intelligence has become difficult because of the impenetrable nature of deep learning. The central difficulty is in relating unobservable phenomena deep inside models with observable, outside quantities that we can measure from inputs and outputs. For example, can we detect gendered perceptions of occupations (e.g., female librarian, male electrician) using questions to and answers from a word embedding-based system? Current techniques for detecting biases are often customized for a task, dataset, or method, affecting their generalization. In this work, we draw from Psychophysics in Experimental Psychology---meant to relate quantities from the real world (i.e., "Physics") into subjective measures in the mind (i.e., "Psyche")---to propose an intellectually coherent and generalizable framework to detect biases in AI. Specifically, we adapt the two-alternative forced choice task (2AFC) to estimate potential biases and the strength of those biases in black-box models. We successfully reproduce previously-known biased perceptions in word embeddings and sentiment analysis predictions. We discuss how concepts in experimental psychology can be naturally applied to understanding artificial mental phenomena, and how psychophysics can form a useful methodological foundation to study fairness in AI.


AI Weekly: NeurIPS proves machine learning at scale is hard

#artificialintelligence

The world's largest AI research conference is underway in Vancouver, Canada. Researchers are presenting more than 1,400 papers at the Neural Information Processing Systems (NeurIPS) conference, ranging from work that organizers believe has had the greatest impact over the past decade to Yoshua Bengio's continued march toward consciousness for deep learning. But even as the conference showed theoretical research and neuroscience-related papers on the rise alongside categories like algorithms and deep learning, the mushrooming of the event itself -- and the associated growing pains -- was a constant theme, and it speaks to the growth of the AI field in general. Organizers said that at the start of the conference Sunday, they expected about 400 people to show up for registration. All told, NeurIPS 2019 welcomed 13,000 attendees, up 40% from the prior year.


A Sobering Message About the Future at AI's Biggest Party

#artificialintelligence

More than 13,000 artificial intelligence mavens flocked to Vancouver this week for the world's leading academic AI conference, NeurIPS. The venue included a maze of colorful corporate booths aiming to lure recruits for projects like software that plays doctor. Google handed out free luggage scales and socks depicting the colorful bikes employees ride on its campus, while IBM offered hats emblazoned with "I A ." Tuesday night, Google and Uber hosted well-lubricated, over-subscribed parties. At a bleary 8:30 the next morning, one of Google's top researchers gave a keynote with a sobering message about AI's future. Blaise Aguera y Arcas praised the revolutionary technique known as deep learning that has seen teams like his get phones to recognize faces and voices.


14 data scientists you should follow on Twitter TechBeacon

#artificialintelligence

The application of artificial intelligence (AI) and machine learning to business and IT, from intelligent IT operations (AIOps) to service management to software testing, is keeping the data revolution moving at lightning speed. That's why data science remains a popular concentration for computer science students who have the talent for math and analytics. And it's why more organizations are clamoring for data scientists who can help make decisions faster and put their businesses ahead of competitors. To help you keep up, TechBeacon assembled this list of leading data scientists to follow on Twitter. Plus: Get the 2019 Forrester Wave for ESM.


12 Everyday Applications Of Artificial Intelligence Many People Aren't Aware Of

#artificialintelligence

By now, almost everyone knows a little bit about artificial intelligence, but most people aren't tech experts, and many may not be aware of just how big an impact AI has. The truth is most consumers interact with technology incorporating AI every day. From the searches we perform in Google to the advertisements we see on social media, AI is an ever-present feature of our lives. To help nonspecialists grasp the degree to which AI has been woven into the fabric of modern society, 12 experts from Forbes Technology Council detail some applications of AI that many may not be aware of. Calling customer service used to be as exciting as seeing a dentist.