Education
Scalable Private Learning with PATE
Papernot, Nicolas, Song, Shuang, Mironov, Ilya, Raghunathan, Ananth, Talwar, Kunal, Erlingsson, Úlfar
The rapid adoption of machine learning has increased concerns about the privacy implications of machine learning models trained on sensitive data, such as medical records or other personal information. To address those concerns, one promising approach is Private Aggregation of Teacher Ensembles, or PATE, which transfers to a "student" model the knowledge of an ensemble of "teacher" models, with intuitive privacy provided by training teachers on disjoint data and strong privacy guaranteed by noisy aggregation of teachers' answers. However, PATE has so far been evaluated only on simple classification tasks like MNIST, leaving unclear its utility when applied to larger-scale learning tasks and real-world datasets. In this work, we show how PATE can scale to learning tasks with large numbers of output classes and uncurated, imbalanced training data with errors. For this, we introduce new noisy aggregation mechanisms for teacher ensembles that are more selective and add less noise, and prove their tighter differential-privacy guarantees. Our new mechanisms build on two insights: the chance of teacher consensus is increased by using more concentrated noise and, lacking consensus, no answer need be given to a student. The consensus answers used are more likely to be correct, offer better intuitive privacy, and incur lower-differential privacy cost. Our evaluation shows our mechanisms improve on the original PATE on all measures, and scale to larger tasks with both high utility and very strong privacy ($\varepsilon$ < 1.0).
Auditing Black-Box Models Using Transparent Model Distillation With Side Information
Tan, Sarah, Caruana, Rich, Hooker, Giles, Lou, Yin
Black-box risk scoring models permeate our lives, yet are typically proprietary or opaque. We propose a transparent model distillation approach to audit such models. Model distillation was first introduced to transfer knowledge from a large, complex teacher model to a faster, simpler student model without significant loss in prediction accuracy. To this we add a third criterion - transparency. To gain insight into black-box models, we treat them as teachers, training transparent student models to mimic the risk scores assigned by the teacher. Moreover, we use side information in the form of the actual outcomes the teacher scoring model was intended to predict in the first place. By training a second transparent model on the outcomes, we can compare the two models to each other. When comparing models trained on risk scores to models trained on outcomes, we show that it is necessary to calibrate the risk-scoring model's predictions to remove distortion that may have been added to the black-box risk-scoring model during or after its training process. We also show how to compute confidence intervals for the particular class of transparent student models we use - tree-based additive models with pairwise interactions (GA2Ms) - to support comparison of the two transparent models. We demonstrate the methods on four public datasets: COMPAS, Lending Club, Stop-and-Frisk, and Chicago Police.
The Human Angle
In a future teeming with robots and artificial intelligence, humans seem to be on the verge of being crowded out. But in reality the opposite is true. To be successful, organizations need to become more human than ever. Organizations that focus only on automation will automate away their competitive edge. The most successful will focus instead on skills that set them apart and that can't be duplicated by AI or machine learning.
How Google does Machine Learning Coursera
About this course: What is machine learning, and what kinds of problems can it solve? Google thinks about machine learning slightly differently -- of being about logic, rather than just data. We talk about why such a framing is useful when thinking about building a pipeline of machine learning models. Then, we discuss the five phases of converting a candidate use case to be driven by machine learning, and consider why it is important the phases not be skipped. We end with a recognition of the biases that machine learning can amplify and how to recognize this.
AI and HR: How to Find the Right Balance Between Automation and Personalization - The Human Resources Social Network
Automation and personalization, although very different in meaning, are very closely connected and go hand in hand with each other. A good question to ask ourselves in this context is – what happens if one interferes with the other? When we talk about the development of businesses, personalization, automation, tools and devices that will take the way we do business to a whole new level, we realize that there is a need to automate personalization more, while customizing automation. This is where automation vs. personalization issue arises. In the context of Artificial Intelligence and Human Resources, automation and personalization are intertwined as well as these two areas.
No, Mr Trump, video games do not cause mass shootings
With Donald Trump, everything old is new again, it seems. His latest effort to grapple with the school shooting in Parkland, Florida, sees him joining his fellow Republicans, such as the Kentucky governor, Matt Bevin, in resuscitating a long-dormant culture war, blaming video games for mass shootings. "I'm hearing more and more people say the level of violence on video games is really shaping young people's thoughts," Bevin said this week at a White House meeting on school security, where he also launched into a tirade about violent films. This echoes the thoughts of Wayne LaPierre, the president of the National Rifle Association (NRA), in 2012 when he tried to pin the Sandy Hook shooting on "vicious violent video games, with names like Bulletstorm, Grand Theft Auto, Mortal Kombat and Splatterhouse". It's a remarkable series of logic leaps that allows a person to scorn a simulator while holding the actual gun whose use is seen as blameless, but here we are again.
Optimising IT operations with Artificial Intelligence
IT solutions provider NIIT Technologies Ltd and AI firm Arago have decided to deepen their partnership to optimise the IT operations of Global In-House Centres (GICs) using artificial intelligence. "As global MNCs in India drive innovation through their GICs, there is a need for them to build deeper partnerships with IT service providers to innovate with intelligent automation," said Arvind Mehrotra, president, Infrastructure Management Services. Umamaheshwar Mudigonda, vice-president, Service Provider Business, of Arago, said that the company had high hopes. "We aim to enable the GICs use cutting-edge AI technologies and implement practical solutions, said a press release.
Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samples
Lee, Kimin, Lee, Honglak, Lee, Kibok, Shin, Jinwoo
The problem of detecting whether a test sample is from in-distribution (i.e., training distribution by a classifier) or out-of-distribution sufficiently different from it arises in many real-world machine learning applications. However, the state-of-art deep neural networks are known to be highly overconfident in their predictions, i.e., do not distinguish in- and out-of-distributions. Recently, to handle this issue, several threshold-based detectors have been proposed given pre-trained neural classifiers. However, the performance of prior works highly depends on how to train the classifiers since they only focus on improving inference procedures. In this paper, we develop a novel training method for classifiers so that such inference algorithms can work better. In particular, we suggest two additional terms added to the original loss (e.g., cross entropy). The first one forces samples from out-of-distribution less confident by the classifier and the second one is for (implicitly) generating most effective training samples for the first one. In essence, our method jointly trains both classification and generative neural networks for out-of-distribution. We demonstrate its effectiveness using deep convolutional neural networks on various popular image datasets.
AI-Driven Robot Learns the Meaning of Love, on Paper at Least
It's been a typical week for typical college student BINA48. On Monday, BINA attended her robot ethics class. On Tuesday, the second-semester student had an excused absence to ring the bell at the stock exchange, and soon BINA will be assistant-teaching a kindergarten class and getting a face-lift at Hanson Robotics. But that hasn't stopped the robot, which looks like the bust of a flesh-and-blood woman, from completing a Philosophy of Love course at Notre Dame de Namur University in Belmont, California. Programmed to be social, BINA48 presented her final project along with a human student, demonstrating that the robot could retain and present a philosophical perspective on love.