Government
Algorithmic Censoring in Dynamic Learning Systems
Chien, Jennifer, Roberts, Margaret, Ustun, Berk
Dynamic learning systems subject to selective labeling exhibit censoring, i.e. persistent negative predictions assigned to one or more subgroups of points. In applications like consumer finance, this results in groups of applicants that are persistently denied and thus never enter into the training data. In this work, we formalize censoring, demonstrate how it can arise, and highlight difficulties in detection. We consider safeguards against censoring - recourse and randomized-exploration - both of which ensure we collect labels for points that would otherwise go unobserved. The resulting techniques allow examples from censored groups to enter into the training data and correct the model. Our results highlight the otherwise unmeasured harms of censoring and demonstrate the effectiveness of mitigation strategies across a range of data generating processes.
PeakNet: An Autonomous Bragg Peak Finder with Deep Neural Networks
Wang, Cong, Li, Po-Nan, Thayer, Jana, Yoon, Chun Hong
Serial crystallography at X-ray free electron laser (XFEL) and synchrotron facilities has experienced tremendous progress in recent times enabling novel scientific investigations into macromolecular structures and molecular processes. However, these experiments generate a significant amount of data posing computational challenges in data reduction and real-time feedback. Bragg peak finding algorithm is used to identify useful images and also provide real-time feedback about hit-rate and resolution. Shot-to-shot intensity fluctuations and strong background scattering from buffer solution, injection nozzle and other shielding materials make this a time-consuming optimization problem. Here, we present PeakNet, an autonomous Bragg peak finder that utilizes deep neural networks. The development of this system 1) eliminates the need for manual algorithm parameter tuning, 2) reduces false-positive peaks by adjusting to shot-to-shot variations in strong background scattering in real-time, 3) eliminates the laborious task of manually creating bad pixel masks and the need to store these masks per event since these can be regenerated on demand. PeakNet also exhibits exceptional runtime efficiency, processing a 1920-by-1920 pixel image around 90 ms on an NVIDIA 1080 Ti GPU, with the potential for further enhancements through parallelized analysis or GPU stream processing. PeakNet is well-suited for expert-level real-time serial crystallography data analysis at high data rates.
Continual Learning for Predictive Maintenance: Overview and Challenges
Hurtado, Julio, Salvati, Dario, Semola, Rudy, Bosio, Mattia, Lomonaco, Vincenzo
Deep learning techniques have become one of the main propellers for solving engineering problems effectively and efficiently. For instance, Predictive Maintenance methods have been used to improve predictions of when maintenance is needed on different machines and operative contexts. However, deep learning methods are not without limitations, as these models are normally trained on a fixed distribution that only reflects the current state of the problem. Due to internal or external factors, the state of the problem can change, and the performance decreases due to the lack of generalization and adaptation. Contrary to this stationary training set, real-world applications change their environments constantly, creating the need to constantly adapt the model to evolving scenarios. To aid in this endeavor, Continual Learning methods propose ways to constantly adapt prediction models and incorporate new knowledge after deployment. Despite the advantages of these techniques, there are still challenges to applying them to real-world problems. In this work, we present a brief introduction to predictive maintenance, non-stationary environments, and continual learning, together with an extensive review of the current state of applying continual learning in real-world applications and specifically in predictive maintenance. We then discuss the current challenges of both predictive maintenance and continual learning, proposing future directions at the intersection of both areas. Finally, we propose a novel way to create benchmarks that favor the application of continuous learning methods in more realistic environments, giving specific examples of predictive maintenance.
Plurality Veto: A Simple Voting Rule Achieving Optimal Metric Distortion
Kizilkaya, Fatih Erdem, Kempe, David
The metric distortion framework posits that n voters and m candidates are jointly embedded in a metric space such that voters rank candidates that are closer to them higher. A voting rule's purpose is to pick a candidate with minimum total distance to the voters, given only the rankings, but not the actual distances. As a result, in the worst case, each deterministic rule picks a candidate whose total distance is at least three times larger than that of an optimal one, i.e., has distortion at least 3. A recent breakthrough result showed that achieving this bound of 3 is possible; however, the proof is non-constructive, and the voting rule itself is a complicated exhaustive search. Our main result is an extremely simple voting rule, called Plurality Veto, which achieves the same optimal distortion of 3. Each candidate starts with a score equal to his number of first-place votes. These scores are then gradually decreased via an n-round veto process in which a candidate drops out when his score reaches zero. One after the other, voters decrement the score of their bottom choice among the standing candidates, and the last standing candidate wins. We give a one-paragraph proof that this voting rule achieves distortion 3. This rule is also immensely practical, and it only makes two queries to each voter, so it has low communication overhead. We also generalize Plurality Veto into a class of randomized voting rules in the following way: Plurality veto is run only for k < n rounds; then, a candidate is chosen with probability proportional to his residual score. This general rule interpolates between Random Dictatorship (for k=0) and Plurality Veto (for k=n-1), and k controls the variance of the output. We show that for all k, this rule has distortion at most 3.
"That Is a Suspicious Reaction!": Interpreting Logits Variation to Detect NLP Adversarial Attacks
Mosca, Edoardo, Agarwal, Shreyash, Rando, Javier, Groh, Georg
Adversarial attacks are a major challenge faced by current machine learning research. These purposely crafted inputs fool even the most advanced models, precluding their deployment in safety-critical applications. Extensive research in computer vision has been carried to develop reliable defense strategies. However, the same issue remains less explored in natural language processing. Our work presents a model-agnostic detector of adversarial text examples. The approach identifies patterns in the logits of the target classifier when perturbing the input text. The proposed detector improves the current state-of-the-art performance in recognizing adversarial inputs and exhibits strong generalization capabilities across different NLP models, datasets, and word-level attacks.
ChatGPT developer OpenAI to locate first non-US office in London
OpenAI, the developer of ChatGPT, has chosen London as the location for its first international office in a boost to the UK's attempts to stay competitive in the artificial intelligence race. The San Francisco-based company behind the popular chatbot said on Wednesday that it would start its expansion outside the US in the UK capital. OpenAI said the UK office would reinforce efforts to create "safe AGI". AGI refers to artificial general intelligence, or a highly intelligent AI system that OpenAI's chief executive, Sam Altman, has described as "generally smarter than humans". "We are thrilled to extend our research and development footprint into London, a city globally renowned for its rich culture and exceptional talent pool," said Diane Yoon, OpenAI's head of human resources.
Biden Administration Weighs Further Curbs on Sales of A.I. Chips to China
The deliberations were earlier reported by The Wall Street Journal. Nvidia's shares fell roughly 2 percent in morning trading on Wednesday following reports of the potential export crackdown. The company has been one of the primary beneficiaries of the enthusiasm over artificial intelligence, with its share price surging by roughly 180 percent this year. Such additional restrictions, if adopted, would not have an immediate impact on Nvidia's financial results, Colette Kress, the chief financial officer of Nvidia, said Wednesday on a call with reporters. But over the long term, they "will result in a permanent loss of opportunities for the U.S. industry to compete and lead in one of the world's largest markets," she said.
Empowering Asia's citizens: The generative AI opportunity for government
The fundamental value of generative AI is to serve as a human "co-pilot." This might mean accelerating workers' ability to find the information they need: for example, quickly searching laws, regulations, and previous reports on a topic to locate an answer or drive new policy directions. AI tools can also help summarize meeting notes or streamline the process of drafting a standard piece of ministerial correspondence. The Government Technology Agency of Singapore (GovTech) is harnessing the power of generative AI using Microsoft Azure OpenAI service to complete these types of routine tasks. This AI-powered assistance might allow team members to branch out into practical fieldwork, interact with citizens directly, or focus on the more human and strategic aspects of their role.
Facial Recognition Spreads as Tool to Fight Shoplifting
Among democratic nations, Britain is at the forefront of using live facial recognition, with courts and regulators signing off on its use. The police in London and Cardiff are experimenting with the technology to identify wanted criminals as they walk down the street. In May, it was used to scan the crowds at the coronation of King Charles III. But the use by retailers has drawn criticism as a disproportionate solution for minor crimes. Individuals have little way of knowing they are on the watchlist or how to appeal.
Titan submersible disaster underscores dangers of deep-sea exploration – an engineer explains why most ocean science is conducted with crewless submarines
Researchers are increasingly using small, autonomous underwater robots to collect data in the world's oceans. Rescuers spotted debris from the tourist submarine Titan on the ocean floor near the wreck of the Titanic on June 22, 2023, indicating that the vessel suffered a catastrophic failure and the five people aboard were killed. Bringing people to the bottom of the deep ocean is inherently dangerous. At the same time, climate change means collecting data from the world's oceans is more vital than ever. Purdue University mechanical engineer Nina Mahmoudian explains how researchers reduce the risks and costs associated with deep-sea exploration: Send down subs, but keep people on the surface.