Goto

Collaborating Authors

 Government


Optimal Network Compression

arXiv.org Artificial Intelligence

This paper introduces a formulation of the optimal network compression problem for financial systems. This general formulation is presented for different levels of network compression or rerouting allowed from the initial interbank network. We prove that this problem is, generically, NP-hard. We focus on objective functions generated by systemic risk measures under shocks to the financial network. We use this framework to study the (sub)optimality of the maximally compressed network. We conclude by studying the optimal compression problem for specific networks; this permits us to study, e.g., the so-called robust fragility of certain network topologies more generally as well as the potential benefits and costs of network compression. In particular, under systematic shocks and heterogeneous financial networks the robust fragility results of Acemoglu et al. (2015) no longer hold generally.


Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learning

arXiv.org Artificial Intelligence

An ideal learned representation should display transferability and robustness. Supervised contrastive learning (SupCon) is a promising method for training accurate models, but produces representations that do not capture these properties due to class collapse -- when all points in a class map to the same representation. Recent work suggests that "spreading out" these representations improves them, but the precise mechanism is poorly understood. We argue that creating spread alone is insufficient for better representations, since spread is invariant to permutations within classes. Instead, both the correct degree of spread and a mechanism for breaking this invariance are necessary. We first prove that adding a weighted class-conditional InfoNCE loss to SupCon controls the degree of spread. Next, we study three mechanisms to break permutation invariance: using a constrained encoder, adding a class-conditional autoencoder, and using data augmentation. We show that the latter two encourage clustering of latent subclasses under more realistic conditions than the former. Using these insights, we show that adding a properly-weighted class-conditional InfoNCE loss and a class-conditional autoencoder to SupCon achieves 11.1 points of lift on coarse-to-fine transfer across 5 standard datasets and 4.7 points on worst-group robustness on 3 datasets, setting state-of-the-art on CelebA by 11.5 points.


Interactive Machine Learning: A State of the Art Review

arXiv.org Artificial Intelligence

Machine learning has proved useful in many software disciplines, including computer vision, speech and audio processing, natural language processing, robotics and some other fields. However, its applicability has been significantly hampered due its black-box nature and significant resource consumption. Performance is achieved at the expense of enormous computational resource and usually compromising the robustness and trustworthiness of the model. Recent researches have been identifying a lack of interactivity as the prime source of these machine learning problems. Consequently, interactive machine learning (iML) has acquired increased attention of researchers on account of its human-in-the-loop modality and relatively efficient resource utilization. Thereby, a state-of-the-art review of interactive machine learning plays a vital role in easing the effort toward building human-centred models. In this paper, we provide a comprehensive analysis of the state-of-the-art of iML. We analyze salient research works using merit-oriented and application/task oriented mixed taxonomy. We use a bottom-up clustering approach to generate a taxonomy of iML research works. Research works on adversarial black-box attacks and corresponding iML based defense system, exploratory machine learning, resource constrained learning, and iML performance evaluation are analyzed under their corresponding theme in our merit-oriented taxonomy. We have further classified these research works into technical and sectoral categories. Finally, research opportunities that we believe are inspiring for future work in iML are discussed thoroughly.


FRUIT: Faithfully Reflecting Updated Information in Text

arXiv.org Artificial Intelligence

Textual knowledge bases such as Wikipedia require considerable effort to keep up to date and consistent. While automated writing assistants could potentially ease this burden, the problem of suggesting edits grounded in external knowledge has been under-explored. In this paper, we introduce the novel generation task of *faithfully reflecting updated information in text* (FRUIT) where the goal is to update an existing article given new evidence. We release the FRUIT-WIKI dataset, a collection of over 170K distantly supervised data produced from pairs of Wikipedia snapshots, along with our data generation pipeline and a gold evaluation set of 914 instances whose edits are guaranteed to be supported by the evidence. We provide benchmark results for popular generation systems as well as EDIT5 -- a T5-based approach tailored to editing we introduce that establishes the state of the art. Our analysis shows that developing models that can update articles faithfully requires new capabilities for neural generation models, and opens doors to many new applications.


Why Robust Natural Language Understanding is a Challenge

arXiv.org Artificial Intelligence

With the proliferation of Deep Machine Learning into real-life applications, a particular property of this technology has been brought to attention: robustness Neural Networks notoriously present low robustness and can be highly sensitive to small input perturbations. Recently, many methods for verifying networks' general properties of robustness have been proposed, but they are mostly applied in Computer Vision. In this paper we propose a Verification specification for Natural Language Understanding classification based on larger regions of interest, and we discuss the challenges of such task. We observe that, although the data is almost linearly separable, the verifier struggles to output positive results and we explain the problems and implications.


2020 U.S. presidential election in swing states: Gender differences in Twitter conversations

arXiv.org Artificial Intelligence

Social media is commonly used by the public during election campaigns to express their opinions regarding different issues. Among various social media channels, Twitter provides an efficient platform for researchers and politicians to explore public opinion regarding a wide range of topics such as the economy and foreign policy. Current literature mainly focuses on analyzing the content of tweets without considering the gender of users. This research collects and analyzes a large number of tweets and uses computational, human coding, and statistical analyses to identify topics in more than 300,000 tweets posted during the 2020 U.S. presidential election and to compare female and male users regarding the average weight of the discussed topics. Our findings are based upon a wide range of topics, such as tax, climate change, and the COVID-19 pandemic. Out of the topics, there exists a significant difference between female and male users for more than 70% of topics.


Open High-Resolution Satellite Imagery: The WorldStrat Dataset -- With Application to Super-Resolution

arXiv.org Artificial Intelligence

Analyzing the planet at scale with satellite imagery and machine learning is a dream that has been constantly hindered by the cost of difficult-to-access highly-representative high-resolution imagery. To remediate this, we introduce here the WorldStrat dataset. The largest and most varied such publicly available dataset, at Airbus SPOT 6/7 satellites' high resolution of up to 1.5 m/pixel, empowered by European Space Agency's Phi-Lab as part of the ESA-funded QueryPlanet project, we curate nearly 10,000 sqkm of unique locations to ensure stratified representation of all types of land-use across the world: from agriculture to ice caps, from forests to multiple urbanization densities. We also enrich those with locations typically under-represented in ML datasets: sites of humanitarian interest, illegal mining sites, and settlements of persons at risk. We temporally-match each high-resolution image with multiple low-resolution images from the freely accessible lower-resolution Sentinel-2 satellites at 10 m/pixel. We accompany this dataset with an open-source Python package to: rebuild or extend the WorldStrat dataset, train and infer baseline algorithms, and learn with abundant tutorials, all compatible with the popular EO-learn toolbox. We hereby hope to foster broad-spectrum applications of ML to satellite imagery, and possibly develop from free public low-resolution Sentinel2 imagery the same power of analysis allowed by costly private high-resolution imagery. We illustrate this specific point by training and releasing several highly compute-efficient baselines on the task of Multi-Frame Super-Resolution. High-resolution Airbus imagery is CC BY-NC, while the labels and Sentinel2 imagery are CC BY, and the source code and pre-trained models under BSD. The dataset is available at https://zenodo.org/record/6810792 and the software package at https://github.com/worldstrat/worldstrat .


The Top 3 AI Myths in Cybersecurity

#artificialintelligence

Whether it's in novels, or the movies based on them, artificial intelligence has been a subject of fascination for decades. The synthetic humans envisioned by Philip K. Dick remain (fortunately) the stuff of science fiction, artificial intelligence is real and playing an increasingly large role in many aspects of our lives. While it's fun to root against (or maybe for) human-like robots with AI brains, a much more mundane, but equally powerful form of AI is starting to play a role in cybersecurity. The goal is for AI to be a force multiplier for hardworking security professionals. Security operations center (SOC) analysts, as we saw in the most recent Devo SOC Performance Report, are often overwhelmed by the never-ending number of alerts that hit their screens each day.


Silent Sentry: Rail-mounted Robots With AI For Surveillance Along LoC

#artificialintelligence

By Avinash Prabhakar New Delhi, July 12: The Silent Sentry is one among the 75 Artificial Intelligence (AI) enabled defence products, which were launched by Defence Minister Rajnath Singh at the event'AIDef' (Artificial Intelligence in Defence)' on Monday. Out of the total AI defence products launched, many have already been deployed while the others are in the process of being deployed. The Silent Sentry is a key technology developed by the design bureau of the Indian Army to plug the gaps in Surveillance networks.They are rail-mounted Robots to be used as additional features to enhance Surveillance along the Line of Control (LoC). The fully 3D printed robot slides can be installed on the fences and in the Anti Infiltration Obstacle System (AIOS).The Robots which function autonomously within set limits can be controlled by computers, tablets and Android apps. The robot traverses on metal rails between two set points and utilises an electric motor for propulsion.The robot communicates by creating an ad-hoc network running on 2.4 Ghz Wi-Fi standards.


Russia Seeks Iran Drones After Losses In Ukraine: White House

International Business Times

A senior US official said Tuesday that Russia's plan to acquire hundreds of combat drones from Iran shows its urgent need to reinforce due to heavy losses four months after invading Ukraine. John Kirby, a spokesman for the national security council, said the deal, revealed by the White House on Monday, also shows Iran's willingness to support Moscow's war on Ukraine. But he said supply the drones would not necessarily affect US ongoing attempts to negotiate a return to the 2015 six-party deal to prevent Tehran from developing nuclear weapons. "We continue to want to see a nuclear deal that takes Iran's nuclear ambitions, at least its nuclear weapons ambitions, off the table," Kirby said. On Monday the White House revealed intelligence that Russia and Iran are moving quickly on a drone supply pact, which comes as Russia forces face stiff Ukrainian resistance in their push to consolidate control of eastern and southern Ukraine.