South America
Automatic Detection of Influential Actors in Disinformation Networks
Smith, Steven T., Kao, Edward K., Mackin, Erika D., Shah, Danelle C., Simek, Olga, Rubin, Donald B.
The weaponization of digital communications and social media to conduct disinformation campaigns at immense scale, speed, and reach presents new challenges to identify and counter hostile influence operations (IO). This paper presents an end-to-end framework to automate detection of disinformation narratives, networks, and influential actors. The framework integrates natural language processing, machine learning, graph analytics, and a novel network causal inference approach to quantify the impact of individual actors in spreading IO narratives. We demonstrate its capability on real-world hostile IO campaigns with Twitter datasets collected during the 2017 French presidential elections, and known IO accounts disclosed by Twitter over a broad range of IO campaigns (May 2007-February 2020), over 50 thousand accounts, 17 countries, and different account types including both trolls and bots. Our system detects IO accounts with 96% precision, 79% recall, and 96% area-under-the-PR-curve, maps out salient network communities, and discovers high-impact accounts that escape the lens of traditional impact statistics based on activity counts and network centrality. Results are corroborated with independent sources of known IO accounts from U.S. Congressional reports, investigative journalism, and IO datasets provided by Twitter.
Detecting Social Media Manipulation in Low-Resource Languages
Haider, Samar, Luceri, Luca, Deb, Ashok, Badawy, Adam, Peng, Nanyun, Ferrara, Emilio
Social media have been deliberately used for malicious purposes, including political manipulation and disinformation. Most research focuses on high-resource languages. However, malicious actors share content across countries and languages, including low-resource ones. Here, we investigate whether and to what extent malicious actors can be detected in low-resource language settings. We discovered that a high number of accounts posting in Tagalog were suspended as part of Twitter's crackdown on interference operations after the 2016 US Presidential election. By combining text embedding and transfer learning, our framework can detect, with promising accuracy, malicious users posting in Tagalog without any prior knowledge or training on malicious content in that language. We first learn an embedding model for each language, namely a high-resource language (English) and a low-resource one (Tagalog), independently. Then, we learn a mapping between the two latent spaces to transfer the detection model. We demonstrate that the proposed approach significantly outperforms state-of-the-art models, including BERT, and yields marked advantages in settings with very limited training data-the norm when dealing with detecting malicious activity in online platforms.
An End-to-End Differentiable but Explainable Physics Engine for Tensegrity Robots: Modeling and Control
Wang, Kun, Aanjaneya, Mridul, Bekris, Kostas
This work proposes an end-to-end differentiable physics engine for tensegrity robots, which introduces a data-efficient linear contact model for accurately predicting collision responses that arise due to contacting surfaces, and a linear actuator model that can drive these robots by expanding and contracting their flexible cables. To the best of the authors' knowledge, this is the \emph{first} differentiable physics engine for tensegrity robots that supports cable modeling, contact, and actuation. This engine can be used inside an off-the-shelf, RL-based locomotion controller in order to provide training examples. This paper proposes a progressive training pipeline for the differentiable physics engine that helps avoid local optima during the training phase and reduces data requirements. It demonstrates the data-efficiency benefits of using the differentiable engine for learning locomotion policies for NASA's icosahedron SUPERballBot. In particular, after the engine has been trained with few trajectories to match a ground truth simulated model, then a policy learned on the differentiable engine is shown to be transferable back to the ground-truth model. Training the controller requires orders of magnitude more data than training the differential engine.
AI opens new avenues for smart cities
The pandemic has dealt a body blow to many of the world's cities. As they seek to recover from the economic and social fall-out from COVID-19, municipalities are stepping up efforts to deploy big data and artificial intelligence (AI) to improve urban life. Equipped with a real-time view of what is happening across a city, municipalities hope to be able to make timely interventions, while spurring the development of innovative services. "We are using AI to become the eyes of the city," Maarten Sukel, AI lead at the City of Amsterdam, told a recent Science Business webinar entitled: How will real-time data reshape our cities? Although municipalities generally lack the granular behavioural data available to the major Internet platforms, advances in AI are making it easier to analyse the growing volume of data being captured by street level cameras and other sensors.
Multi-channel MR Reconstruction (MC-MRRec) Challenge -- Comparing Accelerated MR Reconstruction Models and Assessing Their Genereralizability to Datasets Collected with Different Coils
Beauferris, Youssef, Teuwen, Jonas, Karkalousos, Dimitrios, Moriakov, Nikita, Caan, Mattha, Rodrigues, Lívia, Lopes, Alexandre, Pedrini, Hélio, Rittner, Letícia, Dannecker, Maik, Studenyak, Viktor, Gröger, Fabian, Vyas, Devendra, Faghih-Roohi, Shahrooz, Jethi, Amrit Kumar, Raju, Jaya Chandra, Sivaprakasam, Mohanasankar, Loos, Wallace, Frayne, Richard, Souza, Roberto
The 2020 Multi-channel Magnetic Resonance Reconstruction (MC-MRRec) Challenge had two primary goals: 1) compare different MR image reconstruction models on a large dataset and 2) assess the generalizability of these models to datasets acquired with a different number of receiver coils (i.e., multiple channels). The challenge had two tracks: Track 01 focused on assessing models trained and tested with 12-channel data. Track 02 focused on assessing models trained with 12-channel data and tested on both 12-channel and 32-channel data. While the challenge is ongoing, here we describe the first edition of the challenge and summarise submissions received prior to 5 September 2020. Track 01 had five baseline models and received four independent submissions. Track 02 had two baseline models and received two independent submissions. This manuscript provides relevant comparative information on the current state-of-the-art of MR reconstruction and highlights the challenges of obtaining generalizable models that are required prior to clinical adoption. Both challenge tracks remain open and will provide an objective performance assessment for future submissions. Subsequent editions of the challenge are proposed to investigate new concepts and strategies, such as the integration of potentially available longitudinal information during the MR reconstruction process. An outline of the proposed second edition of the challenge is presented in this manuscript.
Bayesian Reconstruction of Fourier Pairs
Tobar, Felipe, Araya-Hernández, Lerko, Huijse, Pablo, Djurić, Petar M.
In a number of data-driven applications such as detection of arrhythmia, interferometry or audio compression, observations are acquired indistinctly in the time or frequency domains: temporal observations allow us to study the spectral content of signals (e.g., audio), while frequency-domain observations are used to reconstruct temporal/spatial data (e.g., MRI). Classical approaches for spectral analysis rely either on i) a discretisation of the time and frequency domains, where the fast Fourier transform stands out as the \textit{de facto} off-the-shelf resource, or ii) stringent parametric models with closed-form spectra. However, the general literature fails to cater for missing observations and noise-corrupted data. Our aim is to address the lack of a principled treatment of data acquired indistinctly in the temporal and frequency domains in a way that is robust to missing or noisy observations, and that at the same time models uncertainty effectively. To achieve this aim, we first define a joint probabilistic model for the temporal and spectral representations of signals, to then perform a Bayesian model update in the light of observations, thus jointly reconstructing the complete (latent) time and frequency representations. The proposed model is analysed from a classical spectral analysis perspective, and its implementation is illustrated through intuitive examples. Lastly, we show that the proposed model is able to perform joint time and frequency reconstruction of real-world audio, healthcare and astronomy signals, while successfully dealing with missing data and handling uncertainty (noise) naturally against both classical and modern approaches for spectral estimation.
Neural Composition: Learning to Generate from Multiple Models
Filimonov, Denis, Gadde, Ravi Teja, Rastrow, Ariya
Decomposing models into multiple components is critically important in many applications such as language modeling (LM) as it enables adapting individual components separately and biasing of some components to the user's personal preferences. Conventionally, contextual and personalized adaptation for language models, are achieved through class-based factorization, which requires class-annotated data, or through biasing to individual phrases which is limited in scale. In this paper, we propose a system that combines model-defined components, by learning when to activate the generation process from each individual component, and how to combine probability distributions from each component, directly from unlabeled text data.
Real-time object detection method based on improved YOLOv4-tiny
Jiang, Zicong, Zhao, Liquan, Li, Shuaiyang, Jia, Yanfei
The "You only look once v4"(YOLOv4) is one type of object detection methods in deep learning. YOLOv4-tiny is proposed based on YOLOv4 to simple the network structure and reduce parameters, which makes it be suitable for developing on the mobile and embedded devices. To improve the real-time of object detection, a fast object detection method is proposed based on YOLOv4-tiny. It firstly uses two ResBlock-D modules in ResNet-D network instead of two CSPBlock modules in Yolov4-tiny, which reduces the computation complexity. Secondly, it designs an auxiliary residual network block to extract more feature information of object to reduce detection error. In the design of auxiliary network, two consecutive 3x3 convolutions are used to obtain 5x5 receptive fields to extract global features, and channel attention and spatial attention are also used to extract more effective information. In the end, it merges the auxiliary network and backbone network to construct the whole network structure of improved YOLOv4-tiny. Simulation results show that the proposed method has faster object detection than YOLOv4-tiny and YOLOv3-tiny, and almost the same mean value of average precision as the YOLOv4-tiny. It is more suitable for real-time object detection.
2020 election: Artificial Intelligence has chosen a winner - Report Door
Artificial intelligence has chosen a winner for the 2020 presidential election -- but there's a catch. Hernan Makse is a statistical physicist at City University of New York who runs the Complex Networks and Data Science Lab at the Levich Institute in Manhattan. His lab uses AI to predict the outcomes of international elections using social media traffic, focusing mainly on Twitter, a platform with over 48 million monthly active users in the US. "We usually start one year from the election, and then we use that data to train the machine and predict the outcome of the election at the national level," he said in a recent interview with The Independent, noting how AI can now also be used to predict local and state election outcomes after data is organized by geolocation. "Predicting elections is, of course, quite complicated."
FABRIZIO POLTRONIERI
Fabrizio Poltronieri is an artist who explores the relationship technology and deep-rooted philosophical concepts, such as chance. His current artwork involves Artificial Intelligence, applying machine and deep learning techniques to create and design narratives, moving images and objects. He is a self-taught programmer who started to code during his childhood. His first degree was in Maths, he has a Master Degree in Education and Culture and holds a PhD in Semiotics from the Pontifical Catholic University of São Paulo (PUC/SP). Poltronieri is an Associate Professor and permanent member of the IOCT (Institute of Creative Technologies) at De Montfort University, Leicester, UK, supervising PhD students and teaching creative code in the Digital Arts MA.