Government
Crime Prediction using Machine Learning with a Novel Crime Dataset
Shohan, Faisal Tareque, Akash, Abu Ubaida, Ibrahim, Muhammad, Alam, Mohammad Shafiul
Crime is an unlawful act that carries legal repercussions. Bangladesh has a high crime rate due to poverty, population growth, and many other socio-economic issues. For law enforcement agencies, understanding crime patterns is essential for preventing future criminal activity. For this purpose, these agencies need structured crime database. This paper introduces a novel crime dataset that contains temporal, geographic, weather, and demographic data about 6574 crime incidents of Bangladesh. We manually gather crime news articles of a seven year time span from a daily newspaper archive. We extract basic features from these raw text. Using these basic features, we then consult standard service-providers of geo-location and weather data in order to garner these information related to the collected crime incidents. Furthermore, we collect demographic information from Bangladesh National Census data. All these information are combined that results in a standard machine learning dataset. Together, 36 features are engineered for the crime prediction task. Five supervised machine learning classification algorithms are then evaluated on this newly built dataset and satisfactory results are achieved. We also conduct exploratory analysis on various aspects the dataset. This dataset is expected to serve as the foundation for crime incidence prediction systems for Bangladesh and other countries. The findings of this study will help law enforcement agencies to forecast and contain crime as well as to ensure optimal resource allocation for crime patrol and prevention.
Energy System Digitization in the Era of AI: A Three-Layered Approach towards Carbon Neutrality
Xie, Le, Huang, Tong, Zheng, Xiangtian, Liu, Yan, Wang, Mengdi, Vittal, Vijay, Kumar, P. R., Shakkottai, Srinivas, Cui, Yi
The transition towards carbon-neutral electricity is one of the biggest game changers in addressing climate change since it addresses the dual challenges of removing carbon emissions from the two largest sectors of emitters: electricity and transportation. The transition to a carbon-neutral electric grid poses significant challenges to conventional paradigms of modern grid planning and operation. Much of the challenge arises from the scale of the decision making and the uncertainty associated with the energy supply and demand. Artificial Intelligence (AI) could potentially have a transformative impact on accelerating the speed and scale of carbon-neutral transition, as many decision making processes in the power grid can be cast as classic, though challenging, machine learning tasks. We point out that to amplify AI's impact on carbon-neutral transition of the electric energy systems, the AI algorithms originally developed for other applications should be tailored in three layers of technology, markets, and policy. Introduction To grapple with climate change, many countries are striving to achieve carbon-neutrality of their electricity sectors.
The future is different: Large pre-trained language models fail in prediction tasks
Cvejoski, Kostadin, Sánchez, Ramsés J., Ojeda, César
Large pre-trained language models (LPLM) have shown spectacular success when fine-tuned on downstream supervised tasks. Yet, it is known that their performance can drastically drop when there is a distribution shift between the data used during training and that used at inference time. In this paper we focus on data distributions that naturally change over time and introduce four new REDDIT datasets, namely the WALLSTREETBETS, ASKSCIENCE, THE DONALD, and POLITICS sub-reddits. First, we empirically demonstrate that LPLM can display average performance drops of about 88% (in the best case!) when predicting the popularity of future posts from sub-reddits whose topic distribution changes with time. We then introduce a simple methodology that leverages neural variational dynamic topic models and attention mechanisms to infer temporal language model representations for regression tasks. Our models display performance drops of only about 40% in the worst cases (2% in the best ones) when predicting the popularity of future posts, while using only about 7% of the total number of parameters of LPLM and providing interpretable representations that offer insight into real-world events, like the GameStop short squeeze of 2021
On the Safety of Interpretable Machine Learning: A Maximum Deviation Approach
Wei, Dennis, Nair, Rahul, Dhurandhar, Amit, Varshney, Kush R., Daly, Elizabeth M., Singh, Moninder
Interpretable and explainable machine learning has seen a recent surge of interest. We focus on safety as a key motivation behind the surge and make the relationship between interpretability and safety more quantitative. Toward assessing safety, we introduce the concept of maximum deviation via an optimization problem to find the largest deviation of a supervised learning model from a reference model regarded as safe. We then show how interpretability facilitates this safety assessment. For models including decision trees, generalized linear and additive models, the maximum deviation can be computed exactly and efficiently. For tree ensembles, which are not regarded as interpretable, discrete optimization techniques can still provide informative bounds. For a broader class of piecewise Lipschitz functions, we leverage the multi-armed bandit literature to show that interpretability produces tighter (regret) bounds on the maximum deviation. We present case studies, including one on mortgage approval, to illustrate our methods and the insights about models that may be obtained from deviation maximization.
Scalable Gaussian Process Hyperparameter Optimization via Coverage Regularization
Wood, Killian, Dunton, Alec M., Muyskens, Amanda, Priest, Benjamin W.
Gaussian processes (GPs) are Bayesian non-parametric models popular in a variety of applications due to their accuracy and native uncertainty quantification (UQ). Tuning GP hyperparameters is critical to ensure the validity of prediction accuracy and uncertainty; uniquely estimating multiple hyperparameters in, e.g. the Matern kernel can also be a significant challenge. Moreover, training GPs on large-scale datasets is a highly active area of research: traditional maximum likelihood hyperparameter training requires quadratic memory to form the covariance matrix and has cubic training complexity. To address the scalable hyperparameter tuning problem, we present a novel algorithm which estimates the smoothness and length-scale parameters in the Matern kernel in order to improve robustness of the resulting prediction uncertainties. Using novel loss functions similar to those in conformal prediction algorithms in the computational framework provided by the hyperparameter estimation algorithm MuyGPs, we achieve improved UQ over leave-one-out likelihood maximization while maintaining a high degree of scalability as demonstrated in numerical experiments.
Counterfactual harm
Richens, Jonathan G., Beard, Rory, Thompson, Daniel H.
To act safely and ethically in the real world, agents must be able to reason about harm and avoid harmful actions. However, to date there is no statistical method for measuring harm and factoring it into algorithmic decisions. In this paper we propose the first formal definition of harm and benefit using causal models. We show that any factual definition of harm must violate basic intuitions in certain scenarios, and show that standard machine learning algorithms that cannot perform counterfactual reasoning are guaranteed to pursue harmful policies following distributional shifts. We use our definition of harm to devise a framework for harm-averse decision making using counterfactual objective functions. We demonstrate this framework on the problem of identifying optimal drug doses using a dose-response model learned from randomized control trial data. We find that the standard method of selecting doses using treatment effects results in unnecessarily harmful doses, while our counterfactual approach allows us to identify doses that are significantly less harmful without sacrificing efficacy.
Isometric Representations in Neural Networks Improve Robustness
Beshkov, Kosio, Verhellen, Jonas, Lepperød, Mikkel Elle
Artificial and biological agents cannon learn given completely random and unstructured data. The structure of data is encoded in the metric relationships between data points. In the context of neural networks, neuronal activity within a layer forms a representation reflecting the transformation that the layer implements on its inputs. In order to utilize the structure in the data in a truthful manner, such representations should reflect the input distances and thus be continuous and isometric. Supporting this statement, recent findings in neuroscience propose that generalization and robustness are tied to neural representations being continuously differentiable. In machine learning, most algorithms lack robustness and are generally thought to rely on aspects of the data that differ from those that humans use, as is commonly seen in adversarial attacks. During cross-entropy classification, the metric and structural properties of network representations are usually broken both between and within classes. This side effect from training can lead to instabilities under perturbations near locations where such structure is not preserved. One of the standard solutions to obtain robustness is to add ad hoc regularization terms, but to our knowledge, forcing representations to preserve the metric structure of the input data as a stabilising mechanism has not yet been studied. In this work, we train neural networks to perform classification while simultaneously maintaining within-class metric structure, leading to isometric within-class representations. Such network representations turn out to be beneficial for accurate and robust inference. By stacking layers with this property we create a network architecture that facilitates hierarchical manipulation of internal neural representations. Finally, we verify that isometric regularization improves the robustness to adversarial attacks on MNIST.
The Bias in AI: Case study of facial recognition technology - What the Aid
Facial recognition's history can be traced back to its beginning in the sixties, which continued to develop until the recent research in this field (Libby and Ehrenfeld, 2021). In the seventies, NEC used the technology of facial recognition in Osaka Expo '70 in Japan and it attracted a huge audience (Gates, 2016) and is still evolving to unknown destinations, like any other new technology it has its share of controversial debates, arguments, and ethical dilemmas. In this case study we will explore and understand what facial recognition is, what the possible biases of this technology are. Long ago boarder control used witnesses to identify a suspect, or even use a professional artist to draw a picture of the suspect from the witness description to compare it with existing criminal data base (Horkaew et al., 2020). Facial Recognition Technology (FCT) is an artificial intelligence (AI) tool used to recognize and identify digital forms of facial footage or videos and cross-link the findings to existing databases using algorithms, (Thomas, 2018; Deborah Raji et al., 2020; European Union Agency for Fundamental Rights (FRA), 2020).
Russia seeks drone attack probe, guarantees to resume grain deal
Russia's President Vladimir Putin has told his Turkish counterpart Recep Tayyip Erdogan that Moscow would consider resuming a deal allowing grain exports from Ukrainian seaports but only after securing "real guarantees" from Kyiv. The phone call between the two leaders on Tuesday came following Russia's suspension of its participation in the deal due to what it said was a drone attack on Moscow's fleet in Crimea that it blamed on Ukraine. Kyiv has not claimed responsibility and has denied using the safe shipping corridor for military purposes. Putin told Erdogan that Russia sought "real guarantees from Kyiv about the strict observance of the Istanbul agreement, in particular about not using the humanitarian corridor for military purposes", according to a statement from the Kremlin. The grain export deal between Russia and Ukraine was brokered by Turkey and the United Nations in July to ease a world food crisis caused in part by Moscow's invasion of Ukraine, a major grain producer, and an earlier blockade of its ports.
Ukraine's 58th Brigade In The Heart Of The Bakhmut Mire
In the east Ukrainian city of Bakhmut, 15 kilometres (nine miles) from the positions held by Russian forces, an artillery unit waits for the signal. The four soldiers duck and put their hands over their ears. "According to the coordinates we received, the target is infantry," says Oleksandr, 37, between two radioed orders. Around 30 seconds later, the 50 kilo (110-pound) "fragmentation" shell, pinched from the Russians after their retreat from a nearby town, will explode above the position held by Moscow's troops, showering them with its payload. A Ukrainian drone supports the operation "in real time", monitoring the effectiveness of the strike from the old Soviet D-20 cannon in order to better calibrate the next one.