Africa
Some recent advances in reasoning based on analogical proportions
Bounhas, Myriam, Prade, Henri, Richard, Gilles
Analogical proportions (AP) are statements of the form "a is to b ascis to d". They compare the pairs of items(a,b) and(c, d) in terms of their differences and similarities. The explicit use of APs in analogical reasoning has contributed to a renewal of its applications, leading to many developments, especially in the last decade; see [30] for a survey. However, even if much has been already done both at the theoretical and at the practical levels, the very nature of APs may not yet be fully understood and their full potential explored. In the following, we survey recent works on APs along three directions: their role in classification tasks [4]; their use for providing explanations [20]; their relation with multi-valued dependencies [21]. This just intends to be an introductory paper, and the reader is referred to the above references for more details on each issue.
Renormalization in the neural network-quantum field theory correspondence
Erbin, Harold, Lahoche, Vincent, Samary, Dine Ousmane
A statistical ensemble of neural networks can be described in terms of a quantum field theory (NN-QFT correspondence). The infinite-width limit is mapped to a free field theory, while finite N corrections are mapped to interactions. After reviewing the correspondence, we will describe how to implement renormalization in this context and discuss preliminary numerical results for translation-invariant kernels. A major outcome is that changing the standard deviation of the neural network weight distribution corresponds to a renormalization flow in the space of networks.
Federated Learning -- Methods, Applications and beyond
Heusinger, Moritz, Raab, Christoph, Rossi, Fabrice, Schleif, Frank-Michael
In recent years the applications of machine learning models have increased rapidly, due to the large amount of available data and technological progress.While some domains like web analysis can benefit from this with only minor restrictions, other fields like in medicine with patient data are strongerregulated. In particular \emph{data privacy} plays an important role as recently highlighted by the trustworthy AI initiative of the EU or general privacy regulations in legislation. Another major challenge is, that the required training \emph{data is} often \emph{distributed} in terms of features or samples and unavailable for classicalbatch learning approaches. In 2016 Google came up with a framework, called \emph{Federated Learning} to solve both of these problems. We provide a brief overview on existing Methods and Applications in the field of vertical and horizontal \emph{Federated Learning}, as well as \emph{Fderated Transfer Learning}.
A Topic Modeling Approach to Classifying Open Street Map Health Clinics and Schools in Sub-Saharan Africa
Anderson, Joshua W., Encina, Luis Iñaki Alberro, Karippacheril, Tina George, Hersh, Jonathan, Stringer, Cadence
In the wake of the COVID-19 pandemic, the World Bank's 2020 Global Economic Prospects forecasts a baseline global GDP contraction of 5.2 percent, making it the deepest global recession in decades. Between 71 to 100 million people are expected to be pushed into extreme poverty, almost half of them in South Asia and more than a third in Sub-Saharan Africa. As a result, since March 2020 over 215 countries and territories have implemented 1,414 social protection measures to respond to the pandemic and ensuing economic crisis. Social assistance programs account for 62 percent of all social protection response measures, half of them being cash-based transfers of some sort. This major shock has revealed the many challenges governments face when attempting to quickly respond to crises in order to protect the poor and vulnerable. Providing timely assistance and support to those households most in need can increase their resilience and reduce the negative impacts of the shock on their short and medium-term well-being. Nonetheless, the lack of readily available and up-to-date socioeconomic data necessary to prioritize shock-responsive social protection measures is an important binding constraint for many governments in developing countries. This paper presents a portion of our work on a larger project with the World Bank to identify the most vulnerable populations in these countries. Having timely access to such information, particularly in data-deprived contexts, can improve the capacity of governments to design and operationalize better and more shock-responsive social protection measures.
Generative AI (2/2): what will the future look like?
In my previous Article about Generative AI, I tried to set up the basics by giving a definition of this new technology trend, explaining its use cases and how the underlying algorithms where working. Now I want to extend a little bit on which type of actors will emerge of this trends, what are the opportunities for entrepreneurs and what will be the challenges they will be facing. Most industries could be impacted by Generative AI, but some more than others. Here I'll discuss some of the most important ones from my point of view. Copywriting is the most obvious and notorious usage of Generative AI.
Capgemini develops new AI solution to advance the treatment of River Blindness
PARIS, November 21, 2022 – A team of experts at Capgemini, in collaboration with University Hospital Bonn and Amazon Web Services, has developed an artificial intelligence (AI) model that will accelerate the speed of clinical trials aiming to establish new treatments for River Blindness, a neglected tropical disease which affects over 20 million people globally[1]. Currently, the specialist work of clinical trials can only be carried out manually by a handful of global experts, so the winning model could save years of work and speed up the development of new treatments. The India-based winning team developed a model which harnesses deep learning technology to identify the larvae worm that causes River Blindness, using images from existing clinical studies. In total, over 70,000 sections of clinical data were utilized to train the AI, leading to the creation of a model that can identify worm sections in microscopic images with almost 90% accuracy. The ability to automate such a high proportion of the required analysis will unlock the potential of faster and more consistent assessment of the efficacy of new drugs, which could save the eyesight of sufferers worldwide.
Is Your Model Sensitive? SPeDaC: A New Benchmark for Detecting and Classifying Sensitive Personal Data
Gambarelli, Gaia, Gangemi, Aldo, Tripodi, Rocco
In recent years, there has been an exponential growth of applications, including dialogue systems, that handle sensitive personal information. This has brought to light the extremely important issue of personal data protection in virtual environments. Sensitive Information Detection (SID) approaches different domains and languages in literature. However, if we refer to the personal data domain, a shared benchmark or the absence of an available labeled resource makes comparison with the state-of-the-art difficult. We introduce and release SPeDaC , a new annotated resource for the identification of sensitive personal data categories in the English language. SPeDaC enables the evaluation of computational models for three different SID subtasks with increasing levels of complexity. SPeDaC 1 regards binary classification, a model has to detect if a sentence contains sensitive information or not; whereas, in SPeDaC 2 we collected labeled sentences using 5 categories that relate to macro-domains of personal information; in SPeDaC 3, the labeling is fine-grained (61 personal data categories). We conduct an extensive evaluation of the resource using different state-of-the-art-classifiers. The results show that SPeDaC is challenging, particularly with regard to fine-grained classification. The transformer models achieve the best results (acc. RoBERTa on SPeDaC 1 = 98.20%, DeBERTa on SPeDaC 2 = 95.81% and SPeDaC 3 = 77.63%).
SlimFL: Federated Learning with Superposition Coding over Slimmable Neural Networks
Yun, Won Joon, Kwak, Yunseok, Baek, Hankyul, Jung, Soyi, Ji, Mingyue, Bennis, Mehdi, Park, Jihong, Kim, Joongheon
Federated learning (FL) is a key enabler for efficient communication and computing, leveraging devices' distributed computing capabilities. However, applying FL in practice is challenging due to the local devices' heterogeneous energy, wireless channel conditions, and non-independently and identically distributed (non-IID) data distributions. To cope with these issues, this paper proposes a novel learning framework by integrating FL and width-adjustable slimmable neural networks (SNN). Integrating FL with SNNs is challenging due to time-varying channel conditions and data distributions. In addition, existing multi-width SNN training algorithms are sensitive to the data distributions across devices, which makes SNN ill-suited for FL. Motivated by this, we propose a communication and energy-efficient SNN-based FL (named SlimFL) that jointly utilizes superposition coding (SC) for global model aggregation and superposition training (ST) for updating local models. By applying SC, SlimFL exchanges the superposition of multiple-width configurations decoded as many times as possible for a given communication throughput. Leveraging ST, SlimFL aligns the forward propagation of different width configurations while avoiding inter-width interference during backpropagation. We formally prove the convergence of SlimFL. The result reveals that SlimFL is not only communication-efficient but also deals with non-IID data distributions and poor channel conditions, which is also corroborated by data-intensive simulations.
Language Models as Inductive Reasoners
Yang, Zonglin, Dong, Li, Du, Xinya, Cheng, Hao, Cambria, Erik, Liu, Xiaodong, Gao, Jianfeng, Wei, Furu
Inductive reasoning is a core component of human intelligence. In the past research of inductive reasoning within computer science, logic language is used as representations of knowledge (facts and rules, more specifically). However, logic language can cause systematic problems for inductive reasoning such as disability of handling raw input such as natural language, sensitiveness to mislabeled data, and incapacity to handle ambiguous input. To this end, we propose a new task, which is to induce natural language rules from natural language facts, and create a dataset termed DEER containing 1.2k rule-fact pairs for the task, where rules and facts are written in natural language. New automatic metrics are also proposed and analysed for the evaluation of this task. With DEER, we investigate a modern approach for inductive reasoning where we use natural language as representation for knowledge instead of logic language and use pretrained language models as ''reasoners''. Moreover, we provide the first and comprehensive analysis of how well pretrained language models can induce natural language rules from natural language facts. We also propose a new framework drawing insights from philosophy literature for this task, which we show in the experiment section that surpasses baselines in both automatic and human evaluations.
Design Considerations of an Unmanned Aerial Vehicle for Aerial Filming
Casazola, Dennis, Arnez, Fabio, Espinoza, Huascar
Filming sport videos from an aerial view has always been a hard and an expensive task to achieve, especially in sports that require a wide open area for its normal development or the ones that put in danger human safety. Recently, a new solution arose for aerial filming based on the use of Unmanned Aerial Vehicles (UAVs), which is substantially cheaper than traditional aerial filming solutions that require conventional aircrafts like helicopters or complex structures for wide mobility. In this paper, we describe the design process followed for building a customized UAV suitable for sports aerial filming. The process includes the requirements definition, technical sizing and selection of mechanical, hardware and software technologies, as well as the whole integration and operation settings. One of the goals is to develop technologies allowing to build low cost UAVs and to manage them for a wide range of usage scenarios while achieving high levels of flexibility and automation. This work also shows some technical issues found during the development of the UAV as well as the solutions implemented.