Goto

Collaborating Authors

 Africa


Document-aware Positional Encoding and Linguistic-guided Encoding for Abstractive Multi-document Summarization

arXiv.org Artificial Intelligence

One key challenge in multi-document summarization is to capture the relations among input documents that distinguish between single document summarization (SDS) and multi-document summarization (MDS). Few existing MDS works address this issue. One effective way is to encode document positional information to assist models in capturing cross-document relations. However, existing MDS models, such as Transformer-based models, only consider token-level positional information. Moreover, these models fail to capture sentences' linguistic structure, which inevitably causes confusions in the generated summaries. Therefore, in this paper, we propose document-aware positional encoding and linguistic-guided encoding that can be fused with Transformer architecture for MDS. For document-aware positional encoding, we introduce a general protocol to guide the selection of document encoding functions. For linguistic-guided encoding, we propose to embed syntactic dependency relations into the dependency relation mask with a simple but effective non-linear encoding learner for feature learning. Extensive experiments show the proposed model can generate summaries with high quality.


Pareto Driven Surrogate (ParDen-Sur) Assisted Optimisation of Multi-period Portfolio Backtest Simulations

arXiv.org Artificial Intelligence

Portfolio management is a multi-period multi-objective optimisation problem subject to a wide range of constraints. However, in practice, portfolio management is treated as a single-period problem partly due to the computationally burdensome hyper-parameter search procedure needed to construct a multi-period Pareto frontier. This study presents the \gls{ParDen-Sur} modelling framework to efficiently perform the required hyper-parameter search. \gls{ParDen-Sur} extends previous surrogate frameworks by including a reservoir sampling-based look-ahead mechanism for offspring generation in \glspl{EA} alongside the traditional acceptance sampling scheme. We evaluate this framework against, and in conjunction with, several seminal \gls{MO} \glspl{EA} on two datasets for both the single- and multi-period use cases. Our results show that \gls{ParDen-Sur} can speed up the exploration for optimal hyper-parameters by almost $2\times$ with a statistically significant improvement of the Pareto frontiers, across multiple \glspl{EA}, for both datasets and use cases.


Twitter conversations predict the daily confirmed COVID-19 cases

arXiv.org Artificial Intelligence

As of writing this paper, COVID-19 (Coronavirus disease 2019) has spread to more than 220 countries and territories. Following the outbreak, the pandemic's seriousness has made people more active on social media, especially on the microblogging platforms such as Twitter and Weibo. The pandemic-specific discourse has remained on-trend on these platforms for months now. Previous studies have confirmed the contributions of such socially generated conversations towards situational awareness of crisis events. The early forecasts of cases are essential to authorities to estimate the requirements of resources needed to cope with the outgrowths of the virus. Therefore, this study attempts to incorporate the public discourse in the design of forecasting models particularly targeted for the steep-hill region of an ongoing wave. We propose a sentiment-involved topic-based latent variables search methodology for designing forecasting models from publicly available Twitter conversations. As a use case, we implement the proposed methodology on Australian COVID-19 daily cases and Twitter conversations generated within the country. Experimental results: (i) show the presence of latent social media variables that Granger-cause the daily COVID-19 confirmed cases, and (ii) confirm that those variables offer additional prediction capability to forecasting models. Further, the results show that the inclusion of social media variables introduces 48.83--51.38% improvements on RMSE over the baseline models. We also release the large-scale COVID-19 specific geotagged global tweets dataset, MegaGeoCOV, to the public anticipating that the geotagged data of this scale would aid in understanding the conversational dynamics of the pandemic through other spatial and temporal contexts.


VALUE: Understanding Dialect Disparity in NLU

arXiv.org Artificial Intelligence

English Natural Language Understanding (NLU) systems have achieved great performances and even outperformed humans on benchmarks like GLUE and SuperGLUE. However, these benchmarks contain only textbook Standard American English (SAE). Other dialects have been largely overlooked in the NLP community. This leads to biased and inequitable NLU systems that serve only a sub-population of speakers. To understand disparities in current models and to facilitate more dialect-competent NLU systems, we introduce the VernAcular Language Understanding Evaluation (VALUE) benchmark, a challenging variant of GLUE that we created with a set of lexical and morphosyntactic transformation rules. In this initial release (V.1), we construct rules for 11 features of African American Vernacular English (AAVE), and we recruit fluent AAVE speakers to validate each feature transformation via linguistic acceptability judgments in a participatory design manner. Experiments show that these new dialectal features can lead to a drop in model performance. To run the transformation code and download both synthetic and gold-standard dialectal GLUE benchmarks, see https://github.com/SALT-NLP/value


BDPGO: Balanced Distributed Pose Graph Optimization Framework for Swarm Robotics

arXiv.org Artificial Intelligence

Distributed pose graph optimization (DPGO) is one of the fundamental techniques of swarm robotics. Currently, the sub-problems of DPGO are built on the native poses. Our validation proves that this approach may introduce an imbalance in the sizes of the sub-problems in real-world scenarios, which affects the speed of DPGO optimization, and potentially increases communication requirements. In addition, the coherence of the estimated poses is not guaranteed when the robots in the swarm fail, or partial robots are disconnected. In this paper, we propose BDPGO, a balanced distributed pose graph optimization framework using the idea of decoupling the robot poses and DPGO. BDPGO re-distributes the poses in the pose graph to the robot swarm in a balanced way by introducing a two-stage graph partitioning method to build balanced subproblems. Our validation demonstrates that BDPGO significantly improves the optimization speed without changing the specific algorithm of DPGO in realistic datasets. What's more, we also validate that BDPGO is robust to robot failure, changes in the wireless network. BDPGO has capable of keeps the coherence of the estimated poses in these situations. The framework also has the potential to be applied to other collaborative simultaneous localization and mapping (CSLAM) problems involved in distributedly solving the factor graph.


Selection Collider Bias in Large Language Models

arXiv.org Artificial Intelligence

In this paper we motivate the causal mechanisms behind sample selection induced collider bias (selection collider bias) that can cause Large Language Models (LLMs) to learn unconditional dependence between entities that are unconditionally independent in the real world. We show that selection collider bias can become amplified in underspecified learning tasks, and although difficult to overcome, we describe a method to exploit the resulting spurious correlations for determination of when a model may be uncertain about its prediction. We demonstrate an uncertainty metric that matches human uncertainty in tasks with gender pronoun underspecification on an extended version of the Winogender Schemas evaluation set, and we provide an online demo where users can apply our uncertainty metric to their own texts and models.


87% of Climate and AI Leaders Believe That AI Is Critical in...

#artificialintelligence

Climate change will have significant impacts on environmental, social, political, and economic systems around the world. Climate change mitigation, along with adaptation and resilience, is therefore crucial. Efforts to achieve net-zero emissions by 2050 will be essential, as will efforts to prepare for the consequences of climate change and to minimize the resulting harm. Applying advanced analytics and artificial intelligence (AI) to climate challenges provides a vital way to make meaningful change at this critical moment. According to a new report from the AI for the Planet Alliance, produced in collaboration with Boston Consulting Group (BCG) and BCG GAMMA, 87% of public- and private-sector leaders who oversee climate and AI topics believe that AI is a valuable asset in the fight against climate change.


87% of climate and AI leaders believe that AI is critical in the fight against climate change

#artificialintelligence

DUBAI: Climate change will have significant impacts on environmental, social, political, and economic systems around the world. Climate change mitigation, along with adaptation and resilience, is therefore crucial. Efforts to achieve net-zero emissions by 2050 will be essential, as will efforts to prepare for the consequences of climate change and to minimize the resulting harm. Applying advanced analytics and artificial intelligence (AI) to climate challenges provides a vital way to make meaningful change at this critical moment. According to a new report from the AI for the Planet Alliance, produced in collaboration with Boston Consulting Group (BCG) and BCG GAMMA, 87% of public- and private-sector leaders who oversee climate and AI topics believe that AI is a valuable asset in the fight against climate change.


The Best AI Image Generators in 2022

#artificialintelligence

Whether you like them or not, Artificial Intelligence (AI) image generators have exploded in popularity this year and the technology shows no signs of stopping. So if you're feeling confused about which AI Image generator you should use in 2022, this is a complete guide to the best options out there. A product of the Elon Musk co-founded research lab OpenAI, DALL-E 2, which we'll refer to as simply DALL-E, is the software most people can name when you ask them about AI text-to-image generators. When it launched in April, DALL-E stunned social media with its ability to turn a brief description into a photo-realistic image. For the few people with privileged access to the closed-off tool, DALL-E was so exceptional that it almost felt like magic -- whether that involved generating pictures of "a raccoon astronaut with the cosmos reflecting on the glass of his helmet" or "teddy bears shopping for groceries in Ancient Egypt," all from a simple text prompt.


Spectroscopy and Chemometrics + Machine-Learning News Weekly #36, 2022

#artificialintelligence

NIR Calibration-Model Services Services for Professional Development of NIRS Calibrations NIR Near-Infrared-Spectroscopy QA QC QAQC Laboratory LINK Spectroscopy and Chemometrics News Weekly 35, 2022 NIRS NIR Spectroscopy MachineLearning Spectrometer Spectrometric Analytical Chemistry Chemical Analysis Lab Labs Laboratories Laboratory Software IoT Sensors QA QC Testing Quality LINK Near-Infrared Spectroscopy (NIRS) "Comparing Calibration Algorithms for the Rapid Characterization of Pretreated Corn Stover Using Near-Infrared Spectroscopy" LINK "Indirect Measurement of -Glucan Content in Barley Grain with Near-Infrared Reflectance Spectroscopy" LINK "Foods: Markov Transition Field Combined with Convolutional Neural Network Improved the Predictive Performance of Near-Infrared Spectroscopy Models for Determination of Aflatoxin B1 in Maize" LINK "Determination of Fruit Freshness Using Near-Infrared Spectroscopy and Machine Learning Techniques" LINK "Extensive evaluation of prediction ...