Goto

Collaborating Authors

 South America


Inductive Logic Programming At 30: A New Introduction

Journal of Artificial Intelligence Research

Inductive logic programming (ILP) is a form of machine learning. The goal of ILP is to induce a hypothesis (a set of logical rules) that generalises training examples. As ILP turns 30, we provide a new introduction to the field. We introduce the necessary logical notation and the main learning settings; describe the building blocks of an ILP system; compare several systems on several dimensions; describe four systems (Aleph, TILDE, ASPAL, and Metagol); highlight key application areas; and, finally, summarise current limitations and directions for future research.



FETILDA: An Effective Framework For Fin-tuned Embeddings For Long Financial Text Documents

arXiv.org Artificial Intelligence

Unstructured data, especially text, continues to grow rapidly in various domains. In particular, in the financial sphere, there is a wealth of accumulated unstructured financial data, such as the textual disclosure documents that companies submit on a regular basis to regulatory agencies, such as the Securities and Exchange Commission (SEC). These documents are typically very long and tend to contain valuable soft information about a company's performance. It is therefore of great interest to learn predictive models from these long textual documents, especially for forecasting numerical key performance indicators (KPIs). Whereas there has been a great progress in pre-trained language models (LMs) that learn from tremendously large corpora of textual data, they still struggle in terms of effective representations for long documents. Our work fills this critical need, namely how to develop better models to extract useful information from long textual documents and learn effective features that can leverage the soft financial and risk information for text regression (prediction) tasks. In this paper, we propose and implement a deep learning framework that splits long documents into chunks and utilizes pre-trained LMs to process and aggregate the chunks into vector representations, followed by self-attention to extract valuable document-level features. We evaluate our model on a collection of 10-K public disclosure reports from US banks, and another dataset of reports submitted by US companies. Overall, our framework outperforms strong baseline methods for textual modeling as well as a baseline regression model using only numerical data. Our work provides better insights into how utilizing pre-trained domain-specific and fine-tuned long-input LMs in representing long documents can improve the quality of representation of textual data, and therefore, help in improving predictive analyses.


Artificial Intelligence in BFSI Market 68.23 Billion By 2028, Growing At A CAGR of 36.5% By Emergen Research

#artificialintelligence

Emergen Research is a market research and consulting company that provides syndicated research reports, customized research reports, and consulting services. Our solutions purely focus on your purpose to locate, target, and analyze consumer behavior shifts across demographics, across industries, and help clients make smarter business decisions. We offer market intelligence studies ensuring relevant and fact-based research across multiple industries, including Healthcare, Touch Points, Chemicals, Types, and Energy. We consistently update our research offerings to ensure our clients are aware of the latest trend's existent in the market. Emergen Research has a strong base of experienced analysts from varied areas of expertise. Our industry experience and ability to develop a concrete solution to any research problems provides our clients with the ability to secure an edge over their respective competitors.


Sports Analytics 101, Intro

#artificialintelligence

Originally published on Towards AI the World's Leading AI and Technology News and Media Company. If you are building an AI-related product or service, we invite you to consider becoming an AI sponsor. At Towards AI, we help scale AI and technology startups. Let us help you unleash your technology to the masses. I am writing a series of articles about how data analytics and machine learning can impact and be helpful in sports analytics.


Britain's most amazing shipwrecks REVEALED: Underwater monuments to the UK's rich maritime heritage

Daily Mail - Science & tech

A whopping 350 years after it sank off the coast of Norfolk, authorities have revealed on Friday that HMS Gloucester has finally been found. The'outstanding' ship, which sank on May 6, 1682 after hitting the Norfolk sandbanks in the southern North Sea, was uncovered 28 miles off the coast of Great Yarmouth half-buried on the seabed. But HMS Gloucester is just one of thousands of shipwrecks that litter the British coast, the majority of which haven't been seen by the human eye for centuries. It's thought nearly 40,000 wrecks could be waiting to be found off the British coast, according to Historic England, providing snapshots of the UK's rich maritime heritage. But at least 90 are known to exist and experts have pinpointed their location, although many likely won't ever be brought to land and could disintegrate to nothing in the decades to come.


Fast Adaptive Non-Monotone Submodular Maximization Subject to a Knapsack Constraint

Journal of Artificial Intelligence Research

Constrained submodular maximization problems encompass a wide variety of applications, including personalized recommendation, team formation, and revenue maximization via viral marketing. The massive instances occurring in modern-day applications can render existing algorithms prohibitively slow. Moreover, frequently those instances are also inherently stochastic. Focusing on these challenges, we revisit the classic problem of maximizing a (possibly non-monotone) submodular function subject to a knapsack constraint. We present a simple randomized greedy algorithm that achieves a 5.83-approximation and runs in O(n log n) time, i.e., at least a factor n faster than other state-of-the-art algorithms. The versatility of our approach allows us to further transfer it to a stochastic version of the problem. There, we obtain a (9 + ε)-approximation to the best adaptive policy, which is the first constant approximation for non-monotone objectives. Experimental evaluation of our algorithms showcases their improved performance on real and synthetic data.


Planning with Critical Section Macros: Theory and Practice

Journal of Artificial Intelligence Research

Macro-operators (macros) are a well-known technique for enhancing performance of planning engines by providing "short-cuts" in the state space. Existing macro learning systems usually generate macros by considering most frequent action sequences in training plans. Unfortunately, frequent action sequences might not capture meaningful activities as a whole, leading to a limited beneficial impact for the planning process. In this paper, inspired by resource locking in critical sections in parallel computing, we propose a technique that generates macros able to capture whole activities in which limited resources (e.g., a robotic hand, or a truck) are used. Specifically, such a Critical Section macro starts by locking the resource (e.g., grabbing an object), continues by using the resource (e.g., manipulating the object) and finishes by releasing the resource (e.g., dropping the object). Hence, such a macro bridges states in which the resource is locked and cannot be used. We also introduce versions of Critical Section macros dealing with multiple resources and phased locks. Usefulness of macros is evaluated using a range of state-of-the-art planners, and a large number of benchmarks from the deterministic and learning tracks of recent editions of the International Planning Competition.


Principal Components Bias in Over-parameterized Linear Models, and its Manifestation in Deep Neural Networks

arXiv.org Artificial Intelligence

Recent work suggests that convolutional neural networks of different architectures learn to classify images in the same order. To understand this phenomenon, we revisit the over-parametrized deep linear network model. Our analysis reveals that, when the hidden layers are wide enough, the convergence rate of this model's parameters is exponentially faster along the directions of the larger principal components of the data, at a rate governed by the corresponding singular values. We term this convergence pattern the Principal Components bias (PC-bias). Empirically, we show how the PC-bias streamlines the order of learning of both linear and non-linear networks, more prominently at earlier stages of learning. We then compare our results to the simplicity bias, showing that both biases can be seen independently, and affect the order of learning in different ways. Finally, we discuss how the PC-bias may explain some benefits of early stopping and its connection to PCA, and why deep networks converge more slowly with random labels.


Social media misinformation threatens 'scientific credibility', report says

Daily Mail - Science & tech

Britons' trust in science is at an all-time high after the Covid pandemic, a new report reveals – but misinformation on social media continues to present a'threat to scientific credibility'. The 3M State of Science Index, published on Tuesday, reveals that 90 per cent of UK residents trust science in 2022, compared with 85 per cent in 2019. This stat also compares with 88 per cent of Europeans and 89 per cent of people globally who trust science in 2022. In the UK, 57 per cent of Brits say they are now more appreciative of science after the pandemic, likely due to the efforts of scientists in creating Covid vaccines. However, misinformation'is widespread' on social media and threatens the future of the public's understanding of science, the report says.