Goto

Collaborating Authors

 Oceania


Automated tabulation of clinical trial results: A joint entity and relation extraction approach with transformer-based language representations

arXiv.org Artificial Intelligence

Evidence-based medicine, the practice in which healthcare professionals refer to the best available evidence when making decisions, forms the foundation of modern healthcare. However, it relies on labour-intensive systematic reviews, where domain specialists must aggregate and extract information from thousands of publications, primarily of randomised controlled trial (RCT) results, into evidence tables. This paper investigates automating evidence table generation by decomposing the problem across two language processing tasks: \textit{named entity recognition}, which identifies key entities within text, such as drug names, and \textit{relation extraction}, which maps their relationships for separating them into ordered tuples. We focus on the automatic tabulation of sentences from published RCT abstracts that report the results of the study outcomes. Two deep neural net models were developed as part of a joint extraction pipeline, using the principles of transfer learning and transformer-based language representations. To train and test these models, a new gold-standard corpus was developed, comprising almost 600 result sentences from six disease areas. This approach demonstrated significant advantages, with our system performing well across multiple natural language processing tasks and disease areas, as well as in generalising to disease domains unseen during training. Furthermore, we show these results were achievable through training our models on as few as 200 example sentences. The final system is a proof of concept that the generation of evidence tables can be semi-automated, representing a step towards fully automating systematic reviews.


A Validation Tool for Designing Reinforcement Learning Environments

arXiv.org Artificial Intelligence

Reinforcement learning (RL) has gained increasing attraction in the academia and tech industry with launches to a variety of impactful applications and products. Although research is being actively conducted on many fronts (e.g., offline RL, performance, etc.), many RL practitioners face a challenge that has been largely ignored: determine whether a designed Markov Decision Process (MDP) is valid and meaningful. This study proposes a heuristic-based feature analysis method to validate whether an MDP is well formulated. We believe an MDP suitable for applying RL should contain a set of state features that are both sensitive to actions and predictive in rewards. We tested our method in constructed environments showing that our approach can identify certain invalid environment formulations. As far as we know, performing validity analysis for RL problem formulation is a novel direction. We envision that our tool will serve as a motivational example to help practitioners apply RL in real-world problems more easily.


Unsupervised Editing for Counterfactual Stories

arXiv.org Artificial Intelligence

Creating what-if stories requires reasoning about prior statements and possible outcomes of the changed conditions. One can easily generate coherent endings under new conditions, but it would be challenging for current systems to do it with minimal changes to the original story. Therefore, one major challenge is the trade-off between generating a logical story and rewriting with minimal-edits. In this paper, we propose EDUCAT, an editing-based unsupervised approach for counterfactual story rewriting. EDUCAT includes a target position detection strategy based on estimating causal effects of the what-if conditions, which keeps the causal invariant parts of the story. EDUCAT then generates the stories under fluency, coherence and minimal-edits constraints. We also propose a new metric to alleviate the shortcomings of current automatic metrics and better evaluate the trade-off. We evaluate EDUCAT on a public counterfactual story rewriting benchmark. Experiments show that EDUCAT achieves the best trade-off over unsupervised SOTA methods according to both automatic and human evaluation. The resources of EDUCAT are available at: https://github.com/jiangjiechen/EDUCAT.


A Generative Car-following Model Conditioned On Driving Styles

arXiv.org Artificial Intelligence

Car-following (CF) modeling, an essential component in simulating human CF behaviors, has attracted increasing research interest in the past decades. This paper pushes the state of the art by proposing a novel generative hybrid CF model, which achieves high accuracy in characterizing dynamic human CF behaviors and is able to generate realistic human CF behaviors for any given observed or even unobserved driving style. Specifically, the ability of accurately capturing human CF behaviors is ensured by designing and calibrating an Intelligent Driver Model (IDM) with time-varying parameters. The reason behind is that such time-varying parameters can express both the inter-driver heterogeneity, i.e., diverse driving styles of different drivers, and the intra-driver heterogeneity, i.e., changing driving styles of the same driver. The ability of generating realistic human CF behaviors of any given observed driving style is achieved by applying a neural process (NP) based model. The ability of inferring CF behaviors of unobserved driving styles is supported by exploring the relationship between the calibrated time-varying IDM parameters and an intermediate variable of NP. To demonstrate the effectiveness of our proposed models, we conduct extensive experiments and comparisons, including CF model parameter calibration, CF behavior prediction, and trajectory simulation for different driving styles.


Where is Memory Information Stored in the Brain?

arXiv.org Artificial Intelligence

Within the scientific research community, memory information in the brain is commonly believed to be stored in the synapse - a hypothesis famously attributed to psychologist Donald Hebb. However, there is a growing minority who postulate that memory is stored inside the neuron at the molecular (RNA or DNA) level - an alternative postulation known as the cell-intrinsic hypothesis, coined by psychologist Randy Gallistel. In this paper, we review a selection of key experimental evidence from both sides of the argument. We begin with Eric Kandel's studies on sea slugs, which provided the first evidence in support of the synaptic hypothesis. Next, we touch on experiments in mice by John O'Keefe (declarative memory and the hippocampus) and Joseph LeDoux (procedural fear memory and the amygdala). Then, we introduce the synapse as the basic building block of today's artificial intelligence neural networks. After that, we describe David Glanzman's study on dissociating memory storage and synaptic change in sea slugs, and Susumu Tonegawa's experiment on reactivating retrograde amnesia in mice using laser. From there, we highlight Germund Hesslow's experiment on conditioned pauses in ferrets, and Beatrice Gelber's experiment on conditioning in single-celled organisms without synapses (Paramecium aurelia). This is followed by a description of David Glanzman's experiment on transplanting memory between sea slugs using RNA. Finally, we provide an overview of Brian Dias and Kerry Ressler's experiment on DNA transfer of fear in mice from parents to offspring. We conclude with some potential implications for the wider field of psychology.


Blockwise Sequential Model Learning for Partially Observable Reinforcement Learning

arXiv.org Artificial Intelligence

This paper proposes a new sequential model learning architecture to solve partially observable Markov decision problems. Rather than compressing sequential information at every timestep as in conventional recurrent neural network-based methods, the proposed architecture generates a latent variable in each data block with a length of multiple timesteps and passes the most relevant information to the next block for policy optimization. The proposed blockwise sequential model is implemented based on self-attention, making the model capable of detailed sequential learning in partial observable settings. The proposed model builds an additional learning network to efficiently implement gradient estimation by using self-normalized importance sampling, which does not require the complex blockwise input data reconstruction in the model learning. Numerical results show that the proposed method significantly outperforms previous methods in various partially observable environments.


Secure Federated Learning for Residential Short Term Load Forecasting

arXiv.org Artificial Intelligence

The inclusion of intermittent and renewable energy sources has increased the importance of demand forecasting in power systems. Smart meters can play a critical role in demand forecasting due to the measurement granularity they provide. Despite their virtue, smart meters used for forecasting face some constraints as consumers' privacy concerns, reluctance of utilities and vendors to share data with competitors or third parties, and regulatory constraints. This paper examines a collaborative machine learning method, federated learning extended with privacy preserving techniques for short-term demand forecasting using smart meter data as a solution to the previous constraints. The combination of privacy preserving techniques and federated learning enables to ensure consumers' confidentiality concerning both their data, the models generated using it (Differential Privacy), and the communication mean (Secure Aggregation). To evaluate this paper's collaborative secure federated learning setting, we explore current literature to select the baseline for our simulations and evaluation. We simulate and evaluate several scenarios that explore how traditional centralized approaches could be projected in the direction of a decentralized, collaborative and private system. The results obtained over the evaluations provided decent performance and in a privacy setting using differential privacy almost perfect privacy budgets (1.39,$10e^{-5}$) and (2.01,$10e^{-5}$) with a negligible performance compromise.


'Help! I've been spotted!' Terry Pratchett on Thief, his favourite video game

The Guardian

In November 2001, Terry Pratchett was in Chester, famed for its Roman ruins and well-preserved medieval architecture. Staying at a hotel in the city centre, Pratchett opened the window of his room, and looked across the historic skyline. "I realised I could drop down on to a roof," he wrote later. "And from then on there was a vista of roofs, leads and ledges leading all the way to the end of the street and beyond; there were even little doors and inviting attic windows … There is a line break, and then he adds. "I'm going to have to stop playing this game." Pratchett was not considering a new career as a cat burglar. He was reflecting on his favourite video game – Thief II: The Metal Age. Released in March 2000, Thief II was the sequel to 1998's Thief: The Dark Project, a pioneering stealth game set in a gothic fantasy world. In both games, players donned the cowl of Garrett, a laconic master thief partly inspired by Raymond Chandler's PI Philip Marlowe. Thief charged players with breaking into medieval mansions, rooftop apartments, banks, cathedrals even police stations, stealing as much coin and valuables as they could while avoiding patrols of sword-wielding guards. Pratchett's relationship with video games is well documented. Always technologically savvy, he was an early adopter of PC gaming, and enjoyed everything from Doom to Deus Ex and Call of Duty. He even helped to create a mod (an unofficial add-on) for The Elder Scrolls IV: Oblivion, writing lines of dialogue for a character. But Pratchett held a particular affection for Thief. He played all three games in the series, and often contributed to a Usenet newsgroup named alt.games.thief-dark-project. That newsgroup, analogous to a modern forum, has long since been deactivated, but its posts survive in a Google groups archive. Combined, they provide a fascinating record of Pratchett's evolving relationship with both the Thief series and video games in general. Like so many players who become involved in online communities, he posted because he was stuck. In a post titled: "Help!


Edge Artificial Intelligence Market Research Report by Processor, by Component, by Source, by End-Use, by Application, by Region - Global Forecast to 2026 - Cumulative Impact of COVID-19

#artificialintelligence

GNW The Global Edge Artificial Intelligence Market size was estimated at USD 572.00 million in 2020 and expected to reach USD 701.73 million in 2021, at a CAGR 23.35% to reach USD 2,014.99 million by 2026. Market Statistics: The report provides market sizing and forecast across five major currencies - USD, EUR GBP, JPY, and AUD. It helps organization leaders make better decisions when currency exchange data is readily available. In this report, the years 2018 and 2019 are considered historical years, 2020 as the base year, 2021 as the estimated year, and years from 2022 to 2026 are considered the forecast period. Market Segmentation & Coverage: This research report categorizes the Edge Artificial Intelligence to forecast the revenues and analyze the trends in each of the following sub-markets: Based on Processor, the market was studied across ASIC, CPU, and GPU.


Singapore Remains Top In APAC For AI Readiness

#artificialintelligence

Salesforce has announced the second edition of its Asia Pacific AI Readiness Index, which saw Singapore retain the top spot for AI readiness. Prepared by Access Partnership, the report uses an AI Index to assess the readiness of governments, businesses, and consumers across 11 APAC economies in their adoption of AI technologies. Singapore leads all three indices of AI readiness with an overall score of 65.7, followed by Japan (60.0) and Hong Kong (59.3). The role of AI is increasing, and Salesforce noted it is delivering around 120 billion AI-powered predictions every day, up from 6.5 billion in October 2019. According to PwC, AI will contribute approximately USD15.7 trillion to global GDP by 2030, up from USD2 trillion in 2019.