Oceania
Pandemic's cancer backlogs receive treatment from AI innovation
Ruban Thanigasalam (centre, right) has used a robotic surgical system for 15 years, and says it benefits patients and surgeons.Credit: Ken Leanfore The COVID-19 pandemic has stretched health-care workforces around the world to their limits, as illness and burnout extract a toll from clinicians, nurses and staff. The need for innovations that can reduce workloads is pressing and has intensified interest in artificial intelligence (AI) and robotics as potential technologies to help in many ways, from processing doctors' notes, to improving surgical outcomes, and even assisting clinicians with rapid decision-making during crises. Cancer diagnosis and treatment have been especially affected by the pandemic, as hospital resources are diverted to urgent infectious-disease outbreaks, and health-care staff are ill or in isolation. Many of the key pressure points in this field are tasks that lend themselves to innovative solutions using AI and robotics. One of these is image processing for cancer screening and diagnosis; for example, checking mammograms.
BrainChip Fortifies Neuromorphic Patent Portfolio with New Awards and IP Acquisition
Laguna Hills, Calif. – DATE, 2022 – BrainChip Holdings Ltd (ASX: BRN, OTCQX: BRCHF, ADR: BCHPY), the world's first commercial producer of ultra-low power neuromorphic AI IP, has extended the breadth and depth of its neuromorphic IP with two new patents granted by the US Patents and Trademarks Office (USPTO), and the acquisition of previously licensed technology from Toulouse Tech Transfer (TTT). These latest additions of technical assets reinforce BrainChip's event-based processor differentiation for high performance, ultra-low power AI inference and on-chip learning. BrainChip also acquired full ownership of the IP rights related to JAST learning rule and algorithms from French technology transfer-based company TTT, including issued patent EP3324344 and pending patents US2019/0286944 and EP3324343. The invention related to the acquired IP rights include pattern detection algorithms that provide BrainChip with significant competitive advantages. The company held an exclusive license for the IP prior to their acquisition.
Metaphorical Paraphrase Generation: Feeding Metaphorical Language Models with Literal Texts
Ottolina, Giorgio, Pavlopoulos, John
This study presents a new approach to metaphorical paraphrase generation by masking literal tokens of literal sentences and unmasking them with metaphorical language models. Unlike similar studies, the proposed algorithm does not only focus on verbs but also on nouns and adjectives. Despite the fact that the transfer rate for the former is the highest (56%), the transfer of the latter is feasible (24% and 31%). Human evaluation showed that our system-generated metaphors are considered more creative and metaphorical than human-generated ones while when using our transferred metaphors for data augmentation improves the state of the art in metaphorical sentence classification by 3% in F1.
Searching for Better Database Queries in the Outputs of Semantic Parsers
Osokin, Anton, Saparina, Irina, Yarullin, Ramil
The task of generating a database query from a question in natural language suffers from ambiguity and insufficiently precise description of the goal. The problem is amplified when the system needs to generalize to databases unseen at training. In this paper, we consider the case when, at the test time, the system has access to an external criterion that evaluates the generated queries. The criterion can vary from checking that a query executes without errors to verifying the query on a set of tests. In this setting, we augment neural autoregressive models with a search algorithm that looks for a query satisfying the criterion. We apply our approach to the state-of-the-art semantic parsers and report that it allows us to find many queries passing all the tests on different datasets.
Marginalized particle Gibbs for multiple state-space models coupled through shared parameters
Wigren, Anna, Lindsten, Fredrik
We consider Bayesian inference from multiple time series described by a common state-space model (SSM) structure, but where different subsets of parameters are shared between different submodels. An important example is disease-dynamics, where parameters can be either disease or location specific. Parameter inference in these models can be improved by systematically aggregating information from the different time series, most notably for short series. Particle Gibbs (PG) samplers are an efficient class of algorithms for inference in SSMs, in particular when conjugacy can be exploited to marginalize out model parameters from the state update. We present two different PG samplers that marginalize static model parameters on-the-fly: one that updates one model at a time conditioned on the datasets for the other models, and one that concurrently updates all models by stacking them into a high-dimensional SSM. The distinctive features of each sampler make them suitable for different modelling contexts. We provide insights on when each sampler should be used and show that they can be combined to form an efficient PG sampler for a model with strong dependencies between states and parameters. The performance is illustrated on two linear-Gaussian examples and on a real-world example on the spread of mosquito-borne diseases.
Fine-grained Few-shot Recognition by Deep Object Parsing
Zhu, Ruizhao, Zhu, Pengkai, Mishra, Samarth, Saligrama, Venkatesh
We propose a new method for fine-grained few-shot recognition via deep object parsing. In our framework, an object is made up of K distinct parts and for each part, we learn a dictionary of templates, which is shared across all instances and categories. An object is parsed by estimating the locations of these K parts and a set of active templates that can reconstruct the part features. We recognize test instances by comparing its active templates and the relative geometry of its part locations against those of the presented few-shot instances. Our method is end-to-end trainable to learn part templates on-top of a convolutional backbone. To combat visual distortions such as orientation, pose and size, we learn templates at multiple scales, and at test-time parse and match instances across these scales. We show that our method is competitive with the state-of-the-art, and by virtue of parsing enjoys interpretability as well.
Frustratingly Easy Sentiment Analysis of Text Streams: Generating High-Quality Emotion Arcs Using Emotion Lexicons
Teodorescu, Daniela, Mohammad, Saif M.
Automatically generated emotion arcs -- that capture how an individual or a population feels over time -- are widely used in industry and research. However, there is little work on evaluating the generated arcs. This is in part due to the difficulty of establishing the true (gold) emotion arc. Our work, for the first time, systematically and quantitatively evaluates automatically generated emotion arcs. We also compare two common ways of generating emotion arcs: Machine-Learning (ML) models and Lexicon-Only (LexO) methods. Using a number of diverse datasets, we systematically study the relationship between the quality of an emotion lexicon and the quality of the emotion arc that can be generated with it. We also study the relationship between the quality of an instance-level emotion detection system (say from an ML model) and the quality of emotion arcs that can be generated with it. We show that despite being markedly poor at instance level, LexO methods are highly accurate at generating emotion arcs by aggregating information from hundreds of instances. This has wide-spread implications for commercial development, as well as research in psychology, public health, digital humanities, etc. that values simple interpretable methods and disprefers the need for domain-specific training data, programming expertise, and high-carbon-footprint models.
M2D2: A Massively Multi-domain Language Modeling Dataset
Reid, Machel, Zhong, Victor, Gururangan, Suchin, Zettlemoyer, Luke
We present M2D2, a fine-grained, massively multi-domain corpus for studying domain adaptation in language models (LMs). M2D2 consists of 8.5B tokens and spans 145 domains extracted from Wikipedia and Semantic Scholar. Using ontologies derived from Wikipedia and ArXiv categories, we organize the domains in each data source into 22 groups. This two-level hierarchy enables the study of relationships between domains and their effects on in- and out-of-domain performance after adaptation. We also present a number of insights into the nature of effective domain adaptation in LMs, as examples of the new types of studies M2D2 enables. To improve in-domain performance, we show the benefits of adapting the LM along a domain hierarchy; adapting to smaller amounts of fine-grained domain-specific data can lead to larger in-domain performance gains than larger amounts of weakly relevant data. We further demonstrate a trade-off between in-domain specialization and out-of-domain generalization within and across ontologies, as well as a strong correlation between out-of-domain performance and lexical overlap between domains.
A Systematic Review of Machine Learning Techniques for Cattle Identification: Datasets, Methods and Future Directions
Hossain, Md Ekramul, Kabir, Muhammad Ashad, Zheng, Lihong, Swain, Dave L., McGrath, Shawn, Medway, Jonathan
Increased biosecurity and food safety requirements may increase demand for efficient traceability and identification systems of livestock in the supply chain. The advanced technologies of machine learning and computer vision have been applied in precision livestock management, including critical disease detection, vaccination, production management, tracking, and health monitoring. This paper offers a systematic literature review (SLR) of vision-based cattle identification. More specifically, this SLR is to identify and analyse the research related to cattle identification using Machine Learning (ML) and Deep Learning (DL). For the two main applications of cattle detection and cattle identification, all the ML based papers only solve cattle identification problems. However, both detection and identification problems were studied in the DL based papers. Based on our survey report, the most used ML models for cattle identification were support vector machine (SVM), k-nearest neighbour (KNN), and artificial neural network (ANN). Convolutional neural network (CNN), residual network (ResNet), Inception, You Only Look Once (YOLO), and Faster R-CNN were popular DL models in the selected papers. Among these papers, the most distinguishing features were the muzzle prints and coat patterns of cattle. Local binary pattern (LBP), speeded up robust features (SURF), scale-invariant feature transform (SIFT), and Inception or CNN were identified as the most used feature extraction methods.
ezCoref: Towards Unifying Annotation Guidelines for Coreference Resolution
Gupta, Ankita, Karpinska, Marzena, Zhao, Wenlong, Krishna, Kalpesh, Merullo, Jack, Yeh, Luke, Iyyer, Mohit, O'Connor, Brendan
Large-scale, high-quality corpora are critical for advancing research in coreference resolution. However, existing datasets vary in their definition of coreferences and have been collected via complex and lengthy guidelines that are curated for linguistic experts. These concerns have sparked a growing interest among researchers to curate a unified set of guidelines suitable for annotators with various backgrounds. In this work, we develop a crowdsourcing-friendly coreference annotation methodology, ezCoref, consisting of an annotation tool and an interactive tutorial. We use ezCoref to re-annotate 240 passages from seven existing English coreference datasets (spanning fiction, news, and multiple other domains) while teaching annotators only cases that are treated similarly across these datasets. Surprisingly, we find that reasonable quality annotations were already achievable (>90% agreement between the crowd and expert annotations) even without extensive training. On carefully analyzing the remaining disagreements, we identify the presence of linguistic cases that our annotators unanimously agree upon but lack unified treatments (e.g., generic pronouns, appositives) in existing datasets. We propose the research community should revisit these phenomena when curating future unified annotation guidelines.