Oceania
Vision-based system identification and 3D keypoint discovery using dynamics constraints
Jaques, Miguel, Asenov, Martin, Burke, Michael, Hospedales, Timothy
This paper introduces V-SysId, a novel method that enables simultaneous keypoint discovery, 3D system identification, and extrinsic camera calibration from an unlabeled video taken from a static camera, using only the family of equations of motion of the object of interest as weak supervision. V-SysId takes keypoint trajectory proposals and alternates between maximum likelihood parameter estimation and extrinsic camera calibration, before applying a suitable selection criterion to identify the track of interest. This is then used to train a keypoint tracking model using supervised learning. Results on a range of settings (robotics, physics, physiology) highlight the utility of this approach.
FaxPlainAC: A Fact-Checking Tool Based on EXPLAINable Models with HumAn Correction in the Loop
Zhang, Zijian, Rudra, Koustav, Anand, Avishek
Fact-checking on the Web has become the main mechanism through which we detect the credibility of the news or information. Existing fact-checkers verify the authenticity of the information (support or refute the claim) based on secondary sources of information. However, existing approaches do not consider the problem of model updates due to constantly increasing training data due to user feedback. It is therefore important to conduct user studies to correct models' inference biases and improve the model in a life-long learning manner in the future according to the user feedback. In this paper, we present FaxPlainAC, a tool that gathers user feedback on the output of explainable fact-checking models. FaxPlainAC outputs both the model decision, i.e., whether the input fact is true or not, along with the supporting/refuting evidence considered by the model. Additionally, FaxPlainAC allows for accepting user feedback both on the prediction and explanation. Developed in Python, FaxPlainAC is designed as a modular and easily deployable tool. It can be integrated with other downstream tasks and allowing for fact-checking human annotation gathering and life-long learning.
TEASEL: A Transformer-Based Speech-Prefixed Language Model
Arjmand, Mehdi, Dousti, Mohammad Javad, Moradi, Hadi
Multimodal language analysis is a burgeoning field of NLP that aims to simultaneously model a speaker's words, acoustical annotations, and facial expressions. In this area, lexicon features usually outperform other modalities because they are pre-trained on large corpora via Transformer-based models. Despite their strong performance, training a new self-supervised learning (SSL) Transformer on any modality is not usually attainable due to insufficient data, which is the case in multimodal language learning. This work proposes a Transformer-Based Speech-Prefixed Language Model called TEASEL to approach the mentioned constraints without training a complete Transformer model. TEASEL model includes speech modality as a dynamic prefix besides the textual modality compared to a conventional language model. This method exploits a conventional pre-trained language model as a cross-modal Transformer model. We evaluated TEASEL for the multimodal sentiment analysis task defined by CMU-MOSI dataset. Extensive experiments show that our model outperforms unimodal baseline language models by 4% and outperforms the current multimodal state-of-the-art (SoTA) model by 1% in F1-score. Additionally, our proposed method is 72% smaller than the SoTA model.
End-to-End Conversational Search for Online Shopping with Utterance Transfer
Xiao, Liqiang, Ma2, Jun, Dong, Xin Luna, Martinez-Gomez, Pascual, Zalmout, Nasser, Chen, Wei, Zhao, Tong, He, Hao, Jin, Yaohui
Successful conversational search systems can present natural, adaptive and interactive shopping experience for online shopping customers. However, building such systems from scratch faces real word challenges from both imperfect product schema/knowledge and lack of training dialog data.In this work we first propose ConvSearch, an end-to-end conversational search system that deeply combines the dialog system with search. It leverages the text profile to retrieve products, which is more robust against imperfect product schema/knowledge compared with using product attributes alone. We then address the lack of data challenges by proposing an utterance transfer approach that generates dialogue utterances by using existing dialog from other domains, and leveraging the search behavior data from e-commerce retailer. With utterance transfer, we introduce a new conversational search dataset for online shopping. Experiments show that our utterance transfer method can significantly improve the availability of training dialogue data without crowd-sourcing, and the conversational search system significantly outperformed the best tested baseline.
Estimating a new panel MSK dataset for comparative analyses of national absorptive capacity systems, economic growth, and development in low and middle income economies
Within the national innovation system literature, empirical analyses are severely lacking for developing economies. Particularly, the low- and middle-income countries (LMICs) eligible for the World Bank's International Development Association (IDA) support, are rarely part of any empirical discourse on growth, development, and innovation. One major issue hindering panel analyses in LMICs, and thus them being subject to any empirical discussion, is the lack of complete data availability. This work offers a new complete panel dataset with no missing values for LMICs eligible for IDA's support. I use a standard, widely respected multiple imputation technique (specifically, Predictive Mean Matching) developed by Rubin (1987). This technique respects the structure of multivariate continuous panel data at the country level. I employ this technique to create a large dataset consisting of many variables drawn from publicly available established sources. These variables, in turn, capture six crucial country-level capacities: technological capacity, financial capacity, human capital capacity, infrastructural capacity, public policy capacity, and social capacity. Such capacities are part and parcel of the National Absorptive Capacity Systems (NACS). The dataset (MSK dataset) thus produced contains data on 47 variables for 82 LMICs between 2005 and 2019. The dataset has passed a quality and reliability check and can thus be used for comparative analyses of national absorptive capacities and development, transition, and convergence analyses among LMICs.
Feature Importance in Gradient Boosting Trees with Cross-Validation Feature Selection
Adler, Afek Ilay, Painsky, Amichai
Gradient Boosting Machines (GBM) are among the go-to algorithms on tabular data, which produce state of the art results in many prediction tasks. Despite its popularity, the GBM framework suffers from a fundamental flaw in its base learners. Specifically, most implementations utilize decision trees that are typically biased towards categorical variables with large cardinalities. The effect of this bias was extensively studied over the years, mostly in terms of predictive performance. In this work, we extend the scope and study the effect of biased base learners on GBM feature importance (FI) measures. We show that although these implementation demonstrate highly competitive predictive performance, they still, surprisingly, suffer from bias in FI. By utilizing cross-validated (CV) unbiased base learners, we fix this flaw at a relatively low computational cost. We demonstrate the suggested framework in a variety of synthetic and real-world setups, showing a significant improvement in all GBM FI measures while maintaining relatively the same level of prediction accuracy.
Artificial intelligence weather forecasting for smart farms - NZ Herald
Researchers working on smart irrigation systems have developed a way to choose the most accurate weather forecast, out of those offered in the week leading up to a given day. Dr Eric Wang, an Internet of Things researcher at James Cook University (JCU) in Cairns, works on technology that allows farmers to make data-driven decisions. "Every farmer would love to have a perfect weather forecast, but accurate forecasts are even more important to those who are embracing technology, and in particular the Internet of Things (IoT)," Wang said. In farming, the Internet of Things involved smart devices that talked to each other, to make recommendations such as when, where and how much to irrigate, Wang said. "That decision requires a lot of information, such as the needs of the particular crop, the current stage of its development, soil moisture and of course the weather."
US judge rules only humans, not AI, can get patents
The big picture: A US judge ruled this week that an artificial intelligence cannot be listed as the inventor of a patent. This ruling is the latest on an issue that has come before judges in multiple countries. A court in Alexandria, Virginia, ruled that inventions can only be patented under the name of a "natural person." The decision was made against someone who tried to list two designs under the name of an AI as part of a broader project to gain worldwide recognition of AI-powered inventions. Imagination Engines, Inc. CEO Stephen Thaler built an AI called DEBUS, which independently designed a new kind of drink holder and flashing light (used to get someone's attention). The name "DEBUS," along with "Invention generated by artificial intelligence," was used in the attempted patent filing for the inventions.
To present AI as optimistic or dystopian? "That was the biggest argument"
AI 2041: Ten Visions for Our Future is an unusual book. Each chapter consists of a short story, penned by science fiction writer Chen Qiufan, and a related analysis piece from Kai-Fu Lee, CEO of Sinovation Ventures and author of the nonfiction bestseller AI Superpowers. Chen, who also is founder of Thema Mundi, a content development studio, spoke with Fast Company on the eve of the release of AI 2041 about his collaboration with Lee, his own experiences with artificial intelligence, and what machine learning will mean for artists and writers. This interview was edited for length and clarity. Fast Company: How did this project come about?
Quantitative reconstruction of defects in multi-layered bonded composites using fully convolutional network-based ultrasonic inversion
Rao, Jing, Yang, Fangshu, Mo, Huadong, Kollmannsberger, Stefan, Rank, Ernst
Ultrasonic methods have great potential applications to detect and characterize defects in multi-layered bonded composites. However, it remains challenging to quantitatively reconstruct defects, such as disbonds and kissing bonds, that influence the integrity of adhesive bonds and seriously reduce the strength of assemblies. In this work, an ultrasonic method based on the supervised fully convolutional network (FCN) is proposed to quantitatively reconstruct defects hidden in multi-layered bonded composites. In the training process of this method, an FCN establishes a non-linear mapping from measured ultrasonic data to the corresponding velocity models of multi-layered bonded composites. In the predicting process, the trained network obtained from the training process is used to directly reconstruct the velocity models from the new measured ultrasonic data of adhesively bonded composites. The presented FCN-based inversion method can automatically extract useful features in multi-layered composites. Although this method is computationally expensive in the training process, the prediction itself in the online phase takes only seconds. The numerical results show that the FCN-based ultrasonic inversion method is capable to accurately reconstruct ultrasonic velocity models of the high contrast defects, which has great potential for online detection of adhesively bonded composites.