South America
RecNet: Early Attention Guided Feature Recovery
Biswas, Subrata, Islam, Bashima
Uncertainty in sensors results in corrupted input streams and hinders the performance of Deep Neural Networks (DNN), which focus on deducing information from data. However, for sensors with multiple input streams, the relevant information among the streams correlates and hence contains mutual information. This paper utilizes this opportunity to recover the perturbed information due to corrupted input streams. We propose RecNet, which estimates the information entropy at every element of the input feature to the network and interpolates the missing information in the input feature matrix. Finally, using the estimated information entropy and interpolated data, we introduce a novel guided replacement procedure to recover the complete information that is the input to the downstream DNN task. We evaluate the proposed algorithm on a sound event detection and localization application where audio streams from the microphone array are corrupted. We have recovered the performance drop due to the corrupted input stream and reduced the localization error with non-corrupted input streams.
Anomaly Detection of UAV State Data Based on Single-class Triangular Global Alignment Kernel Extreme Learning Machine
Hu, Feisha, Wang, Qi, Shao, Haijian, Gao, Shang, Yu, Hualong
Unmanned Aerial Vehicles (UAVs) are widely used and meet many demands in military and civilian fields. With the continuous enrichment and extensive expansion of application scenarios, the safety of UAVs is constantly being challenged. To address this challenge, we propose algorithms to detect anomalous data collected from drones to improve drone safety. We deployed a one-class kernel extreme learning machine (OCKELM) to detect anomalies in drone data. By default, OCKELM uses the radial basis (RBF) kernel function as the kernel function of the model. To improve the performance of OCKELM, we choose a Triangular Global Alignment Kernel (TGAK) instead of an RBF Kernel and introduce the Fast Independent Component Analysis (FastICA) algorithm to reconstruct UAV data. Based on the above improvements, we create a novel anomaly detection strategy FastICA-TGAK-OCELM. The method is finally validated on the UCI dataset and detected on the Aeronautical Laboratory Failures and Anomalies (ALFA) dataset. The experimental results show that compared with other methods, the accuracy of this method is improved by more than 30%, and point anomalies are effectively detected.
A Federated Approach for Hate Speech Detection
Gala, Jay, Gandhi, Deep, Mehta, Jash, Talat, Zeerak
Hate speech detection has been the subject of high research attention, due to the scale of content created on social media. In spite of the attention and the sensitive nature of the task, privacy preservation in hate speech detection has remained under-studied. The majority of research has focused on centralised machine learning infrastructures which risk leaking data. In this paper, we show that using federated machine learning can help address privacy the concerns that are inherent to hate speech detection while obtaining up to 6.81% improvement in terms of F1-score.
Memory-assisted prompt editing to improve GPT-3 after deployment
Madaan, Aman, Tandon, Niket, Clark, Peter, Yang, Yiming
Large LMs such as GPT-3 are powerful, but can commit mistakes that are obvious to humans. For example, GPT-3 would mistakenly interpret "What word is similar to good?" to mean a homophone, while the user intended a synonym. Our goal is to effectively correct such errors via user interactions with the system but without retraining, which will be prohibitively costly. We pair GPT-3 with a growing memory of recorded cases where the model misunderstood the user's intents, along with user feedback for clarification. Such a memory allows our system to produce enhanced prompts for any new query based on the user feedback for error correction on similar cases in the past. On four tasks (two lexical tasks, two advanced ethical reasoning tasks), we show how a (simulated) user can interactively teach a deployed GPT-3, substantially increasing its accuracy over the queries with different kinds of misunderstandings by the GPT-3. Our approach is a step towards the low-cost utility enhancement for very large pre-trained LMs. Code, data, and instructions to implement MEMPROMPT for a new task at https://www.memprompt.com/.
Front-End Adapter: Adapting Front-End Input of Speech based Self-Supervised Learning for Speech Recognition
Chen, Xie, Ma, Ziyang, Tang, Changli, Wang, Yujin, Zheng, Zhisheng
Recent years have witnessed a boom in self-supervised learning (SSL) in various areas including speech processing. Speech based SSL models present promising performance in a range of speech related tasks. However, the training of SSL models is computationally expensive and a common practice is to fine-tune a released SSL model on the specific task. It is essential to use consistent front-end input during pre-training and fine-tuning. This consistency may introduce potential issues when the optimal front-end is not the same as that used in pre-training. In this paper, we propose a simple but effective front-end adapter to address this front-end discrepancy. By minimizing the distance between the outputs of different front-ends, the filterbank feature (Fbank) can be compatible with SSL models which are pre-trained with waveform. The experiment results demonstrate the effectiveness of our proposed front-end adapter on several popular SSL models for the speech recognition task.
Distributed Planning with Asynchronous Execution with Local Navigation for Multi-agent Pickup and Delivery Problem
Miyashita, Yuki, Yamauchi, Tomoki, Sugawara, Toshiharu
We propose a distributed planning method with asynchronous execution for multi-agent pickup and delivery (MAPD) problems for environments with occasional delays in agents' activities and flexible endpoints. MAPD is a crucial problem framework with many applications; however, most existing studies assume ideal agent behaviors and environments, such as a fixed speed of agents, synchronized movements, and a well-designed environment with many short detours for multiple agents to perform tasks easily. However, such an environment is often infeasible; for example, the moving speed of agents may be affected by weather and floor conditions and is often prone to delays. The proposed method can relax some infeasible conditions to apply MAPD in more realistic environments by allowing fluctuated speed in agents' actions and flexible working locations (endpoints). Our experiments showed that our method enables agents to perform MAPD in such an environment efficiently, compared to the baseline methods. We also analyzed the behaviors of agents using our method and discuss the limitations.
'Star Trek: Picard' actors reunite for final season, Patrick Stewart says Jean Luc 'not the same person'
William Shatner, 'Star Trek' alum and author of'Boldly Go,' spoke to Fox News Digital about his decadeslong friendship with Leonard Nimoy, as well as his iconic on-screen kiss with Nichelle Nichols. "Star Trek" fans can bask in nostalgia, as the cast of the iconic science fiction series has reunited. After more than two decades, "Star Trek: Nemesis" actors, including Gates McFadden, LeVar Burton, Jonathan Frakes and Patrick Stewart, revealed the decision to reprise their famous roles and what it was like working together on the spacecraft again on "Star Trek: Picard." Stewart, who's known for his role as Jean Luc Picard in the "Star Trek" franchise, gave fans a preview of what they can expect in the current series. "Star Trek: Nemesis" actors, including, from left, Jonathan Frakes, Patrick Stewart, Gates McFadden, LeVar Burton and Michael Dorn, reprise their famous roles on "Star Trek: Picard."
Lebanon, Slovenia, UAE lead interest in AI Crypto
Lebanon, Slovenia, and the United Arab Emirates (UAE) are the top three countries that are most interested in Artificial Intelligence (AI) crypto, according to CoinGecko's recent report. Countries with major economic problems, like Nigeria, Sri Lanka, and Pakistan, have also ranked higher in the charts -- while the U.S. was placed 33rd, the CoinGecko report stated. The report measured the search popularity of 14 English search terms related to AI crypto between Nov. 30, 2022, and Feb. 16. A 100 indicates maximum popularity, while 50 indicates half -- zero would mean there was not enough data to examine. Lebanon scored 100 on almost all 14 search terms -- collecting 1,200 points and ranking first on the list.
Can 'we the people' keep AI in check? • TechCrunch
Technologist and researcher Aviv Ovadya isn't sure that generative AI can be governed, but he thinks the most plausible means of keeping it in check might just be entrusting those who will be impacted by AI to collectively decide on the ways to curb it. That means you; it means me. It's the power of large networks of individuals to problem solve faster and more equitably than a small group of individuals might do alone (including, say, in Washington). In Taiwan, for example, civic-minded hackers in 2015 formed a platform -- "virtual Taiwan" -- that "brings together representatives from the public, private and social sectors to debate policy solutions to problems primarily related to the digital economy," as explained in 2019 by Taiwan's digital minister, Audrey Tang in the New York Times. Since then, vTaiwan, as it's known, has tackled dozens of issues by "relying on a mix of online debate and face-to-face discussions with stakeholders," Tang wrote at the time.
Descartes: Generating Short Descriptions of Wikipedia Articles
Sakota, Marija, Peyrard, Maxime, West, Robert
Wikipedia is one of the richest knowledge sources on the Web today. In order to facilitate navigating, searching, and maintaining its content, Wikipedia's guidelines state that all articles should be annotated with a so-called short description indicating the article's topic (e.g., the short description of beer is "Alcoholic drink made from fermented cereal grains"). Nonetheless, a large fraction of articles (ranging from 10.2% in Dutch to 99.7% in Kazakh) have no short description yet, with detrimental effects for millions of Wikipedia users. Motivated by this problem, we introduce the novel task of automatically generating short descriptions for Wikipedia articles and propose Descartes, a multilingual model for tackling it. Descartes integrates three sources of information to generate an article description in a target language: the text of the article in all its language versions, the already-existing descriptions (if any) of the article in other languages, and semantic type information obtained from a knowledge graph. We evaluate a Descartes model trained for handling 25 languages simultaneously, showing that it beats baselines (including a strong translation-based baseline) and performs on par with monolingual models tailored for specific languages. A human evaluation on three languages further shows that the quality of Descartes's descriptions is largely indistinguishable from that of human-written descriptions; e.g., 91.3% of our English descriptions (vs. 92.1% of human-written descriptions) pass the bar for inclusion in Wikipedia, suggesting that Descartes is ready for production, with the potential to support human editors in filling a major gap in today's Wikipedia across languages.