Goto

Collaborating Authors

 Media


In-Sensor Radio Frequency Computing for Energy-Efficient Intelligent Radar

arXiv.org Artificial Intelligence

Radio Frequency Neural Networks (RFNNs) have demonstrated advantages in realizing intelligent applications across various domains. However, as the model size of deep neural networks rapidly increases, implementing large-scale RFNN in practice requires an extensive number of RF interferometers and consumes a substantial amount of energy. To address this challenge, we propose to utilize low-rank decomposition to transform a large-scale RFNN into a compact RFNN while almost preserving its accuracy. Specifically, we develop a Tensor-Train RFNN (TT-RFNN) where each layer comprises a sequence of low-rank third-order tensors, leading to a notable reduction in parameter count, thereby optimizing RF interferometer utilization in comparison to the original large-scale RFNN. Additionally, considering the inherent physical errors when mapping TT-RFNN to RF device parameters in real-world deployment, from a general perspective, we construct the Robust TT-RFNN (RTT-RFNN) by incorporating a robustness solver on TT-RFNN to enhance its robustness. To adapt the RTT-RFNN to varying requirements of reshaping operations, we further provide a reconfigurable reshaping solution employing RF switch matrices. Empirical evaluations conducted on MNIST and CIFAR-10 datasets show the effectiveness of our proposed method.


Chatbots as social companions: How people perceive consciousness, human likeness, and social health benefits in machines

arXiv.org Artificial Intelligence

As artificial intelligence (AI) becomes more widespread, one question that arises is how human-AI interaction might impact human-human interaction. Chatbots, for example, are increasingly used as social companions, but little is known about how their use impacts human relationships. A common hypothesis is that these companion bots are detrimental to social health by harming or replacing human interaction. To understand how companion bots impact social health, we studied people who used companion bots and people who did not. Contrary to expectations, companion bot users indicated that these relationships were beneficial to their social health, whereas nonusers viewed them as harmful. Another common assumption is that people perceive conscious, humanlike AI as disturbing and threatening. Among both users and nonusers, however, we found the opposite: perceiving companion bots as more conscious and humanlike correlated with more positive opinions and better social health benefits. Humanlike bots may aid social health by supplying reliable and safe interactions, without necessarily harming human relationships.


Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity

arXiv.org Artificial Intelligence

This survey addresses the crucial issue of factuality in Large Language Models (LLMs). As LLMs find applications across diverse domains, the reliability and accuracy of their outputs become vital. We define the Factuality Issue as the probability of LLMs to produce content inconsistent with established facts. We first delve into the implications of these inaccuracies, highlighting the potential consequences and challenges posed by factual errors in LLM outputs. Subsequently, we analyze the mechanisms through which LLMs store and process facts, seeking the primary causes of factual errors. Our discussion then transitions to methodologies for evaluating LLM factuality, emphasizing key metrics, benchmarks, and studies. We further explore strategies for enhancing LLM factuality, including approaches tailored for specific domains. We focus two primary LLM configurations standalone LLMs and Retrieval-Augmented LLMs that utilizes external data, we detail their unique challenges and potential enhancements. Our survey offers a structured guide for researchers aiming to fortify the factual reliability of LLMs.


A General Search-based Framework for Generating Textual Counterfactual Explanations

arXiv.org Artificial Intelligence

One of the prominent methods for explaining the decision of a machine-learning classifier is by a counterfactual example. Most current algorithms for generating such examples in the textual domain are based on generative language models. Generative models, however, are trained to minimize a specific loss function in order to fulfill certain requirements for the generated texts. Any change in the requirements may necessitate costly retraining, thus potentially limiting their applicability. In this paper, we present a general search-based framework for generating counterfactual explanations in the textual domain. Our framework is model-agnostic, domain-agnostic, anytime, and does not require retraining in order to adapt to changes in the user requirements. We model the task as a search problem in a space where the initial state is the classified text, and the goal state is a text in a given target class. Our framework includes domain-independent modification operators, but can also exploit domain-specific knowledge through specialized operators. The search algorithm attempts to find a text from the target class with minimal user-specified distance from the original classified object.


UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluation

arXiv.org Artificial Intelligence

Large Language Models (LLMs) are popular for their impressive abilities, but the need for model-specific fine-tuning or task-specific prompt engineering can hinder their generalization. We propose UPRISE (Universal Prompt Retrieval for Improving zero-Shot Evaluation), which tunes a lightweight and versatile retriever that automatically retrieves prompts for a given zero-shot task input. Specifically, we demonstrate universality in a cross-task and cross-model scenario: the retriever is tuned on a diverse set of tasks, but tested on unseen task types; we use a small frozen LLM, GPT-Neo-2.7B, for tuning the retriever, but test the retriever on different LLMs of much larger scales, such as BLOOM-7.1B, OPT-66B and GPT3-175B. Additionally, we show that UPRISE mitigates the hallucination problem in our experiments with ChatGPT, suggesting its potential to improve even the strongest LLMs. Our model and code are available at https://github.com/microsoft/LMOps.


The Year in Moviegoing

The New Yorker

As yet, we cannot tell whether 2023 will be remembered for the movies that we saw or for the movies that were hobbled and hog-tied by industrial action. The strikes called by SAG-AFTRA and the Writers Guild of America caused productions to be paused and release dates to be pushed back. If you missed Jeff Nichols's new film, "The Bikeriders," with Austin Butler and Tom Hardy, when it kicked off the Telluride Film Festival, at the end of August, but hoped to see it when it opened in early December, tough. Having been passed from one studio to another--20th Century Studios to Focus Features--like a difficult foster child, the movie will now be sent forth into the world next year. Amid this gloom, there were sparks of cheering news; not all artistic endeavors fell afoul of the strikes.


Apple is adapting the Hugo Award-winning sci-fi book series Murderbot

Engadget

The Hugo Award-winning The Murderbot Diaries books from Martha Wells are becoming a 10-episode Apple TV series starring Alexander Skarsgård, Apple announced. It will follow a self-aware "SecUnit" robot that must hide its free will in order to complete a dangerous assignment and comes from About a Boy creators Chris and Paul Weitz. "Murderbot is an action-packed sci-fi series, based on the award-winning books by Wells, about a self-hacking security android who is horrified by human emotion yet drawn to its vulnerable'clients,'" Apple wrote. "Murderbot must hide its free will and complete a dangerous assignment when all it really wants is to be left alone to watch futuristic soap operas and figure out its place in the universe." The Weitz brothers will write, direct and produce the series, while Skarsgård will also serve as executive producer.


Jack Black doesn't believe AI is 'all doom and gloom': It's not going 'to be like Terminator'

FOX News

Marva Bailer, a tech executive, author, and speaker, shares why utilizing AI may be more expensive than physical actors. "Super Mario Bros." star Jack Black is feeling positive about the future with artificial intelligence, even with lingering concerns over the technology in the industry. "It's so new that it's hard to really say what the future holds, but I don't have all doom and gloom," he told The Hollywood Reporter. "I don't feel like, 'Oh no, it's going to be like Terminator where it comes and destroys all the human jobs.' I'm not convinced about that because I can admit, I don't know, and I'm hoping that it's going to be a great new world and that it's going to be a tool that all of us can use to make ourselves better and make the world better."


Pipeline and Dataset Generation for Automated Fact-checking in Almost Any Language

arXiv.org Artificial Intelligence

This article presents a pipeline for automated fact-checking leveraging publicly available Language Models and data. The objective is to assess the accuracy of textual claims using evidence from a ground-truth evidence corpus. The pipeline consists of two main modules -- the evidence retrieval and the claim veracity evaluation. Our primary focus is on the ease of deployment in various languages that remain unexplored in the field of automated fact-checking. Unlike most similar pipelines, which work with evidence sentences, our pipeline processes data on a paragraph level, simplifying the overall architecture and data requirements. Given the high cost of annotating language-specific fact-checking training data, our solution builds on the Question Answering for Claim Generation (QACG) method, which we adapt and use to generate the data for all models of the pipeline. Our strategy enables the introduction of new languages through machine translation of only two fixed datasets of moderate size. Subsequently, any number of training samples can be generated based on an evidence corpus in the target language. We provide open access to all data and fine-tuned models for Czech, English, Polish, and Slovak pipelines, as well as to our codebase that may be used to reproduce the results.We comprehensively evaluate the pipelines for all four languages, including human annotations and per-sample difficulty assessment using Pointwise V-information. The presented experiments are based on full Wikipedia snapshots to promote reproducibility. To facilitate implementation and user interaction, we develop the FactSearch application featuring the proposed pipeline and the preliminary feedback on its performance.


Towards the Unification of Generative and Discriminative Visual Foundation Model: A Survey

arXiv.org Artificial Intelligence

The advent of foundation models, which are pre-trained on vast datasets, has ushered in a new era of computer vision, characterized by their robustness and remarkable zero-shot generalization capabilities. Mirroring the transformative impact of foundation models like large language models (LLMs) in natural language processing, visual foundation models (VFMs) have become a catalyst for groundbreaking developments in computer vision. This review paper delineates the pivotal trajectories of VFMs, emphasizing their scalability and proficiency in generative tasks such as text-to-image synthesis, as well as their adeptness in discriminative tasks including image segmentation. While generative and discriminative models have historically charted distinct paths, we undertake a comprehensive examination of the recent strides made by VFMs in both domains, elucidating their origins, seminal breakthroughs, and pivotal methodologies. Additionally, we collate and discuss the extensive resources that facilitate the development of VFMs and address the challenges that pave the way for future research endeavors. A crucial direction for forthcoming innovation is the amalgamation of generative and discriminative paradigms. The nascent application of generative models within discriminative contexts signifies the early stages of this confluence. This survey aspires to be a contemporary compendium for scholars and practitioners alike, charting the course of VFMs and illuminating their multifaceted landscape.