Goto

Collaborating Authors

 Media


From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscape

arXiv.org Artificial Intelligence

This comprehensive survey explored the evolving landscape of generative Artificial Intelligence (AI), with a specific focus on the transformative impacts of Mixture of Experts (MoE), multimodal learning, and the speculated advancements towards Artificial General Intelligence (AGI). It critically examined the current state and future trajectory of generative Artificial Intelligence (AI), exploring how innovations like Google's Gemini and the anticipated OpenAI Q* project are reshaping research priorities and applications across various domains, including an impact analysis on the generative AI research taxonomy. It assessed the computational challenges, scalability, and real-world implications of these technologies while highlighting their potential in driving significant progress in fields like healthcare, finance, and education. It also addressed the emerging academic challenges posed by the proliferation of both AI-themed and AI-generated preprints, examining their impact on the peer-review process and scholarly communication. The study highlighted the importance of incorporating ethical and human-centric methods in AI development, ensuring alignment with societal norms and welfare, and outlined a strategy for future AI research that focuses on a balanced and conscientious use of MoE, multimodality, and AGI in generative AI.


Do LLMs Work on Charts? Designing Few-Shot Prompts for Chart Question Answering and Summarization

arXiv.org Artificial Intelligence

A number of tasks have been proposed recently to facilitate easy access to charts such as chart QA and summarization. The dominant paradigm to solve these tasks has been to fine-tune a pretrained model on the task data. However, this approach is not only expensive but also not generalizable to unseen tasks. On the other hand, large language models (LLMs) have shown impressive generalization capabilities to unseen tasks with zero- or few-shot prompting. However, their application to chart-related tasks is not trivial as these tasks typically involve considering not only the underlying data but also the visual features in the chart image. We propose PromptChart, a multimodal few-shot prompting framework with LLMs for chart-related applications. By analyzing the tasks carefully, we have come up with a set of prompting guidelines for each task to elicit the best few-shot performance from LLMs. We further propose a strategy to inject visual information into the prompts. Our experiments on three different chart-related information consumption tasks show that with properly designed prompts LLMs can excel on the benchmarks, achieving state-of-the-art.


Human Voice Pitch Estimation: A Convolutional Network with Auto-Labeled and Synthetic Data

arXiv.org Artificial Intelligence

In the domain of music and sound processing, pitch extraction plays a pivotal role. Our research presents a specialized convolutional neural network designed for pitch extraction, particularly from the human singing voice in acapella performances. Notably, our approach combines synthetic data with auto-labeled acapella sung audio, creating a robust training environment. Evaluation across datasets--comprising synthetic sounds, opera recordings, and time-stretched vowels--demonstrates its efficacy. This work paves the way for enhanced pitch extraction in both music and voice settings.


All in One: Multi-task Prompting for Graph Neural Networks

arXiv.org Artificial Intelligence

Recently, ''pre-training and fine-tuning'' has been adopted as a standard workflow for many graph tasks since it can take general graph knowledge to relieve the lack of graph annotations from each application. However, graph tasks with node level, edge level, and graph level are far diversified, making the pre-training pretext often incompatible with these multiple tasks. This gap may even cause a ''negative transfer'' to the specific application, leading to poor results. Inspired by the prompt learning in natural language processing (NLP), which has presented significant effectiveness in leveraging prior knowledge for various NLP tasks, we study the prompting topic for graphs with the motivation of filling the gap between pre-trained models and various graph tasks. In this paper, we propose a novel multi-task prompting method for graph models. Specifically, we first unify the format of graph prompts and language prompts with the prompt token, token structure, and inserting pattern. In this way, the prompting idea from NLP can be seamlessly introduced to the graph area. Then, to further narrow the gap between various graph tasks and state-of-the-art pre-training strategies, we further study the task space of various graph applications and reformulate downstream problems to the graph-level task. Afterward, we introduce meta-learning to efficiently learn a better initialization for the multi-task prompt of graphs so that our prompting framework can be more reliable and general for different tasks. We conduct extensive experiments, results from which demonstrate the superiority of our method.


ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding

arXiv.org Machine Learning

We introduce ZeroSCROLLS, a zero-shot benchmark for natural language understanding over long texts, which contains only test and small validation sets, without training data. We adapt six tasks from the SCROLLS benchmark, and add four new datasets, including two novel information fusing tasks, such as aggregating the percentage of positive reviews. Using ZeroSCROLLS, we conduct a comprehensive evaluation of both open-source and closed large language models, finding that Claude outperforms ChatGPT, and that GPT-4 achieves the highest average score. However, there is still room for improvement on multiple open challenges in ZeroSCROLLS, such as aggregation tasks, where models struggle to pass the naive baseline. As the state of the art is a moving target, we invite researchers to evaluate their ideas on the live ZeroSCROLLS leaderboard.


Ice-T OK with AI avatar playing his roles forever, wonders if digital double would be skillful in bed

FOX News

Ice-T was honored with a star on the Hollywood Walk of Fame on Feb. 17. Rapper and TV drama mainstay Ice-T recently claimed he's open to the idea of artificial intelligence being used to create a digital double of himself that can act long after he's gone. However, he is cautious about one thing: whether his future avatar has the requisite skills in the bedroom. The "Law & Order: Special Victims Unit" star expressed he was fine with the notion that an AI version of him might reprise his roles indefinitely. "I think Ice-T could potentially act forever," Ice-T, whose real name is Tracy Marrow, told Page Six. The star was interviewed before hosting a book launch for Mark Minevich's "Our Planet Powered by AI." Rapper Ice-T recently claimed hed be fine if an AI-generated version of himself played his TV and movie roles long into the future.


A seeing AI app now on Android is a game changer for the visually impaired

FOX News

Kurt'CyberGuy' Knutsson explains the value of an AI app for the visually impaired Have you ever struggled to see something in the dark, or to read a small print or to recognize a familiar face? If you have, you are not alone. Many people face these challenges every day, and they can affect their quality of life and independence. But what if there were a way to enhance your vision with the power of artificial intelligence? CLICK TO GET KURT'S FREE CYBERGUY NEWSLETTER WITH SECURITY ALERTS, QUICK VIDEO TIPS, TECH REVIEWS, AND EASY HOW-TO'S TO MAKE YOU SMARTER Seeing AI is an app that uses artificial intelligence to lend a hand when it's hard to see things around you.


Samer Abu Daqqa: Al Jazeera cameraman killed in Gaza drone strike

BBC News

The Foreign Press Association (FPA), which represents several hundred journalists working for international news organisations, said it grieved the cameraman's death.


The 2024 Golden Globe winners, as predicted by AI - so do you agree with its suggestions?

Daily Mail - Science & tech

After months of anticipation, the 2024 Golden Globes nominees were finally announced this week. From popstar Dua Lipa to actress Hannah Waddingham, plenty of British and Irish stars managed to earn themselves top nods. But while the stars will have to wait until 7 January to discover their fate, we let curiosity get the better of us and enlisted AI to help predict the results. MailOnline gave Google's Bard the list of nominees and asked it to guess the winners, based on past trends and current reviews. So, do you agree with its predictions?


Paloma: A Benchmark for Evaluating Language Model Fit

arXiv.org Artificial Intelligence

Language models (LMs) commonly report perplexity on monolithic data held out from training. Implicitly or explicitly, this data is composed of domains$\unicode{x2013}$varying distributions of language. Rather than assuming perplexity on one distribution extrapolates to others, Perplexity Analysis for Language Model Assessment (Paloma), measures LM fit to 585 text domains, ranging from nytimes.com to r/depression on Reddit. We invite submissions to our benchmark and organize results by comparability based on compliance with guidelines such as removal of benchmark contamination from pretraining. Submissions can also record parameter and training token count to make comparisons of Pareto efficiency for performance as a function of these measures of cost. We populate our benchmark with results from 6 baselines pretrained on popular corpora. In case studies, we demonstrate analyses that are possible with Paloma, such as finding that pretraining without data beyond Common Crawl leads to inconsistent fit to many domains.