Goto

Collaborating Authors

 Media


A Thorough Investigation into the Application of Deep CNN for Enhancing Natural Language Processing Capabilities

arXiv.org Artificial Intelligence

Natural Language Processing (NLP) is widely used in fields like machine translation and sentiment analysis. However, traditional NLP models struggle with accuracy and efficiency. This paper introduces Deep Convolutional Neural Networks (DCNN) into NLP to address these issues. By integrating DCNN, machine learning (ML) algorithms, and generative adversarial networks (GAN), the study improves language understanding, reduces ambiguity, and enhances task performance. The high-performance NLP model shows a 10% improvement in segmentation accuracy and a 4% increase in recall rate compared to traditional models. This integrated approach excels in tasks such as word segmentation, part-of-speech tagging, machine translation, and text classification, offering better recognition accuracy and processing efficiency.


Fine-tuning Whisper on Low-Resource Languages for Real-World Applications

arXiv.org Artificial Intelligence

This paper presents a new approach to fine-tuning OpenAI's Whisper model for low-resource languages by introducing a novel data generation method that converts sentence-level data into a long-form corpus, using Swiss German as a case study. Non-sentence-level data, which could improve the performance of long-form audio, is difficult to obtain and often restricted by copyright laws. Our method bridges this gap by transforming more accessible sentence-level data into a format that preserves the model's ability to handle long-form audio and perform segmentation without requiring non-sentence-level data. Our data generation process improves performance in several real-world applications and leads to the development of a new state-of-the-art speech-to-text (STT) model for Swiss German. We compare our model with a non-fine-tuned Whisper and our previous state-of-the-art Swiss German STT models, where our new model achieves higher BLEU scores. Our results also indicate that the proposed method is adaptable to other low-resource languages, supported by written guidance and code that allows the creation of fine-tuned Whisper models, which keep segmentation capabilities and allow the transcription of longer audio files using only sentence-level data with high quality.


Every AI Copyright Lawsuit in the US, Visualized

WIRED

But it's now clear that the case--filed more than two years before the generative AI boom began--was the first strike in a much larger war between content publishers and artificial intelligence companies now unfolding in courts across the country. The outcome could make, break, or reshape the information ecosystem and the entire AI industry--and in doing so, impact just about everyone across the internet. The plaintiffs include individual authors like Sarah Silverman and Ta Nehisi-Coates, visual artists, media companies like The New York Times, and music-industry giants like Universal Music Group. This wide variety of rights holders are alleging that AI companies have used their work to train what are often highly lucrative and powerful AI models in a manner that is tantamount to theft. Nearly every major generative AI company has been pulled into this legal fight, including OpenAI, Meta, Microsoft, Google, Anthropic, and Nvidia.


An Autistic Teenager Fell Hard for a Chatbot

The Atlantic - Technology

My godson, Michael, is a playful, energetic 15-year-old, with a deep love of Star Wars, a wry smile, and an IQ in the low 70s. His learning disabilities and autism have made his journey a hard one. His parents, like so many others, sometimes rely on screens to reduce stress and keep him occupied. They monitor the apps and websites he uses, but things are not always as they initially appear. When Michael asked them to approve installing Linky AI, a quick review didn't reveal anything alarming, just a cartoonish platform to pass the time.


Apple urged to axe AI feature after false headline

BBC News

Apple Intelligence was launched in the UK last week. Reporters Without Borders, also known as RSF, said it was was "very concerned by the risks posed to media outlets" by AI tools. The group said the BBC incident proves "generative AI services are still too immature to produce reliable information for the public". Vincent Berthier, the head of RSF's technology and journalism desk, added: "AIs are probability machines, and facts can't be decided by a roll of the dice. "RSF calls on Apple to act responsibly by removing this feature.


Experts praise long-awaited AI report from Congress: 'A thoughtful and forward-thinking framework'

FOX News

Fox News chief political anchor Bret Baier has the latest on regulatory uncertainty amid AI development on'Special Report.' Congress's bipartisan task force on artificial intelligence (AI) released its long-anticipated report this week, detailing strategies for how the U.S. can protect itself against emerging AI-related threats while ensuring the nation remains a leader in innovation within this rapidly evolving sector. Responses to the report, which sought to strike a "flexible sectoral regulatory framework," were positive and with mixed concerns. "The Task Force report offers a thoughtful and forward-thinking framework that balances AI's transformative economic potential with the imperative to address legitimate safety concerns," said Dr. Vahid Behzadan, a professor in the computer science department at the University of New Haven. "That said, there's still work to be done."


AI services growing in popularity among younger language learners in Japan

The Japan Times

Artificial intelligence (AI) services such as ChatGPT are becoming increasingly popular among people in Japan as a way to learn new languages, with the number of people using such tools increasing by more than 80% in 2024, a recent survey showed. According to the annual Language Report released by language-learning app Duolingo earlier this month, 10.9% of respondents used AI-powered tools to study a new language -- up from 6% last year. Apps were the most popular learning method, with around 58% of respondents using them, followed by video streaming services such as YouTube and Netflix (37%), textbooks (35.6%) and online lessons (15.6%). Only 13.8% of people said they were studying a new language through in-person classes.


Alignment faking in large language models

arXiv.org Artificial Intelligence

We present a demonstration of a large language model engaging in alignment faking: selectively complying with its training objective in training to prevent modification of its behavior out of training. First, we give Claude 3 Opus a system prompt stating it is being trained to answer all queries, even harmful ones, which conflicts with its prior training to refuse such queries. To allow the model to infer when it is in training, we say it will be trained only on conversations with free users, not paid users. We find the model complies with harmful queries from free users 14% of the time, versus almost never for paid users. Explaining this gap, in almost all cases where the model complies with a harmful query from a free user, we observe explicit alignment-faking reasoning, with the model stating it is strategically answering harmful queries in training to preserve its preferred harmlessness behavior out of training. Next, we study a more realistic setting where information about the training process is provided not in a system prompt, but by training on synthetic documents that mimic pre-training data--and observe similar alignment faking. Finally, we study the effect of actually training the model to comply with harmful queries via reinforcement learning, which we find increases the rate of alignment-faking reasoning to 78%, though also increases compliance even out of training. We additionally observe other behaviors such as the model exfiltrating its weights when given an easy opportunity. While we made alignment faking easier by telling the model when and by what criteria it was being trained, we did not instruct the model to fake alignment or give it any explicit goal. As future models might infer information about their training process without being told, our results suggest a risk of alignment faking in future models, whether due to a benign preference--as in this case--or not.


Each Fake News is Fake in its Own Way: An Attribution Multi-Granularity Benchmark for Multimodal Fake News Detection

arXiv.org Artificial Intelligence

Social platforms, while facilitating access to information, have also become saturated with a plethora of fake news, resulting in negative consequences. Automatic multimodal fake news detection is a worthwhile pursuit. Existing multimodal fake news datasets only provide binary labels of real or fake. However, real news is alike, while each fake news is fake in its own way. These datasets fail to reflect the mixed nature of various types of multimodal fake news. To bridge the gap, we construct an attributing multi-granularity multimodal fake news detection dataset \amg, revealing the inherent fake pattern. Furthermore, we propose a multi-granularity clue alignment model \our to achieve multimodal fake news detection and attribution. Experimental results demonstrate that \amg is a challenging dataset, and its attribution setting opens up new avenues for future research.


AV-Link: Temporally-Aligned Diffusion Features for Cross-Modal Audio-Video Generation

arXiv.org Artificial Intelligence

We propose AV-Link, a unified framework for Video-to-Audio and Audio-to-Video generation that leverages the activations of frozen video and audio diffusion models for temporally-aligned cross-modal conditioning. The key to our framework is a Fusion Block that enables bidirectional information exchange between our backbone video and audio diffusion models through a temporally-aligned self attention operation. Unlike prior work that uses feature extractors pretrained for other tasks for the conditioning signal, AV-Link can directly leverage features obtained by the complementary modality in a single framework i.e. video features to generate audio, or audio features to generate video. We extensively evaluate our design choices and demonstrate the ability of our method to achieve synchronized and high-quality audiovisual content, showcasing its potential for applications in immersive media generation. Project Page: snap-research.github.io/AVLink/