Goto

Collaborating Authors

 Large Language Model


'I'm over knife attack,' says Salman Rushdie

BBC News

When asked about the effect of AI on authors, Sir Salman said: "I don't have Chat GPT... I try very hard to pretend it doesn't exist. Someone asked it to write a couple of hundred words like me... it was terrible. And it has no sense of humour." Despite being considered one of the greatest living writers, Sir Salman joked that authors "don't even have that much money... except the two of us (him and host Erica Wagner) and those who write about child wizards... the Taylor Swift of literature," referring to JK Rowling.


US lawyer sanctioned after caught using ChatGPT for court brief

The Guardian

The Utah court of appeals has sanctioned a lawyer after he was discovered to have used ChatGPT for a filing he made in which he referenced a nonexistent court case. Earlier this week, the Utah court of appeals made the decision to sanction Richard Bednar over claims that he filed a brief which included false citations. According to court documents reviewed by ABC4, Bednar and Douglas Durbano, another Utah-based lawyer who was serving as the petitioner's counsel, filed a "timely petition for interlocutory appeal". Upon reviewing the brief which was written by a law clerk, the respondent's counsel found several false citations of cases. "It appears that at least some portions of the Petition may be AI-generated, including citations and even quotations to at least one case that does not appear to exist in any legal database (and could only be found in ChatGPT and references to cases that are wholly unrelated to the referenced subject matter," the respondent's counsel said in documents reviewed by ABC4.


Review for NeurIPS paper: MPNet: Masked and Permuted Pre-training for Language Understanding

Neural Information Processing Systems

Summary and Contributions: In this paper, the authors propose a new pre-trained language model called MPNet, which combines the advantages of both BERT (MLM) and XLNet (PLM). The proposed MPNet leverages the dependency among predicted tokens through PLM and takes auxiliary position information as input to reduce the position discrepancy. In practice, to combine MLM and PLM poses great challenge, and the authors propose several delicate designs to overcome the issues. The experiments are mainly carried out on a base model (i.e., 110M params), and the results show that the proposed MPNet could give consistent and significant improvements over similar baseline models. Overall, the idea of the paper is straightforward and easy to understand, which is a natural extension to combine the MLM and PLM.


Review for NeurIPS paper: MPNet: Masked and Permuted Pre-training for Language Understanding

Neural Information Processing Systems

This paper proposes a new approach to self-supervised pretraining on text, building very closely on prior work in BERT and XLNet. The paper demonstrates that the approach yields models that are noticably better than comparable models from prior work, and isolates the reason for this in a reasonably thorough ablation. While one reviewer raises concerns about the quality of comparisons, I'm convinced that they are already pretty much up to the standards of the field, and will be fully satisfactory after the promised revisions/additions. While this work is perhaps somewhat incremental, the method is effective and relevant to a highly prominent open problem in ML for text.


Future-proof your career by mastering AI skills for just 20

Popular Science

If you're starting to feel a little behind in your career because you aren't completely proficient with AI, you don't need to worry. Even beginners can quickly master valuable AI skills without any tech background in the ChatGPT & Automation E-Degree program, and it's on sale right now for just 19.97 This program offers 12 captivating modules that allow you to immerse yourself in more than 25 hours of engaging coursework. It will transform your perception of the digital world. You'll master ChatGPT and over 20 AI tools that are indispensable in facing the dynamic challenges in today's coding, business, and marketing industries.


Fox News AI Newsletter: Scammers can exploit your data from just 1 ChatGPT search

FOX News

Welcome to Fox News' Artificial Intelligence newsletter with the latest AI technology advancements. IN TODAY'S NEWSLETTER: - Scammers can exploit your data from just one ChatGPT search - Business Insider embraces AI while laying off 21% of workforce - Nvidia, Dell partner with Trump admin to make next-gen supercomputer GUARD YOUR DATA: ChatGPT and other large language models (LLMs) have become amazing helpers for everyday tasks. Whether it's summarizing complex ideas, designing a birthday card or even planning your apartment's layout, you can get impressive results with just a simple prompt. NEWS BREAK: Business Insider announced Thursday that the company will be shrinking the size of its newsroom and making layoffs, impacting over a fifth of its staff. Business Insider CEO Barbara Peng said in an internal memo obtained by Fox News Digital that the company is "fully embracing AI," as 70% of the company's staff currently uses Enterprise ChatGPT, with a goal of 100%.


'One day I overheard my boss saying: just put it in ChatGPT': the workers who lost their jobs to AI

The Guardian

I've been a freelance journalist for 10 years, usually writing for magazines and websites about cinema. I presented a morning show on Radio Krakรณw twice a week for about two years. It was only one part of my work, but I really enjoyed it. It was about culture and cinema, and featured a range of people, from artists to activists. I remember interviewing Ukrainians about the Russian invasion for the first programme I presented, back in 2022. I was let go in August 2024, alongside a dozen co-workers who were also part-time. We were told the radio station was having financial problems.


AmoebaLLM: Constructing Any-Shape Large Language Models for Efficient and Instant Deployment

Neural Information Processing Systems

Motivated by the transformative capabilities of large language models (LLMs) across various natural language tasks, there has been a growing demand to deploy these models effectively across diverse real-world applications and platforms. However, the challenge of efficiently deploying LLMs has become increasingly pronounced due to the varying application-specific performance requirements and the rapid evolution of computational platforms, which feature diverse resource constraints and deployment flows. These varying requirements necessitate LLMs that can adapt their structures (depth and width) for optimal efficiency across different platforms and application specifications. To address this critical gap, we propose AmoebaLLM, a novel framework designed to enable the instant derivation of LLM subnets of arbitrary shapes, which achieve the accuracy-efficiency frontier and can be extracted immediately after a one-time fine-tuning. In this way, AmoebaLLM significantly facilitates rapid deployment tailored to various platforms and applications.


DiReCT: Diagnostic Reasoning for Clinical Notes via Large Language Models

Neural Information Processing Systems

Large language models (LLMs) have recently showcased remarkable capabilities, spanning a wide range of tasks and applications, including those in the medical domain. Models like GPT-4 excel in medical question answering but may face challenges in the lack of interpretability when handling complex tasks in real clinical settings. We thus introduce the diagnostic reasoning dataset for clinical notes (DiReCT), aiming at evaluating the reasoning ability and interpretability of LLMs compared to human doctors. It contains 511 clinical notes, each meticulously annotated by physicians, detailing the diagnostic reasoning process from observations in a clinical note to the final diagnosis. Additionally, a diagnostic knowledge graph is provided to offer essential knowledge for reasoning, which may not be covered in the training data of existing LLMs.


Plaud Note review: Smart, simple AI transcription in a tiny package

PCWorld

Plaud Note is a compact AI-powered voice recorder that automatically transcribes audio into text in 112 languages. It magnetically attaches to your phone, has long battery life, and saves time for both journalists and everyday users. The Plaude Note is built for users who want to capture conversations and quickly convert audio into text. If I'd had one of these when I started writing over 30 years ago, I could've saved myself weeks of work! But the Plaude Note isn't just for journalists, it's equally handy if you need to record a doctor's advice during an appointment and later share it with the Social Security office, an insurance company, or anyone else who needs the information in writing.