Goto

Collaborating Authors

 Large Language Model


OpenAI CEO Sam Altman says Elon Musk-backed letter calling for AI pause wasn't 'optimal way to address it'

FOX News

Twitter and Tesla CEO Elon Musk weighs in on the dangers of artificial intelligence, the future of Twitter and more in an exclusive'Tucker Carlson Tonight' interview. OpenAI CEO Sam Altman says that a letter signed by Twitter CEO Elon Musk and others in the technology community calling for a pause on "giant AI experiments" wasn't the right way to address the issue. Musk, Steve Wozniak, and other tech leaders signed the letter in March, which asked AI developers to "immediately pause for at least 6 months the training of AI systems more powerful than GPT-4." During a virtual appearance at the Massachusetts Institute of Technology on Thursday, Altman addressed the letter. "There's parts of the thrust that I really agree with," Altman said, adding that his team spent more than six months after completing the training of ChatGPT 4 to study safety components before it was released.


Exclusive: Is Goldman Sachs preparing its own AI chatbot?

#artificialintelligence

Argenti also likened the advent of powerful generative artificial intelligence systems such as ChatGPT to the invention of the printing press, and predicted the technology will transform how businesses store and organize institutional knowledge, according to the email. He also raised the question of whether A.I. could make rising inequality worse. Goldman Sachs declined to comment on Argenti's message. In the email, Argenti said that while others have said generative A.I. will be more impactful than the discovery of fire, the debut of the internet, or the move to cloud computing, he believed that a better analogy is the invention of the printing press, which had the effect of both democratizing access to knowledge as well as massively accelerating the codification of knowledge. Argenti said that while "efficiency gains are capturing a lot of the mindshare" he believed "LLMs are a breakthrough in knowledge more than they are in productivity."


Elon Musk has created his own artificial intelligence company

Engadget

Elon Musk, who's been vocally critical about artificial intelligence lately, seems to be planning something AI related. According to The Wall Street Journal and The Financial Times, Musk has founded a new artificial intelligence company called X.AI Corp. Based on a state filing from last month that the sources have viewed, the new company is incorporated in Nevada and lists Musk as the sole director, as well as Jared Birchall, the director of his family's offices, as the secretary. The multi-company executive is known to have a special affinity for the letter "X" and has even recently renamed Twitter, Inc. as X Corp. Musk is no stranger to AI projects. He co-founded OpenAI before leaving the company almost a decade ago.


LUT-GEMM: Quantized Matrix Multiplication based on LUTs for Efficient Inference in Large-Scale Generative Language Models

arXiv.org Artificial Intelligence

The recent advancements in self-supervised learning, combined with the Transformer architecture, have enabled natural language processing (NLP) to achieve remarkably low perplexity. However, powerful NLP models necessitate increasing model size, leading to substantial computational and memory requirements. In this paper, we introduce an efficient inference framework tailored for large-scale generative language models. To reduce the model size, we employ a weight-only quantization strategy while preserving full precision for activations. As a result, we attain sub-4-bit quantization for each weight through non-uniform or uniform quantization techniques. Our proposed kernel, called LUT-GEMM, then accelerates quantized matrix multiplications, offering a flexible balance between compression ratio and accuracy. Unlike earlier matrix multiplication kernels that accommodated weight-only quantization, LUT-GEMM efficiently eliminates the resource-demanding dequantization process for both uniform and non-uniform quantization methods. By reducing the latency of individual GPUs and the overall inference process for large-scale language models, LUT-GEMM provides significant performance improvements in inference. The impact of LUT-GEMM is facilitated by implementing high compression ratios through low-bit quantization and efficient LUT-based operations, which decreases the number of required GPUs. For the OPT-175B model with 3-bit quantization, we show that LUT-GEMM accelerates the latency for generating each token by 2.1x compared to OPTQ, which requires costly dequantization. Consequently, LUT-GEMM enables inference of the OPT-175B model on a single GPU without noticeable degradation in accuracy or performance, while the non-quantized OPT-175B model requires a minimum of 8 GPUs.


Analyzing the Performance of ChatGPT in Cardiology and Vascular Pathologies

arXiv.org Artificial Intelligence

The article aims to analyze the performance of ChatGPT, a large language model developed by OpenAI, in the context of cardiology and vascular pathologies. The study evaluated the accuracy of ChatGPT in answering challenging multiple-choice questions (QCM) using a dataset of 190 questions from the Siamois-QCM platform. The goal was to assess ChatGPT potential as a valuable tool in medical education compared to two well-ranked students of medicine. The results showed that ChatGPT outperformed the students, scoring 175 out of 190 correct answers with a percentage of 92.10\%, while the two students achieved scores of 163 and 159 with percentages of 85.78\% and 82.63\%, respectively. These results showcase how ChatGPT has the potential to be highly effective in the fields of cardiology and vascular pathologies by providing accurate answers to relevant questions.


Elon Musk is reportedly planning an A.I. startup to compete with OpenAI, which he cofounded

#artificialintelligence

Tesla CEO Elon Musk is planning to launch an artificial intelligence startup that would go head-to-head with OpenAI, the Financial Times reported Friday. Musk -- the CEO of Tesla, SpaceX and Twitter -- has been building a team of researchers and engineers and has been in conversation with multiple investors, the Financial Times reported, citing sources familiar with the matter. He has also reportedly been recruiting from other top AI firms, including Alphabet-owned DeepMind. "It's real and they are excited about it," a source familiar with the matter told the Financial Times. Musk has secured thousands of Nvidia GPU processors, according to the report.


ChatGPT And More: Large Scale AI Models Entrench Big Tech Power - AI Now Institute

#artificialintelligence

These narratives distract from what we call the "pathologies of scale" that become more entrenched every day: large-scale AI models are still largely controlled by Big Tech firms because of the enormous computing and data resources they require, and also present well-documented concerns around discrimination, privacy and security vulnerabilities, and negative environmental impacts. Large-scale AI models like Large Language Models (LLMs) have received the most hype, and fear-mongering, over the past year. "Opinion You Can Have the Blue Pill or the Red Pill, and We're Out of Blue Pills." Greg Noone, "'Foundation models' may be the future of AI. They're also deeply flawed," Tech Monitor, November 11, 2021 (updated February 9, 2023); Dan McQuillan, "We Come to Bury ChatGPT, Not to Praise It," danmcquillan.org,


Four reasons why you should start with Bing Chat instead of ChatGPT

#artificialintelligence

You've probably heard a lot about both Bing Chat and ChatGPT in recent weeks. Generative AI is here to stay and even if it's not something you can see yourself using in the long term, it's certainly worth trying these tools out and educating yourself a little more on them. Bing Chat is in some ways quite like ChatGPT. Microsoft is a big investor in OpenAI, the company behind ChatGPT, and uses the latest GPT-4 model in the backend of Bing Chat. So, there are definite similarities in the way the two operate.


Elon Musk plans AI startup to rival OpenAI, report says

The Japan Times

Billionaire Elon Musk is working on launching an artificial intelligence start-up that will rival ChatGPT-maker OpenAI, the Financial Times reported on Friday, citing people familiar with his plans. Twitter-owner Musk is assembling a team of AI researchers and engineers, according to the FT report, and is also in discussions with some investors in SpaceX and Tesla about putting money into his new venture. Musk's plan for the firm comes weeks after a group of AI researchers and executives, including himself, called for a six-month pause in developing systems more powerful than OpenAI's GPT-4, citing potential risks to society. This could be due to a conflict with your ad-blocking or security software. Please add japantimes.co.jp and piano.io to your list of allowed sites.


Nvidia's top A.I. chips are selling for more than $40,000 on eBay

#artificialintelligence

Nvidia's most-advanced graphics cards are selling for more than $40,000 on eBay, as demand soars for chips needed to train and deploy artificial intelligence software. The prices for Nvidia's H100 processors were noted by 3D gaming pioneer and former Meta consulting technology chief John Carmack on Twitter. On Friday, at least eight H100s were listed on eBay at prices ranging from $39,995 to just under $46,000. Some retailers have offered it in the past for around $36,000. The H100, announced last year, is Nvidia's latest flagship AI chip, succeeding the A100, a roughly $10,000 chip that's been called the "workhorse" for AI applications.