Goto

Collaborating Authors

 Large Language Model


AI and the FCI: Can ChatGPT Project an Understanding of Introductory Physics?

arXiv.org Artificial Intelligence

ChatGPT is a groundbreaking ``chatbot"--an AI interface built on a large language model that was trained on an enormous corpus of human text to emulate human conversation. Beyond its ability to converse in a plausible way, it has attracted attention for its ability to competently answer questions from the bar exam and from MBA coursework, and to provide useful assistance in writing computer code. These apparent abilities have prompted discussion of ChatGPT as both a threat to the integrity of higher education and conversely as a powerful teaching tool. In this work we present a preliminary analysis of how two versions of ChatGPT (ChatGPT3.5 and ChatGPT4) fare in the field of first-semester university physics, using a modified version of the Force Concept Inventory (FCI) to assess whether it can give correct responses to conceptual physics questions about kinematics and Newtonian dynamics. We demonstrate that, by some measures, ChatGPT3.5 can match or exceed the median performance of a university student who has completed one semester of college physics, though its performance is notably uneven and the results are nuanced. By these same measures, we find that ChatGPT4's performance is approaching the point of being indistinguishable from that of an expert physicist when it comes to introductory mechanics topics. After the completion of our work we became aware of Ref [1], which preceded us to publication and which completes an extensive analysis of the abilities of ChatGPT3.5 in a physics class, including a different modified version of the FCI. We view this work as confirming that portion of their results, and extending the analysis to ChatGPT4, which shows rapid and notable improvement in most, but not all respects.


Koala: An Index for Quantifying Overlaps with Pre-training Corpora

arXiv.org Artificial Intelligence

In very recent years more attention has been placed on probing the role of pre-training data in Large Language Models (LLMs) downstream behaviour. Despite the importance, there is no public tool that supports such analysis of pre-training corpora at large scale. To help research in this space, we launch Koala, a searchable index over large pre-training corpora using compressed suffix arrays with highly efficient compression rate and search support. In its first release we index the public proportion of OPT 175B pre-training data. Koala provides a framework to do forensic analysis on the current and future benchmarks as well as to assess the degree of memorization in the output from the LLMs. Koala is available for public use at https://koala-index.erc.monash.edu/.


AI as Agency Without Intelligence: On ChatGPT, Large Language Models, and Other Generative Models by Luciano Floridi :: SSRN

#artificialintelligence

The article argues that these LLMs can process texts with extraordinary success and often in a way that is indistinguishable from human output, while lacking any intelligence, understanding or cognitive ability. It also highlights the limitations of these LLMs, such as their brittleness (susceptibility to catastrophic failure), unreliability (false or made-up information), and the occasional inability to make elementary logical inferences or deal with simple mathematics. The article concludes that LLMs, represent a decoupling of agency and intelligence. While extremely powerful and potentially very useful, they should not be relied upon for complex reasoning or crucial information, but could be used to gain a deeper understanding of a text's content and context, rather than as a replacement for human input. The best author is neither an LLM nor a human being, but a human being using an LLM proficiently and insightfully.


Artificial intelligence 'godfather' on AI possibly wiping out humanity: 'It's not inconceivable'

FOX News

Fox News correspondent Mark Meredith has the latest on ChatGPT on'Special Report.' Geoffrey Hinton, a computer scientist who has been called "the godfather of artificial intelligence", says it is "not inconceivable" that AI may develop to the point where it poses a threat to humanity. The computer scientist sat down with CBS News this week about his predictions for the advancement of AI. He compared the invention of AI to electricity or the wheel. Hinton, who works at Google and the University of Toronto, said that the development of general purpose AI is progressing sooner than people may imagine.



On With Kara Swisher: Reid Hoffman on Why AI Is Our Co-pilot

#artificialintelligence

Kara Swisher has gotten to know a lot of tech-industry people over the years, and as she explains to producer Nayeema Raza in this episode of On With Kara Swisher, she knows "the difference between jerks and people who really actually do care about something bigger than themselves." Kara wholeheartedly believes LinkedIn co-founder Reid Hoffman falls into the latter camp, even if the two of them don't always agree about the benefits and harms of new technologies such as artificial intelligence. Hoffman is an AI evangelist who is knee-deep in that world (including, until he recently stepped down, being on the board of OpenAI, the nonprofit behind ChatGPT and GPT-4), while Kara looks at the current AI frenzy and sees storm clouds ahead. During her conversation with Hoffman, Kara asks the longtime tech entrepreneur and investor for his thoughts on a range of topics, from the collapse of Silicon Valley Bank to his political advocacy and ongoing fears about Donald Trump. She also grills Hoffman about his seemingly unflinching tech optimism; in the condensed segment below, she asks him to make his best case for several new AI-based technologies as well as explain what does, in fact, worry him about how AI could go wrong. Journalist Kara Swisher brings the news and newsmakers to you twice a week, on Mondays and Thursdays.


ChatGPT: Is SEO - As We Know It - Dead?

#artificialintelligence

Google logo displayed on a phone screen and OpenAI logo on website displayed on a laptop screen are ... [ ] seen in this illustration photo taken in Krakow, Poland on February 7, 2023. ChatGPT has taken the world by storm. Many have asked if it is the new way to do a search. This question is intriguing given the potentially massive impact on the search engine business space and the competitive elements therein. However, that is not the question I ask - in this article - I explore a related question - if you have a business that has relied on Search Engine Optimization (SEO) for traffic and relevance, where does the ChatGPT leave you?


What Does ChatGPT Really Mean For Your Job?

#artificialintelligence

Every now and then, a new application comes along that gets everyone excited (and perhaps a little scared) about the possibilities of artificial intelligence (AI). Right now, the app of the moment is undoubtedly ChatGPT โ€“ the conversational AI interface built on the GPT-3 large language model. More so than anything that has come before it, ChatGPT is capable of producing just about any kind of text or written output to a quality that โ€“ very nearly โ€“ appears as if it was written by a human. What Does ChatGPT Really Mean For Your Job? Every time AI hits the headlines, it prompts discussions about whether it's going to put humans out of work. The World Economic Forum, however, has stated that while some jobs may become redundant, people won't.


I no longer program, I build. ChatGPT + Bing Chat+ Trading Platform

#artificialintelligence

"It appears to me virtually certain that many big changes fueled by artificial intelligence working with human intelligence will lead to shocking advances in many areas over the next 10 years (in fact over the next three years)." It seems like every time we turn around, there's a new gadget or app that's changing the way we live our lives. But did you know that this is just the beginning of a much bigger trend that's happening all around us? That's what Ray Kurzweil's concept of the Exponential Cycle is all about. It might sound a bit scary at first, but trust me, it's actually pretty exciting. The Exponential Cycle is all about how technological progress is not linear but exponential.


Top 5 stories of the week: Generative AI market heating up (even more)

#artificialintelligence

Join top executives in San Francisco on July 11-12, to hear how leaders are integrating and optimizing AI investments for success. Once again, AI news topped the tech headlines this week -- in particular, the generative AI market is becoming increasingly competitive, with both new and well-established enterprises making significant investments. This includes GitHub's new Copilot X; startup Codium AI's new code-integrity tool TestGPT; and a whole slew of new tools, services and capabilities from Nvidia. Still, skepticism remains, with OpenAI's CEO Sam Altman even expressing apprehension. Not topping the list (but still noteworthy AI news): Databricks released its GPT-like Dolly; OpenAI turned ChatGPT into a platform overnight with several new plugins; OpenAI rival Character AI announced a $1 billion valuation; and Google released Bard, a competitor to ChatGPT, Claude and Bing Chat.