Generative AI
Stanford's Alpaca shows that OpenAI may have a problem
Researchers train a language model from Meta with text generated by OpenAI's GPT-3.5 for less than $600 โ and achieve similar performance. Training large language models is expensive, and powerful models remain the monopoly of large technology companies โ right? Researchers at Stanford used 52,000 instruction-following demonstrations generated by OpenAI's GPT-3.5 (text-davinci-003) to fine-tune a seven-billion-parameter variant of Meta's recently announced LLaMA model. Check your inbox or spam folder to confirm your subscription. Instruction training is one of the key techniques that make GPT-3.5 superior to the original GPT-3 model, and the training data used is proprietary to OpenAI.
The way we work is about to change
In just a few months, you'll be able to ask a virtual assistant to transcribe meeting notes during a work call, summarize long email threads to quickly draft suggested replies, quickly create a specific chart in Excel, and turn a Word document into a PowerPoint presentation in seconds. Over the past week, a rapidly evolving artificial intelligence landscape seemed to leap ahead again. Microsoft and Google each unveiled new AI-powered features for their signature productivity tools and OpenAI introduced its next-generation version of the technology that underpins its viral chatbot tool, ChatGPT. Suddenly, AI tools, which have long operated in the background of many services, are now more powerful and more visible across a wide and growing range of workplace tools. Google's new features, for example, promise to help "brainstorm" and "proofread" written work in Docs.
What does the future hold for Nvidia?
Jensen Huang getting carried away about an emerging technology is nothing new. This time last year, the charismatic and excitable co-founder and CEO of chip design giant Nvidia was telling anyone who'd listen about the potential of the metaverse (or the Omniverse, as Nvidia's marketing department prefers to call it). Since then, the metaverse bubble has suffered a slow puncture, and Huang is back to evangelising about one of his favourite topics: artificial intelligence. Describing the growth in power of generative AI systems like GPT-4 โ the model that powers OpenAI's tools such as ChatGPT โ as a "new era of computing", Huang told investors on his company's most recent earnings call that AI was at an "inflection point", stating that businesses have "an urgency to develop and deploy new AI strategies". However, Huang added that he believes many companies face "an insurmountable obstacle" in getting access to the resources and skills needed to make AI work, which is why, he says, Nvidia is getting into the services business.
A Venture Capitalist Imagines What Generative AI Will Change - WSJ
Martin Casado is a general partner at venture-capital company Andreessen Horowitz, where he focuses on enterprise investing. Mr. Casado started his career at Lawrence Livermore National Laboratory, where he worked on large-scale simulations for the Defense Department. His work, first as a researcher and now as an investor, gives him insight into the development of artificial-intelligence products and usage. Wall Street Journal reporter Berber Jin spoke with Mr. Casado at The Wall Street Journal's CIO Network Summit about the current capabilities, and the possible future of, AI.
Quiz: Did AI make this? Test your knowledge.
Generative AI can help you write a rap song about your cat Fluffy in the style of Eminem. It can create a portrait of Elon Musk eating Hot Cheetos inside a rocket in space. But, can it do work tasks for us and produce finished products? Professionals across industries are experimenting with AI tools like ChatGPT, which produces conversational text using GPT-3 and GPT-4, and DALL-E, which creates images, to see if they might aid in their work. Creative jobs in industries such as marketing, writing, design and art may use AI to dream up ideas. Retail, sales and real estate sectors are trying to determine whether AI can speed up processes and get their products to market.
Metaverse Dreams Take a Backseat As Generative AI Funding Takes the Lead / Digital Information World
Meta Platforms, one of the leading tech companies in the world, has shifted its focus from their metaverse initiative to generative AI funding. Meta, formerly known as Facebook, has announced a massive second round of layoffs, reflecting a new focus on generative Artificial Intelligence (AI). This shift comes one and a half years after the firm rebranded itself to reflect its ambitious metaverse initiative. In addition, CEO Mark Zuckerberg has shifted his attention away from the metaverse dream and towards AI advancements. This week, Meta announced that it had closed its Portal platform, which will allow it to focus more resources on developing generative AI technologies.
AI and the future of work: Everything is about to change
In just a few months, you'll be able to ask a virtual assistant to transcribe meeting notes during a work call, summarize long email threads to quickly draft suggested replies, quickly create a specific chart in Excel, and turn a Word document into a PowerPoint presentation in seconds. Over the past week, a rapidly evolving artificial intelligence landscape seemed to leap ahead again. Microsoft and Google each unveiled new AI-powered features for their signature productivity tools and OpenAI introduced its next-generation version of the technology that underpins its viral chatbot tool, ChatGPT. Suddenly, AI tools, which have long operated in the background of many services, are now more powerful and more visible across a wide and growing range of workplace tools. Google's new features, for example, promise to help "brainstorm" and "proofread" written work in Docs.
Google opens up its AI language model PaLM to challenge OpenAI and GPT-3 - The Verge
In order to make it easier for developers to train PaLM to carry out specific tasks, Google is launching a new app alongside the PaLM API called MakerSuite. "With MakerSuite, you'll be able to iterate on prompts, augment your dataset with synthetic data, and easily tune custom models," said the company in a press release. Google says this sort of fine-tuning, which is necessary to create a consumer-friendly AI system, can even be done in a browser, with the computationally intensive work of training and deployment handled by Google Cloud.