Large Language Model
Artificial intelligence 'is gonna ruin the world... and then we adapt'
"AI will pull away some of the reliance on creative agencies," said Fan. Once an agency creative department crafts an original concept, "they're used for all these minor tweaks in copy, images and other things. And may in fact take into account other factors to ensure it's a compelling headline or image that's automatically selected." Fan pointed to AI-driven technology such as GPT-3 (generative pre-trained transformer 3, which is an autoregressive language model that uses deep learning to produce human-like text) as key to such advancements. With GPT-3, "you can get it to respond the way you want it to. It's almost creepy how you can have AI talk to you like a human does," he added.
Q-Pain: A Question Answering Dataset to Measure Social Bias in Pain Management
Logรฉ, Cรฉcile, Ross, Emily, Dadey, David Yaw Amoah, Jain, Saahil, Saporta, Adriel, Ng, Andrew Y., Rajpurkar, Pranav
Recent advances in Natural Language Processing (NLP), and specifically automated Question Answering (QA) systems, have demonstrated both impressive linguistic fluency and a pernicious tendency to reflect social biases. In this study, we introduce Q-Pain, a dataset for assessing bias in medical QA in the context of pain management, one of the most challenging forms of clinical decision-making. Along with the dataset, we propose a new, rigorous framework, including a sample experimental design, to measure the potential biases present when making treatment decisions. We demonstrate its use by assessing two reference Question-Answering systems, GPT-2 and GPT-3, and find statistically significant differences in treatment between intersectional race-gender subgroups, thus reaffirming the risks posed by AI in medical settings, and the need for datasets like ours to ensure safety before medical AI applications are deployed.
GitHub Copilot Open Source Alternatives - KDnuggets
Recently, GitHub publicly unveiled Copilot, the preview of its "AI pair programmer," a code completion style tool designed to provide line or function suggestions in your IDE. It has certainly made waves in the world of programming and beyond, and you have likely heard at least something about it. But Copilot is more than simple autocomplete and is more context aware than other code assistants. Powered by OpenAI's Codex AI system, Copilot contextualizes a situation using docstrings, function names, comments, and preceding code to best generate and suggest what it determines to be the most appropriate code. Copilot is designed to improve over time, "learning" from how developers use it.
The Machine Learning Schools Championed by the Biggest AI Labs in the World
I recently started an AI-focused educational newsletter, that already has over 80,000 subscribers. TheSequence is a no-BS (meaning no hype, no news etc) ML-oriented newsletter that takes 5 minutes to read. The goal is to keep you up to date with machine learning projects, research papers and concepts. Recently, one of my students asked me a question as of whether DeepMind was solely working in reinforcement learning applications. The answer is obviously no but the question is still valid as it rooted in the fact that most of DeepMind's highly publicized work such as AlphaGo, MuZero or AlphaFold are based in reinforcement learning.
DeepMind's Vibrant New Virtual World Trains Flexible AI With Endless Play
Last year, DeepMind researchers wrote that future AI developers may spend less time programming algorithms and more time generating rich virtual worlds in which to train them. In a new paper released this week on the preprint server arXiv, it would seem they're taking the latter part of that prediction very seriously. The paper's authors said they've created an endlessly challenging virtual playground for AI. The world, called XLand, is a vibrant video game managed by an AI overlord and populated by algorithms that must learn the skills to navigate it. The game-managing AI keeps an eye on what the game-playing algorithms are learning and automatically generates new worlds, games, and tasks to continuously confront them with new experiences.
DeepMind's Vibrant New Virtual World Trains Flexible AI With Endless Play
Last year, DeepMind researchers wrote that future AI developers may spend less time programming algorithms and more time generating rich virtual worlds in which to train them. In a new paper released this week on the preprint server arXiv, it would seem they're taking the latter part of that prediction very seriously. The paper's authors said they've created an endlessly challenging virtual playground for AI. The world, called XLand, is a vibrant video game managed by an AI overlord and populated by algorithms that must learn the skills to navigate it. The game-managing AI keeps an eye on what the game-playing algorithms are learning and automatically generates new worlds, games, and tasks to continuously confront them with new experiences.
AI-Memer: Using Machine Learning to Create Funny Memes
The user starts by entering a search query to find a background image, like "apple pie". The system then checks for matching images in Wikimedia Commons [1] and the OpenImages dataset [2]. Both datasets have corresponding text descriptions of the images. I use the CLIP [3] encoders from OpenAI to first perform a semantic search on the text descriptions. A semantic search looks for matching concepts, not just a word search.
Can GitHub Copilot Crack a Facebook Coding Interview?
Github Copilot is a new product created by OpenAI as "Your AI Pair Programmer". It is a plugin that you install in VSCode and it is simple to use and install. I've tested it through the past week and wanted to test it to see how powerful it is, so I went through 3 coding questions on the web that are a set of prepared interview coding questions with it to see how it would perform. How does GitHub Copilot work? Copilot is powered by a deep neural network language model called Codex. Codex is a fine-tuned GPT model trained on top of Github code.
Will Artificial Intelligence Help Us Grieve?
When a loved one passes, will we continue to communicate with the deceased through artificial intelligence? While that sounds like an episode of Black Mirror, the beginnings of a digital afterlife with some potentially positive ramifications recently took place with one man, as Jason Fagone reports in the San Francisco Chronicle. His story centers around writer Joshua Barbeau, a 33-year old who had lost his fiancee eight years earlier from a rare liver disease. At home one night, he accessed a site called Project December. As Fagone notes, the site is "powered by one of the world's most capable artificial intelligence systems, a piece of software known as GPT-3. It knows how to manipulate human language, generating fluent English text in response to a prompt."