Goto

Collaborating Authors

 Generative AI


OpenAI Codex and GPT-3

#artificialintelligence

A few months ago Sam Altman wrote a blog post called Moore's Law for Everything. In it, he spoke about what the world could look like as AI becomes more advanced. First what is an API and GPT-3? We will start with an API. An application programming interface (API) is a connection that allows computers or computer programmes to communicate with one another.


Foundation models risk exacerbating ML's ethical challenges

Stanford HAI

The Transform Technology Summits start October 13th with Low-Code/No Code: Enabling Enterprise Agility. Machine learning is undergoing a paradigm shift with the rise of models trained at massive scale, including Google's BERT, OpenAI's DALL-E, and AI21 Labs' Jurassic-1 Jumbo. Their capabilities and dramatic performance improvements are leading to a new status quo: a single model trained on raw datasets that can be adapted for a wide range of applications. Indeed, OpenAI is reportedly developing a multimodal system trained on images, text, and other data using massive computational resources, which the company's leadership believes is the most promising path toward AGI -- AI that can learn any task a human can. But while the emergence of these "foundational" models presents opportunities, it also poses risks, according to a new study released by the Stanford Human-Centered Artificial Intelligence's (HAI) Center for Research on Foundation Models (CRFM). CFRM, a new initiative made up of an interdisciplinary team of roughly 160 students, faculty, and researchers, today published a deep dive into the legal ramifications, environmental and economic impact, and ethical issues surrounding foundation models.


AI21 Labs has trained a massive language model to give a harsh rivalry to OpenAI's GPT-3

#artificialintelligence

AI21 Labs: OpenAI's GPT-3 is the better part of a year and remained among the largest Artificial Intelligence system in the terms of language models which is ever been created or came into existence. With the help of an API, it has become so easy to use that people are using it for automatically writing the articles and emails along with summarizing the texts, composition of poetries and recipes, generating the codes for deep learning in Python, and creating layouts and templates for websites. But now an Artificial Intelligence lab is based in Tel Aviv, Israel which is named AI21 Labs which stated that they are planning to release a larger model and make it available via a service with the idea of being challenged by OpenAI's dominance in the Natural Language Processing as a service for the development of the Artificial Intelligence field. The startup stated that the largest version of their Artificial Intelligence model is known as Jurassic-1 Jumbo which contains 178 billion parameters and more than 3 billion GPT-3. Taking a look towards Artificial Intelligence along with machine learning parameters are the most important part of the model that is learned from historical training data.


Excited About GitHub Copilot? Use It at Your Own Risk!

#artificialintelligence

This Article was co-authored with Muhammad Abutahir, You can find him on linkedin and instagram. So recently I was surfing the web when I came across a YouTube video on GitHub copilot. It amazed me to see how AI is transforming the lives of programmers all around the globe. The person was boasting about it too much and it didn't seem right for a test version of the software, so I thought of taking a deep dive into the system about how it works. If you don't know what GitHub copilot is, then let me tell you, GitHub copilot is an intelligent AI system released by GitHub and OpenAI organization that gives you appropriate suggestions for your code as well as it can generate an entire function based on the comments you provide! That gives it another name called AI pair programmer.


On the Opportunities and Risks of Foundation Models

arXiv.org Artificial Intelligence

AI is undergoing a paradigm shift with the rise of models (e.g., BERT, DALL-E, GPT-3) that are trained on broad data at scale and are adaptable to a wide range of downstream tasks. We call these models foundation models to underscore their critically central yet incomplete character. This report provides a thorough account of the opportunities and risks of foundation models, ranging from their capabilities (e.g., language, vision, robotics, reasoning, human interaction) and technical principles(e.g., model architectures, training procedures, data, systems, security, evaluation, theory) to their applications (e.g., law, healthcare, education) and societal impact (e.g., inequity, misuse, economic and environmental impact, legal and ethical considerations). Though foundation models are based on standard deep learning and transfer learning, their scale results in new emergent capabilities,and their effectiveness across so many tasks incentivizes homogenization. Homogenization provides powerful leverage but demands caution, as the defects of the foundation model are inherited by all the adapted models downstream. Despite the impending widespread deployment of foundation models, we currently lack a clear understanding of how they work, when they fail, and what they are even capable of due to their emergent properties. To tackle these questions, we believe much of the critical research on foundation models will require deep interdisciplinary collaboration commensurate with their fundamentally sociotechnical nature.


AI21 Labs trains a massive language model to rival OpenAI's GPT-3

#artificialintelligence

The Transform Technology Summits start October 13th with Low-Code/No Code: Enabling Enterprise Agility. For the better part of a year, OpenAI's GPT-3 has remained among the largest AI language models ever created, if not the largest of its kind. Via an API, people have used it to automatically write emails and articles, summarize text, compose poetry and recipes, create website layouts, and generate code for deep learning in Python. But an AI lab based in Tel Aviv, Israel -- AI21 Labs -- says it's planning to release a larger model and make it available via a service, with the idea being to challenge OpenAI's dominance in the "natural language processing-as-a-service" field. The startup says that the largest version of its model -- called Jurassic-1 Jumbo -- contains 178 billion parameters, or 3 billion more than GPT-3 (but not more than PanGu-Alpha, HyperCLOVA, or Wu Dao 2.0).


Codex, an AI system that translates natural language to programming code

#artificialintelligence

Artificial intelligence research company OpenAI has announced the development of an AI system that translates natural language to programming code--called Codex, the system is being released as a free API, at least for the time being. Codex is more of a next-step product for OpenAI, rather than something completely new. It builds on Copilot, a tool for use with Microsoft's GitHub code repository. With the earlier product, users would get suggestions similar to those seen in autocomplete in Google, except it would help finish lines of code. Codex has taken that concept a huge step forward by accepting sentences written in English and translating them into runnable code.


OpenAI launches Codex, an API for translating natural language into code

#artificialintelligence

The Transform Technology Summits start October 13th with Low-Code/No Code: Enabling Enterprise Agility. OpenAI today released OpenAI Codex, its AI system that translates natural language into code, through an API in private beta. Able to understand more than a dozen programming languages, Codex can interpret commands in plain English and execute them, making it possible to build a natural language interface for existing apps. Codex powers Copilot, a GitHub service launched earlier this summer that provides suggestions for whole lines of code inside development environments like Microsoft Visual Studio. Codex is trained on billions of lines of public code and works with a broad set of frameworks and languages, adapting to the edits developers make to match their coding styles.


Introducing Codex, an OpenAI Initiative to Bring Coding to Layman

#artificialintelligence

Code is the language that every computer uses to'speak' and'understand.' When developers write code, they make it to issue instructions to a computer and tell them what to do. But as technology has evolved and everything including the way we order food to eject satellites into space has moved to digital mode, the need for coding has drastically surged. But despite its increasing demand, we are still not able to take coding to laymen. When it comes to programming languages and coding, only tech-savvy can get their hands on it.


What to expect from OpenAI's Codex API

#artificialintelligence

The Transform Technology Summits start October 13th with Low-Code/No Code: Enabling Enterprise Agility. OpenAI will make Codex, its AI programmer technology, available through an application programming interface, the company announced on its blog on Tuesday. In tandem with the announcement, OpenAI CTO Greg Brockman, Chief Scientist Ilya Sutskever, and co-founder Wojciech Zaremba gave an online presentation of the capabilities of the deep learning model. The Codex demo puts the advantages of large language models to full display, showing an impressive capacity to resolve references and write code for a variety of APIs and micro-tasks that can be frustratingly time-consuming. OpenAI is still testing the waters with Codex.