Goto

Collaborating Authors

 Generative AI


What you should know about developing GPT-3 applications

#artificialintelligence

Last week, OpenAI removed the waitlist for the application programming interface to GPT-3, its flagship language model. Now, any developer who meets the conditions for using the OpenAI API can apply and start integrating GPT-3 into their applications. Since the beta release of GPT-3, developers have built hundreds of applications on top of the language model. But building successful GPT-3 products presents unique challenges. You must find a way to leverage the power of OpenAI's advanced deep learning models to provide the best value to your users while keeping your operations scalable and cost-efficient.


AI Innovations That Made Headlines In 2021

#artificialintelligence

AI has, by now, proven its power and impact. The artificial intelligence space is constantly evolving and improving with every passing day. Tech companies and researchers are investing big in bringing out innovations due to the massive potential the impact of AI can hold on the world's biggest problems. As we head towards the end of 2021, let us look back at some of the major AI innovations and incidents that took centre stage this year. OpenAI released DALL·E, a 12-billion parameter version of GPT-3 trained to generate images from text descriptions, using a dataset of text-image pairs.


AI can translate normal written text to code

#artificialintelligence

There are two key considerations when it comes to coding, Greg Brockman, the chief technology officer and co-founder of AI research company OpenAI, told The Verge. Part one is thinking about the problem, Brockman said, and really understanding it. The second part is figuring out how to solve that problem, using code. It's this second aspect that OpenAI's new system, called Codex, hopes to make easier, faster, and more accessible. Codex can go from text to code, taking commands written in plain English and bringing them to life.


OpenAI GPT-3 Waiting List Dropped as GPT-3 Is Fully Released for Developer and Enterprise Use

#artificialintelligence

When OpenAI first debuted its powerful GPT-3 natural language model in June of 2020, it debuted in a limited beta capacity and featured a waiting list where developers could sign up to use its infrastructure and capabilities. Now, the waiting list has been dropped and GPT-3's capabilities are immediately available to developers and enterprises to work on their most challenging language problems, according to a Nov. 18 (Thursday) announcement by OpenAI, an independent AI research and deployment company. But there are some caveats – the general release adds conditions to prevent GPT-3 from being used to harm people, as well as conditions that only allow its use in certain nations around the world. That means that developers in some nations, including Cuba, Iran and Russia, cannot currently access it. "OpenAI is committed to the safe deployment of AI," the organization said in a statement.


A Deep Dive Into GitHub Copilot

#artificialintelligence

The way that an AI product works are going to determine how good it is, plain and simple. Bad tech under the hood is going to be obvious in the final product. Whether it be lack, inconsistency, slowness, could be anything, if the tech is bad, the product is bad. That said, Copilot has a pretty good stack it's working with. Copilot is based on the GPT-3 AI model created by OpenAI which features 175 billion parameters for language processing. The story goes that people were trying to use GPT-3 to get code completion based on a plain-English input.


Neural Program Generation Modulo Static Analysis

arXiv.org Artificial Intelligence

State-of-the-art neural models of source code tend to be evaluated on the generation of individual expressions and lines of code, and commonly fail on long-horizon tasks such as the generation of entire method bodies. We propose to address this deficiency using weak supervision from a static program analyzer. Our neurosymbolic method allows a deep generative model to symbolically compute, using calls to a static-analysis tool, long-distance semantic relationships in the code that it has already generated. During training, the model observes these relationships and learns to generate programs conditioned on them. We apply our approach to the problem of generating entire Java methods given the remainder of the class that contains the method. Our experiments show that the approach substantially outperforms state-of-the-art transformers and a model that explicitly tries to learn program semantics on this task, both in terms of producing programs free of basic semantic errors and in terms of syntactically matching the ground truth.


OpenAI removes GPT-3 API waitlist, now generally available

#artificialintelligence

OpenAI has removed the waitlist to access its GPT-3 API which means any developer can get started. The AI giant unveiled GPT-3 in May last year to a mixed reception. Few doubted GPT-3's impressive ability to generate text similar to a human writer, but many expressed concerns about the societal impact. Fake news and propaganda is already difficult to counter even when it's being generated in relatively limited amounts by human writers. The ability for anyone to use an AI to generate misinformation on a huge scale could have serious implications.



Microsoft launches Azure OpenAI Service, opening access to GPT-3

#artificialintelligence

Microsoft has launched the Azure OpenAI Service – giving Azure customers the ability to utilize OpenAI's machine learning models. Unveiled at the company's recent Ignite event, the service is based on GPT-3, a language model developed by OpenAI, the company which Microsoft backed with $1bn in 2019. Currently invitation-only, the service will give users the ability to make use of GPT-3 in several ways, including content and code generation. "We are just in the beginning stages of figuring out what the power and potential of GPT-3 is," Eric Boyd, corporate vice president for Azure AI, said. "Now we are taking what OpenAI has released and making it available with all the enterprise promises that businesses need to move into production."


OpenAI rival Cohere launches language model API

#artificialintelligence

Cohere, a startup creating large language models to rival those from OpenAI and AI2Labs, today announced the general availability of its commercial platform for app and service development. Through an API, customers can access models fine-tuned for a range of natural language applications, in some cases at a fraction of the cost of rival offerings. The pandemic has accelerated the world's digital transformation, pushing businesses to become more reliant on software to streamline their processes. As a result, the demand for natural language technology is now higher than ever -- particularly in the enterprise. According to a 2021 survey from John Snow Labs and Gradient Flow, 60% of tech leaders indicated that their natural language processing (NLP) budgets grew by at least 10% compared to 2020, while a third -- 33% -- said that their spending climbed by more than 30%.