My code blocks zero-day exploits on hundreds of millions of computers. Always hoping to make the world a better place. What if we trained AI to complete equations instead of images of cats? Can AI help solve the Unified Theory? Remember that shock of seeing some breakthrough for the first time?

Generative Pre-trained Transformer 3 (GPT-3) embraces and augments the GPT-2 model architecture, including pre-normalization, modified initialization, and reversible tokenization. It exhibits strong performance on many Natural Language Processing (NLP) tasks. GPT-3 is an auto-regressive artificial intelligence algorithm developed by OpenAI, an AI-powered research laboratory located in San Francisco, California. It is a massive artificial neural network that takes help from deep learning to generate human-like text and is trained on huge text datasets with thousands of billions of words. It is the third-generation AI language prediction model in the GPT-n series and the successor to GPT-2. In simple words, OpenAI GPT-3 was fed inputs the ways how billions of people write and also was taught how to pick up on writing patterns based on user entry.

A month ago I published this 35-minute-long overview of GPT-3. But I value your time as a reader, so I decided to write a super-condensed 5-minute article. I've summarized the main ideas from the longer article: What GPT-3 is, what it can do, and its present and future impact on the world. GPT-3 is the third version of OpenAI's family of Generative Pre-Trained models. GPT-1 and GPT-2 laid the foundations for GPT-3, proving the success of two key hypotheses: Transformers unsupervised pre-training works fine (GPT-1) and language models can multitask (GPT-2).

The goal of database question answering is to enable natural language querying of real-life relational databases in diverse application domains. Recently, large-scale datasets such as Spider and WikiSQL facilitated novel modeling techniques for text-to-SQL parsing, improving zero-shot generalization to unseen databases. In this work, we examine the challenges that still prevent these techniques from practical deployment. First, we present KaggleDBQA, a new cross-domain evaluation dataset of real Web databases, with domain-specific data types, original formatting, and unrestricted questions. Second, we re-examine the choice of evaluation tasks for text-to-SQL parsers as applied in real-life settings. Finally, we augment our in-domain evaluation task with database documentation, a naturally occurring source of implicit domain knowledge. We show that KaggleDBQA presents a challenge to state-of-the-art zero-shot parsers but a more realistic evaluation setting and creative use of associated database documentation boosts their accuracy by over 13.2%, doubling their performance.

According to OpenAI, more than 300 applications are using GPT-3, which is part of a field called natural language processing. An average of 4.5 billion words are written per day. Some say the quality of GPT-3's text is as good as that written by humans. What follows is GPT-3's response to topics in general investing. MarketWatch: "How to invest in cryptocurrencies by GPT-3."

Programming competition problems are pervasive in the AI community. They can be used to evaluate programmers' abilities to solve artificial tasks as well as to test the limits of state-of-the-art algorithms. A research team from MIT, Allen Institute for AI and Microsoft Research recently introduced Python Programming Puzzles (P3), a novel and open-source collection of programming challenges that capture the essence of puzzles and can be used to teach and evaluate an AI's programming proficiency. The proposed puzzles take the form of a Python function with the answer as an argument. The goal is to find an input x that makes the output of the function true, i.e., a valid answer x satisfies f(x) True.

Since their introduction three years ago, transformer architectures have become the de-facto standard for natural language processing (NLP) tasks and are now also seeing application in areas such as computer vision. Although many transformer architecture modifications have been proposed, these have not proven as easily transferable across implementations and applications as hoped, and that has limited their wider adoption. In a bid to understand why most widely-used transformer applications shun these modifications, a team from Google Research comprehensively evaluated them in a shared experimental setting, where they were surprised to discover that most architecture modifications they looked at do not meaningfully improve performance on downstream NLP tasks. The researchers began by reimplementing and evaluating a variety of transformer variants on the tasks where they are most commonly applied. As a baseline, they used the original transformer model with two modifications: applying layer normalization before the self-attention and feedforward blocks instead of after, and using relative attention with shared biases instead of sinusoidal positional embeddings. The researchers employed two experimental settings to evaluate each modification's performance: transfer learning based on T5, and supervised machine translation on the WMT'14 English-German translation task.

On January 30, 2021, I realized I was the weak link. I had been working with GPT-3, the autoregressive language model from OpenAI for 2 hours. My creative juices were running low. We had maybe 5 poems ready -- out of the 60 or so poems we needed for the book. I stared at the blinking cursor.

Machine programming, which automates the development and maintenance of software, is becoming supercharged by AI. During its Build developer conference in May, Microsoft detailed a new feature in Power Apps that taps OpenAI's GPT-3 language model to assist people in choosing formulas. Intel's ControlFlag can autonomously detect errors in code. And Facebook's TransCoder converts code from one programming language into another. The applications of computer programming are vast in scope.

If you're wondering, who am I to tell you anything about GPT-3 AI? Well, I'm Lillian Pierson, and I help data professionals become world-class data leaders and entrepreneurs - to date I've trained over 1 million data professionals on the topics of data science and AI. I'm a data scientist turned data entrepreneur, and I've been testing out GPT-3 AI for about 3 months now in my data business, Data-Mania.