Goto

Collaborating Authors

 Large Language Model


Build software better, together

#artificialintelligence

Access is limited to a small group of testers during the technical preview of GitHub Copilot. Sign up today for your chance to try it out and help us improve.


[D] GPT-J for text generation: hardware requirements

#artificialintelligence

Video games have, for several decades, only loaded the assets they needed to use, as they used them, due to tiny RAM amounts relative to the asset sizes yea. The original Playstation is a good example with its 2MB of RAM and 800MB discs full of assets. Enabling the ability to do something at all for many, is often more important than being able to do it extremely quickly for a few. Modern games get around this in part, by having the graphics driver handle all the asset management in and out of VRAM, allowing the driver to swap the least recently used assets out to RAM until they are needed, and then swap them back to VRAM, without the executing program having to know it happened. Basically treating all of VRAM and virtual VRAM hosted in RAM as one big asymmetrically speedy storage medium.


Academic and Research

#artificialintelligence

Applications are invited for a new prestigious DeepMind Academic Fellow in Machine Learning at Queen Mary University of London. Following a recent donation to the University from DeepMind, this three-year Fellowship is created to provide an opportunity for an excellent early career researcher in the fields of Computer Science and/or Machine Learning/ Artificial Intelligence to further their research and prepare for a full academic role within a supportive environment. The ideal candidate will have completed a PhD in a relevant field (or expect to have completed by this September) and have clear and ambitious plans for their future research, alongside the enthusiasm to act as a role model for Black researchers of the future. We particularly encourage applications from those who are in under-represented groups, and particularly those who identify as Black, as Black staff are under-represented at this level within the School of Electronic Engineering and Computer Science at Queen Mary. The Fellowship will be research-focused and the successful candidate will be allocated a research studentship to support outputs.


OpenAI Launches GitHub Copilot: AI Focused On Code Generation. Should We Be Worried Now?

#artificialintelligence

Considering its merits and flaws, it is worth asking if GitHub Copilot affects developer jobs in the future. When GPT-3 was released, the answer to this question was a tentative, faint yes. However, now that Copilot is out and will be a commercially available product that integrates into one of the heavily used IDEs globally, we should reconsider our answer. The creators claim the tool will only serve to boost productivity and free developers from doing manual tasks and help them focus on more interesting work. It might also be possible it lowers the barriers for beginners to enter the software industry.


The NLP Cypher

#artificialintelligence

Hey Welcome back! Want to wish everyone in the US a happy 4th of July🎆🎇! Also, want to quickly mention that the NLP Index has doubled in size (since its inception) with now housing over 6,000โ€ฆ


GitHub, OpenAI release GPT-3-autocomplete combo for programmers

#artificialintelligence

If you're a software developer who's used to flying solo, GitHub has some news: Get ready to welcome AI into the coding cockpit. Yesterday, the Microsoft-owned code repository and software platform announced GitHub Copilot, a tool created in partnership with Microsoft partner OpenAI that can make suggestions as programmers write code in real time. It's built atop OpenAI Codex, an AI model that learned from billions of lines of code. How it works: The tool analyzes your previous lines of code to suggest new code, and even functions, that developers can then accept or ignore. The current version works best with languages like Python, JavaScript, TypeScript, Ruby, and Go.


Your AI pair programmer

#artificialintelligence

The Ultimate help and support for the developers is here by the OpenAI and GitHub community. Developed in collaboration with OpenAI, GitHub Copilot is powered by OpenAI Codex, a new AI system created by OpenAI. OpenAI Codex has broad knowledge of how people use code and is significantly more capable than GPT-3 in code generation, in part, because it was trained on a data set that includes a much larger concentration of public source code. GitHub Copilot works with a broad set of frameworks and languages, but this technical preview works especially well for Python, JavaScript, TypeScript, Ruby and Go. So, Now people who are really confused about programming you know it will actually help you to write a neat coed and even in interviews it will definitely help you if you're going for competitive programming.


AI Can Almost Write Like a Human--and More Advances Are Coming

#artificialintelligence

Last month, software developer Kevin Lacker tested GPT-3, the latest version of an artificial-intelligence language system developed by San Francisco-based software company OpenAI LP. The system isn't yet public, but it set off a firestorm in tech circles after OpenAI gave select researchers and developers access so they could provide feedback. They observed its uncanny and unprecedented ability to answer trivia questions, generate long passages of coherent text, design simple software applications and offer plausible recipes for breakfast burritos. Trained on roughly 300 billion words from across the internet, GPT-3 predicts what is most likely to follow a prompt from a human. But ask it to reason, and it struggles.


GitHub unveils AI coding assistant for Visual Studio Code

#artificialintelligence

GitHub has launched a preview of GitHub Copilot, an AI-based coding assitant for Visual Studio Code that suggests lines of code or functions as you type. Built in collaboration with OpenAI, GitHub Copilot draws context from the developer's code, suggesting lines or entire functions while helping to find alternative ways to solve problems, write tests, and explore new APIs without the need to search for answers on the Internet. Introduced June 29, GitHub Copilot adapts to how the user writes code, helping complete work faster. Trained on billions of lines of public code, the tool is powered by OpenAI Codex, an AI system that is more capable than the GPT-3 (Generative Pretrained Transformer) language model in code generation, GitHub said. GitHub Copilot can quickly produce boilerplate code and repetitive patterns, with developers able to feed examples to Copilot and have the tool generate the rest.


OpenAI's gigantic GPT-3 hints at the limits of language models for AI

#artificialintelligence

A little over a year ago, OpenAI, an artificial intelligence company based in San Francisco, stunned the world by showing a dramatic leap in what appeared to be the power of computers to form natural-language sentences, and even to solve questions, such as completing a sentence, and formulating long passages of text people found fairly human. The latest work from that team shows how OpenAI's thinking has matured in some respects. GPT-3, as the newest creation is called, emerged last week, with more bells and whistles, created by some of the same authors as the last version, including Alec Radford and Ilya Sutskever, along with several additional collaborators, including scientists from Johns Hopkins University. It is now a truly monster language model, as it's called, gobbling two orders of magnitude more text than its predecessor. But within that bigger-is-better stunt, the OpenAI team seem to be approaching some deeper truths, much the way Dr. David Bowman approached the limits of the known at the end of the movie 2001.