An introduction blog post and lecture on reinforcement learning from human feedback (RLHF) -- start here if RLHF is confusing (first page results on Google for RLHF). A paper on Measuring Data in machine learning, defining a future field of research that'll improve many ML systems. RLHF is being heavily bet on in industry and has some very different properties than other generative models that make it less suited to open-source: hard to get the data via expensive human annotations, hiring experts in multiple areas like deep RL, and strong potential for internal use-cases like search. As you all know, OpenAI release ChatGPT and it quickly rose to over 1 million users and is the leading talking point in OpenAI's new fundraising rounds. It is the company that stands to represent the closed-API business model.

As artificial intelligence takes over many aspects of our life, the most recent technology to take over the internet is of AI-driven chatbot called ChatGPT that writes poems and essays and makes humourous comments through it. The conversational AI medium has reportedly opened several avenues, but has to be handled with care. According to OpenAI, the company behind chatGPT, they have trained an AI model which interacts in a conversational way. The dialogue format makes it possible for ChatGPT to answer follow-up questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests. ChatGPT is a sibling model to "InstructGPT", which is trained to follow an instruction in a prompt and provide a detailed response, according to OpenAI which was acquired by Microsoft for $1 billion.

AI Tech Master List With Links Let Me Know What I've Missed in the Comments! Midjourney (Free Trial, paid access) https://www.midjourney.com/app/ Microsoft VQ Diffusion (Free to use) https://replicate.com/cjwbw/vq-diffusion Night Cafe (Free & Paid) Explore AI Generated Art - NightCafe Creator Disco Diffusion (Free & Paid) nightmareai/disco-diffusion – Run with an API on Replicate Mage Stable Diffusion: https://www.mage.space/ Cog View 2 (Free & Paid) https://replicate.com/thudm/cogview2

Microsoft is reportedly investing $10-billion in OpenAI, the owner of the somewhat controversial large language model chatbot ChatGPT. It uses a deep learning technique to generate text and conversations often indistinguishable from those created by actual humans. ChatGPT has dazzled amateurs and industry experts ever since its launch at the end of November last year. Given a prompt, ChatGPT can answer complex questions, provide suggestions and even debug programming code all while sounding extremely human. Microsoft's reported $10-billion investment in OpenAI shows that major companies are willing to invest in artificial intelligence software.

Artificial intelligence has in recent years proved itself to be a quick study, although it is being educated in a manner that would shame the most brutal headmaster. Locked into airtight Borgesian libraries for months with no bathroom breaks or sleep, AIs are told not to emerge until they've finished a self-paced speed course in human culture. On the syllabus: a decent fraction of all the surviving text that we have ever produced. When AIs surface from these epic study sessions, they possess astonishing new abilities. People with the most linguistically supple minds--hyperpolyglots--can reliably flip back and forth between a dozen languages; AIs can now translate between more than 100 in real time.

Microsoft Corp has said it will eliminate 10,000 jobs and take a $1.2bn charge as its cloud-computing customers dissect their spending and the company braces for potential recession. The layoffs, announced on Wednesday and far larger than cuts by Microsoft last year, piled on to tens of thousands of job cuts across the technology sector that is long past its ceaseless growth during the pandemic. The news was particularly dramatic coming from Microsoft, a software maker heavily invested in generative artificial intelligence that represents an industry bright spot. However, Microsoft will cut far fewer jobs than it had added during the COVID-19 pandemic as it responded to a boom in demand for its workplace software and cloud computing services with so many people working and studying from home. Microsoft's workforce expanded by about 36 percent in the two fiscal years following the emergence of the pandemic, growing from 163,000 workers at the end of June 2020, to 221,000 in June 2022.

Swanson, who goes by the name "Supercomposite" online, is one of the artists and thinkers testing the possibilities of generative AI, or systems that spit out text or images in response to human input. During the past year, this technology went mainstream, with image generator DALL-E grabbing headlines and, most recently, a publicly available conversational bot built with the advanced language model GPT-3. This bot, named ChatGPT, can respond to questions and requests with the ease of an instant messenger. Its creator, OpenAI, made it available to the public in November, and a million people flocked to try it, the company says.

ChatGPT was hailed as one 2022's most impressive technological innovations upon its release last November. The powerful artificial intelligence (AI) chatbot can generate text on almost any topic or theme, from a Shakespearean sonnet reimagined in the style of Megan Thee Stallion, to complex mathematical theorems described in language a 5 year old can understand. Within a week, it had more than a million users. ChatGPT's creator, OpenAI, is now reportedly in talks with investors to raise funds at a $29 billion valuation, including a potential $10 billion investment by Microsoft. That would make OpenAI, which was founded in San Francisco in 2015 with the aim of building superintelligent machines, one of the world's most valuable AI companies.

In my previous post, I discussed using ChatGPT, the large language model from OpenAI [1], as a writing partner for various types of prose. In this article, I will show how the system can be used to help compose music by generating chords from text prompts. After a brief overview of ChatGPT, I will show the results of my experiments in writing music with the new system in the following styles: jazz, country rock, and reggae. I'll finish by giving my general observations on using the model for composing music with some next steps for future exploration. Note that the third and final installment of this series will be about using the system to create picture books with help from Midjourney. ChatGPT is the latest language model from OpenAI that was designed and trained to interact with people via a chat user interface. GTP stands for Generative Pre-trained Transformer, where a transformer is a type of AI model. You can read a complete background on the system in this series' first article.

Metaverse seamlessly blends the physical world and virtual space via ubiquitous communication and computing infrastructure. In transportation systems, the vehicular Metaverse can provide a fully-immersive and hyperreal traveling experience (e.g., via augmented reality head-up displays, AR-HUDs) to drivers and users in autonomous vehicles (AVs) via roadside units (RSUs). However, provisioning real-time and immersive services necessitates effective physical-virtual synchronization between physical and virtual entities, i.e., AVs and Metaverse AR recommenders (MARs). In this paper, we propose a generative AI-empowered physical-virtual synchronization framework for the vehicular Metaverse. In physical-to-virtual synchronization, digital twin (DT) tasks generated by AVs are offloaded for execution in RSU with future route generation. In virtual-to-physical synchronization, MARs customize diverse and personal AR recommendations via generative AI models based on user preferences. Furthermore, we propose a multi-task enhanced auction-based mechanism to match and price AVs and MARs for RSUs to provision real-time and effective services. Finally, property analysis and experimental results demonstrate that the proposed mechanism is strategy-proof and adverse-selection free while increasing social surplus by 50%.