Large Language Model
The dark secret behind those cute AI-generated animal images
It's no secret that large models, such as DALL-E 2 and Imagen, trained on vast numbers of documents and images taken from the web, absorb the worst aspects of that data as well as the best. OpenAI and Google explicitly acknowledge this. Scroll down the Imagen website--past the dragon fruit wearing a karate belt and the small cactus wearing a hat and sunglasses--to the section on societal impact and you get this: "While a subset of our training data was filtered to removed noise and undesirable content, such as pornographic imagery and toxic language, we also utilized [the] LAION-400M dataset which is known to contain a wide range of inappropriate content including pornographic imagery, racist slurs, and harmful social stereotypes. Imagen relies on text encoders trained on uncurated web-scale data, and thus inherits the social biases and limitations of large language models. As such, there is a risk that Imagen has encoded harmful stereotypes and representations, which guides our decision to not release Imagen for public use without further safeguards in place."
The Morning After: Google claims 'unprecedented photorealism' from its new text-to-image AI
Google has shown off a new artificial intelligence system that can create images based on text input. Its Imagen diffusion model, created by the Brain Team at Google Research, offers "an unprecedented degree of photorealism and a deep level of language understanding." This isn't the first time we've seen AI models like this. OpenAI's DALL·E (and its successor) performed similar witchcraft, turning text into visuals. Google's version, however, tries to create more realistic images.
The New Large Language Models Have no Value for Democracy
Meta's dedication to "openness," as the model's name implies, is what distinguishes OPT-175B. The model has now been made public by Meta (with some caveats). It also provided a wealth of information regarding the training and development process. Meta's decision to become more transparent is admirable. The battle for massive language models, on the other hand, has reached a point where it can no longer be democratized.
AI solves complex physics problems; Amazon 'creepy' AI cameras; Is DeepMind's AI really a human-level intelligence?
I hope that you enjoy the latest AI news and insights, don't forget to comment with your feedback. Make sure to check the Web3 section at the end! But is Gato truly intelligent – having AGI? Google AI took on the challenge: The first iteration of the AI-generated script was completed by November 2021. The script was interesting, but there was also a lot of gibberish. A second version aims to dial a new gate address for a more involved and engaging Stargate script.
How AI makes developers' lives easier, and helps everybody learn to develop software
Ever since Ada Lovelace, a polymath often considered the first computer programmer, proposed in 1843 using holes punched into cards to solve mathematical equations on a never-built mechanical computer, software developers have been translating their solutions to problems into step-by-step instructions that computers can understand. Today, AI-powered software development tools are allowing people to build software solutions using the same language that they use when they talk to other people. These AI-powered tools translate natural language into the programming languages that computers understand. "That allows you, as a developer, to have an intent to accomplish something in your head that you can express in natural language and this technology translates it into code that achieves the intent you have," Scott said. "That's a fundamentally different way of thinking about development than we've had since the beginning of software."
Pinaki Laskar on LinkedIn: #machinelearning #artificialintelligence #nlp
AI Researcher, Cognitive Technologist Inventor - AI Thinking, Think Chain Innovator - AIOT, XAI, Autonomous Cars, IIOT Founder Fisheyebox Spatial Computing Savant, Transformative Leader, Industry X.0 Practitioner What are the current AI or machine learning research trends? NLP AI, large neural networks trained for language understanding and generation, the best shortcuts to artificial general intelligence. Large language models, such as PaLM, GLaM, GPT-3, Megatron-Turing NLG, Gopher, Chinchilla, LaMDA, are led by WuDao 2.0 model trained by studying 1.2TB of text and 4.9TB of images using 1.75tn parameters to simulate conversations, understand pictures, write poems and create recipes. It all is relying on unlimited brute force scaling, tens of gigabytes in size and trained on enormous amounts of text data, sometimes at the petabyte scale. The Pathways Language Model (PaLM), a 540-billion parameter, dense decoder-only Transformer model trained with the Pathways system, which enabled us to efficiently train a single model across multiple TPU v4 Pods.
Google Is Close To Achieving True Artificial Intelligence?
DeepMind, a Google-owned British company, might be on the verge of creating human-level artificial intelligence. The revelation was made by the company's lead researcher Dr. Nando de Freitas in response to The Next Web columnist Tristan Greene who claimed humans will never achieve AGI. For anyone who doesn't know, AGI refers to a machine or program that can understand or learn any intellectual task that humans can. It can also do so without training. Addressing the somewhat pessimistic op-ed, and the decades-long quest to develop artificial general intelligence, Dr de Freitas said the game is over.
A Novelist and an AI Cowrote Your Next Cringe-Read
Last week, while giving a commencement speech to New York University graduates, pop star Taylor Swift offered a timely bit of advice: "No matter how hard you try to avoid being cringe, you will look back on your life and cringe retrospectively. Cringe is unavoidable over a lifetime." We live in inescapably cringe-y times. Los Angeles-based writer K. Allado-McDowell's new novel, Amor Cringe, is a love letter to cringe maximalism. Allado-McDowell set out to write the cringiest story possible and ended up creating an odd, surprisingly funny little book.
Building a culture of pioneering responsibly
As chief operating officer of one of the world's leading artificial intelligence labs, I spend a lot of time thinking about how our technologies impact people's lives – and how we can ensure that our efforts have a positive outcome. This is the focus of my work, and the critical message I bring when I meet world leaders and key figures in our industry. For instance, it was at the forefront of the panel discussion on'Equity Through Technology' that I hosted this week at the World Economic Forum in Davos, Switzerland. Inspired by the important conversations taking place at Davos on building a greener, fairer, better world, I wanted to share a few reflections on my own journey as a technology leader, along with some insight into how we at DeepMind are approaching the challenge of building technology that truly benefits the global community. In 2000, I took a sabbatical from my job at Intel to visit the orphanage in Lebanon where my father was raised. For two months, I worked to install 20 PCs in the orphanage's first computer lab, and to train the students and teachers to use them.
The hype around DeepMind's new AI model misses what's actually cool about it
One of DeepMind's top researchers and a coauthor of the Gato paper, Nando de Freitas, couldn't contain his excitement. "The game is over!" he tweeted, suggesting that there is now a clear path from Gato to artificial general intelligence, or AGI, a vague concept of human- or superhuman-level AI. The way to build AGI, he claimed, is mostly a question of scale: making models such as Gato bigger and better. Unsurprisingly, de Freitas's announcement triggered breathless press coverage that DeepMind is "on the verge" of human-level artificial intelligence. This is not the first time hype has outstripped reality.