Media
Philosophers On GPT-3 (updated with replies by GPT-3) - Daily Nous
Nine philosophers exploreย the various issues and questions raised by the newly released language model, GPT-3, in this edition ofย Philosophers On, guest edited by Annette Zimmermann. Introduction Annette Zimmermann, guest editor GPT-3, a powerful, 175 billion parameter language model developed recently by OpenAI, has been galvanizing public debate and controversy. As the MIT Technology Review puts it: โOpenAIโs new language generator GPT-3 is shockingly goodโand completely mindlessโ. Parts of the technology community hope (and fear) that GPT-3 could brings us one step closer to the hypothetical future possibility of human-like, highly sophisticated artificial general intelligence (AGI). Meanwhile, others (including OpenAIโs own CEO) have critiqued claims about GPT-3โs ostensible proximity to AGI, arguing that they are vastly overstated. Why the hype? As is turns out, GPT-3 is unlike other natural language processing (NLP) systems, the latter of which often struggle with what comes comparatively easily to humans: performing entirely new language tasks based on a few simple instructions and examples. Instead, NLP systems usually have to be pre-trained on a large corpus of text, and then fine-tuned in order to successfully perform a specific task. GPT-3, by contrast, does not require fine tuning of this kind: it seems to be able to perform a whole range of tasks reasonably well, from producing fiction, poetry, and press releases to functioning code, and from music, jokes, and technical manuals, to โnews articles which human evaluators have difficulty distinguishing from articles written by humansโ. The Philosophers On series contains group posts on issues of current interest, with the aim being to show what the careful thinking characteristic of philosophers (and occasionally scholars in related fields) can bring to popular ongoing conversations. Contributors present not fully worked out position papers but rather brief thoughts that can serve as prompts for further reflection and discussion. The contributors to this installment of โPhilosophers Onโ are Amanda Askell (Research Scientist, OpenAI), David Chalmers (Professor of Philosophy, New York University), Justin Khoo (Associate Professor of Philosophy, Massachusetts Institute of Technology), Carlos Montemayor (Professor of Philosophy, San Francisco State University), C. Thi Nguyen (Associate Professor of Philosophy, University of Utah), Regina Rini (Canada Research Chair in Philosophy of Moral and Social Cognition, York University), Henry Shevlin (Research Associate, Leverhulme Centre for..
[D] Why would anyone use Metropolis-Hastings?
The replies to date make sense to me mathematically, but I don't understand the situations where this is needed. Is there a simple example where this comes up, at the level of'you are figuring out a dice game' or card game? I can't seem to get an intuitive feel for it. Book and pages that I have read discuss the algorithms (Gibbs sampling, MCMC, Metropolis-hastings, etc.) but not concrete cases for their need. Edit: thank you for the examples, they help clarify.
[P] I've asked a dozen researchers about their favourite ML books, here are the results
If you don't have much time: start with ISL (you may want to wait for the upcoming Python edition). Should take about a month if you read everyday and code at the same time. This book is very accessible. If you have time: start directly with Bishop's PRML (takes 3-6 months). This is for me the best ML book.
The Building Blocks of Artificial Intelligence
Machine vision is the classification and tracking of real-world objects based on visual, x-ray, laser, or other signals. Optical character recognition was an early success of machine vision, but deciphering handwritten text remains a work in progress. The quality of machine vision depends on human labeling of a large quantity of reference images. The simplest way for machines to start learning is through access to this labeled data. Within the next five years, video-based computer vision will be able to recognize actions and predict motion--for example, in surveillance systems.
How to play your personal music collection on Google Home and Chromecast
Google Play Music is currently the best streaming music service for people who have their own music collections. The service lets users upload 50,000 of their own music files, then access the audio on a wide range of streaming devices. It's a great way to access your own music files from anywhere, and it doesn't cost a dime. Unfortunately, the free ride is just about over. At the end of this year, Google will discontinue Google Play Music and push users over to YouTube Music as a replacement.