Media
An Information-theoretic Approach to Prompt Engineering Without Ground Truth Labels
Sorensen, Taylor, Robinson, Joshua, Rytting, Christopher Michael, Shaw, Alexander Glenn, Rogers, Kyle Jeffrey, Delorey, Alexia Pauline, Khalil, Mahmoud, Fulda, Nancy, Wingate, David
Pre-trained language models derive substantial linguistic and factual knowledge from the massive corpora on which they are trained, and prompt engineering seeks to align these models to specific tasks. Unfortunately, existing prompt engineering methods require significant amounts of labeled data, access to model parameters, or both. We introduce a new method for selecting prompt templates without labeled examples and without direct access to the model. Specifically, over a set of candidate templates, we choose the template that maximizes the mutual information between the input and the corresponding model output. Figure 1: Performance of template selected by our maximum Across 8 datasets representing 7 distinct NLP mutual information method (MI) compared to tasks, we show that when a template has high the the worst, mean, median, and best prompt on GPT-3 mutual information, it also has high accuracy Davinci (175B). Our method performs at almost oracle on the task. On the largest model, selecting levels, without labels or access to model weights.
13 Best Deals on Fitness Trackers, Tablets, and Air Purifiers
Combined with more daylight hours, this weekend's deals have us feeling rather sunny. We found deals on all of those categories and more. Special offer for Gear readers: Get a 1-year subscription to WIRED for $5 ($25 off). This includes unlimited access to WIRED.com and our print magazine (if you'd like). Subscriptions help fund the work we do every day.
Ringworld Needs to Be Updated for Television
Larry Niven's 1970 novel Ringworld is a beloved classic that received the Hugo, Nebula, and Locus awards. But science fiction author Rajan Khanna says the book has some major shortcomings for a modern reader. "I think that what this novel becomes is basically two thought experiments that get sandwiched together," Khanna says in Episode 505 of the Geek's Guide to the Galaxy podcast. "The characters are there to help explain these parts of the thought experiments, but they don't really--for me--become fully fledged, likable, relatable, or even interesting characters." Ringworld is currently being adapted for television by Akiva Goldsman, with Game of Thrones director Alan Taylor slated to direct the pilot.