In computational social science (CSS), researchers analyze documents to explain social and political phenomena. In most scenarios, CSS researchers first obtain labels for documents and then explain labels using interpretable regression analyses in the second step. One increasingly common way to annotate documents cheaply at scale is through large language models (LLMs). However, like other scalable ways of producing annotations, such surrogate labels are often imperfect and biased. We present a new algorithm for using imperfect annotation surrogates for downstream statistical analyses while guaranteeing statistical properties--like asymptotic unbiasedness and proper uncertainty quantification--which are fundamental to CSS research.

Language models (LMs) exhibit remarkable abilities to solve new tasks from just a few examples or textual instructions, especially at scale. They also, paradoxically, struggle with basic functionality, such as arithmetic or factual lookup, where much simpler and smaller specialized models excel. In this paper, we show that LMs can teach themselves to use external tools via simple APIs and achieve the best of both worlds. We introduce Toolformer, a model trained to decide which APIs to call, when to call them, what arguments to pass, and how to best incorporate the results into future token prediction. This is done in a self-supervised way, requiring nothing more than a handful of demonstrations for each API. We incorporate a range of tools, including a calculator, a Q&A system, a search engine, a translation system, and a calendar. Toolformer achieves substantially improved zero-shot performance across a variety of downstream tasks, often competitive with much larger models, without sacrificing its core language modeling abilities.

Fecal vandal's nearly weeklong crime spree comes to an end when police catch her in the act Catching the horny landlady teaching your boyfriend mouth-to-mouth is not a sign that it's time to move MAGA bikini congresswoman sends a message to big brother, Dale Earnhardt turns 75 & MLB fan gets pulverized! Wait... Who is actually using highway rest stop BBQ grills? Hilary Duff's latest Instagram content has suburban millennial moms gasping, a tennis match turns nasty & MEAT Opening day at Six Flags St. Louis ended in chaos after brawl with as many as 100 people broke out Mountain climber survives terrifying 500-foot fall in California's Sierra Nevada, night stranded on ledge Ella Langley's brand deal with American Eagle shows Bud Light how it could've been in 2023, fan fight & MEAT Shannon Elizabeth, to nobody's surprise, cashes in on OnlyFans with reported 7-figure payday in her first week Airline doesn't buy couple's claim that they were praying, bans them for attempting to join mile high club Bill Maher & David Cross get into heated war of words over'looney left' & trans rights, including 3-year-old'Map wars': Brit Hume says redistricting battle is'as bitter' as he's ever seen it Candidates make their case as California governor's race intensifies Hegseth, Caine defend Pentagon's budget request on Capitol Hill Greg Gutfeld: Walz tries to appear'above it all,' but is'drowning' in corruption Ukraine is'militarily' defeated: Trump Trump posts AI image of himself with a gun, says Iran'better get smart soon' Trump calls Comey a'dirty cop' and a'crooked man' Sen. Rand Paul backs White House ballroom after WHCA shooting Steven Hilton says voter ID push could boost GOP turnout in California governor's race There's no question that robots are going to be coming for some folks' jobs sooner rather than later, and it looks like baggage handlers could be one of the first on the robo-chopping block. Japan Airlines is going to start rolling out its humanoid robots to help with baggage at Tokyo's Haneda Airport. Now, while I'm usually not one to celebrate something like this -- I feel it's just one step closer to all of us having to pay our respects to robot overlords -- I was excited about it.