Today's youngsters will never know the painstaking task of going to a library and searching for an article or a particular book. This tedious undertaking involved hours upon hours of trawling through drawers filled with index cards – typically sorted by author, title or subject. An explosion in research publications during the 1940s made it especially time-consuming to locate what you wanted, especially as this was before the invention of the internet. Now, an expert has lifted the lid on the man and the device that changed everything – and it could also be the key to surviving AI. Dr Martin Rudorfer, a lecturer in Computer Science at Aston University, said an American engineer called Vannevar Bush first came up with a solution, dubbed the'memex'.

Recently, after an update that was supposed to make ChatGPT "better at guiding conversations toward productive outcomes," according to release notes from OpenAI, the bot couldn't stop telling users how brilliant their bad ideas were. ChatGPT reportedly told one person that their plan to sell literal "shit on a stick" was "not just smart--it's genius." Many more examples cropped up, and OpenAI rolled back the product in response, explaining in a blog post that "the update we removed was overly flattering or agreeable--often described as sycophantic." The company added that the chatbot's system would be refined and new guardrails would be put into place to avoid "uncomfortable, unsettling" interactions. But this was not just a ChatGPT problem. Sycophancy is a common feature of chatbots: A 2023 paper by researchers from Anthropic found that it was a "general behavior of state-of-the-art AI assistants," and that large language models sometimes sacrifice "truthfulness" to align with a user's views.

In order to be deployed safely, Large Language Models (LLMs) must be capable of dynamically adapting their behavior based on their level of knowledge and uncertainty associated with specific topics. This adaptive behavior, which we refer to as self-restraint, is non-trivial to teach since it depends on the internal knowledge of an LLM. By default, LLMs are trained to maximize the next token likelihood, which does not teach the model to modulate its answer based on its level of uncertainty. In order to learn self-restraint, we devise a utility function that can encourage the model to produce responses only when it is confident in them. This utility function can be used to score generation of different length and abstention. To optimize this function, we introduce ReSearch, a process of "self-reflection" consisting of iterative self-prompting and self-evaluation. We use the ReSearch algorithm to generate synthetic data on which we finetune our models. Compared to their original versions, our resulting models generate fewer \emph{hallucinations} overall at no additional inference cost, for both known and unknown topics, as the model learns to selectively restrain itself. In addition, our method elegantly incorporates the ability to abstain by augmenting the samples generated by the model during the search procedure with an answer expressing abstention.

In 1945, Vannevar Bush published "As We May Think." In it he proposed a Memex, a massive microfilm storage device where users could navigate between documents to concepts throughout the database. His concept directly inspired the invention of hypertext by Ted Nelson and Douglas Engelbart. The hyperlinking that enables so much of our online experience-- such as this link regarding hypertext-- owes much to Bush's vision. Inscription honoring Vannevar Bush in the lobby of MIT's Building 13, which is named after him.

You've likely heard stories about the birth of the PC: of Xerox PARC as the Mecca of computing; of its creation of the Alto, Ethernet, and the laser printer; of the Homebrew Computer Club, the MITS Altair, Bill Gates and the theft of his Micro-soft Basic; of Steve Jobs and Stephen Wozniak, the founding of Apple, and the Jobs visit to PARC that inspired the Macintosh. But what you may not know about is the really early history. The stories of Doug Engelbart and John McCarthy, of the Augmentation Research Center, and of the early days of the Stanford University AI Lab (SAIL) are not well known. Yes, you may have heard that Engelbart invented the mouse, and that SAIL and Stanford led to companies like Sun and Cisco. But there are better stories, great and old ones from the early days of computing, about the events that led to personal computing as we know it. In his wonderful new book, What the Dormouse Said…, John Markoff tells these stories.

Many of the obituaries for Yahoo have contrasted its demise with the flourishing of Google, another Web pioneer. Why was Google's attempt to "organize all the world's information" vastly more successful than Yahoo's? The short answer: Because Google did not organize the world's information. Google got the true spirit of the Web, as it was invented by Tim Berners-Lee. I was excited about escaping from the straightjacket of hierarchical documentation systems….