Large language models (LLMs) often exhibit undesirable behaviors, such as hallucinations and sequence repetitions. We propose to view these behaviors as fallbacks that models exhibit under uncertainty, and investigate the connection between them. We categorize fallback behaviors -- sequence repetitions, degenerate text, and hallucinations -- and extensively analyze them in models from the same family that differ by the amount of pretraining tokens, parameter count, or the inclusion of instruction-following training. Our experiments reveal a clear and consistent ordering of fallback behaviors, across all these axes: the more advanced an LLM is (i.e., trained on more tokens, has more parameters, or instruction-tuned), its fallback behavior shifts from sequence repetitions, to degenerate text, and then to hallucinations. Moreover, the same ordering is observed throughout a single generation, even for the best-performing models; as uncertainty increases, models shift from generating hallucinations to producing degenerate text and then sequence repetitions. Lastly, we demonstrate that while common decoding techniques, such as random sampling, might alleviate some unwanted behaviors like sequence repetitions, they increase harder-to-detect hallucinations.

The Legend of Zelda, one of the most successful and beloved gaming franchises of all time, is being made into a live-action film – and with such iconic characters as Link, Princess Zelda, the demonic Ganon and that one superhot half-fish prince everyone was in love earlier in the year, it's no wonder that the internet has absolutely exploded with people suggesting which actors should play them. So, we here at the Guardian thought we would put together our own dream cast for the upcoming flick. Tom Holland trends as fans discuss the casting of Link in upcoming live-action'Legend of Zelda' movie. However, given the wild success of the two most recent iterations of the series, Breath of the Wild and Tears of the Kingdom, it seems likely that that film will borrow heavily from their roster of characters. Although there are actually four great fairies in BotW and TotK, an amalgamation of these powerful and delightfully camp guardians would make a great cameo when our hero, Link, is in need of healing and magical help.

Chris Hemsworth is a well-known actor who is admired for both his tremendous talent and his exquisite appearance. Hemsworth has established himself as one of the most diverse and committed actors in the business throughout his more than ten-year career. Have you seen any of his Marvel Cinematic Universe performances? With his portrayal of Thor, he gave the character a new depth and complexity that captured the hearts and minds of the public. Hemsworth, however, is not only cast in action movies, as his tragic performance in "In the Heart of the Sea" demonstrates.