The Chincha Kingdom likely used seabird guano to fertilize their corn. Breakthroughs, discoveries, and DIY tips sent six days a week. When it comes to the success of ancient civilizations, the first things that come to mind are typically their military strength, roads, and trade. New research, however, highlights a potential key to the strength of a pre-Incan society that is both surprising and slightly disgusting: seabird guano, also known as bird poop. The successful power in question is the Chincha Kingdom (1000 - 1400 CE), a coastal society that ruled over the Chincha Valley in present-day southern Peru.

This simple generative task requires a model to copy binary symbols over long-range dependencies, ignoring the tokens in between. We find that Transformer FFLMs suffer from a long tail of sporadic reasoning errors, some of which we can eliminate using various regularization techniques.

This simple generative task requires a model to copy binary symbols over long-range dependencies, ignoring the tokens in between. We find that Transformer FFLMs suffer from a long tail of sporadic reasoning errors, some of which we can eliminate using various regularization techniques.