Erzincan
Approximating Families of Sharp Solutions to Fisher's Equation with Physics-Informed Neural Networks
Rohrhofer, Franz M., Posch, Stefan, Gößnitzer, Clemens, Geiger, Bernhard C.
This paper employs physics-informed neural networks (PINNs) to solve Fisher's equation, a fundamental representation of a reaction-diffusion system with both simplicity and significance. The focus lies specifically in investigating Fisher's equation under conditions of large reaction rate coefficients, wherein solutions manifest as traveling waves, posing a challenge for numerical methods due to the occurring steepness of the wave front. To address optimization challenges associated with the standard PINN approach, a residual weighting scheme is introduced. This scheme is designed to enhance the tracking of propagating wave fronts by considering the reaction term in the reaction-diffusion equation. Furthermore, a specific network architecture is studied which is tailored for solutions in the form of traveling waves. Lastly, the capacity of PINNs to approximate an entire family of solutions is assessed by incorporating the reaction rate coefficient as an additional input to the network architecture. This modification enables the approximation of the solution across a broad and continuous range of reaction rate coefficients, thus solving a class of reaction-diffusion systems using a single PINN instance.
LongForm: Optimizing Instruction Tuning for Long Text Generation with Corpus Extraction
Köksal, Abdullatif, Schick, Timo, Korhonen, Anna, Schütze, Hinrich
Instruction tuning enables language models to generalize more effectively and better follow user intent. However, obtaining instruction data can be costly and challenging. Prior works employ methods such as expensive human annotation, crowd-sourced datasets with alignment issues, or generating noisy examples via LLMs. We introduce the LongForm dataset, which is created by leveraging English corpus examples with augmented instructions. We select a diverse set of human-written documents from existing corpora such as C4 and Wikipedia and generate instructions for the given documents via LLMs. This approach provides a cheaper and cleaner instruction-tuning dataset and one suitable for long text generation. We finetune T5, OPT, and LLaMA models on our dataset and show that even smaller LongForm models have good generalization capabilities for text generation. Our models outperform 10x larger language models without instruction tuning on various tasks such as story/recipe generation and long-form question answering. Moreover, LongForm models outperform prior instruction-tuned models such as FLAN-T5 and Alpaca by a large margin. Finally, our models can effectively follow and answer multilingual instructions; we demonstrate this for news generation. We publicly release our data and models: https://github.com/akoksal/LongForm.
A Rosetta Stone for Earthquakes
Istanbul, a city of 14 million people and a crossroads of cultural exchange dating back millennia, may also be where Turkey's next major earthquake strikes. Cities along the North Anatolian Fault, which stretches from eastern Turkey to the Aegean Sea, have experienced an advancing series of strong quakes during the past 80 years, beginning in 1939 when a devastating 7.8-magnitude rupture leveled the city of Erzincan and killed 33,000 people. Most recently, in 1999, 7.4-magnitude quake near the city of İzmit left 17,000 dead and half a million homeless. A few months later, another shock hit Düzce, 60 miles away. Brendan Meade, an applied computational scientist and associate professor of earth and planetary sciences, recently built a computer model of conditions in the North Anatolian Fault.