phrasebook
On the Power of Context-Enhanced Learning in LLMs
Zhu, Xingyu, Panigrahi, Abhishek, Arora, Sanjeev
We formalize a new concept for LLMs, context-enhanced learning. It involves standard gradient-based learning on text except that the context is enhanced with additional data on which no auto-regressive gradients are computed. This setting is a gradient-based analog of usual in-context learning (ICL) and appears in some recent works. Using a multi-step reasoning task, we prove in a simplified setting that context-enhanced learning can be exponentially more sample-efficient than standard learning when the model is capable of ICL. At a mechanistic level, we find that the benefit of context-enhancement arises from a more accurate gradient learning signal. We also experimentally demonstrate that it appears hard to detect or recover learning materials that were used in the context during training. This may have implications for data security as well as copyright.
6 Google Translate tips you need to start using
Decades ago, Star Trek introduced the idea of a "universal translator," a small baton that let crew members converse with aliens in their native languages simply by flipping a switch. This app isn't part of the pre-installed loadout on most phones, but it's indispensable when you travel. It's so overflowing with features, in fact, you might not even realize everything it can do. So here are the six most awesome and useful things you can do with Google Translate on your smartphone. You won't always have the best mobile data connection while traveling the world, so it's a good idea to have an offline backup in Translate.
4 Google Translate features you'll use every day
Google Translate's knowledge of more than 100 languages can help you in your daily workflow as much as it can help you on your next trip. The features below show how it can help you with entire documents or websites, or even your native tongue. Google Translate can parse individual words and phrases, of course, but you can also translate entire websites into a chosen language. You can translate foreign websites like this Italian news publication into another language with Google Translate. Just type the entire URL of the website you want translated in the text box on the left side of Google Translate's home page.