Goto

Collaborating Authors

 deep breath


Deep sighs are not only satisfying--they're healthy

Popular Science

Health Fitness & Exercise Deep sighs are not only satisfying--they're healthy Those deep breaths can really help your lungs. Breakthroughs, discoveries, and DIY tips sent every weekday. There's something to be said about a good sigh . Sometimes that deep exhale doesn't just feel psychologically satisfying, but physically restorative. According to a study published in the journal, new evidence indicates sighing truly is a way to help reset your body--specifically, the fluid that coats your lungs .

  Country:
  Genre: Research Report > New Finding (0.91)
  Industry: Health & Medicine > Therapeutic Area (1.00)

Taking a Deep Breath: Enhancing Language Modeling of Large Language Models with Sentinel Tokens

Luo, Weiyao, Zheng, Suncong, Xia, Heming, Wang, Weikang, Lei, Yan, Liu, Tianyu, Chen, Shuang, Sui, Zhifang

arXiv.org Artificial Intelligence

Large language models (LLMs) have shown promising efficacy across various tasks, becoming powerful tools in numerous aspects of human life. However, Transformer-based LLMs suffer a performance degradation when modeling long-term contexts due to they discard some information to reduce computational overhead. In this work, we propose a simple yet effective method to enable LLMs to take a deep breath, encouraging them to summarize information contained within discrete text chunks. Specifically, we segment the text into multiple chunks and insert special token at the end of each chunk. We then modify the attention mask to integrate the chunk's information into the corresponding token. This facilitates LLMs to interpret information not only from historical individual tokens but also from the token, aggregating the chunk's semantic information. Experiments on language modeling and out-of-domain downstream tasks validate the superiority of our approach.


Re3: Generating Longer Stories With Recursive Reprompting and Revision

Yang, Kevin, Tian, Yuandong, Peng, Nanyun, Klein, Dan

arXiv.org Artificial Intelligence

We consider the problem of automatically generating longer stories of over two thousand words. Compared to prior work on shorter stories, long-range plot coherence and relevance are more central challenges here. We propose the Recursive Reprompting and Revision framework (Re3) to address these challenges by (a) prompting a general-purpose language model to construct a structured overarching plan, and (b) generating story passages by repeatedly injecting contextual information from both the plan and current story state into a language model prompt. We then revise by (c) reranking different continuations for plot coherence and premise relevance, and finally (d) editing the best continuation for factual consistency. Compared to similar-length stories generated directly from the same base model, human evaluators judged substantially more of Re3's stories as having a coherent overarching plot (by 14% absolute increase), and relevant to the given initial premise (by 20%).


Covid killed UBI; Long live guaranteed income

MIT Technology Review

It was December 2020, and she was being invited into a pilot program providing guaranteed income--a direct cash transfer with no strings attached. For Softky, it was a lifeline. "For the first time in a long time, I felt like I could … take a deep breath, start saving, and see myself in the future," she says. The idea of "just giving people money" has been in and out of the news since becoming a favored cause for many high-profile Silicon Valley entrepreneurs, including Twitter's Jack Dorsey, Facebook cofounders Mark Zuckerberg and (separately) Chris Hughes, and Singularity University's Peter Diamandis. They proposed a universal basic income as a solution to the job losses and social conflict that would be wrought by automation and artificial intelligence--the very technologies their own companies create.


Deepak Chopra: Use technology to create a more just and peaceful world

USATODAY - Tech Top Stories

Deepak Chopra is teaming up with Alexa to give'Daily Reflections' to help you start your day relaxed and focused. If you ask Deepak Chopra what the world needs, you might be surprised what he says: "We need technology to rewire the global brain. The internet is the global brain," he said. That's not quite the sentiment one might expect from a renowned spiritual guru. But as he explained in a recent visit to USA TODAY with tech columnist Ed Baig, "If you want to know the human condition, go to the internet--divine and diabolical, sacred and profane, it's all there."


Role-playing video game seen helping ease depression for counselor-shy Japanese

The Japan Times

It's a role-playing video game that, like many of its kind, allows users to choose and customize their own avatar, including a hairstyle and clothing. Set in a medieval fantasy world, users build up their power as their character travels across "provinces," overcoming obstacles and challenges along the way. What's unique about SPARX -- which stands for smart, positive, active, realistic, X-factor thoughts -- is that it's designed specifically for people with mild to moderate depression. SPARX was developed in the late 2000s by researchers and clinicians at the University of Auckland in New Zealand who became alarmed by the high suicide rate among teenagers in the country. They decided to develop a way to reach out to young people who shy away from seeking face-to-face counseling. The game's original English version is currently available only in New Zealand.