Country
Low-Dimensional Structure in the Space of Language Representations is Reflected in Brain Responses
Antonello, Richard, Turek, Javier, Vo, Vy, Huth, Alexander
How related are the representations learned by neural language models, translation models, and language tagging tasks? We answer this question by adapting an encoder-decoder transfer learning method from computer vision to investigate the structure among 100 different feature spaces extracted from hidden representations of various networks trained on language tasks. This method reveals a low-dimensional structure where language models and translation models smoothly interpolate between word embeddings, syntactic and semantic tasks, and future word embeddings. We call this low-dimensional structure a language representation embedding because it encodes the relationships between representations needed to process language for a variety of NLP tasks. We find that this representation embedding can predict how well each individual feature space maps to human brain responses to natural language stimuli recorded using fMRI. Additionally, we find that the principal dimension of this structure can be used to create a metric which highlights the brain's natural language processing hierarchy. This suggests that the embedding captures some part of the brain's natural language representation structure.
TCNN: Triple Convolutional Neural Network Models for Retrieval-based Question Answering System in E-commerce
Automatic question-answering (QA) systems have boomed during last few years, and commonly used techniques can be roughly categorized into Information Retrieval (IR)-based and generation-based. A key solution to the IR based models is to retrieve the most similar knowledge entries of a given query from a QA knowledge base, and then rerank those knowledge entries with semantic matching models. In this paper, we aim to improve an IR based e-commerce QA system-AliMe with proposed text matching models, including a basic Triple Convolutional Neural Network (TCNN) model and two Attention-based TCNN (ATCNN) models. Experimental results show their effect.
Meta is reportedly working on a new AI model called 'Avocado' and it might not be open source
GPU prices could follow RAM's big rise Meta is reportedly working on a new AI model called'Avocado' and it might not be open source Mark Zuckerberg has been shaking up the company's AI strategy as it pursues superintelligence. Meta CEO Mark Zuckerberg speaks during an event at the Biohub Imaging Institute in Redwood City, Calif., Wednesday, Nov. 5, 2025. Mark Zuckerberg has for months publicly hinted that he is backing away from open-source AI models. Now, Meta's latest AI pivot is starting to come into focus. The company is reportedly working on a new model, known inside of Meta as Avocado, which could mark a major shift away from its previous open-source approach to AI development.
Divided Fed lowers rates, signals pause and one 2026 cut as growth rebounds
U.S. Federal Reserve Chair Jerome Powell speaks during a conference following a two-day meeting of the Federal Open Market Committee, at the U.S. Federal Reserve in Washington on Wednesday. Washington - The Federal Reserve cut interest rates on Wednesday in another divided vote, but signaled it will likely pause further reductions in borrowing costs as the U.S. central bank looks for clearer signals about the direction of the job market and inflation that remains somewhat elevated. New projections issued after the Fed's two-day meeting showed the median policymaker sees just one quarter-percentage-point cut in 2026, the same outlook as in September, with inflation expected to slow to around 2.4% by the end of next year even as economic growth accelerates to an above-trend 2.3% and the unemployment rate remains at a moderate 4.4%. In considering the extent and timing of additional adjustments to the target range for the federal funds rate, the Committee will carefully assess incoming data, the rate-setting Federal Open Market Committee said in language that in the past has been used to signal a pause in policy actions -- an outlook at odds with market expectations, which remained locked into two rate cuts next year even after the Fed issued its statement. In a time of both misinformation and too much information, quality journalism is more crucial than ever.
U.S. military funds AI tools to speed modeling of viral outbreaks
As SARS-CoV-2 radiated across the planet in 2020, epidemiologists scrambled to predict its spread--and its deadly consequences. Often, they turned to models that not only simulate viral transmission and hospitalization rates, but can also predict the effect of interventions: masks, vaccines, or travel bans. But in addition to being computationally intensive, models in epidemiology and other disciplines can be black boxes: millions of lines of legacy code subject to finicky tunings by operators at research organizations scattered around the world. They don't always provide clear guidance. "The models that are used are often kind of brittle and nonexplainable," says Erica Briscoe, who was a program manager for the Automating Scientific Knowledge Extraction and Modeling (ASKEM) project at the Defense Advanced Research Projects Agency (DARPA).
Eufy's Best Robot Vacuum Is 405 Off (2025)
Eufy's last-season robot vacuum-mop has a crazy price cut. Grab it before it's gone. Robot vacuums have improved in nearly every feature, and that includes the price. While you can expect to pay anywhere between $1,000 to $1,500 for a brand-new, fully-featured robot vacuum mop, you can snag last year's models for pretty incredible prices. That includes our current best robot vacuum, which is last year's Eufy X10 Pro Omni .
Spotify's new playlist feature gives users more control over their recommendation algorithm
GPU prices could follow RAM's big rise Spotify's new playlist feature gives users more control over their recommendation algorithm Users in New Zealand will be able to write prompts for custom playlists. Spotify is attempting to give users more control over the music the streaming service recommends with a new playlist feature called Prompted Playlist. The beta feature is rolling out in New Zealand starting on December 11, and will let users write a custom prompt that Spotify can use -- alongside their listening history -- to create a playlist of new music. By tapping on Prompted Playlist, Spotify subscribers participating in the beta will be presented with a prompt field where they can type exactly what they want to hear and how they want Spotify's algorithm to respond. And while past AI features took users' individual taste into consideration, Spotify claims Prompted Playlist taps into your entire Spotify listening history, all the way back to day one.
NASA astronaut comes home after circling Earth 3,920 times
Jonny Kim returned after eight months aboard the International Space Station. Breakthroughs, discoveries, and DIY tips sent every weekday. After 245 days in orbit aboard the International Space Station (ISS), one NASA astronaut and two cosmonauts have safely returned to Earth. NASA's Jonny Kim along with Roscosmos cosmonauts Sergey Ryzhikov and Alexey Zubritsky landed near the town of Zhezkazgan, Kazakhstan on December 9, and are now undergoing the standard post-mission health screenings. Kim officially became an astronaut in 2017.