Modern neural language models that are widely used in various NLP tasks risk memorizing sensitive information from their training data. Understanding this memorization is important in real world applications and also from a learningtheoretical perspective. An open question in previous studies of language model memorization is how to filter out "common" memorization. In fact, most memorization criteria strongly correlate with the number of occurrences in the training set, capturing memorized familiar phrases, public knowledge, templated texts, or other repeated data. We formulate a notion of counterfactual memorization which characterizes how a model's predictions change if a particular document is omitted during training. We identify and study counterfactually-memorized training examples in standard text datasets. We estimate the influence of each memorized training example on the validation set and on generated texts, showing how this can provide direct evidence of the source of memorization at test time.

This week in tech: Elon Musk and Donald Trump flood the zone and deploy brinkmanship as a negotiating tactic; US Immigration and Customs Enforcement learns search engine optimization amid arrests and deportations; and Spotify tries to soften its algorithmic image with human-centric public relations. Donald Trump has issued a record number of executive orders since his presidency began: ending birthright citizenship, banning gender transitions for anyone under 19, pardoning the rioters of the January 6 attack, and more. Elon Musk, the world's richest man in charge of the "department of government efficiency", has raided an equally dizzying swath of federal agencies with the stated goal of "slashing waste, fraud, and abuse". Among the half-dozen bureaus are the Consumer Financial Protection Bureau, Department of Education, Department of Labor and, most viciously, the US Agency for International Development (USAid). Trump and Musk are doing their utmost to "flood the zone" – a tactic that the former Trump administration strategist Steve Bannon has touted as one that will purposefully overwhelm the opposition and the media.

We did not find significant difference between the two datasets.

Coca-Cola's new futuristic flavor was co-created using artificial intelligence. Some Americans said it tasted better than the original recipe, but others couldn't stomach a whole can. Coca-Cola is debuting a new flavor – and it's got a hint of citrus in it. Coca-Cola Orange Cream will be available nationwide starting Feb. 10, the Atlanta-based soda company announced on Monday morning. Described as "the delicious taste of Coca-Cola infused with refreshing orange and smooth, creamy vanilla flavors," Coca-Cola Orange Cream will also be available in a Zero Sugar version.

In this supplementary material, we provide details on evaluation metrics, details on our network architecture, a trade-off between computational cost and depth accuracy, additional qualitative results, depth accuracy on overlap regions, point cloud results on the DDAD dataset and nuScenes dataset, and the license of existing assets we used for our paper. To evaluate the depth accuracy, we use the error metric proposed by Eigen et al. [8]. We provide further details on our network architecture with Table 3. For more information about the implementation, please refer to our source code. Our model uses only 1D/2D convolutions and MLPs; we do not use 3D convolution which is computationally heavy and consume extensive memory. We used pre-trained ResNet-18 [16] for the image encoder.

The 2025 Oscar nominations were announced on Thursday, and two New Yorker films are among the contenders. "Incident," which uses body-camera and surveillance footage to examine a police shooting in Chicago, is nominated in the Documentary Short Film category, while "I'm Not a Robot," a darkly humorous Dutch film about a woman taking a series of CAPTCHA tests, is nominated for best Live Action Short. Seventeen previous New Yorker films have been nominated for Academy Awards; a victory at this year's ceremony, scheduled for March 2nd in Los Angeles, would be the magazine's first win. "Incident," directed by Bill Morrison, who produced with Jamie Kalven, chronicles a police killing and its aftermath. On a Chicago sidewalk, an African American man named Harith (Snoop) Augustus is questioned and then pursued by a foot patrol after leaving the barbershop where he works; after a brief scuffle, he is fatally wounded.

Education company Pearson has teamed up with Microsoft to upskill workers for the next era of artificial intelligence (AI). On Tuesday, the two companies announced a partnership to create "a series of copilots, agents and AI tools targeted at helping people develop skills," according to a Pearson representative. The idea behind the partnership is to supercharge Pearson's learning tool acumen with Microsoft Azure Cloud, which will help Pearson scale its AI. Microsoft will build on its current use of Pearson VUE, the company's certification platform, providing more people with the opportunity to access existing certifications through 2029. "Partnering with Microsoft means we can reach more learners than ever before," Pearson CEO Omar Abbosh said in the release.

DJI has lifted its geofence that prevents users in the US from flying over restricted areas like nuclear power plants, airports and wildfires, the company wrote in a blog post on Monday. As of January 13th, areas previously called "restricted zones" or no-fly zones will be shown as "enhanced warning zones" that correspond to designated Federal Aviation Administration (FAA) areas. DJI's Fly app will display a warning about those areas but will no longer stop users from flying inside them, the company said. In the article, DJI wrote that the "in-app alerts will notify operators flying near FAA designated controlled airspace, placing control back in the hands of the drone operators, in line with regulatory principles of the operator bearing final responsibility." It added that technologies like Remote ID [introduced after DJI implemented geofencing] gives authorities "the tools needed to enforce existing rules," DJI's global policy chief Adam Welsh told The Verge.

At CES last year, Sony teased an AR/VR headset prototype focused on "spatial content creation." And at the same time, Siemens announced it was working with Sony to use that same hardware, including the two new controllers it developed, for something it was calling the "industrial metaverse." That's a lot of buzzwords, but at CES 2025 both Siemens and Sony showed the headsets and associated software in action which helped clear up a lot of what the companies are trying to do here. During Sony's CES press conference, it announced its XYN brand of software and hardware solutions, with the headset being a key part of the equation. The XYN "spatial capture solution" uses mirrorless cameras to scan and make photorealistic 3D objects. Using the XYN headset, you can see those objects in 3D production software for animation, video games and other potential uses.

The world's first'city of the future' is nearly ready to welcome its first residents. Developed by car maker Toyota, 'Woven City' sits at the base of Mount Fuji in Japan and features at least 11 'smart' homes powered by hydrogen, AI and other technologies. CEO Akio Toyoda said the 10 billion utopia would serve as a'lab' for innovators to develop the technologies of tomorrow. The city is poised to welcome its first 100 residents, which will be employees, this fall, who will live there for free -- though they'll need to already be Toyota employees and work on developing experimental tech for the company. The program will then expand to 2,200 more people, who will include innovators and their families, parents and pets.