Stranger Things: What could happen next as the show's finale looms? Spoiler warning: This contains some details about what has happened in the show so far, but does not reveal anything about the final four episodes. A Christmas feast may be around the corner, or perhaps another chocolate (no strawberry creams, thanks), but for fans of Stranger Things, another gift is waiting to be consumed. The grand finale of Netflix's hugely popular sci-fi fantasy horror series, which also showcases some questionable 80s fashion choices, is looming. Fans last saw the inhabitants of Hawkins in a perilous place as season five opened, with Demogorgons running rampant, along with the monstrous Vecna.

Recently, Large Language Models (LLMs) have rapidly evolved, approaching Artificial General Intelligence (AGI) while benefiting from large-scale reinforcement learning to enhance Human Alignment (HA) and Reasoning. Recent reward-based optimization algorithms, such as Proximal Policy Optimization (PPO) and Group Relative Policy Optimization (GRPO) have achieved significant performance on reasoning tasks, whereas preference-based optimization algorithms such as Direct Preference Optimization (DPO) significantly improve the performance of LLMs on human alignment. However, despite the strong performance of reward-based optimization methods in alignment tasks , they remain vulnerable to reward hacking. Furthermore, preference-based algorithms (such as Online DPO) haven't yet matched the performance of reward-based optimization algorithms (like PPO) on reasoning tasks, making their exploration in this specific area still a worthwhile pursuit. Motivated by these challenges, we propose the Trust Region Preference Approximation (TRPA) algorithm, which integrates rule-based optimization with preference-based optimization for reasoning tasks. As a preference-based algorithm, TRPA naturally eliminates the reward hacking issue. TRPA constructs preference levels using predefined rules, forms corresponding preference pairs, and leverages a novel optimization algorithm for RL training with a theoretical monotonic improvement guarantee. Experimental results demonstrate that TRPA not only achieves competitive performance on reasoning tasks but also exhibits robust stability. The code of this paper are released and updating on https://github.com/XueruiSu/Trust-Region-Preference-Approximation.git.

I've never played Minecraft in my life--but then I'm not a Christian, either, and have always delighted in the distinctly Mormon cinematic universe of Jared Hess, the director of "A Minecraft Movie." He's best known for "Napoleon Dynamite," from 2004, which evokes its spiritual milieu only implicitly, by the absence of secular pop culture and of teen-age ribaldry. He followed it with "Nacho Libre," starring Jack Black as a friar who enters the wrestling ring to save a convent, and, in 2009, with "Gentlemen Broncos," a celestial gross-out vision of an adolescent gospel. His satire "Don Verdean," from 2015, is explicitly set in church communities and involves relic smuggling in Israel; his 2016 comedy, "Masterminds," is a heist film that's centered on grace and holy innocence. With "A Minecraft Movie," I was impatient to see what Hess would do with another world of extreme fantasy, akin to that of "Gentlemen Broncos." The short answer is, too much and not nearly enough; the I.P. is the boss, the characters are its minions, and Hess--constrained both by a script that he didn't write and by the demands of complex C.G.I.--struggles to live up to his own œuvre, which is among the most substantially loopy (or loopily substantial) in modern cinema.

It was natural that the recent boom in video game adaptations would yield a new film based on the best-known virtual universe of the modern era. Minecraft, the Microsoft-owned digital sandbox that holds the record as the bestselling video game of all time, is finally taking its place in the annals of beloved gaming franchises--like Super Mario Bros. and Sonic the Hedgehog--that have earned the Hollywood studio treatment, celebrity stars and special effects and all. Helmed by Napoleon Dynamite director and friend of Slate Jared Hess, A Minecraft Movie throws Jack Black, Jason Momoa, Danielle Brooks, Emma Myers, and Jennifer Coolidge into the titular game's pixelated universe, subjecting their real-life bodies to the simplistic physics, creative engineering, and bizarre supernatural life forms that make up the expansive worlds of Minecraft. It took about a decade to get this flick off the ground, so the anticipation is high--especially among younger gamers addicted to the online playgrounds that gained such traction during the COVID-19 pandemic lockdowns. Already, the film is breaking box-office records held by previous game adaptations, and if you have a child who spends a lot of time playing on the computer, chances are they're definitely ready and excited to catch A Minecraft Movie--even if you barely know what Minecraft is.

I too rolled my eyes when A Minecraft Movie was announced. We're all tired of seeing Jack Black in video game movies -- he was fine in Super Mario Bros., but good god Borderlands was a disaster. And the Minecraft film's trailers did it no favors, another soulless movie produced on a virtual set about a game that's completely open-ended and plotless. But it turns out A Minecraft Movie is actually good. Honestly, I'm as surprised as you are.

If you're not familiar with Minecraft as a game then this film, notionally a big screen version of same, won't necessarily solve that. Minecraft, even more than most computer games, is what you make of it, an experience generated by the player. So in a way, the idea of making a film set in the Minecraft world is counterintuitive, because it can never replicate what is good about Minecraft, it can only tell you what is good about Minecraft. In addition to that, this comedy-fantasy takes aspects of the Minecraft world and uses them as building blocks in a rollicking adventure suitable for almost all ages, giving Jack Black and Jason Momoa carte blanche to wild out and be deeply silly. Your affection for and/or tolerance of this latter prospect will dictate to a large extent your enjoyment of this film.

In 2002, at age 40, Henry had a massive stroke, which left him with quadriplegia and an inability to speak. Since then, he's learned how to communicate by moving his eyes over a letter board, but he is highly reliant on caregivers and his wife, Jane. Henry got a glimmer of a different kind of life when he saw Charlie Kemp on CNN in 2010. Kemp, a robotics professor at Georgia Tech, was on TV talking about PR2, a robot developed by the company Willow Garage. PR2 was a massive two-armed machine on wheels that looked like a crude metal butler.

Marketers spend billions of dollars on advertisements but to what end? At the time of purchase, if customers cannot recognize the brand for which they saw an ad, the money spent on the ad is essentially wasted. Despite its importance in marketing, until now, there has been no study on the memorability of ads in the ML literature. Most studies have been conducted on short-term recall (<5 mins) on specific content types like object and action videos. On the other hand, the advertising industry only cares about long-term memorability, and ads are almost always highly multimodal, depicting a story through its different modalities. With this motivation, we release the first large-scale memorability dataset, LAMDBA, consisting of 1749 participants and 2205 ads covering 276 brands. Running statistical tests over different participant subpopulations and ad types, we find many interesting insights into what makes an ad memorable. For e.g., we find that brands that use commercials with fast-moving scenes are more memorable than those with slower scenes (p=8e-10) and that people who use ad-blockers remember fewer ads than those who don't (p=5e-3). Next, to simulate the memorability of marketing materials for a particular audience, we present a novel model, Henry, trained to leverage real-world knowledge of LLMs and visual knowledge to predict the memorability. We test Henry on all the prominent memorability datasets in literature (both images and videos) and achieve state-of-the-art performance across all of them. Henry shows strong generalization showing better results in 0-shot on unseen datasets. Next, we propose the task of memorable ad generation and release a large-scale ad dataset, UltraLAMBDA, consisting of 4 million ads with their Henry-assigned memorability scores. We show that aligning Henry to generate memorable content improves memorability scores by more than 25%.

A tech expert has warned that new advances in AI-powered technology will lead to an'explosion' in cybercrime in 2024. Shawn Henry, the chief security officer for CrowdStrike, recently shared how cybercriminals can use AI to sneak through individuals' cybersecurity defenses, spread misinformation, or infiltrate corporate networks. Cybercriminals can use AI to mislead people into believing false narratives during the election season and potentially giving up sensitive information, said the retired executive assistant director of the Federal Bureau of Investigation (FBI). The cybersecurity veteran's warning comes when AI has been given more jobs than ever, including in the US federal and state governments. Twenty-seven departments of the US federal government have deployed AI in some way, and many states have, too.

Teleoperation of mobile manipulators within a home environment can significantly enhance the independence of individuals with severe motor impairments, allowing them to regain the ability to perform self-care and household tasks. There is a critical need for novel teleoperation interfaces to offer effective alternatives for individuals with impairments who may encounter challenges in using existing interfaces due to physical limitations. In this work, we iterate on one such interface, HAT (Head-Worn Assistive Teleoperation), an inertial-based wearable integrated into any head-worn garment. We evaluate HAT through a 7-day in-home study with Henry Evans, a non-speaking individual with quadriplegia who has participated extensively in assistive robotics studies. We additionally evaluate HAT with a proposed shared control method for mobile manipulators termed Driver Assistance and demonstrate how the interface generalizes to other physical devices and contexts. Our results show that HAT is a strong teleoperation interface across key metrics including efficiency, errors, learning curve, and workload. Code and videos are located on our project website.