Industry
FederatedEnsemble-Directed OfflineReinforcementLearning
We consider the problem of federated offline reinforcement learning (RL), a scenario under which distributed learning agents must collaboratively learn a high-quality control policyonly using small pre-collected datasets generated according to different unknown behavior policies. Naรฏvely combining a standard offline RL approach with a standard federated learning approach to solve this problem can lead to poorly performing policies. In response, we develop the Federated Ensemble-Directed Offline Reinforcement Learning Algorithm (FEDORA), which distills the collective wisdom of the clients using an ensemble learning approach. We develop the FEDORA codebase to utilize distributed compute resources on a federated learning platform. We show that FEDORA significantly outperforms other approaches, including offline RL over the combined data pool, in various complex continuous control environments and realworld datasets.
Enhancing Robot Program Synthesis Through Environmental Context
Program synthesis aims to automatically generate an executable program that conforms to the given specification. Recent advancements have demonstrated that deep neural methodologies and large-scale pretrained language models are highly proficient in capturing program semantics. For robot programming, prior works have facilitated program synthesis by incorporating global environments. However, the assumption of acquiring a comprehensive understanding of the entire environment is often excessively challenging to achieve.
Stop cleaning your ears wrong
Warning: This advice may cause you to rethink your pharmacy purchases. Breakthroughs, discoveries, and DIY tips sent six days a week. Whether shouted at you by an angry schoolteacher or said as a gentle reminder by a cautious parent, "Clean your ears" is something most of us know we should be doing regularly. That's why it's so shocking that so few of us know how to actually do it. Case in point: According to industry analysts, the cotton swab market grew from $795 million in 2024 to $828 million in 2025, with a projected compound annual growth rate of 3.8 percent.