Industry
A Lyapunov-based Approach to Safe Reinforcement Learning
Yinlam Chow, Ofir Nachum, Edgar Duenez-Guzman, Mohammad Ghavamzadeh
In many real-world reinforcement learning (RL) problems, besides optimizing the main objective function, an agent must concurrently avoid violating a number of constraints. In particular, besides optimizing performance, it is crucial to guarantee the safety of an agent during training as well as deployment (e.g., a robot should avoid taking actions - exploratory or not - which irrevocably harm its hardware). To incorporate safety in RL, we derive algorithms under the framework of constrained Markov decision processes (CMDPs), an extension of the standard Markov decision processes (MDPs) augmented with constraints on expected cumulative costs.
Swatch's New OpenAI-Powered Tool Lets You Design Your Own Watch
The new AI-DADA tool lets you create a unique Swatch design using AI prompts. You can't make a custom MoonSwatch yet--but it's not entirely off the table. Cast your mind back to 2017. In those heady days before ChatGPT and DALL-E, and Zoom calls, Swatch launched a fancy online platform that let you, the watch-buying public, design your own Swatch watch . It was called Swatch x You, and it let you tweak Swatch's standard New Gent 41-mm model by selecting one of the (surprisingly limited) preset designs, which you could then move, zoom, and rotate to fit over the watch and strap.