Ensuring Safety in an Uncertain Environment: Constrained MDPs via Stochastic Thresholds
This paper studies constrained Markov decision processes (CMDPs) with constraints against stochastic thresholds, aiming at safety of reinforcement learning in unknown and uncertain environments. We leverage a Growing-Window estimator sampling from interactions with the uncertain and dynamic environment to estimate the thresholds, based on which we design Stochastic Pessimistic-Optimistic Thresholding (SPOT), a novel model-based primal-dual algorithm for multiple constraints against stochastic thresholds. SPOT enables reinforcement learning under both pessimistic and optimistic threshold settings. We prove that our algorithm achieves sublinear regret and constraint violation; i.e., a reward regret of $\tilde{\mathcal{O}}(\sqrt{T})$ while allowing an $\tilde{\mathcal{O}}(\sqrt{T})$ constraint violation over $T$ episodes. The theoretical guarantees show that our algorithm achieves performance comparable to that of an approach relying on fixed and clear thresholds. To the best of our knowledge, SPOT is the first reinforcement learning algorithm that realises theoretical guaranteed performance in an uncertain environment where even thresholds are unknown.
A Minecraft Movie just set a new record with the biggest opening ever for a video game adaptation in the US
A Minecraft Movie has reportedly surpassed the record previously set by 2023's The Super Mario Bros. Movie for the biggest ever domestic box office opening of a video game adaptation. The new movie, which was released in theaters on Friday, raked in 157 million in the US in its opening weekend, according to The Hollywood Reporter. A Minecraft Movie is doing well internationally, too; THR reports that it's earned 301M altogether in its global debut. The Super Mario Bros. Movie pulled in 146 million in its domestic opening and 377 million globally. A Minecraft Movie stars Jack Black, Sebastian Hansen, Emma Myers, Jason Momoa, Danielle Brooks and Jennifer Coolidge.
You have until 27 April to score a A 24 Windows 11 Pro license
TL;DR: Give your old PC a new lease on life with a Microsoft Windows 11 Pro license, now only A 24 through 27 April. Need a new laptop but don't have the budget to buy one? We've found the next best thing -- updating your operating system. If you've got an old PC that could use an upgrade, Microsoft Windows 11 Pro is now just A 24, A 301 off the usual price. But you'll want to act fast because this deal ends 27 April.
A Minecraft Movie storms box office despite lukewarm reviews
Around half of the film's global takings came from North America, according to EntTelligence. The box office numbers come despite reviews for the film being mostly underwhelming. The Telegraph awarded it two stars, saying the charm of the video game was "nowhere to be found", while the Guardian gave it just one star, saying it has "a cobbled-together feel". It does not appear to have stopped families showing up in force to see it. "It has definitely overperformed all industry projections," said Steve Buck, chief strategy officer at EntTelligence, which said the film had enjoyed a late ticket surge.
Russian air strikes kill 1 in Kyiv as Zelenskyy demands more pressure on Putin
One person was killed Sunday as Russian air strikes hit the Ukrainian capital, Kyiv, while the death toll from Friday's deadly attack on the central Ukrainian city of Kryvyi Rih continued to rise. The Kyiv victim was found close to the strike's epicenter of the attack in the city's Darnytskyi district, Mayor Vitali Klitschko said. A further three people were injured in the strike, which saw fires break out in several nonresidential areas, damaging cars and buildings. In a statement on social media, Ukrainian President Volodymyr Zelenskyy said the intensifying Russian attacks showed that there is still insufficient international pressure on Moscow. US WILL KNOW IN'MATTER OF WEEKS' IF RUSSIA IS SERIOUS ABOUT PEACE OR USING'DELAY TACTIC': RUBIO He said Russia has launched more than 1,460 guided aerial bombs, nearly 670 attack drones and more than 30 missiles at Ukraine in the past week alone.
Use OpenAI to find profitable stocks during the historic dip
You've seen headlines about the market crash and maybe even wondered if now's your shot at finally investing. A stock-picking tool powered by OpenAI is helping regular folks identify strong opportunities with minimal risk. Meet Sterling Stock Picker, the thing that could turn your savings account into an early retirement, extra travel funds, or whatever you wish. Rather than gambling with your hard-earned dollars, this tool helps you research options that match your preferences and risk tolerance, and a lifetime subscription is just 68.99 (reg. Want to dive into the stock market but feel like you're reading a foreign language?
Why neglecting AI ethics is such risky business - and how to do AI right
Nearly 80 years ago, in July 1945, MH Hasham Premji founded Western India Vegetable Products Limited in Amalner, a town in the Jalgaon district of Maharashtra, India, located on the banks of the Bori River. The company began as a manufacturer of cooking oils. In the 1970s, the company pivoted to IT and changed its name to Wipro. Over the years, it has grown to become one of India's biggest tech companies, with operations in 167 countries, nearly a quarter of a million employees, and revenue north of 10 billion. The company is led by executive chairman Rishad Premji, grandson of the original founder.
World's first AI-powered industrial super-humanoid robot
This robot figures to revolutionize enterprise operations, particularly in the logistics and manufacturing sectors. In a groundbreaking development, California-based robotics and artificial intelligence (AI) company Dexterity has unveiled Mech, the world's first industrial super-humanoid robot. This innovative creation figures to revolutionize enterprise operations, particularly in the logistics and manufacturing sectors. Let's dive into the details of this new technology and explore its potential impact on the industry. GET SECURITY ALERTS & EXPERT TECH TIPS -- SIGN UP FOR KURT'S THE CYBERGUY REPORT NOW This industrial super-humanoid robot features two arms mounted on a rover, allowing it to navigate warehouses and industrial sites with ease.
Are you still using Office 2019? Upgrade to the 2024 version for AI integration
TL;DR: Save 36% on Microsoft Office 2024, the latest version that comes with AI enhancements for apps like Word, Excel, and more. If you haven't heard, Microsoft Office 2024 hit the virtual shelves late last year. If you're still working with the 2019 or 2021 editions, you may be due for an upgrade, especially since the latest version of Microsoft Office comes with a fresh makeover, new productivity features, and AI integration that could streamline your work. Ready for your favorite productivity apps to get an upgrade? Save over 30% on a license and grab a lifetime license to Office 2024 for your PC or Mac for 159.97 (reg.
Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directions
Hou, Xinyi, Zhao, Yanjie, Wang, Shenao, Wang, Haoyu
The Model Context Protocol (MCP) is a standardized interface designed to enable seamless interaction between AI models and external tools and resources, breaking down data silos and facilitating interoperability across diverse systems. This paper provides a comprehensive overview of MCP, focusing on its core components, workflow, and the lifecycle of MCP servers, which consists of three key phases: creation, operation, and update. We analyze the security and privacy risks associated with each phase and propose strategies to mitigate potential threats. The paper also examines the current MCP landscape, including its adoption by industry leaders and various use cases, as well as the tools and platforms supporting its integration. We explore future directions for MCP, highlighting the challenges and opportunities that will influence its adoption and evolution within the broader AI ecosystem. Finally, we offer recommendations for MCP stakeholders to ensure its secure and sustainable development as the AI landscape continues to evolve.