Technology
Context-dependent upper-confidence bounds for directed exploration
Directed exploration strategies for reinforcement learning are critical for learning an optimal policy in a minimal number of interactions with the environment. Many algorithms use optimism to direct exploration, either through visitation estimates or upper confidence bounds, as opposed to data-inefficient strategies like e-greedy that use random, undirected exploration. Most data-efficient exploration methods require significant computation, typically relying on a learned model to guide exploration. Least-squares methods have the potential to provide some of the data-efficiency benefits of model-based approaches--because they summarize past interactions--with the computation closer to that of model-free approaches. In this work, we provide a novel, computationally efficient, incremental exploration strategy, leveraging this property of least-squares temporal difference learning (LSTD). We derive upper confidence bounds on the action-values learned by LSTD, with context-dependent (or state-dependent) noise variance. Such context-dependent noise focuses exploration on a subset of variable states, and allows for reduced exploration in other states. We empirically demonstrate that our algorithm can converge more quickly than other incremental exploration strategies using confidence estimates on action-values.
Oscars security tighter than ever: 1-mile police buffer amid Iran war
Things to Do in L.A. Tap to enable a layout that focuses on the article. Workers move a decorative replica Oscar statue as preparations are made on the red carpet arrivals area ahead of the 98th Academy Awards in Hollywood on Friday. This is read by an automated voice. Please report any issues or inconsistencies here . It's been more than two decades since the Oscars were celebrated as the United States was launching a war in the Middle East.
Drone attack on market in Sudan kills 11, as air war civilian toll mounts
A drone attack on a busy market in western Sudan has killed 11 people and wounded dozens more, including children, as the United Nations warns that the country's rapidly escalating air wars have claimed more than 200 civilian lives in little over a week. The attack on Adikong market, near Sudan's border with Chad, ignited fuel reserves and sent flames tearing through the area on Thursday. MSF described it as the second deadly drone attack on the same area in less than a month. Drones have become a key weapon used by both sides in the war between the Sudanese Armed Forces (SAF) and the paramilitary Rapid Support Forces that began in April 2023. UN Human Rights Chief Volker Turk said on Thursday he was appalled by the scale of intensifying aerial assaults on civilians in the war, warning that more than 200 people had been killed by drones across the Kordofan region and White Nile state since March 4 alone.
Sample-Efficient Reinforcement Learning with Stochastic Ensemble Value Expansion
Jacob Buckman, Danijar Hafner, George Tucker, Eugene Brevdo, Honglak Lee
We propose stochastic ensemble value expansion (STEVE), a novel model-based technique that addresses this issue. By dynamically interpolating between model rollouts of various horizon lengths for each individual example, STEVE ensures that the model is only utilized when doing so does not introduce significant errors.
Eerie timeline emerges in disappearance of Air Force general tied to UFO programs and Area 51-era research
Trump's campaign against Fed chair Jerome Powell dealt crushing blow in court The astonishing moment Scott Bessent returns to interview after'Situation Room' call from Trump Kylie Jenner's total humiliation in Hollywood: Derogatory rumor leaves her boyfriend's peers'laughing at her' behind her back I was once so heavy I broke my toilet seat. Now I've shed 322lbs without weight-loss shots... this is the easy lifestyle shift that helped me do it Inside the sex guide electrifying conservative women: Good Christian wives purring over'explicit illustrations' that teach them the ultimate taboos Yellowstone fans go wild as Cole Hauser unveils spinoff series Dutton Ranch: 'Here we go!' Recall of cream cheeses upgraded to most serious risk over contamination with deadly bacteria... 'reasonable probability of death' Trump's Iran war death toll climbs to 13 after all crew onboard US refueling plane died in crash Michigan synagogue shooter who smashed car into temple is pictured for the first time as family's terrorist links are revealed I've spent 25 years treating patients with autism. This is the truth about the condition that many people don't want to hear: DR MAX PEMBERTON Woman who had years-long romance with Timothee Chalamet says he blindsided her with Kylie Jenner relationship: 'I was in love with him' Real-life'Matilda', 8, who couldn't catch a break gets adopted by kind Miss Honey-esque teacher Alexander brothers' alleged HIGH SCHOOL rape video: Classmates speak out on sickening footage... as creepy unseen photos are exposed It has been weeks since a retired Air Force general who has been linked to UFO programs went missing from his New Mexico home. William'Neil' McCasland, 68, was last seen around 11am on February 27 near Quail Run Court NE in Albuquerque, during a one-hour window while his wife left the house. The Bernalillo County Sheriff's Office (BCSO) released a new timeline Thursday describing his last known movements.