Indian Ocean
Object-Centric Diffusion for Efficient Video Editing
Kahatapitiya, Kumara, Karjauv, Adil, Abati, Davide, Porikli, Fatih, Asano, Yuki M., Habibian, Amirhossein
Diffusion-based video editing have reached impressive quality and can transform either the global style, local structure, and attributes of given video inputs, following textual edit prompts. However, such solutions typically incur heavy memory and computational costs to generate temporally-coherent frames, either in the form of diffusion inversion and/or cross-frame attention. In this paper, we conduct an analysis of such inefficiencies, and suggest simple yet effective modifications that allow significant speed-ups whilst maintaining quality. Moreover, we introduce Object-Centric Diffusion, coined as OCD, to further reduce latency by allocating computations more towards foreground edited regions that are arguably more important for perceptual quality. We achieve this by two novel proposals: i) Object-Centric Sampling, decoupling the diffusion steps spent on salient regions or background, allocating most of the model capacity to the former, and ii) Object-Centric 3D Token Merging, which reduces cost of cross-frame attention by fusing redundant tokens in unimportant background regions. Both techniques are readily applicable to a given video editing model \textit{without} retraining, and can drastically reduce its memory and computational cost. We evaluate our proposals on inversion-based and control-signal-based editing pipelines, and show a latency reduction up to 10x for a comparable synthesis quality.
Israel, Ukraine, and AI are among expected discussion topics at the upcoming World Economic Forum
Heritage Foundation researcher Emma Waters joins'Fox & Friends Weekend' to discuss a recent report that a global birth decline is good for the planet. More than 60 heads of state and government and hundreds of business leaders are coming to Switzerland to discuss the biggest global challenges during the World Economic Forum's annual gathering next week, ranging from Israeli President Isaac Herzog to Ukrainian President Volodymyr Zelenskyy. The likes of U.S. Secretary of State Antony Blinken, Chinese Premier Li Qiang, EU Commission President Ursula von der Leyen, French President Emmanuel Macron, U.N. Secretary-General Antonio Guterres and many others will descend on the Alpine ski resort town of Davos on Jan. 15-19, organizers said Tuesday. Attendees have their work cut out for them with two major wars -- the Israel-Hamas conflict and Russia's invasion of Ukraine -- plus problems like climate change, major disruptions to trade in the Red Sea, a weak global economy and misinformation powered by rapidly advancing artificial intelligence in a major election year. Trust has eroded on peace and security, with global cooperation down since 2016 and plummeting since 2020, forum President Borge Brende said at a briefing.
'Brink of war': Hezbollah-Israel trade further strikes across border
The Israeli army and Hezbollah, based in Lebanon, have again traded fire across the border. The Iran-backed Hezbollah on Tuesday launched a drone attack on an Israeli command base. Israel retaliated with air strikes, while it is also reported to have killed three Hezbollah members in a targeted strike. The rise in attacks across the Israel-Lebanon border is stoking fear that the war in Gaza threatens to spark a regional conflagration. Hezbollah said that it had targeted the "enemy's northern command centre in the city of Safed with several drones" in retaliation for the killing of Hezbollah field commander Wissam al-Tawil in Lebanon on Monday, as well as an attack on Hamas's deputy leader Saleh al-Arouri in Beirut last week.
GRAM: Global Reasoning for Multi-Page VQA
Blau, Tsachi, Fogel, Sharon, Ronen, Roi, Golts, Alona, Ganz, Roy, Avraham, Elad Ben, Aberdam, Aviad, Tsiper, Shahar, Litman, Ron
The increasing use of transformer-based large language models brings forward the challenge of processing long sequences. In document visual question answering (DocVQA), leading methods focus on the single-page setting, while documents can span hundreds of pages. We present GRAM, a method that seamlessly extends pre-trained single-page models to the multi-page setting, without requiring computationally-heavy pretraining. To do so, we leverage a single-page encoder for local page-level understanding, and enhance it with document-level designated layers and learnable tokens, facilitating the flow of information across pages for global reasoning. To enforce our model to utilize the newly introduced document-level tokens, we propose a tailored bias adaptation method. For additional computational savings during decoding, we introduce an optional compression stage using our C-Former model, which reduces the encoded sequence length, thereby allowing a tradeoff between quality and latency. Extensive experiments showcase GRAM's state-of-the-art performance on the benchmarks for multi-page DocVQA, demonstrating the effectiveness of our approach.
Impossibility Theorems for Feature Attribution
Bilodeau, Blair, Jaques, Natasha, Koh, Pang Wei, Kim, Been
Despite a sea of interpretability methods that can produce plausible explanations, the field has also empirically seen many failure cases of such methods. In light of these results, it remains unclear for practitioners how to use these methods and choose between them in a principled way. In this paper, we show that for moderately rich model classes (easily satisfied by neural networks), any feature attribution method that is complete and linear -- for example, Integrated Gradients and SHAP -- can provably fail to improve on random guessing for inferring model behaviour. Our results apply to common end-tasks such as characterizing local model behaviour, identifying spurious features, and algorithmic recourse. One takeaway from our work is the importance of concretely defining end-tasks: once such an end-task is defined, a simple and direct approach of repeated model evaluations can outperform many other complex feature attribution methods.
Iraqi prime minister condemns US strike on a high-ranking militia commander
Senior foreign affairs correspondent Greg Palkot provides details on the major strike on an Iraqi militia leader and the U.S.'s response to Houthi attacks in the Red Sea Iraq has condemned the United States after U.S. forces carried out a drone strike in central Baghdad on Thursday that killed a high-ranking militia commander. Iraqi Prime Minister Mohammed Shia al-Sudani said Friday that the U.S. targeting and killing Mushtaq Taleb al-Saidi -- or "Abu Taqwa," the leader of the Harakat Hezbollah al-Nujaba, an Iraqi Shi'ite militant group -- was a violation of Iraqi sovereignty. A U.S. defense official confirmed that Thursday's drone strike on a vehicle containing the militia leader and three other militia members was authorized as he was responsible for recent attacks on U.S. personnel. Sudani said Friday that the U.S. had bypassed the Iraqi government, which is "the body authorized to impose the law." In his statement, he also reiterated calls for U.S. troops to withdraw from the country.
ISIS claims responsibility for suicide bomb attacks on Soleimani memorial in Iran
Fox News Flash top headlines are here. Check out what's clicking on Foxnews.com. The Islamic State of Iraq and Syria (ISIS) is claiming responsibility for the suicide bomb attacks in Iran this week, Fox News Digital has learned. ISIS claims to have orchestrated the double suicide bomber attack at the memorial to deceased Iranian military official Qassem Soleimani. A statement from ISIS published to Telegram named terrorist operatives Omar al-Mowahid and Sayefulla al-Mujahid as the suicidal attackers behind the "dual martyrdom operation."
US-led coalition issues warning to Houthis, vows 'consequences' for Red Sea attacks
Fox News chief national security correspondent Jennifer Griffin reports on shipping conglomerates rerouting their ships to avoid the Red Sea and U.S. Navy helicopters sinking three Houthi vessels on'Special Report.' A U.S.-led coalition of 13 countries issued a warning to Iran-backed Houthi rebels in Yemen on Wednesday, vowing consequences should the group continue attacks in the Red Sea. The U.S. was joined by the U.K., Australia, Bahrain, Belgium, Canada, Denmark, Germany, Italy, Japan, Netherlands and New Zealand in Wednesday's statement. The nations said that the destabilization of trade throughout the Red Sea is "unacceptable" and vowed consequences. "Ongoing Houthi attacks in the Red Sea are illegal, unacceptable, and profoundly destabilizing. There is no lawful justification for intentionally targeting civilian shipping and naval vessels. Attacks on vessels, including commercial vessels, using unmanned aerial vehicles, small boats, and missiles, including the first use of anti-ship ballistic missiles against such vessels, are a direct threat to the freedom of navigation that serves as the bedrock of global trade in one of the world's most critical waterways," the nations wrote.
Iranian media report at least 103 killed, 141 injured in explosions near grave of General Qassem Soleimani
Foreign Policy Adviser to Netanyahu Dr. Ophir Falk tells'Cavuto Live' that it could take Israel anywhere from a week to a year to'destroy Hamas.' A pair of explosions near the grave of Iranian general Qassem Soleimani killed at least 103 people and wounded up to 141 more in Kerman, Iran, according to Wednesday reports from Iranian media. Iranian officials say the explosions occurred during a ceremony honoring Soleimani on the fourth anniversary of his death. Soleimani was killed in 2020 at the hands of a U.S. drone strike ordered by then-President Trump. "The blasts were caused by terrorist attacks," Iranian media quoted a local official as saying, without accusing any specific party. "Several gas canisters exploded on the road leading to the cemetery."
Data Assimilation in Chaotic Systems Using Deep Reinforcement Learning
Hammoud, Mohamad Abed El Rahman, Raboudi, Naila, Titi, Edriss S., Knio, Omar, Hoteit, Ibrahim
Data assimilation (DA) plays a pivotal role in diverse applications, ranging from climate predictions and weather forecasts to trajectory planning for autonomous vehicles. A prime example is the widely used ensemble Kalman filter (EnKF), which relies on linear updates to minimize variance among the ensemble of forecast states. Recent advancements have seen the emergence of deep learning approaches in this domain, primarily within a supervised learning framework. However, the adaptability of such models to untrained scenarios remains a challenge. In this study, we introduce a novel DA strategy that utilizes reinforcement learning (RL) to apply state corrections using full or partial observations of the state variables. Our investigation focuses on demonstrating this approach to the chaotic Lorenz '63 system, where the agent's objective is to minimize the root-mean-squared error between the observations and corresponding forecast states. Consequently, the agent develops a correction strategy, enhancing model forecasts based on available system state observations. Our strategy employs a stochastic action policy, enabling a Monte Carlo-based DA framework that relies on randomly sampling the policy to generate an ensemble of assimilated realizations. Results demonstrate that the developed RL algorithm performs favorably when compared to the EnKF. Additionally, we illustrate the agent's capability to assimilate non-Gaussian data, addressing a significant limitation of the EnKF.