narrative
REGen: Multimodal Retrieval-Embedded Generation for Long-to-Short Video Editing
Short videos are an effective tool for promoting contents and improving knowledge accessibility. While existing extractive video summarization methods struggle to produce a coherent narrative, existing abstractive methods cannot'quote' from the input videos, i.e., inserting short video clips in their outputs. In this work, we explore new video editing models for generating shorts that feature a coherent narrative with embedded video insertions extracted from a long input video. We propose a novel retrieval-embedded generation (REG) framework that allows a large language model to quote multimodal resources while maintaining a coherent narrative. Our proposed REGen system first generates the output story script with quote placeholders using a finetuned large language model, and then uses a multimodal retrieval model to replace the quote placeholders by selecting a video clip that best supports the narrative from a pool of candidate quotable video clips. We examine the proposed method on the task of documentary teaser generation, where short interview insertions are commonly used to support the narrative of a documentary. Our objective evaluations show that the proposed method can effectively insert short video clips while maintaining a coherent narrative. In a subjective survey, we show that our proposed method outperforms existing abstractive and extractive approaches in terms of coherence, alignment, and realism in documentary teaser generation.
Monoculture or Multiplicity: Which Is It?
Two narratives about machine learning ecosystems grew out of recent algorithmic fairness discourse. In one, dubbed \emph{monoculture}, algorithmic ecosystems tend toward homogeneity akin to a single model making all decisions. Individuals then face the risk of systematic exclusion with no recourse. In the other, \emph{model multiplicity}, many models solve the same task with similar accuracy, causing excessive variation in outcomes. Both narratives are compelling, yet, seemingly at odds: model multiplicity can't exist in a strict monoculture.
Dating Is a Rich Person's Game Now
Dating Is a Rich Person's Game Now People actually can't afford to date anymore. Ask just about anyone what's wrong with modern dating and they will likely tell you the same thing: The apps suck. They're built on a pay-to-win model. Fewer people are finding quality partners. Some studies have even suggested that increased time on them leads to higher depression and anxiety while also contributing to loneliness among men .
The Online Civil War About 'Michael' Is a Battle Over Truth
Fans want to reclaim the music and myth of Michael Jackson in the new biopic while critics call for accountability. Still from, which opened April 24. Is truth determined by the size of the audience it reaches? If so, --a new film about the pop singer Michael Jackson that is on track to have the biggest-ever opening for a music biopic, with projected earnings of $70 million at the US box office, despite critics saying it sanitizes the reality of who Jackson actually was--intends to supplant the King of Pop as the apotheosis of artistic virtue. The film's release has sparked a familiar but newly intensified civil war online, between those eager to reclaim the music and myth of Jackson, and those who see any celebration of him as a failure of accountability.
Cracking the Code of Juxtaposition: Can AI Models Understand the Humorous Contradictions
Recent advancements in large vision language models have demonstrated remarkable proficiency across a wide range of tasks. Yet, these models still struggle with understanding the nuances of human humor through juxtaposition, particularly when it involves nonlinear narratives that underpin many jokes and humor cues. This paper investigates this challenge by focusing on comics with contradictory narratives, where each comic consists of two panels that create a humorous contradiction. We introduce the YesBut benchmark, which comprises tasks of varying difficulty aimed at assessing AI's capabilities in recognizing and interpreting these comics, ranging from literal content comprehension to deep narrative reasoning. Through extensive experimentation and analysis of recent commercial or open-sourced large vision language models, we assess their capability to comprehend the complex interplay of the narrative humor inherent in these comics. Our results show that even the state-of-the-art models still struggle with this task. Our findings offer insights into the current limitations and potential improvements for AI in understanding human creative expressions.
What Iranians are being told about the war
The first reports appeared on foreign screens, beyond the reach of most Iranians. On 28 February Prime Minister Benjamin Netanyahu said there were signs that the tyrant is no more, suggesting Supreme Leader Ayatollah Ali Khamenei had been killed in a joint US-Israeli strike. Iranians watching state television, however, encountered silence. Government officials would neither confirm nor deny Khamenei's death. On one of the state broadcaster's channels, IRTV3, one news presenter urged viewers to trust him and the latest information the government had.