Goto

Collaborating Authors

 peninsula


The Generative AI Paradox on Evaluation: What It Can Solve, It May Not Evaluate

arXiv.org Artificial Intelligence

This paper explores the assumption that Large Language Models (LLMs) skilled in generation tasks are equally adept as evaluators. We assess the performance of three LLMs and one open-source LM in Question-Answering (QA) and evaluation tasks using the TriviaQA (Joshi et al., 2017) dataset. Results indicate a significant disparity, with LLMs exhibiting lower performance in evaluation tasks compared to generation tasks. Intriguingly, we discover instances of unfaithful evaluation where models accurately evaluate answers in areas where they lack competence, underscoring the need to examine the faithfulness and trustworthiness of LLMs as evaluators. This study contributes to the understanding of "the Generative AI Paradox" (West et al., 2023), highlighting a need to explore the correlation between generative excellence and evaluation proficiency, and the necessity to scrutinize the faithfulness aspect in model evaluations.


Russia detains man accused of plotting rail bombing in Crimea

Al Jazeera

Russia's Federal Security Service (FSB) has detained a man for plotting a rail bombing in Crimea as a drone was downed over the Moscow-occupied peninsula. Crimea, which Russia seized from Ukraine in 2014, has been targeted by Ukrainian drone raids and sabotage attacks as Kyiv tries to retake the peninsula. The FSB said on Friday the suspect – a Russian citizen in his mid-40s – had been "collecting information on the deployment of Russian defence ministry facilities and units" and was preparing a railway bombing. "In a hiding place he had organised [we] found and seized an improvised explosive device made using foreign-made plastic explosives," it said. It said the man had been acting on the "instructions of Ukrainian military intelligence" and had been remanded in custody. Russia's TASS news agency said the man was a resident of the Crimean city of Sevastopol.


Russia says destroyed 42 Ukraine-launched drones over Crimea

Al Jazeera

Russia's defence ministry has said its air defence forces destroyed a large-scale Ukrainian-launched drone attack on the Crimean Peninsula, which Moscow annexed from Ukraine in 2014. Crimea has been targeted by Kyiv since Moscow launched its full-scale invasion of Ukraine in February 2022, but has come under more intense, increased attacks in recent weeks. The Russian Ministry of Defence said early on Friday its forces shot down nine drones, while 33 others "were suppressed by electronic warfare and crashed without reaching the target". It did not elaborate on whether there had been any damage or casualties. It added that it had also shot down a Ukraine-launched missile over the Kaluga region, which borders the Moscow region.


Russia says 20 Ukrainian drones destroyed over Crimea

Al Jazeera

Russia's defence ministry said its forces destroyed a wave of 20 Ukrainian drones over the Russian-annexed Crimean Peninsula. There were no casualties and no damage as a result of the attempted attack early on Saturday morning, the defence ministry said on the Telegram messaging app. Fourteen drones were destroyed by air defence systems and six were suppressed by electronic warfare, the ministry said. It was not immediately clear what was the target of the reported attacks on the peninsula. Sergei Kryuchkov, an adviser to the Russia-installed governor of Crimea, said earlier that air defence systems were engaged in repelling air attacks in different parts of the peninsula.


Ukraine attacked Russian village with cluster munitions: Governor

Al Jazeera

The governor of Russia's Belgorod region has said that Ukraine fired cluster munitions at a village near the Ukrainian border on Friday, but that there were no casualties or damage. The governor made the statement on Saturday during a daily briefing on his Telegram channel, without providing visual evidence. There was no immediate comment from Ukrainian authorities. "In Belgorod district, 21 artillery shells and three cluster munitions from a multiple-launch rocket system were fired at the village of Zhuravlevka," Governor Vyacheslav Gladkov said. Ukraine received cluster bombs from the United States this month, but it has pledged to use them only to dislodge concentrations of enemy soldiers. They contain dozens of small bomblets that rain shrapnel over a wide area, but are banned in many countries due to the potential danger they pose to civilians.


Ukraine likely to face bloody Crimea fight, satellite images show

Al Jazeera

An analysis of satellite images by Al Jazeera has revealed that Russian forces are fortifying the Crimean peninsula in anticipation of a Ukrainian attempt to recapture it. Experts say that those defences are likely to make any such effort difficult and bloody. As the war grinds on for more than a year, Ukraine's political and military leadership has made it clear that it defines victory as reclaiming its 1991 borders, which Russia had recognised. The United Nations and all of Ukraine's Western allies also recognise those borders, which include Crimea. The investigation by Al Jazeera's Sanad news verification and monitoring unit found that between February and March, the Crimean border and surrounding areas were transformed into a fortified barrier ahead of an expected spring counteroffensive by Ukrainian forces.


Kremlin Sees 'Risk' Of Ukraine Attacks On Crimea

International Business Times

The Kremlin said Thursday that the Moscow-annexed Crimean Peninsula was vulnerable to Ukrainian attacks after officials said they had shot down a drone near a key naval base. The latest drone attack comes after Russian President Vladimir Putin recently visited the only bridge connecting Crimea with the Russian mainland to survey work to repair the key artery damaged in a blast Moscow blamed on Kiyv. "There are certainly risks because the Ukrainian side continues its policy of organising terrorist attacks. But, on the other hand, information we get indicates that effective countermeasures are being taken," Kremlin spokesman Dmitry Peskov told reporters. The Moscow-appointed governor of Crimea Sergei Aksyonov said last month that Russia was strengthening fortifications on the peninsula in the wake of recent attacks.


Eight Feared Dead As Russia Tourist Helicopter Crashes Into Lake

International Business Times

A helicopter carrying 16 tourists and crew on a volcano sightseeing trip in Russia's far east crashed into a lake on Thursday, leaving eight people feared dead and two others in serious condition, local officials said. The Mi-8 helicopter crash-landed into Kuril Lake in the mountainous Kamchatka peninsula amid poor visibility and sank, governor Vladimir Solodov said. Staff of the Kronotsky Nature Reserve saved half of the people onboard, he added. "They approached the scene in a boat and saved eight people," Solodov said in a statement. Two of the survivors were now in intensive care with various injuries.


As North casts cloud over the peninsula, South Korea's weapons makers tap into a silver lining

The Japan Times

SEOUL – The constant missile and nuclear threats from South Korea's belligerent northern neighbor have racked regional tensions sky-high, but they are a boon for the country's burgeoning defense industry. South Korea has been one of the world's largest importers of military equipment and technology for decades -- mostly from the U.S. -- but in recent years its domestic sector has grown rapidly. Arms exports have soared tenfold in a decade, from just $253 million in 2006 to $2.5 billion last year, according to government data. The country's missiles, howitzers, submarines and warplanes are especially popular in Southeast Asia, Eastern Europe and South America. Once a largely agricultural backwater devastated by war, South Korea now has companies that have become world leaders in fields ranging from shipbuilding to smartphones, and its arms manufacturers are starting to follow suit.


Asteroid could have thrust Earth into darkness for 2 YEARS

Daily Mail - Science & tech

After roaming the planet for 165 million years, it is thought the dinosaurs were wiped off the face of the planet when an asteroid crashed into Earth 66 million years ago. The impact of the asteroid would have thrown up huge amounts of debris, and new computer simulations have revealed the extent to which this affected our planet. The findings suggest that Earth would have been plunged into darkness for as long as two years. The impact of the asteroid would have thrown up huge amounts of debris, and new computer simulations have revealed the extent to which this affected our planet (artist's impression) The team used computers to model what Earth might have looked at the end of the Cretaceous Period, after a large asteroid struck what is now the Yucatán Peninsula, beneath the gulf of Mexico. The simulations found 15,000 million tons of soot would have been sent into the atmosphere after the asteroid hit, forming a barrier between the Earth and sunlight.