Goto

Collaborating Authors

 crispo


CriSPO: Multi-Aspect Critique-Suggestion-guided Automatic Prompt Optimization for Text Generation

arXiv.org Artificial Intelligence

Existing automatic prompt engineering methods are typically designed for discriminative tasks, where new task prompts are iteratively refined with limited feedback from a single metric reflecting a single aspect. However, these approaches are suboptimal for generative tasks, which require more nuanced guidance beyond a single numeric metric to improve the prompt and optimize multiple aspects of the generated text. To address these challenges, we propose a novel multi-aspect Critique-Suggestion-guided automatic Prompt Optimization (CriSPO) approach. CriSPO introduces a critique-suggestion module as its core component. This module spontaneously discovers aspects, and compares generated and reference texts across these aspects, providing specific suggestions for prompt modification. These clear critiques and actionable suggestions guide a receptive optimizer module to make more substantial changes, exploring a broader and more effective search space. To further improve CriSPO with multi-metric optimization, we introduce an Automatic Suffix Tuning (AST) extension to enhance the performance of task prompts across multiple metrics. We evaluate CriSPO on 4 state-of-the-art LLMs across 4 summarization and 5 QA datasets. Extensive experiments show 3-4\% ROUGE score improvement on summarization and substantial improvement of various metrics on QA.


The Morning After: Did Microsoft just neg Blizzard Activision?

Engadget

In a recent filing, Microsoft told New Zealand's Commerce Commission that Blizzard Activision produces no "must-have" games. Weird thing to say when the company plans to spend $68.7 billion to buy the gaming giant behind Call of Duty, Overwatch, Diablo, World of Warcraft and plenty more. In the document, Microsoft said: "There is nothing unique about the video games developed and published by Activision Blizzard that is a'must have' for rival PC and console video game distributors that give rise to a foreclosure concern." Attempting to downplay the importance of Call of Duty is just one of the ways Microsoft has tried to placate regulators. In February, the company pledged it would continue to make the franchise available on PlayStation consoles beyond any existing agreements between Sony and Activision. Apple's 10.2-inch iPad is back on sale for $300 at Amazon Sony is retiring the PlayStation 5's Accolades feature because people aren't nice An e-bike- and scooter-sharing startup co-founded by Olympian Usain Bolt appears to have stopped operations.