factgenie
factgenie: A Framework for Span-based Evaluation of Generated Texts
Kasner, Zdeněk, Plátek, Ondřej, Schmidtová, Patrícia, Balloccu, Simone, Dušek, Ondřej
We present factgenie: a framework for annotating and visualizing word spans in textual model outputs. Annotations can capture various span-based phenomena such as semantic inaccuracies or irrelevant text. With factgenie, the annotations can be collected both from human crowdworkers and large language models. Our framework consists of a web interface for data visualization and gathering text annotations, powered by an easily extensible codebase.
Country:
- Europe > Middle East > Malta (0.07)
- Europe > Czechia > Prague (0.05)
- North America > United States > New Mexico (0.05)
- (3 more...)
Technology: