Statistical Deficiency for Task Inclusion Estimation

Fosse, Loïc, Béchet, Frédéric, Favre, Benoît, Damnati, Géraldine, Lecorvé, Gwénolé, Darrin, Maxime, Formont, Philippe, Piantanida, Pablo

arXiv.org Artificial Intelligence 

While we theoretically show for which annotated datasets exist, and it is commonly the shortcomings of naively measuring cross-task accepted that the summarization task, at performance by directly applying each model to least in the news domain, requires NER skills to each other task, the contributions of the paper are be performed effectively. As a consequence, studying threefold: generated summaries from the perspective of A theoretical framework for task definition retained named entities is a relevant evaluation and inclusion. Based on information concepts angle (Pagnoni et al., 2021; Berezin and Batura, and theory, we propose a clear definition of a task 2022; Akani et al., 2023). According to this principle, and candidate notions of inclusion (independent a more general hypothesis is that multi-task of the notion of model).