jp-evalb: Robust Alignment-based PARSEVAL Measures
Park, Jungyeul, Wang, Junrui, Jo, Eunkyul Leah, Park, Angela Yoonseo
–arXiv.org Artificial Intelligence
We introduce an evaluation system designed to compute PARSEVAL measures, offering a viable alternative to \texttt{evalb} commonly used for constituency parsing evaluation. The widely used \texttt{evalb} script has traditionally been employed for evaluating the accuracy of constituency parsing results, albeit with the requirement for consistent tokenization and sentence boundaries. In contrast, our approach, named \texttt{jp-evalb}, is founded on an alignment method. This method aligns sentences and words when discrepancies arise. It aims to overcome several known issues associated with \texttt{evalb} by utilizing the `jointly preprocessed (JP)' alignment-based method. We introduce a more flexible and adaptive framework, ultimately contributing to a more accurate assessment of constituency parsing performance.
arXiv.org Artificial Intelligence
May-22-2024
- Country:
- North America
- United States
- Pennsylvania (0.04)
- Washington > King County
- Seattle (0.04)
- Texas > Travis County
- Austin (0.04)
- New York > Monroe County
- Rochester (0.04)
- Louisiana > Orleans Parish
- New Orleans (0.04)
- California
- Monterey County > Pacific Grove (0.04)
- San Diego County > San Diego (0.04)
- Canada
- British Columbia (0.05)
- Ontario > Toronto (0.04)
- United States
- Europe
- France (0.04)
- Czechia > Prague (0.04)
- Bulgaria (0.04)
- Latvia > Riga Municipality
- Riga (0.04)
- Italy
- Ireland > Leinster
- County Dublin > Dublin (0.04)
- Denmark > Capital Region
- Copenhagen (0.04)
- Asia
- China > Hong Kong (0.04)
- South Korea > Seoul
- Seoul (0.04)
- Africa > Middle East
- Egypt > Giza Governorate > Giza (0.04)
- North America
- Genre:
- Research Report (0.64)
- Technology: