Fantastic Examples and Where to Find Them - Compiling Czech
Dataset for Evaluating Dictionary Examples

D 2024

Fantastic Examples and Where to Find Them - Compiling Czech Dataset for Evaluating Dictionary Examples

DENISOVÁ, Michaela a Pavel RYCHLÝ

Základní údaje

Originální název

Fantastic Examples and Where to Find Them - Compiling Czech Dataset for Evaluating Dictionary Examples

Autoři

DENISOVÁ, Michaela a Pavel RYCHLÝ

Vydání

Brno, Proceedings of the Eighteenth Workshop on Recent Advances in Slavonic Natural Languages Processing, od s. 37-46, 10 s. 2024

Nakladatel

Tribun EU

Další údaje

Jazyk

angličtina

Typ výsledku

Stať ve sborníku

Obor

10201 Computer sciences, information science, bioinformatics

Stát vydavatele

Česká republika

Utajení

není předmětem státního či obchodního tajemství

Forma vydání

tištěná verze "print"

Odkazy

Domovská stránka workshopu, Plný text

Označené pro přenos do RIV

Ano

Kód RIV

RIV/00216224:14330/24:00137913

Organizační jednotka

Fakulta informatiky

ISBN

978-80-263-1835-4

ISSN

Klíčová slova anglicky

Dictionary examples; GDEX; Evaluation

Příznaky

Recenzováno

Změněno: 25. 3. 2025 07:56, Mgr. Michaela Denisová

Anotace

V originále

Examples are an important part of a dictionary entry, helping users better understand the word and its usage in context. However, selecting good examples is a challenging and time-consuming task due to varying selection criteria and the vast amount of data to choose from. While different tools have been developed to address this, evaluation remains flawed and lacks standardisation. In this paper, we compile an evaluation dataset for the Czech language, using the GDEX tool and manual annotations to classify examples and explain the classification. Based on our findings, we propose general annotation guidelines to improve consistency. This dataset serves as a foundation for the unified evaluation of dictionary example scoring tools and opens discussion on how to annotate examples. Additionally, we make the dataset publicly available.

Návaznosti

MUNI/A/1590/2023, interní kód MU

Název: Využití technik umělé inteligence pro zpracování dat, komplexní analýzy a vizualizaci rozsáhlých dat

Investor: Masarykova univerzita, Využití technik umělé inteligence pro zpracování dat, komplexní analýzy a vizualizaci rozsáhlých dat

Citovat

DENISOVÁ, Michaela a Pavel RYCHLÝ. Fantastic Examples and Where to Find Them - Compiling Czech Dataset for Evaluating Dictionary Examples. In Aleš Horák, Pavel Rychlý, Adam Rambousek. Proceedings of the Eighteenth Workshop on Recent Advances in Slavonic Natural Languages Processing. Brno: Tribun EU, 2024, s. 37-46. ISBN 978-80-263-1835-4.

@inproceedings{2458181,
   author = {Denisová, Michaela and Rychlý, Pavel},
   address = {Brno},
   booktitle = {Proceedings of the Eighteenth Workshop on Recent Advances in Slavonic Natural Languages Processing},
   editor = {Aleš Horák, Pavel Rychlý, Adam Rambousek},
   keywords = {Dictionary examples; GDEX; Evaluation},
   howpublished = {tištěná verze "print"},
   language = {eng},
   location = {Brno},
   isbn = {978-80-263-1835-4},
   pages = {37-46},
   publisher = {Tribun EU},
   title = {Fantastic Examples and Where to Find Them - Compiling Czech Dataset for Evaluating Dictionary Examples},
   url = {https://raslan2024.nlp-consulting.net/},
   year = {2024}
}

TY  - CONF
ID  - 2458181
AU  - Denisová, Michaela - Rychlý, Pavel
PY  - 2024
TI  - Fantastic Examples and Where to Find Them - Compiling Czech Dataset for Evaluating Dictionary Examples
PB  - Tribun EU
CY  - Brno
SN  - 9788026318354
KW  - Dictionary examples
KW  - GDEX
KW  - Evaluation
UR  - https://raslan2024.nlp-consulting.net/
N2  - Examples are an important part of a dictionary entry, helping users better understand the word and its usage in context. However, selecting good examples is a challenging and time-consuming task due to varying selection criteria and the vast amount of data to choose from. While different tools have been developed to address this, evaluation remains flawed and lacks standardisation. In this paper, we compile an evaluation dataset for the Czech language, using the GDEX tool and manual annotations to classify examples and explain the classification. Based on our findings, we propose general annotation guidelines to improve consistency. This dataset serves as a foundation for the unified evaluation of dictionary example scoring tools and opens discussion on how to annotate examples. Additionally, we make the dataset publicly available.
ER  -

DENISOVÁ, Michaela a Pavel RYCHLÝ. Fantastic Examples and Where to Find Them - Compiling Czech Dataset for Evaluating Dictionary Examples. In Aleš Horák, Pavel Rychlý, Adam Rambousek. \textit{Proceedings of the Eighteenth Workshop on Recent Advances in Slavonic Natural Languages Processing}. Brno: Tribun EU, 2024, s.~37-46. ISBN~978-80-263-1835-4.

Přehled o publikaci