When Word Pairs Matter - Analysis of the English-Slovak
Evaluation Dataset

D 2021

When Word Pairs Matter - Analysis of the English-Slovak Evaluation Dataset

DENISOVÁ, Michaela a Pavel RYCHLÝ

Základní údaje

Originální název

When Word Pairs Matter - Analysis of the English-Slovak Evaluation Dataset

Autoři

DENISOVÁ, Michaela (703 Slovensko, garant, domácí) a Pavel RYCHLÝ (203 Česká republika, domácí)

Vydání

Brno, Proceedings of the Fifteenth Workshop on Recent Advances in Slavonic Natural Languages Processing, RASLAN 2021, od s. 141-149, 9 s. 2021

Nakladatel

Tribun EU

Další údaje

Jazyk

angličtina

Typ výsledku

Stať ve sborníku

Obor

10200 1.2 Computer and information sciences

Stát vydavatele

Česká republika

Utajení

není předmětem státního či obchodního tajemství

Forma vydání

tištěná verze "print"

Odkazy

Domovská stránka workshopu Plný text

Kód RIV

RIV/00216224:14330/21:00123252

Organizační jednotka

Fakulta informatiky

ISBN

978-80-263-1670-1

ISSN

Klíčová slova anglicky

Cross-lingual word embeddings; Ground truth dictionary; Evaluation; English; Slovak

Změněno: 15. 5. 2024 09:28, RNDr. Pavel Šmerk, Ph.D.

Anotace

V originále

Cross-lingual word embeddings facilitate the transfer of lexical knowledge across languages, and they are mainly used for finding transla- tion equivalents. Translation equivalents obtained in this way are usually evaluated with the help of ground truth dictionaries. However, the evalu- ation process, including the ground truth dictionaries, differs from model to model, impeding the correct interpretation of the results. Therefore, in this paper, we provide a thorough analysis of the English-Slovak ground truth dictionary and employ our analysis in evaluating two cross-lingual word embedding models. We show that word pairs choice is an important factor when accurately reflecting the model’s performance.

Návaznosti

LM2018101, projekt VaV

Název: Digitální výzkumná infrastruktura pro jazykové technologie, umění a humanitní vědy (Akronym: LINDAT/CLARIAH-CZ)

Investor: Ministerstvo školství, mládeže a tělovýchovy ČR, LINDAT/CLARIAH-CZ - Digitální výzkumná infrastruktura pro jazykové technologie, umění a humanitní vědy

Citovat

DENISOVÁ, Michaela a Pavel RYCHLÝ. When Word Pairs Matter - Analysis of the English-Slovak Evaluation Dataset. In Horák, Rychlý, Rambousek. Proceedings of the Fifteenth Workshop on Recent Advances in Slavonic Natural Languages Processing, RASLAN 2021. Brno: Tribun EU, 2021, s. 141-149. ISBN 978-80-263-1670-1.

@inproceedings{1809763,
   author = {Denisová, Michaela and Rychlý, Pavel},
   address = {Brno},
   booktitle = {Proceedings of the Fifteenth Workshop on Recent Advances in Slavonic Natural Languages Processing, RASLAN 2021},
   editor = {Horák, Rychlý, Rambousek},
   keywords = {Cross-lingual word embeddings; Ground truth dictionary; Evaluation; English; Slovak},
   howpublished = {tištěná verze "print"},
   language = {eng},
   location = {Brno},
   isbn = {978-80-263-1670-1},
   pages = {141-149},
   publisher = {Tribun EU},
   title = {When Word Pairs Matter - Analysis of the English-Slovak Evaluation Dataset},
   url = {https://raslan2021.nlp-consulting.net/},
   year = {2021}
}

TY  - JOUR
ID  - 1809763
AU  - Denisová, Michaela - Rychlý, Pavel
PY  - 2021
TI  - When Word Pairs Matter - Analysis of the English-Slovak Evaluation Dataset
PB  - Tribun EU
CY  - Brno
SN  - 9788026316701
KW  - Cross-lingual word embeddings
KW  - Ground truth dictionary
KW  - Evaluation
KW  - English
KW  - Slovak
UR  - https://raslan2021.nlp-consulting.net/
N2  - Cross-lingual word embeddings facilitate the transfer of lexical knowledge across languages, and they are mainly used for finding transla- tion equivalents. Translation equivalents obtained in this way are usually evaluated with the help of ground truth dictionaries. However, the evalu- ation process, including the ground truth dictionaries, differs from model to model, impeding the correct interpretation of the results. Therefore, in this paper, we provide a thorough analysis of the English-Slovak ground truth dictionary and employ our analysis in evaluating two cross-lingual word embedding models. We show that word pairs choice is an important factor when accurately reflecting the model’s performance.
ER  -

DENISOVÁ, Michaela a Pavel RYCHLÝ. When Word Pairs Matter - Analysis of the English-Slovak Evaluation Dataset. In Horák, Rychlý, Rambousek. \textit{Proceedings of the Fifteenth Workshop on Recent Advances in Slavonic Natural Languages Processing, RASLAN 2021}. Brno: Tribun EU, 2021, s.~141-149. ISBN~978-80-263-1670-1.

Podrobný výpis o publikaci