When Word Pairs Matter - Analysis of the English-Slovak
Evaluation Dataset

D 2021

When Word Pairs Matter - Analysis of the English-Slovak Evaluation Dataset

DENISOVÁ, Michaela and Pavel RYCHLÝ

Basic information

Original name

When Word Pairs Matter - Analysis of the English-Slovak Evaluation Dataset

Authors

DENISOVÁ, Michaela (703 Slovakia, guarantor, belonging to the institution) and Pavel RYCHLÝ (203 Czech Republic, belonging to the institution)

Edition

Brno, Proceedings of the Fifteenth Workshop on Recent Advances in Slavonic Natural Languages Processing, RASLAN 2021, p. 141-149, 9 pp. 2021

Publisher

Tribun EU

Other information

Language

English

Type of outcome

Stať ve sborníku

Field of Study

10200 1.2 Computer and information sciences

Country of publisher

Czech Republic

Confidentiality degree

není předmětem státního či obchodního tajemství

Publication form

printed version "print"

References:

Domovská stránka workshopu Plný text

RIV identification code

RIV/00216224:14330/21:00123252

Organization unit

Faculty of Informatics

ISBN

978-80-263-1670-1

ISSN

Keywords in English

Cross-lingual word embeddings; Ground truth dictionary; Evaluation; English; Slovak

Změněno: 15/5/2024 09:28, RNDr. Pavel Šmerk, Ph.D.

Abstract

V originále

Cross-lingual word embeddings facilitate the transfer of lexical knowledge across languages, and they are mainly used for finding transla- tion equivalents. Translation equivalents obtained in this way are usually evaluated with the help of ground truth dictionaries. However, the evalu- ation process, including the ground truth dictionaries, differs from model to model, impeding the correct interpretation of the results. Therefore, in this paper, we provide a thorough analysis of the English-Slovak ground truth dictionary and employ our analysis in evaluating two cross-lingual word embedding models. We show that word pairs choice is an important factor when accurately reflecting the model’s performance.

Links

LM2018101, research and development project

Name: Digitální výzkumná infrastruktura pro jazykové technologie, umění a humanitní vědy (Acronym: LINDAT/CLARIAH-CZ)

Investor: Ministry of Education, Youth and Sports of the CR

Citovat

DENISOVÁ, Michaela and Pavel RYCHLÝ. When Word Pairs Matter - Analysis of the English-Slovak Evaluation Dataset. In Horák, Rychlý, Rambousek. Proceedings of the Fifteenth Workshop on Recent Advances in Slavonic Natural Languages Processing, RASLAN 2021. Brno: Tribun EU, 2021, p. 141-149. ISBN 978-80-263-1670-1.

@inproceedings{1809763,
   author = {Denisová, Michaela and Rychlý, Pavel},
   address = {Brno},
   booktitle = {Proceedings of the Fifteenth Workshop on Recent Advances in Slavonic Natural Languages Processing, RASLAN 2021},
   editor = {Horák, Rychlý, Rambousek},
   keywords = {Cross-lingual word embeddings; Ground truth dictionary; Evaluation; English; Slovak},
   howpublished = {tištěná verze "print"},
   language = {eng},
   location = {Brno},
   isbn = {978-80-263-1670-1},
   pages = {141-149},
   publisher = {Tribun EU},
   title = {When Word Pairs Matter - Analysis of the English-Slovak Evaluation Dataset},
   url = {https://raslan2021.nlp-consulting.net/},
   year = {2021}
}

TY  - JOUR
ID  - 1809763
AU  - Denisová, Michaela - Rychlý, Pavel
PY  - 2021
TI  - When Word Pairs Matter - Analysis of the English-Slovak Evaluation Dataset
PB  - Tribun EU
CY  - Brno
SN  - 9788026316701
KW  - Cross-lingual word embeddings
KW  - Ground truth dictionary
KW  - Evaluation
KW  - English
KW  - Slovak
UR  - https://raslan2021.nlp-consulting.net/
N2  - Cross-lingual word embeddings facilitate the transfer of lexical knowledge across languages, and they are mainly used for finding transla- tion equivalents. Translation equivalents obtained in this way are usually evaluated with the help of ground truth dictionaries. However, the evalu- ation process, including the ground truth dictionaries, differs from model to model, impeding the correct interpretation of the results. Therefore, in this paper, we provide a thorough analysis of the English-Slovak ground truth dictionary and employ our analysis in evaluating two cross-lingual word embedding models. We show that word pairs choice is an important factor when accurately reflecting the model’s performance.
ER  -

DENISOVÁ, Michaela and Pavel RYCHLÝ. When Word Pairs Matter - Analysis of the English-Slovak Evaluation Dataset. In Horák, Rychlý, Rambousek. \textit{Proceedings of the Fifteenth Workshop on Recent Advances in Slavonic Natural Languages Processing, RASLAN 2021}. Brno: Tribun EU, 2021, p.~141-149. ISBN~978-80-263-1670-1.

Detailed Information on Publication Record