Extrinsic Corpus Evaluation with a Collocation Dictionary Task

D 2014

Extrinsic Corpus Evaluation with a Collocation Dictionary Task

KILGARRIFF, Adam, Pavel RYCHLÝ, Miloš JAKUBÍČEK, Vojtěch KOVÁŘ, Vít BAISA et. al.

Základní údaje

Originální název

Extrinsic Corpus Evaluation with a Collocation Dictionary Task

Autoři

KILGARRIFF, Adam (826 Velká Británie a Severní Irsko), Pavel RYCHLÝ (203 Česká republika, garant, domácí), Miloš JAKUBÍČEK (203 Česká republika, domácí), Vojtěch KOVÁŘ (203 Česká republika, domácí), Vít BAISA (203 Česká republika, domácí) a Lucia KOCINCOVÁ (703 Slovensko, domácí)

Vydání

Reykjavik, Iceland, Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), od s. 1-8, 8 s. 2014

Nakladatel

European Language Resources Association (ELRA)

Další údaje

Jazyk

angličtina

Typ výsledku

Stať ve sborníku

Obor

10201 Computer sciences, information science, bioinformatics

Stát vydavatele

Česká republika

Utajení

není předmětem státního či obchodního tajemství

Forma vydání

elektronická verze "online"

Odkazy

URL

Kód RIV

RIV/00216224:14330/14:00073227

Organizační jednotka

Fakulta informatiky

ISBN

978-2-9517408-8-4

UT WoS

000355611002024

Klíčová slova anglicky

corpus; evaluation; collocation

Štítky

firank_B

Změněno: 20. 7. 2018 14:43, Mgr. Michal Petr

Anotace

V originále

The NLP researcher or application-builder often wonders ``what corpus should I use, or should I build one of my own? If I build one of my own, how will I know if I have done a good job?'' Currently there is very little help available for them. They are in need of a framework for evaluating corpora. We develop such a framework, in relation to corpora which aim for good coverage of `general language'. The task we set is automatic creation of a publication-quality collocations dictionary. For a sample of 100 headwords of Czech and 100 of English, we identify a gold standard dataset of (ideally) all the collocations that should appear for these headwords in such a dictionary. The datasets are being made available alongside this paper. We then use them to determine precision and recall for a range of corpora, with a range of parameters.

Návaznosti

LM2010013, projekt VaV

Název: LINDAT-CLARIN: Institut pro analýzu, zpracování a distribuci lingvistických dat (Akronym: LINDAT-Clarin)

Investor: Ministerstvo školství, mládeže a tělovýchovy ČR, Projekt LINDAT-Clarin - Vybudování a provoz českého uzlu pan-evropské infrastruktury pro výzkum

VF20102014003, projekt VaV

Název: Analýza přirozeného jazyka v prostředí internetu (Akronym: APJI)

Investor: Ministerstvo vnitra ČR, Analýza přirozeného jazyka v prostředí internetu

Citovat

KILGARRIFF, Adam, Pavel RYCHLÝ, Miloš JAKUBÍČEK, Vojtěch KOVÁŘ, Vít BAISA a Lucia KOCINCOVÁ. Extrinsic Corpus Evaluation with a Collocation Dictionary Task. Online. In Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Hrafn Loftsson and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis. Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14). Reykjavik, Iceland: European Language Resources Association (ELRA), 2014, s. 1-8. ISBN 978-2-9517408-8-4.

@inproceedings{1186170,
   author = {Kilgarriff, Adam and Rychlý, Pavel and Jakubíček, Miloš and Kovář, Vojtěch and Baisa, Vít and Kocincová, Lucia},
   address = {Reykjavik, Iceland},
   booktitle = {Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)},
   editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Hrafn Loftsson and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis},
   keywords = {corpus; evaluation; collocation},
   howpublished = {elektronická verze "online"},
   language = {eng},
   location = {Reykjavik, Iceland},
   isbn = {978-2-9517408-8-4},
   pages = {1-8},
   publisher = {European Language Resources Association (ELRA)},
   title = {Extrinsic Corpus Evaluation with a Collocation Dictionary Task},
   url = {http://www.lrec-conf.org/proceedings/lrec2014/summaries/52.html},
   year = {2014}
}

TY  - JOUR
ID  - 1186170
AU  - Kilgarriff, Adam - Rychlý, Pavel - Jakubíček, Miloš - Kovář, Vojtěch - Baisa, Vít - Kocincová, Lucia
PY  - 2014
TI  - Extrinsic Corpus Evaluation with a Collocation Dictionary Task
PB  - European Language Resources Association (ELRA)
CY  - Reykjavik, Iceland
SN  - 9782951740884
KW  - corpus
KW  - evaluation
KW  - collocation
UR  - http://www.lrec-conf.org/proceedings/lrec2014/summaries/52.html
L2  - http://www.lrec-conf.org/proceedings/lrec2014/summaries/52.html
N2  - The NLP researcher or application-builder often wonders ``what corpus should I use, or should I build one of my own? If I build one of my own, how will I know if I have done a good job?'' Currently there is very little help available for them. They are in need of a framework for evaluating corpora. We develop such a framework, in relation to corpora which aim for good coverage of `general language'. The task we set is automatic creation of a publication-quality collocations dictionary. For a sample of 100 headwords of Czech and 100 of English, we identify a gold standard dataset of (ideally) all the collocations that should appear for these headwords in such a dictionary. The datasets are being made available alongside this paper. We then use them to determine precision and recall for a range of corpora, with a range of parameters.
ER  -

KILGARRIFF, Adam, Pavel RYCHLÝ, Miloš JAKUBÍČEK, Vojtěch KOVÁŘ, Vít BAISA a Lucia KOCINCOVÁ. Extrinsic Corpus Evaluation with a Collocation Dictionary Task. Online. In Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Hrafn Loftsson and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis. \textit{Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)}. Reykjavik, Iceland: European Language Resources Association (ELRA), 2014, s.~1-8. ISBN~978-2-9517408-8-4.

Podrobný výpis o publikaci