Další formáty:
BibTeX
LaTeX
RIS
@inproceedings{1131334,
author = {Jakubíček, Miloš and Šmerk, Pavel and Rychlý, Pavel},
address = {Brno},
booktitle = {RASLAN 2013 Recent Advances in Slavonic Natural Language Processing},
editor = {A. Horák, P. Rychlý},
keywords = {word to number index; number to word index; finite state automata; hat-trie},
howpublished = {tištěná verze "print"},
language = {eng},
location = {Brno},
isbn = {978-80-263-0520-0},
pages = {63-67},
publisher = {Tribun EU},
title = {Fast Construction of a Word-Number Index for Large Data},
url = {https://nlp.fi.muni.cz/raslan/2013/paper10.pdf},
year = {2013}
}
TY - JOUR
ID - 1131334
AU - Jakubíček, Miloš - Šmerk, Pavel - Rychlý, Pavel
PY - 2013
TI - Fast Construction of a Word-Number Index for Large Data
PB - Tribun EU
CY - Brno
SN - 9788026305200
KW - word to number index
KW - number to word index
KW - finite state automata
KW - hat-trie
UR - https://nlp.fi.muni.cz/raslan/2013/paper10.pdf
N2 - The paper presents a work still in progress, but with promising results. We offer a new method of construction of word to number and number to word indices for very large corpus data (tens of billions of tokens), which is up to an order of magnitude faster than the current approach. We use HAT-trie for sorting the data and Daciuk’s algorithm for building a minimal deterministic finite state automaton from sorted data. The latter we reimplemented and our new implementation is roughly three times faster and with smaller memory footprint than the one of Daciuk. This is useful not only for building word-number indices, but also for many other applications, e.g. building data for morphological analysers.
ER -
JAKUBÍČEK, Miloš, Pavel ŠMERK a Pavel RYCHLÝ. Fast Construction of a Word-Number Index for Large Data. In A. Horák, P. Rychlý. \textit{RASLAN 2013 Recent Advances in Slavonic Natural Language Processing}. Brno: Tribun EU. s.~63-67. ISBN~978-80-263-0520-0. 2013.
|
