MEDVEĎ, Marek, Vojtěch KOVÁŘ and Miloš JAKUBÍČEK. English-French Document Alignment Based on Keywords and Statistical Translation. Online. In Proceedings of the First Conference on Machine Translation, Volume 2: Shared Task Papers. Berlin: Association for Computational Linguistics, 2016, p. 728-732. ISBN 978-1-945626-10-4.
Other formats:   BibTeX LaTeX RIS
Basic information
Original name English-French Document Alignment Based on Keywords and Statistical Translation
Authors MEDVEĎ, Marek (703 Slovakia, guarantor, belonging to the institution), Vojtěch KOVÁŘ (203 Czech Republic, belonging to the institution) and Miloš JAKUBÍČEK (203 Czech Republic, belonging to the institution).
Edition Berlin, Proceedings of the First Conference on Machine Translation, Volume 2: Shared Task Papers, p. 728-732, 5 pp. 2016.
Publisher Association for Computational Linguistics
Other information
Original language English
Type of outcome Proceedings paper
Field of Study 10201 Computer sciences, information science, bioinformatics
Confidentiality degree is not subject to a state or trade secret
Publication form electronic version available online
RIV identification code RIV/00216224:14330/16:00088114
Organization unit Faculty of Informatics
ISBN 978-1-945626-10-4
Keywords in English bilingual document alignment
Tags firank_B
Changed by Changed by: RNDr. Miloš Jakubíček, Ph.D., učo 172962. Changed: 4/9/2016 22:05.
Abstract
In this paper we present our approach to the Bilingual Document Alignment Task (WMT16), where the main goal was to reach the best recall on extracting aligned pages within the provided data. Our approach consists of tree main parts: data preprocessing, keyword extraction and text pairs scoring based on keyword matching. For text preprocessing we use the TreeTagger pipeline that contains the Unitok tool (Michelfeit et al., 2014) for tokenization and the TreeTagger morphological analyzer (Schmid, 1994). After keywords extraction from the texts according TF-IDF scoring our system searches for comparable English-French pairs. Using a statistical dictionary created from a large English-French parallel corpus, the system is able to find comaparable documents. At the end this procedure is combined with the baseline algorithm and best one-to-one pairing is selected. The result reaches 91.6% recall on provided training data. After a deep error analysis (see section 5) the recall reached 97.4%.
Links
GA15-13277S, research and development projectName: Hyperintensionální logika pro analýzu přirozeného jazyka
Investor: Czech Science Foundation
LM2015071, research and development projectName: Jazyková výzkumná infrastruktura v České republice (Acronym: LINDAT-Clarin)
Investor: Ministry of Education, Youth and Sports of the CR
7F14047, research and development projectName: Harvesting big text data for under-resourced languages (Acronym: HaBiT)
Investor: Ministry of Education, Youth and Sports of the CR
PrintDisplayed: 1/5/2024 04:53