Závěrečná práce: Bc. Jan Brichta: Text quality classification for machine translation training
Diplomová práce
Text quality classification for machine translation training
Anotace
Tato práce porovnává metody filtrování textu pro český jazyk a vyhodnocuje jejich vliv na neuronový strojový překlad (NMT). Hlavním cílem je prozkoumat několik přístupů k filtrování na úrovni vět, otestovat je na úlohách překladu z češtiny do angličtiny a poskytnout reprodukovatelný evaluační postup. Jsou vytvořeny dvě ručně anotované "gold standard" datové sady, které slouží k měření shody filtrů …více
Abstract
This thesis compares text filtering methods for Czech and evaluates their effect on neural machine translation (NMT). The main goal is to explore multiple sentence-level filtering approaches, test them using Czech–English translation tasks, and provide a reproducible evaluation pipeline. Two human‑annotated gold‑standard datasets are created to measure filter agreement with human judgments. Comparing …více
Zadání práce
Text filtering is often used for finding suitable data for given task and improving model quality.
There are numerous tasks benefiting from filtered text data such as spam detection, LLM assistent creation and fine-tuning, or Machine translation.
Since there are many text filters, it might be impossible to exhaustively evaluate all of them, however, it is worth doing an overview on few such methods in the field of machine translation and creating a way to compare them.
Goals:
The main goal of this thesis is to explore and implement multiple sentence filtering approaches, and test them using machine translation measures using Czech-English data. An important part of the thesis shall be an evaluation the of filters and a way to evaluate a given filter on machine translation.
Specifically, the filters will be used to create data from which machine translation models will be trained and tested using measures such as ChrF or Comet.
A large part of the focus of the thesis shall be on the evaluation/comparison
of filtering methods on machine translation to help compare different filtering methods.
Requirements:
The final work shall consist of:
- Comparing few modern approaches of text filtering methods for machine translation.
- Implementing/importing some such approaches and describing them in the thesis. Two of these methods shall be Fastext based filltering and embedding+neural network classifier.
- Evaluating the filtering approaches using machine translation measures.
- A written thesis containing results of the work done
29. 5. 2026 09:59, doc. Mgr. Pavel Rychlý, Ph.D., učo 3692
Práce na příbuzné téma
Seznam prací, které mají shodná klíčová slova.
-
Conversion between First-person and Third-person Narratives
Mgr. Veronika Burgerová -
Chunking Strategies for the .NET Ecosystem
Mgr. Kryštof Suchánek -
Corpora from reddit.com texts
Mgr. Jan Brichta -
Automatizovaná analýza Rámcového vzdělávacího programu pro základní vzdělávání
Mgr. et Mgr. Hana Boháčová -
Chatbot-like Natural Language Interface to a Web-based Information System
Bc. Michal Spiegel, učo 525189 -
A Chatbot to the CLARIN help
Bc. Filip Prochác -
Automatická analýza a agregace zboží z akčních letáků
Bc. Vítězslav Jíra -
Sino-Soviet Split in the selected Czechoslovak media
Mgr. Richard Janák




