MACHURA, Jakub, Hana ŽIŽKOVÁ, Jan ŠVEC and Adam FRÉMUND. IS IT POSSIBLE TO RE-EDUCATE ROBERTA? EXPERT-DRIVEN MACHINE LEARNING FOR PUNCTUATION CORRECTION. In SLOVKO, 18 - 20 October 2023, Bratislava. 2023. Available from: https://dx.doi.org/10.2478/jazcas-2023-0052.
Other formats:   BibTeX LaTeX RIS
Basic information
Original name IS IT POSSIBLE TO RE-EDUCATE ROBERTA? EXPERT-DRIVEN MACHINE LEARNING FOR PUNCTUATION CORRECTION
Authors MACHURA, Jakub, Hana ŽIŽKOVÁ, Jan ŠVEC and Adam FRÉMUND.
Edition SLOVKO, 18 - 20 October 2023, Bratislava, 2023.
Other information
Original language English
Type of outcome Presentations at conferences
Field of Study 60203 Linguistics
Country of publisher Slovakia
Confidentiality degree is not subject to a state or trade secret
Organization unit Faculty of Arts
Doi http://dx.doi.org/10.2478/jazcas-2023-0052
Keywords in English comma; Czech; vocative; machine learning; RoBERTa
Tags International impact, Reviewed
Changed by Changed by: doc. Mgr. Markéta Ziková, Ph.D., učo 9336. Changed: 8/1/2024 16:10.
Abstract
Although Czech rule-based tools for automatic punctuation insertion rely on extensive grammar and achieve respectable precision, the pre-trained Transformers outperform rule-based systems in precision and recall (Machura et al. 2022). The Czech pre-trained RoBERTa model achieves excellent results, yet a certain level of phenomena is ignored, and the model partially makes errors. This paper aims to investigate whether it is possible to retrain the RoBERTa language model to increase the number of sentence commas the model correctly detects. We have chosen a very specific and narrow type of sentence comma, namely the sentence comma delimiting vocative phrases, which is clearly defined in the grammar and is very often omitted by writers. The chosen approaches were further tested and evaluated on different types of texts
Links
MUNI/A/1249/2022, interní kód MUName: Lexikon a gramatika češtiny III - 2023
Investor: Masaryk University
PrintDisplayed: 10/10/2024 21:46