Is it Possible to Re-educate RoBERTa? Expert-driven Machine
Learning for Punctuation Correction

J 2023

Is it Possible to Re-educate RoBERTa? Expert-driven Machine Learning for Punctuation Correction

MACHURA, Jakub; Hana ŽIŽKOVÁ; Adam FRÉMUND a Jan ŠVEC

Základní údaje

Originální název

Is it Possible to Re-educate RoBERTa? Expert-driven Machine Learning for Punctuation Correction

Autoři

MACHURA, Jakub; Hana ŽIŽKOVÁ; Adam FRÉMUND a Jan ŠVEC

Vydání

Jazykovedný časopis, Bratislava, Jazykovedný ústav Ľudovíta Štúra Slovenskej akadémie vied, 2023, 0021-5597

Další údaje

Jazyk

angličtina

Typ výsledku

Článek v odborném periodiku

Obor

60203 Linguistics

Stát vydavatele

Slovensko

Utajení

není předmětem státního či obchodního tajemství

Odkazy

URL

Označené pro přenos do RIV

Ano

Kód RIV

RIV/00216224:14210/23:00131927

Organizační jednotka

Filozofická fakulta

DOI

https://doi.org/10.2478/jazcas-2023-0052

EID Scopus

2-s2.0-85181757325

Klíčová slova anglicky

comma; Czech; vocative; machine learning; RoBERTa

Štítky

rivok

Příznaky

Mezinárodní význam, Recenzováno

Změněno: 22. 2. 2024 16:25, doc. Mgr. Markéta Ziková, Ph.D.

Anotace

V originále

Although Czech rule-based tools for automatic punctuation insertion rely on extensive grammar and achieve respectable precision, the pre-trained Transformers outperform rule-based systems in precision and recall [hidden reference]. The Czech pre-trained RoBERTa model achieves excellent results, yet a certain level of phenomena is ignored, and the model partially makes errors. This paper aims to investigate whether it is possible to retrain the RoBERTa language model to increase the number of sentence commas the model correctly detects. We have chosen a very specific and narrow type of sentence comma, namely the sentence comma delimiting vocative phrases, which is clearly defined in the grammar and is very often omitted by writers. The chosen approaches were further tested and evaluated on different types of texts.

Návaznosti

MUNI/A/1249/2022, interní kód MU

Název: Lexikon a gramatika češtiny III - 2023

Investor: Masarykova univerzita, Lexikon a gramatika češtiny III - 2023

Citovat

MACHURA, Jakub; Hana ŽIŽKOVÁ; Adam FRÉMUND a Jan ŠVEC. Is it Possible to Re-educate RoBERTa? Expert-driven Machine Learning for Punctuation Correction. Jazykovedný časopis. Bratislava: Jazykovedný ústav Ľudovíta Štúra Slovenskej akadémie vied, 2023, roč. 74, č. 1, s. 357-368. ISSN 0021-5597. Dostupné z: https://doi.org/10.2478/jazcas-2023-0052.

@article{2326659,
   author = {Machura, Jakub and Žižková, Hana and Frémund, Adam and Švec, Jan},
   article_location = {Bratislava},
   article_number = {1},
   doi = {https://doi.org/10.2478/jazcas-2023-0052},
   keywords = {comma; Czech; vocative; machine learning; RoBERTa},
   language = {eng},
   issn = {0021-5597},
   journal = {Jazykovedný časopis},
   title = {Is it Possible to Re-educate RoBERTa? Expert-driven Machine Learning for Punctuation Correction},
   url = {https://www.juls.savba.sk/ediela/jc/2023/1/jc23-01.pdf},
   volume = {74},
   year = {2023}
}

TY  - JOUR
ID  - 2326659
AU  - Machura, Jakub - Žižková, Hana - Frémund, Adam - Švec, Jan
PY  - 2023
TI  - Is it Possible to Re-educate RoBERTa? Expert-driven Machine Learning for Punctuation Correction
JF  - Jazykovedný časopis
VL  - 74
IS  - 1
SP  - 357-368
EP  - 357-368
PB  - Jazykovedný ústav Ľudovíta Štúra Slovenskej akadémie vied
SN  - 00215597
KW  - comma
KW  - Czech
KW  - vocative
KW  - machine learning
KW  - RoBERTa
UR  - https://www.juls.savba.sk/ediela/jc/2023/1/jc23-01.pdf
N2  - Although Czech rule-based tools for automatic punctuation insertion rely on extensive grammar and achieve respectable precision, the pre-trained Transformers outperform rule-based systems in precision and recall [hidden reference]. The Czech pre-trained RoBERTa model achieves excellent results, yet a certain level of phenomena is ignored, and the model partially makes errors. This paper aims to investigate whether it is possible to retrain the RoBERTa language model to increase the number of sentence commas the model correctly detects. We have chosen a very specific and narrow type of sentence comma, namely the sentence comma delimiting vocative phrases, which is clearly defined in the grammar and is very often omitted by writers. The chosen approaches were further tested and evaluated on different types of texts.
ER  -

MACHURA, Jakub; Hana ŽIŽKOVÁ; Adam FRÉMUND a Jan ŠVEC. Is it Possible to Re-educate RoBERTa? Expert-driven Machine Learning for Punctuation Correction. \textit{Jazykovedný časopis}. Bratislava: Jazykovedný ústav Ľudovíta Štúra Slovenskej akadémie vied, 2023, roč.~74, č.~1, s.~357-368. ISSN~0021-5597. Dostupné z: https://doi.org/10.2478/jazcas-2023-0052.

Přehled o publikaci