EFFENBERGER, Tomáš and Radek PELÁNEK. Impact of Methodological Choices on the Evaluation of Student Models. Online. In Bittencourt I., Cukurova M., Muldner K., Luckin R., Millán E. Artificial Intelligence in Education. AIED 2020. Lecture Notes in Computer Science, vol 12163. Cham: Springer, 2020, p. 153-164. ISBN 978-3-030-52236-0. Available from: https://dx.doi.org/10.1007/978-3-030-52237-7_13.
Other formats:   BibTeX LaTeX RIS
Basic information
Original name Impact of Methodological Choices on the Evaluation of Student Models
Authors EFFENBERGER, Tomáš (203 Czech Republic, guarantor, belonging to the institution) and Radek PELÁNEK (203 Czech Republic, belonging to the institution).
Edition Cham, Artificial Intelligence in Education. AIED 2020. Lecture Notes in Computer Science, vol 12163. p. 153-164, 12 pp. 2020.
Publisher Springer
Other information
Original language English
Type of outcome Proceedings paper
Field of Study 10201 Computer sciences, information science, bioinformatics
Country of publisher Switzerland
Confidentiality degree is not subject to a state or trade secret
Publication form electronic version available online
WWW URL
Impact factor Impact factor: 0.402 in 2005
RIV identification code RIV/00216224:14330/20:00116669
Organization unit Faculty of Informatics
ISBN 978-3-030-52236-0
ISSN 0302-9743
Doi http://dx.doi.org/10.1007/978-3-030-52237-7_13
UT WoS 000885049000013
Keywords in English adaptive learning; student modeling; intelligent tutoring systems; introductory programming
Tags core_A, firank_A
Tags International impact, Reviewed
Changed by Changed by: RNDr. Pavel Šmerk, Ph.D., učo 3880. Changed: 16/8/2023 13:14.
Abstract
The evaluation of student models involves many methodological decisions, e.g., the choice of performance metric, data filtering, and cross-validation setting. Such issues may seem like technical details, and they do not get much attention in published research. Nevertheless, their impact on experiments can be significant. We report experiments with six models for predicting problem-solving times in four introductory programming exercises. Our focus is not on these models per se but rather on the methodological choices necessary for performing these experiments. The results show, particularly, the importance of the choice of performance metric, including details of its computation and presentation.
Links
MUNI/A/1050/2019, interní kód MUName: Rozsáhlé výpočetní systémy: modely, aplikace a verifikace IX (Acronym: SV-FI MAV IX)
Investor: Masaryk University, Category A
PrintDisplayed: 18/7/2024 14:21