EFFENBERGER, Tomáš and Radek PELÁNEK. Validity and Reliability of Student Models for Problem-Solving Activities. Online. In Proceedings of the 11th International Conference on Learning Analytics and Knowledge. New York, NY, USA: Association for Computing Machinery, 2021, p. 1-11. ISBN 978-1-4503-8935-8. Available from: https://dx.doi.org/10.1145/3448139.3448140.
Other formats:   BibTeX LaTeX RIS
Basic information
Original name Validity and Reliability of Student Models for Problem-Solving Activities
Authors EFFENBERGER, Tomáš (203 Czech Republic, guarantor, belonging to the institution) and Radek PELÁNEK (203 Czech Republic, belonging to the institution).
Edition New York, NY, USA, Proceedings of the 11th International Conference on Learning Analytics and Knowledge, p. 1-11, 11 pp. 2021.
Publisher Association for Computing Machinery
Other information
Original language English
Type of outcome Proceedings paper
Field of Study 10201 Computer sciences, information science, bioinformatics
Country of publisher United States of America
Confidentiality degree is not subject to a state or trade secret
Publication form electronic version available online
WWW URL
RIV identification code RIV/00216224:14330/21:00121402
Organization unit Faculty of Informatics
ISBN 978-1-4503-8935-8
Doi http://dx.doi.org/10.1145/3448139.3448140
UT WoS 000883342500001
Keywords in English student modeling; skills; difficulties; validity; reliability; performance measures; problem solving; introductory programming
Tags core_A, firank_A
Tags International impact, Reviewed
Changed by Changed by: RNDr. Pavel Šmerk, Ph.D., učo 3880. Changed: 16/8/2023 13:16.
Abstract
Student models are typically evaluated through predicting the correctness of the next answer. This approach is insufficient in the problem-solving context, especially for student models that use performance data beyond binary correctness. We propose more comprehensive methods for validating student models and illustrate them in the context of introductory programming. We demonstrate the insufficiency of the next answer correctness prediction task, as it is neither able to reveal low validity of student models that use just binary correctness, nor does it show increased validity of models that use other performance data. The key message is that the prevalent usage of the next answer correctness for validating student models and binary correctness as the only input to the models is not always warranted and limits the progress in learning analytics.
Links
MUNI/A/1549/2020, interní kód MUName: Zapojení studentů Fakulty informatiky do mezinárodní vědecké komunity 21 (Acronym: SKOMU)
Investor: Masaryk University
PrintDisplayed: 26/4/2024 09:09