Art der Publikation: Beitrag in Sammelwerk

Evaluating Submissions in Source Code Highlighting Tasks - Preliminary Considerations for Automatic Assessment

Autor(en):
Kramer, M.; Barkmin, M.; Brinda, T.
Herausgeber:
Mühling, A.; Cutts, Q.; Schwill, A.
Titel des Sammelbands:
Proceedings of the 13th Workshop in Primary and Secondary Computing Education (WIPSCE 2018), Potsdam, Germany, 4.-6. Oktober 2018
Verlag:
ACM Press
Ort(e):
New York
Veröffentlichung:
2018
ISBN:
978-1-4503-6588-8
Sprache:
English
Schlagworte:
Object-Oriented Programming, Highlighting, Assessment
Digital Object Identifier (DOI):
doi:10.1145/3265757.3265775
Link zum Volltext:
https://www.ddi.wiwi.uni-due.de/forschung/publikationen/acm/#kramer-barkmin-brinda-2018
Zitation:
Download BibTeX

Kurzfassung

The reading and understanding of source code is a necessary prerequisite for prospective programmers to write their own code. Thus, a reasonable task is to determine certain concepts like class identifiers in a given source code. In order to automatically evaluate the responses, they must be quantified. Hence, it is vital to have reliable and valid methods of measurement. In this paper we apply different means of measurement on constructed examples and compare them. Cohen's κ seems to be an adequate measure.