Publications

Type of Publication: Article in Collected Edition

Evaluating Responses in Source Code Highlighting Tasks - Preliminary Considerations for Automatic Assessment

Author(s):
Kramer, M.; Barkmin, M.; Brinda, T.
Editor:
Mühling, A.; Cutts, Q.; Schwill, A.
Title of Anthology:
Proceedings of the 13th Workshop in Primary and Secondary Computing Education (WIPSCE 2018), Potsdam, Germany, 4.-6. Oktober 2018
pages:
1-4
Publisher:
ACM Press
Location(s):
New York
Publication Date:
2018
ISBN:
978-1-4503-6588-8
Language:
English
Keywords:
Object-Oriented Programming, Highlighting, Assessment
Digital Object Identifier (DOI):
doi:10.1145/3265757.3265775
Link to complete version:
https://www.ddi.wiwi.uni-due.de/forschung/publikationen/acm/#kramer-barkmin-brinda-2018
Citation:
Download BibTeX

Abstract

The reading and understanding of source code is a necessary prerequisite for prospective programmers to write their own code. Thus, a reasonable task is to determine certain concepts like class identifiers in a given source code. In order to automatically evaluate the responses, they must be quantified. Hence, it is vital to have reliable and valid methods of measurement. In this paper we apply different means of measurement on constructed examples and compare them. Cohen's κ seems to be an adequate measure.