Can I read Marking: Visual Grading with Highlighting Errors and Annotating Missing Bits on EtoBox?

Marking: Visual Grading with Highlighting Errors and Annotating Missing Bits by Sonkar, Shashank; Liu, Naiming; Mallick, Debshila B.; Baraniuk, Richard G. is a scholarly article available to read on EtoBox.

What is Marking: Visual Grading with Highlighting Errors and Annotating Missing Bits about?

In this paper, we introduce "Marking", a novel grading task that enhances automated grading systems by performing an in-depth analysis of student responses and providing students with visual highlights. Unlike traditional systems that provide binary scores, "marking" identifies and categorizes segments of the student response as correct, incorrect, or irrelevant and detects omissions from gold answers. We introduce a new dataset meticulously curated by Subject Matter Experts specifically for this task. We frame "Marking" as an extension of the Natural Language Inference (NLI) task, which is extensively explored in the field of Natural Language Processing. The gold answer and the student response play the roles of premise and hypothesis in NLI, respectively. We subsequently train language models to identify entailment, contradiction, and neutrality from student response, akin to NLI, and with the added dimension of identifying omissions from gold answers. Our experimental setup involves the use of transformer models, specifically BERT and RoBERTa, and an intelligent training step using the e-SNLI dataset. We present extensive baseline results highlighting the complexity of the "Mark

Author

Sonkar, Shashank; Liu, Naiming; Mallick, Debshila B.; Baraniuk, Richard G.

Published

2024

Language

EN