Can I read Towards an optimised evaluation of teachers' discourse: The case of engaging messages on EtoBox?

Towards an optimised evaluation of teachers' discourse: The case of engaging messages by Falcon, Samuel; Leon, Jaime is a scholarly article available to read on EtoBox.

What is Towards an optimised evaluation of teachers' discourse: The case of engaging messages about?

Evaluating teachers' skills is crucial for enhancing education quality and student outcomes. Teacher discourse, significantly influencing student performance, is a key component. However, coding this discourse can be laborious. This study addresses this issue by introducing a new methodology for optimising the assessment of teacher discourse. The research consisted of two studies, both within the framework of engaging messages used by secondary education teachers. The first study involved training two large language models on real-world examples from audio-recorded lessons over two academic years to identify and classify the engaging messages from the lessons' transcripts. This resulted in sensitivities of 84.31% and 91.11%, and specificities of 97.69% and 86.36% in identification and classification, respectively. The second study applied these models to transcripts of audio-recorded lessons from a third academic year to examine the frequency and distribution of message types by educational level and moment of the academic year. Results showed teachers predominantly use messages emphasising engagement benefits, linked to improved outcomes, while one-third highlighted non-engagement

Author

Falcon, Samuel; Leon, Jaime

Published

2024

Language

EN