The full text of this article hosted at iucr.org is unavailable due to technical difficulties.

SPECIAL ISSUE ARTICLE

Improving early prediction of academic failure using sentiment analysis on self‐evaluated comments

L.C. Yu

Corresponding Author

E-mail address: lcyu@saturn.yzu.edu.tw

Department of Information Management, Yuan Ze University, , Taoyuan City, Taiwan

Correspondence

Liang‐Chih Yu, Department of Information Management, Yuan Ze University, No. 135, Yuandong Road, Zhongli District, Taoyuan City 320, Taiwan.

Email: lcyu@saturn.yzu.edu.tw

Search for more papers by this author
C.W. Lee

Department of Information Management, Yuan Ze University, , Taoyuan City, Taiwan

Search for more papers by this author
H.I. Pan

Department of Information Management, Yuan Ze University, , Taoyuan City, Taiwan

Search for more papers by this author
C.Y. Chou

Department of Computer Science and Engineering, Yuan Ze University, , Taoyuan City, Taiwan

Search for more papers by this author
P.Y. Chao

Department of Information Communication, Yuan Ze University, , Taoyuan City, Taiwan

Search for more papers by this author
Z.H. Chen

Graduate Institute of Information and Computer Education, National Taiwan Normal University, , Taipei City, Taiwan

Search for more papers by this author
S.F. Tseng

Department of Information Management, Yuan Ze University, , Taoyuan City, Taiwan

Search for more papers by this author
C.L. Chan

Department of Information Management, Yuan Ze University, , Taoyuan City, Taiwan

Search for more papers by this author
K.R. Lai

Department of Computer Science and Engineering, Yuan Ze University, , Taoyuan City, Taiwan

Search for more papers by this author
First published: 01 March 2018

Abstract

This study presents a model for the early identification of students who are likely to fail in an academic course. To enhance predictive accuracy, sentiment analysis is used to identify affective information from text‐based self‐evaluated comments written by students. Experimental results demonstrated that adding extracted sentiment information from student self‐evaluations yields a significant improvement in early‐stage prediction quality. The results also indicate the limited early‐stage predictive value of structured data, such as homework completion, attendance, and exam grades, due to data sparseness at the beginning of the course. Thus, applying sentiment analysis to unstructured data (e.g., self‐evaluation comments) can play an important role in improving the accuracy of early‐stage predictions. The findings present educators with an opportunity to provide students with real‐time feedback and support to help students become self‐regulated learners. Using the exploring results for improvement in teaching and learning initiatives is important to maintain students' performances and the effectiveness of the learning process.

Lay Description

What is already known about this topic:

  • The impact of emotional state on academic performance
  • Early intervention is a key factor in preventing academic failure by at‐risk students.

What this paper adds:

  • Apply sentiment analysis to enhance predictive accuracy in early stage.
  • Built a Chinese affective resource with valence ratings for each affective word, and use it to automatically extract emotions from self‐evaluation comments.

Implications for practice and/or policy:

  • Point out the limited early‐stage predictive ability of structured data and using unstructured data to bridge the gap.
  • Using information visualization to build self‐regulated system by structured and unstructured data. For educators, easy to recognize students' emotion during the class; for students, easy to understand how well they are performing in a class in a timely manner.