Deteksi Antusiasme Siswa dengan Algoritma Yolov8 pada Proses Pembelajaran Daring

Kartika Salma; Syarif Hidayat

doi:10.35870/jimik.v5i2.716

Vol. 5 No. 2 (2024) • Articles

Open Access

Deteksi Antusiasme Siswa dengan Algoritma Yolov8 pada Proses Pembelajaran Daring

Kartika Salma

Universitas Islam Indonesia

Syarif Hidayat

Universitas Islam Indonesia

DOI: https://doi.org/10.35870/jimik.v5i2.716

Published: May 10, 2024 Pages: 1611-1618

Original Full-Text Article

Download published version for reading and archiving

Download PDF

Abstract

The implementation of Face Emotion Recognition (FER) technology in online classes opens up new opportunities to effectively monitor students' emotional responses and adjust the teaching approach. Through FER, instructors can monitor students' emotional responses to learning materials in real-time and enable quick adjustments based on individual needs. Additionally, this technology can also be used to detect the level of enthusiasm or lack thereof among students towards the learning process, allowing for the optimization of teaching strategies. This study focuses on the implementation of the YOLOv8 algorithm in detecting students' enthusiasm, comparing the performance of YOLOv8n, YOLOv8s, YOLOv8m, and YOLOv8l models. Test results show that YOLOv8n performs the best with an accuracy rate of 95.3% and a fast inference time of 62ms, enabling real-time object detection. Thus, the application of YOLOv8 in this context aims to detect students' enthusiasm in real-time and allows instructors to quickly adjust their approach to meet students' needs. Furthermore, this research contributes to improving the quality of online learning by providing insights into students' emotional engagement and serving as a tool to help instructors better understand and respond appropriately to students' emotions during the online learning process.

Keywords:

Face Emotion Recognition (FER) Emotional Response Real-Time Enthusiasm Detection Accuracy Yolov8

Article Metrics & Downloads Graph

Monthly Download Trends:

Author Biographies

Kartika Salma Universitas Islam Indonesia

Program Studi Informatika, Fakultas Teknologi Industri, Universitas Islam Indonesia, Kabupaten Sleman, Daerah Istimewa Yogyakarta, Indonesia.

Syarif Hidayat Universitas Islam Indonesia

Program Studi Informatika, Fakultas Teknologi Industri, Universitas Islam Indonesia, Kabupaten Sleman, Daerah Istimewa Yogyakarta, Indonesia.

How to Cite

Salma, K., & Hidayat, S. (2024). Deteksi Antusiasme Siswa dengan Algoritma Yolov8 pada Proses Pembelajaran Daring. Jurnal Indonesia : Manajemen Informatika Dan Komunikasi, 5(2), 1611-1618. https://doi.org/10.35870/jimik.v5i2.716

License

Creative Commons Attribution 4.0 International License (CC BY 4.0)

This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License .

Share: You are free to copy, distribute, and transmit the work in any medium or format.
Adapt: You are free to remix, transform, and build upon the work for any purpose, even commercially.
Attribution: You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.

Copyright & Retention: Authors retain copyright without restrictions and grant this journal the right of first publication under an open-access model. The journal retains non-exclusive publishing rights for archiving, indexing, and scholarly dissemination.

References

Total: 16 References

Anggraini, N. A., & Fadillah, N. (2019). Analisis Deteksi Emosi Manusia dari Suara Percakapan Menggunakan Matlab dengan Metode KNN. InfoTekJar (Jurnal Nas. Inform. dan Teknol. Jaringan), 3(2), 176-179.
AZIZI, F. N. (2021). Deteksi Emosi Menggunakan Citra Ekspresi Wajah Secara Otomatis.
Darwin, C., Ekman, P., & Prodger, P. (2002). The expression of the emotions in man and animals: Oxford University Press. USA,(1872 reprinted 2002).
Ekman, P., & Friesen, W. V. (1971). Constants across cultures in the face and emotion. Journal of personality and social psychology, 17(2), 124.
Goodfellow, I. J., Erhan, D., Carrier, P. L., Courville, A., Mirza, M., Hamner, B., ... & Bengio, Y. (2013). Challenges in representation learning: A report on three machine learning contests. In Neural Information Processing: 20th International Conference, ICONIP 2013, Daegu, Korea, November 3-7, 2013. Proceedings, Part III 20 (pp. 117-124). Springer berlin heidelberg.

Gupta, S., Kumar, P., & Tekchandani, R. K. (2023). Facial emotion recognition based real-time learner engagement detection system in online learning context using deep learning models. Multimedia Tools and Applications, 82(8), 11365-11394. DOI: https://doi.org/10.1109/IROS55552.2023.10342139.
Hasan, M. A., & Lazem, A. H. (2023). Facial Human Emotion Recognition by Using YOLO Faces Detection Algorithm. CENTRAL ASIAN JOURNAL OF MATHEMATICAL THEORY AND COMPUTER SCIENCES, 4(10), 1-11.
Hendriyana, H., & Maulana, Y. H. (2020). Identification of types of wood using convolutional neural network with MobileNet architecture. Jurnal RESTI (Rekayasa Sistem Dan Teknologi Informasi), 4(1), 70-76. DOI: https://doi.org/10.29207/resti.v4i1.1445.
Jiang, P., Ergu, D., Liu, F., Cai, Y., & Ma, B. (2022). A Review of Yolo algorithm developments. Procedia computer science, 199, 1066-1073. DOI: https://doi.org/10.1016/j.procs.2022.01.135.
Kovalchuk, Y., Budini, E., Cook, R. M., & Walsh, A. (2022). Investigating the relationship between facial mimicry and empathy. Behavioral Sciences, 12(8), 250.
Lin, R. (2022, February). Analysis on the selection of the appropriate batch size in CNN neural network. In 2022 International Conference on Machine Learning and Knowledge Engineering (MLKE) (pp. 106-109). IEEE. DOI: https://doi.org/ 10.1109/MLKE55170.2022.00026.
Ma, J., Ushiku, Y., & Sagara, M. (2022). The effect of improving annotation quality on object detection datasets: A preliminary study. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 4850-4859).
Ohoirat, A. L. E. PENGEMBANGAN INSTRUMEN ANALISIS VIDEO UNTUK MENENTUKAN PROFIL KARAKTER CALON GURU DALAM MEMBUKA PELAJARAN DITINJAU DARI EKSPRESI WAJAH.
Prasetyawan, D. (2020). Penentuan Emosi pada Video dengan Convolutional Neural Network. JISKA (Jurnal Informatika Sunan Kalijaga), 5(1), 23-35. DOI: https://doi.org/10.14421/jiska.2020.51-04.
Saini, M., & Susan, S. (2023). Tackling class imbalance in computer vision: a contemporary review. Artificial Intelligence Review, 56(Suppl 1), 1279-1335.
Terven, J., & Cordova-Esparza, D. (2023). A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS. arXiv preprint arXiv:2304.00501.