jimik@stmiki.ac.id 081377790601 Online Submission Open
Vol. 6 No. 3 (2025) • Articles
Open Access

Klasifikasi Kemampuan Mahasiswa Berdasarkan Automatic Essay Scoring terhadap Jawaban Essay Ujian Kompetensi dengan Metode Machine Learning

Muhammad Hakiki
Institut Teknologi Sepuluh Nopember
Chastine Fatichah
Institut Teknologi Sepuluh Nopember
Published: September 10, 2025 Pages: 1532-1546
Original Full-Text Article
Download published version for reading and archiving
Download PDF
Abstract

Manually assessing student answers and grouping student abilities is very time-consuming. Therefore, a system is needed that can automatically assess student essay answers and group student abilities. This study proposes a method for classifying student abilities based on the Automatic Essay Scoring value using the LSTM method and several classification methods. The number of datasets used in this study was 98 students, while the questions tested in this competency exam were 200 questions. The parameters used for LSTM are student answers. The benefit of this study is to find out which students have mastered the lecture and which students have not mastered the lecture. The results of this study indicate that the LSTM method successfully provides automatic essay assessment with an accuracy value of 0.9, while the most superior classification method is the Decision Tree method with the ROS oversampling method, which is 0.654.

Keywords:
Automatic Essay Scoring Classification LSTM Naive Bayes SVM Decision Tree
Article Metrics & Downloads Graph
Monthly Download Trends:
Author Biographies
Muhammad Hakiki Institut Teknologi Sepuluh Nopember

Program Studi Teknik Informatika, Fakultas Teknologi Elektro dan Informatika Cerdas, Institut Teknologi Sepuluh Nopember, Kota Surabaya, Provinsi Jawa Timur, Indonesia

Chastine Fatichah Institut Teknologi Sepuluh Nopember

Program Studi Teknik Informatika, Fakultas Teknologi Elektro dan Informatika Cerdas, Institut Teknologi Sepuluh Nopember, Kota Surabaya, Provinsi Jawa Timur, Indonesia

How to Cite
Hakiki, M., & Fatichah, C. (2025). Klasifikasi Kemampuan Mahasiswa Berdasarkan Automatic Essay Scoring terhadap Jawaban Essay Ujian Kompetensi dengan Metode Machine Learning. Jurnal Indonesia : Manajemen Informatika Dan Komunikasi, 6(3), 1532-1546. https://doi.org/10.63447/jimik.v6i3.1325
License

Creative Commons Attribution 4.0 International License (CC BY 4.0)

This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License .

  • Share: You are free to copy, distribute, and transmit the work in any medium or format.
  • Adapt: You are free to remix, transform, and build upon the work for any purpose, even commercially.
  • Attribution: You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
Copyright & Retention: Authors retain copyright without restrictions and grant this journal the right of first publication under an open-access model. The journal retains non-exclusive publishing rights for archiving, indexing, and scholarly dissemination.

References
Total: 26 References
  1. Ameliatus, Q., & Fatah, Z. (2024). Perbandingan metode klasifikasi Random Forest dan Support Vector Machine dalam memprediksi capaian studi mahasiswa. https://doi.org/10.69714/em8qnw54
  2. Arifin, A. R., Purnamasari, P. D., & Ratna, A. A. P. (2021, June). Automatic essay scoring for indonesian short answers using siamese manhattan long short-term memory. In 2021 International Conference on Electrical, Communication, and Computer Engineering (ICECCE) (pp. 1-6). IEEE. https://doi.org/10.1109/ICECCE52056.2021.9514223
  3. Astari Umbu Zaza, D., Umar, E., Ema Ose Sanga, F., Maris Sumba Jl Karya kasih No, S., Tambolaka, K., Barat Daya, S., & Abstrak, N. (2024). Penerapan text mining dalam klasifikasi judul skripsi mahasiswa pada Universitas Stella Maris Sumba menggunakan metode Naïve Bayes. Journal of Informatics and Business, 2(3).
  4. Aytaç, U. C., Güneş, A., & Ajlouni, N. (2022). A novel adaptive momentum method for medical image classification using convolutional neural network. BMC Medical Imaging, 22(1). https://doi.org/10.1186/s12880-022-00755-z
  5. Bakti, R. Y. (2024). Klasifikasi Mahasiswa Berpotensi Putus Studi Menggunakan Algoritma Decision Tree pada Fakultas Teknik Unismuh Makassar. Arus Jurnal Sains dan Teknologi, 2(2), 532-542. https://doi.org/10.57250/ajst.v2i2.674
  6. Chimingyang, H. (2020). An automatic system for essay questions scoring based on LSTM and word embedding. Proceedings - 2020 5th International Conference on Information Science, Computer Technology and Transportation, ISCTT 2020, 355–364. https://doi.org/10.1109/ISCTT51595.2020.00068
  7. Cho, K., & Kim, Y. (2022). Improving streamflow prediction in the WRF-Hydro model with LSTM networks. Journal of Hydrology, 605, 127297. https://doi.org/10.1016/j.jhydrol.2021.127297
  8. Ifenthaler, D. (2022). Automated essay scoring systems. In Handbook of open, distance and digital education (pp. 1-15). Singapore: Springer Nature Singapore. https://doi.org/10.1007/978-981-19-0351-9_59-1
  9. Intelligence, C. (2023). Retracted: An Automated Toxicity Classification on Social Media Using LSTM and Word Embedding. Computational Intelligence and Neuroscience, 2023, 9850820. https://doi.org/10.1155/2023/9850820
  10. Kusumawati, R., Ainul Yaqin, M., & Artikel, S. (2024). Klasifikasi data mahasiswa lampau menggunakan metode Decision Tree dan Support Vector Machine. ILKOMNIKA: Journal of Computer Science and Applied Informatics, 6(3), 328–340. https://doi.org/10.28926/ilkomnika.v6i3.687
  11. Lagakis, P., & Demetriadis, S. (2021, November). Automated essay scoring: A review of the field. In 2021 International Conference on Computer, Information and Telecommunication Systems (CITS) (pp. 1-6). IEEE. https://doi.org/10.1109/CITS52676.2021.9618476
  12. Lahitani, A. R. (2022). Automated Essay Scoring menggunakan Cosine Similarity pada Penilaian Esai Multi Soal. Jurnal Kajian Ilmiah, 22(2), 107-118. https://doi.org/10.31599/m8n1x493
  13. Li, F., Xi, X., Cui, Z., Li, D., & Zeng, W. (2023). Automatic essay scoring method based on multi-scale features. Applied Sciences, 13(11), 6775. https://doi.org/10.3390/app13116775
  14. Ludwig, S., Mayer, C., Hansen, C., Eilers, K., & Brandt, S. (2021). Automated essay scoring using transformer models. Psych, 3(4), 897–915. https://doi.org/10.3390/psych3040056
  15. Muriyatmoko, D., Musthafa, A., & Fa-Idzaa, M. (2024, December). Perbandingan Metode Support Vector Machine dan Random Forest dalam Menganalisis Pengaruh Musik Terhadap Penurunan Tingkat Stress Mahasiswi Semester 7 saat Skripsi (Studi Kasus: Universitas Darussalam Gontor). In Prosiding Seminar Nasional Amikom Surakarta (Vol. 2, pp. 128-135).
  16. Novianto, E., Suhirman, S., & Prasetyo, D. (2024). Perbandingan metode klasifikasi Random Forest dan Support Vector Machine dalam memprediksi capaian studi mahasiswa. 9(4), 1821–1833. https://doi.org/10.29100/jipi.v9i4.5423
  17. Nurhidayat, A., Asmunin, A., & Suyatno, D. F. (2021). Prediksi Kinerja Akademik Mahasiswa Menggunakan Machine Learning dengan Sequential Minimal Optimization untuk Pengelola Program Studi. JIEET (Journal of Information Engineering and Educational Technology), 5(2), 84-91. https://doi.org/10.26740/jieet.v5n2.p84-91.
  18. Nurul Jariah SIntam, R., Akram Nur Risal, A., Fatmarani Surianto, D., Komputer, T., Negeri Makassar Jl Mallengkeri Raya, U., Tambung, P., Tamalate, K., Makassar, K., & Selatan, S. (2024). Klasifikasi Mahasiswa Berprestasi Menggunakan Fuzzy C-Means Dan Naive Bayes. Jurnal Ilmiah Informatika Global, 15(1), 9-16.
  19. Saputro, H., & Budiyanto, U. (2024). Model Penilaian Esai Otomatis Menggunakan Algoritma Rabin-Karp, Dice Coefficient Similarity dan Synonym Recognition Studi Kasus Pada Universitas Budi Luhur. SKANIKA: Sistem Komputer dan Teknik Informatika, 7(1), 1-11. https://doi.org/10.36080/skanika.v7i1.3146
  20. Sari, J. S. I., Umar, E., & Momo, L. L. (2024). Prediksi Kelulusan Mahasiswa Tepat Waktu Menggunakan Metode Naïve Bayes Dan Decision Tree Pada Universitas Stella Maris Sumba. Journal Of Informatics And Busisnes, 2(3), 362-368.
  21. Satrio Junaidi, Valicia Anggela, R., & Kariman, D. (2024). Klasifikasi metode data mining untuk prediksi kelulusan tepat waktu mahasiswa dengan algoritma Naïve Bayes, Random Forest, Support Vector Machine (SVM) dan Artificial Neural Network (ANN). Journal of Applied Computer Science and Technology, 5(1), 109–119. https://doi.org/10.52158/jacost.v5i1.489
  22. Shedriko, S., & Firdaus, M. (2022, January). Penentuan Klasifikasi Dengan Crisp-Dm Dalam Memprediksi Kelulusan Mahasiswa Pada Suatu Mata Kuliah. In Seminar Nasional Riset dan Inovasi Teknologi (SEMNAS RISTEK) (Vol. 6, No. 1). https://doi.org/10.30998/semnasristek.v6i1.5814.
  23. Susanti, M. N. I., Ramadhan, A., & Warnars, H. L. H. S. (2022). Automatic essay exam scoring system: A systematic literature review. Procedia Computer Science, 216, 531–538. https://doi.org/10.1016/j.procs.2022.12.166
  24. Tomu, I. R. M., Noya Van Delsen, M. S., & Lewaherilla, N. (2024). Klasifikasi Ketepatan Waktu Lulus Mahasiswa Jurusan Matematika Universitas Pattimura Menggunakan Metode Naïve Bayes Classifier. Proximal: Jurnal Penelitian Matematika Dan Pendidikan Matematika, 7(2), 864–872. https://doi.org/10.30605/proximal.v7i2.4153
  25. Wiratmo, A., & Fatichah, C. (2020). Indonesian short essay scoring using transfer learning dependency tree LSTM. International Journal of Intelligent Engineering and Systems, 13(2), 278–285. https://doi.org/10.22266/ijies2020.0430.27
  26. Wisniewski, M., Rana, Z. A., & Petrunin, I. (2022). Drone model classification using convolutional neural network trained on synthetic data. Journal of Imaging, 8(8), 218. https://doi.org/10.3390/jimaging8080218.
Similar Articles

Articles sharing related keywords and machine learning classifications:

Sentiment Analysis of Cigarette Use Based on Opinions from X Using Naive Bayes and SVM
Vol. 5 No. 3 (2024) • DOI: 10.35870/jimik.v5i3.947
Perbandingan Algoritma Klasifikasi Decision Tree, Random Forest, dan Naive Bayes dalam Prediksi Kelulusan Mahasiswa
Vol. 7 No. 3 (2026) • DOI: 10.63447/jimik.v7i3.2082
Klasifikasi Penyakit Migrain dengan Metode Naïve Bayes pada Dataset Kaggle
Vol. 6 No. 1 (2025) • DOI: 10.35870/jimik.v6i1.1150
Analisis Sentimen Pemecatan Shin Tae-yong pada Media Sosial X untuk Monitoring Opini Publik Menggunakan Naïve Bayes dan Support Vector Machines
Vol. 6 No. 3 (2025) • DOI: 10.63447/jimik.v6i3.1561
PERBANDINGAN METODE BALANCED SCORECARD DAN NAÏVE BAYES DALAM PREDIKSI DAN REKOMENDASI PADA PENILAIAN KINERJA GURU (STUDI KASUS : SMK YADIKA 12 DEPOK)
Vol. 4 No. 2 (2023) • DOI: 10.35870/jimik.v4i2.230