Klasifikasi Kemampuan Mahasiswa Berdasarkan Automatic Essay Scoring terhadap Jawaban Essay Ujian Kompetensi dengan Metode Machine Learning
DOI:
https://doi.org/10.63447/jimik.v6i3.1325Keywords:
Automatic Essay Scoring, Classification, LSTM, Naive Bayes, SVM, Decision TreeAbstract
Manually assessing student answers and grouping student abilities is very time-consuming. Therefore, a system is needed that can automatically assess student essay answers and group student abilities. This study proposes a method for classifying student abilities based on the Automatic Essay Scoring value using the LSTM method and several classification methods. The number of datasets used in this study was 98 students, while the questions tested in this competency exam were 200 questions. The parameters used for LSTM are student answers. The benefit of this study is to find out which students have mastered the lecture and which students have not mastered the lecture. The results of this study indicate that the LSTM method successfully provides automatic essay assessment with an accuracy value of 0.9, while the most superior classification method is the Decision Tree method with the ROS oversampling method, which is 0.654.
Downloads
References
Ameliatus, Q., & Fatah, Z. (2024). Perbandingan metode klasifikasi Random Forest dan Support Vector Machine dalam memprediksi capaian studi mahasiswa. https://doi.org/10.69714/em8qnw54
Arifin, A. R., Purnamasari, P. D., & Ratna, A. A. P. (2021, June). Automatic essay scoring for indonesian short answers using siamese manhattan long short-term memory. In 2021 International Conference on Electrical, Communication, and Computer Engineering (ICECCE) (pp. 1-6). IEEE. https://doi.org/10.1109/ICECCE52056.2021.9514223
Astari Umbu Zaza, D., Umar, E., Ema Ose Sanga, F., Maris Sumba Jl Karya kasih No, S., Tambolaka, K., Barat Daya, S., & Abstrak, N. (2024). Penerapan text mining dalam klasifikasi judul skripsi mahasiswa pada Universitas Stella Maris Sumba menggunakan metode Naïve Bayes. Journal of Informatics and Business, 2(3).
Aytaç, U. C., Güneş, A., & Ajlouni, N. (2022). A novel adaptive momentum method for medical image classification using convolutional neural network. BMC Medical Imaging, 22(1). https://doi.org/10.1186/s12880-022-00755-z
Bakti, R. Y. (2024). Klasifikasi Mahasiswa Berpotensi Putus Studi Menggunakan Algoritma Decision Tree pada Fakultas Teknik Unismuh Makassar. Arus Jurnal Sains dan Teknologi, 2(2), 532-542. https://doi.org/10.57250/ajst.v2i2.674
Chimingyang, H. (2020). An automatic system for essay questions scoring based on LSTM and word embedding. Proceedings - 2020 5th International Conference on Information Science, Computer Technology and Transportation, ISCTT 2020, 355–364. https://doi.org/10.1109/ISCTT51595.2020.00068
Cho, K., & Kim, Y. (2022). Improving streamflow prediction in the WRF-Hydro model with LSTM networks. Journal of Hydrology, 605, 127297. https://doi.org/10.1016/j.jhydrol.2021.127297
Ifenthaler, D. (2022). Automated essay scoring systems. In Handbook of open, distance and digital education (pp. 1-15). Singapore: Springer Nature Singapore. https://doi.org/10.1007/978-981-19-0351-9_59-1
Intelligence, C. (2023). Retracted: An Automated Toxicity Classification on Social Media Using LSTM and Word Embedding. Computational Intelligence and Neuroscience, 2023, 9850820. https://doi.org/10.1155/2023/9850820
Kusumawati, R., Ainul Yaqin, M., & Artikel, S. (2024). Klasifikasi data mahasiswa lampau menggunakan metode Decision Tree dan Support Vector Machine. ILKOMNIKA: Journal of Computer Science and Applied Informatics, 6(3), 328–340. https://doi.org/10.28926/ilkomnika.v6i3.687
Lagakis, P., & Demetriadis, S. (2021, November). Automated essay scoring: A review of the field. In 2021 International Conference on Computer, Information and Telecommunication Systems (CITS) (pp. 1-6). IEEE. https://doi.org/10.1109/CITS52676.2021.9618476
Lahitani, A. R. (2022). Automated Essay Scoring menggunakan Cosine Similarity pada Penilaian Esai Multi Soal. Jurnal Kajian Ilmiah, 22(2), 107-118. https://doi.org/10.31599/m8n1x493
Li, F., Xi, X., Cui, Z., Li, D., & Zeng, W. (2023). Automatic essay scoring method based on multi-scale features. Applied Sciences, 13(11), 6775. https://doi.org/10.3390/app13116775
Ludwig, S., Mayer, C., Hansen, C., Eilers, K., & Brandt, S. (2021). Automated essay scoring using transformer models. Psych, 3(4), 897–915. https://doi.org/10.3390/psych3040056
Muriyatmoko, D., Musthafa, A., & Fa-Idzaa, M. (2024, December). Perbandingan Metode Support Vector Machine dan Random Forest dalam Menganalisis Pengaruh Musik Terhadap Penurunan Tingkat Stress Mahasiswi Semester 7 saat Skripsi (Studi Kasus: Universitas Darussalam Gontor). In Prosiding Seminar Nasional Amikom Surakarta (Vol. 2, pp. 128-135).
Novianto, E., Suhirman, S., & Prasetyo, D. (2024). Perbandingan metode klasifikasi Random Forest dan Support Vector Machine dalam memprediksi capaian studi mahasiswa. 9(4), 1821–1833. https://doi.org/10.29100/jipi.v9i4.5423
Nurhidayat, A., Asmunin, A., & Suyatno, D. F. (2021). Prediksi Kinerja Akademik Mahasiswa Menggunakan Machine Learning dengan Sequential Minimal Optimization untuk Pengelola Program Studi. JIEET (Journal of Information Engineering and Educational Technology), 5(2), 84-91. https://doi.org/10.26740/jieet.v5n2.p84-91.
Nurul Jariah SIntam, R., Akram Nur Risal, A., Fatmarani Surianto, D., Komputer, T., Negeri Makassar Jl Mallengkeri Raya, U., Tambung, P., Tamalate, K., Makassar, K., & Selatan, S. (2024). Klasifikasi Mahasiswa Berprestasi Menggunakan Fuzzy C-Means Dan Naive Bayes. Jurnal Ilmiah Informatika Global, 15(1), 9-16.
Saputro, H., & Budiyanto, U. (2024). Model Penilaian Esai Otomatis Menggunakan Algoritma Rabin-Karp, Dice Coefficient Similarity dan Synonym Recognition Studi Kasus Pada Universitas Budi Luhur. SKANIKA: Sistem Komputer dan Teknik Informatika, 7(1), 1-11. https://doi.org/10.36080/skanika.v7i1.3146
Sari, J. S. I., Umar, E., & Momo, L. L. (2024). Prediksi Kelulusan Mahasiswa Tepat Waktu Menggunakan Metode Naïve Bayes Dan Decision Tree Pada Universitas Stella Maris Sumba. Journal Of Informatics And Busisnes, 2(3), 362-368.
Satrio Junaidi, Valicia Anggela, R., & Kariman, D. (2024). Klasifikasi metode data mining untuk prediksi kelulusan tepat waktu mahasiswa dengan algoritma Naïve Bayes, Random Forest, Support Vector Machine (SVM) dan Artificial Neural Network (ANN). Journal of Applied Computer Science and Technology, 5(1), 109–119. https://doi.org/10.52158/jacost.v5i1.489
Shedriko, S., & Firdaus, M. (2022, January). Penentuan Klasifikasi Dengan Crisp-Dm Dalam Memprediksi Kelulusan Mahasiswa Pada Suatu Mata Kuliah. In Seminar Nasional Riset dan Inovasi Teknologi (SEMNAS RISTEK) (Vol. 6, No. 1). https://doi.org/10.30998/semnasristek.v6i1.5814.
Susanti, M. N. I., Ramadhan, A., & Warnars, H. L. H. S. (2022). Automatic essay exam scoring system: A systematic literature review. Procedia Computer Science, 216, 531–538. https://doi.org/10.1016/j.procs.2022.12.166
Tomu, I. R. M., Noya Van Delsen, M. S., & Lewaherilla, N. (2024). Klasifikasi Ketepatan Waktu Lulus Mahasiswa Jurusan Matematika Universitas Pattimura Menggunakan Metode Naïve Bayes Classifier. Proximal: Jurnal Penelitian Matematika Dan Pendidikan Matematika, 7(2), 864–872. https://doi.org/10.30605/proximal.v7i2.4153
Wiratmo, A., & Fatichah, C. (2020). Indonesian short essay scoring using transfer learning dependency tree LSTM. International Journal of Intelligent Engineering and Systems, 13(2), 278–285. https://doi.org/10.22266/ijies2020.0430.27
Wisniewski, M., Rana, Z. A., & Petrunin, I. (2022). Drone model classification using convolutional neural network trained on synthetic data. Journal of Imaging, 8(8), 218. https://doi.org/10.3390/jimaging8080218.
Downloads
Published
Issue
Section
License
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC-BY 4.0) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
License: All articles are licensed under 
