Assessing Writing Abilities using AI-Powered Writing Evaluations
Article Sidebar
Main Article Content
Abstract
This study aims to investigate the effectiveness of AI software, Automated Writing Evaluation (AWE), in identifying grammatical errors and increasing writing abilities among Malaysian public university students, as well as their perspectives on AI software in enhancing writing skills. The outcomes of this study reveal that students have good attitudes toward the implementation of AWE. The findings have implications for using artificial intelligence (AI) software (AWE) in ESL writing classes. Moreover, future scholars are anticipated to do similar research to increase the effect and relevance of this work.
Article Details
License
Copyright (c) 2023 Nurul Ajleaa Abdul Rahman, Luqmanul Hakim Zulkornain, Azman Che Mat, Martin Kustati
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
Ab Rahim, S. N. S., Jamaludin, N. L. ., Ali, A. ., & Isa, S. S. . (2022). Influence of Innovation in Education: Mediation of knowledge transfer. Environment-Behaviour Proceedings Journal, 7(SI9), 311-316. https://doi.org/10.21834/ebpj.v7iSI9.4280
Ab Wahid, M., Lee, W. K., & Baharudin, F. (2020). Implementing project-based learning for sustainability management course at postgraduate level. Asian Journal of University Education, 16(2), 84-92.
Agustin, R., & Wulandari, S. (2022). The analysis of grammatical errors on students' essay writing by using Grammarly. Jurnal Pendidikan Bahasa Inggris Proficiency, 4(1), 39–46. https://doi.org/10.32503/proficiency.v4i1.2247
Ananda, M., Nisa, R., & Safura, S. (2021). Students’ Perceptions Towards the Use of Grammarly in Checking Grammar in Assignment. Journal of English Language and Education, 1(2), 72–77. http://dx.doi.org/10.1016/S1607-551X(08)70133-5
Baharuddin, M. F. ., Mohd Amin, Z. ., Rahmad, F. ., & Kaspol, M. . (2022). Satisfaction on Online Learning during Covid-19 Pandemic: Perspective of Malaysian students. Environment-Behaviour Proceedings Journal, 7(SI10), 147-152. https://doi.org/10.21834/ebpj.v7iSI10.4108
Bouchoux, D. E. (2019). Legal Research and Writing for Paralegals. Wolters Kluwer Law & Business.
Faller, J. M. V. (2018). Grammarly Investigation into EFL Writing Issues Involving Omani Learners. International Journal of Language & Linguistics, 5(3). https://doi.org/10.30845/ijll.v5n316
Fitria, T. N. (2018). Error Analysis Found in Students' Writing Composition of Simple Future Tense. ELS Journal on Interdisciplinary Studies in Humanities, 1(3), 240–251.
Fitria, T. N. (2020a). Error Analysis Found in Students' Writing Composition in Simple Past Tense of Recount Text. ENGLISH FRANCA : Academic Journal of English Language and Education, 4(2), 141. https://doi.org/10.29240/ef.v4i2.1154
Fitria, T. N. (2020b). Spelling Error Analysis In Students' Writing English Composition. Getsempena English Education Journal, 7(2), 240–254. https://doi.org/10.46244/geej.v7i2.988
Fitriani, K., & Nurazni, L. (2022). Exploring English Department Students’ Perceptions on Using Grammarly to Check the Grammar in their Writing. Journal of English Teaching, 8(1), 15–25.
Ghufron, M. A. (2019). Exploring an Automated Feedback Program Grammarly and Teacher Corrective Feedback in EFL Writing Assessment: Modern vs. Traditional Assessment. ELLIC. ELLiC 2019, 307.
Ghufron, M. A., & Rosyida, F. (2018). The Role of Grammarly in Assessing English as a Foreign Language (EFL) Writing. Lingua Cultura, 12(4), 395–4 https://doi.org/10.21512/lc.v12i4.4582
Grammarly. (2020). About Grammarly. Retrieved from https://support.grammarly.com/hc/enus/categories/115000018611-About-Grammrly
Grimes, D., & Warschauer, M. (2010). Utility in a fallible tool: A multi-site case study of automated writing evaluation. The Journal of Technology, Learning, and Assessment, 8(6), 1-44.
Hanauer, D.I., Sheridan, C.L., Englander, K. (2019). Linguistic injustice in the writing of research articles in English as a second language: data from Taiwanese and Mexican Researchers.
Ibrahim, Z. ., Hussin, N. ., Wan Mokhtar, W. N. H. ., & Hashim, H. . (2022). Assessing the Effect of Digital Social Media towards Face to Face Communication during Pandemic COVID-19 in Higher Educational Institutions. Environment-Behaviour Proceedings Journal, 7(SI10), 41-46. https://doi.org/10.21834/ebpj.v7iSI10.4099
Koltovskaia, S. (2020). Student engagement with automated written corrective feedback (AWCF) provided by Grammarly: a multiple case study. Assessing Writing 44 (June 2022).
Lim, F.V., Phua, J. (2019). Teaching writing with language feedback technology. Comput. Compos. 54, 102518.
Maharani, M. M. (2018). Graphic Organisers to Improve Students' Writing on Recount Paragraphs. Metathesis: Journal of English Language, Literature, and Teaching, 2(2), 211–221. https://doi.org/10.31002/metathesis.v2i2.942
Mammadova, T. (2019). Teaching Grammar to a Grammar-Free Generation. Cambridge Scholars Publishing. Nova, M. (2018). Utilising Grammarly in evaluation academic writing: A narrative research EFL students’ experience. Journal of English education and applied linguistic. https://fkip.ummetro.ac.id/journal/index.php/English
Mat Zali, M. ., Mohd Razlan, R. ., Raja Baniamin, R. M. ., & Setia , R. . (2022). Interactional Metadiscourse Analysis of ESL Learners’ Essays. Environment-Behaviour Proceedings Journal, 7(SI9), 55-60. https://doi.org/10.21834/ebpj.v7iSI9.4248
Mohammad, S. N., Yusof, M. K. T. M., Puaad, M. B. F. M., Jamal, M. H., & Wee, L. S. (2023). Investigating Students’ Perception and Preferences of Online Learning in UiTM Pasir Gudang Campus. Asian Journal of University Education, 19(1), 223-234.
Naim, I. A. M., Luqman, N. M. A. N., & Matmin, J. (2020). Enhancing Students' Writing Performance in Higher Learning through Think-Write-Pair-Share: An Experimental Study. Asian Journal of University Education, 16(3), 255-264.
Nuro’azah, D. (2019). The effectiveness of Grammarly checker toward students’ writing quality. English.Fakultas Tarbiyah dan Ilmu Keguruan. URI: http://repo.iain-tulungagung.ac.id/id/id/eprint/12020
O’Neill, R., & Russell, A. M. T. (2019). Stop! Grammar time university students' perceptions of the automated feedback program Grammarly. Australasian Journal of Educational Technology, 35(1), 42-56.
Parra, G. L., & Calero, S. X. (2019). Automated writing evaluation tools in improvement of the writing skill. International Journal of Instruction, 12(2), 209-226. https://doi.org/10.29333/iji.2019.12214a
Perdana, I., & Farida, M. (2019). Online Grammar Checkers and Their Use for EFL Writing. Journal of English Teaching, Applied Linguistics, and Literatures (JETALL), 2(2), 67–76. https://doi.org/10.20527/jetall.v2i2.7332
Popenici, S.A.D., Kerr, S. (2017). Exploring the impact of artificial intelligence on teaching and learning in higher education. Res. Pract. Technol. Enhanc. Learn. (RPTEL) 12 (1).
Qiang, Z. (2014). An experimental research on applying automated essay scoring system to college English writing course. International Journal of English Language Teaching, 1(2), 35-41. https://doi.org/10.5430/ijelt.v1n2p35
Rahimi, M., Zhang, L.J. (2018). Writing task complexity, students’ motivational beliefs, anxiety and their writing production in English as a second language. Read. Writ. 32 (3), 761–786.
Rahman, N. A. A., Zulkornain, L. H., & Hamzah, N. H. (2022). Exploring Artificial Intelligence using Automated Writing Evaluation for Writing Skills. Environment-Behaviour Proceedings Journal, 7(SI9), 547-553.
Rahman, N. A. A., & Othman, Z. (2020). Enhancing Tvet Learners'21st Century Skills Through Innovative Speaking Skill Technique.
Rahman, N. A. A., & Maaarof, N. (2015). The Relationship between Language Learning Strategies and Students’ Motivation in Learning English as A Second Language. Jurnal Teknikal Sosial Sains, 1-17
Rani, Theodora. (2016). Students Perception of Self-Assessment and the Use of Self-Assessment in English Writing Skill. In KOLITA 14 : Konferensi Linguistik Tahunan Atma Jaya Keempat Belas, page 217-221.
Soegiyarto, M. S., Putri, R. A., & Saputra, S. D. (2022). The Importance of Getting Automated Grammar Feedback via Grammarly , for Increasing Students ’ English Language Proficiency.
Sarkam, N. A., Nasrudin, N. H., Razi, N. F. M., & Junid, R. A. (2022). Student readiness factors for online distance learning (ODL) among Malaysian Public Universities during COVID-19: A Proposed Conceptual Model. Asian Journal of University Education, 18(4), 1048-1061.
Ware, P. (2018). Automated writing assessment. In J. I. Liontas,& M. Delli Carpini (Eds.), The TESOL Encyclopedia of English Language Teaching(pp. 1-7). Hoboken, NJ: Wiley Blackwell. https://doi.org/10.1002/9781118784235.eelt0543
Yang, C. (2013). How Chinese beginning writers learn English writing: A survey of writing strategies. Journal of Educational and Social Research, 3(1), 9–18. doi: 10.5901/jesr.2013.v3n1p9
Zawacki-Richter, O., Marín, V.I., Bond, M., Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – where are the educators? Int. J. Educat. Technol. Higher Educat. 16 (1).
Zhang, Z. (2020). Engaging with automated writing evaluation (AWE) feedback on L2 writing: Student perceptions and revisions. Elsevier Inc: Assessing writing, pp. 43, 1-14
Zinkevich, N. A., & Ledeneva, T. V. (2021). Using Grammarly to Enhance Students’ Academic Writing Skills. Professional Discourse & Communication, 3(4), 51–63. https://doi.org/10.24833/2687-0126-2021-3-4-51-63