Embedding Automated Writing Evaluation in Providing Formative Feedback
DOI:
https://doi.org/10.15642/NOBEL.2024.15.2.155-170Keywords:
formative feedback, writing, automated writing evaluation (AWE)Abstract
The pivotal role of feedback in improving students’ writing competence has been undeniable, yet there has not been any agreement about how feedback can improve learning. The advancement of technology has opened opportunities to give feedback facilitated by technology, commonly referred to as Automated Writing Evaluation (AWE). AWE-based applications help produce effective feedback mostly because they are friendly. Several studies have documented that several AWE-based applications can potentially improve students’ writing skills. Nevertheless, effective feedback constitutes more than timely feedback. AWE-based applications cannot attain other factors, such as ongoing and goal-oriented. In other words, an AWE-based application is merely a form of feedback, such as comments and scores. Therefore, improving students’ writing competence cannot rely solely on AWE-based applications. The AWE-based application should be framed in the process of feedback provision that aims to improve learning, known as formative feedback. This paper elaborates on how AWE can be framed in formative feedback. The concept of formative feedback and the writing process will be discussed thoroughly before discussing how AWE tools can be embedded in formative feedback during the writing process.
Downloads
References
Al-Inbari, F. A. Y., & Al-Wasy, B. Q. M. (2023). The impact of automated writing evaluation (AWE) on EFL learners’ peer and self-editing. Education and Information Technologies, 28(6), 6645–6665. https://doi.org/10.1007/s10639-022-11458-x
Al-Wasy, B. Q., & Mahdi, H. S. (2016). The effect of mobile phone applications on improving EFL learners’ self-editing. Journal of Education and Human Development, 5(3), 149–157. https://doi.org/10.15640/jehd.v5n3a16
Aliotta, M. (2018). Mastering academic writing in the sciences: A step by step guide. CRC Press Taylor and Francis Group.
Ambarwati, E. K. (2021). Indonesian university students’ appropriating Grammarly for formative feedback. ELT in Focus, 3(1), 1–11. https://doi.org/10.35706/eltinfc.v4i1.5216
Ariyanto, M. S. A., Mukminatien, N., & Tresnadewi, S. (2021). College students’ perceptions of an automated writing evaluation as a supplementary feedback tool in a writing class. Jurnal Ilmu Pendidikan, 27(1), 41–51. https://doi.org/10.17977/um048v27i1p41-51
Bailey, S. (2003). Academic writing: A practical guide for students. Psychology Press.
Barrot, J. S. (2022). Integrating technology into ESL/EFL writing through Grammarly. RELC Journal, 53(3), 764–768. https://doi.org/10.1177/0033688220966632
Brown, H. D., & Abeywickrama, P. (2010). Language assessment: Principles and classroom practice (2nd ed.). Pearson Education Inc.
Butts, J. (2017). The more writing process, the better. In Bad Ideas about Writing (pp. 109–116). Digital Publishing Institute.
Cheng, G. (2022). Exploring the effects of automated tracking of student responses to teacher feedback in draft revision: evidence from an undergraduate EFL writing course. Interactive Learning Environments, 30(2), 353–375. https://doi.org/10.1080/10494820.2019.1655769
Cotos, E. (2011). Potential of automated writing evaluation feedback. CALICO Journal, 28(2), 420–459. https://doi.org/10.11139/cj.28.2.420-459
Cotos, E. (2023). Automated feedback on writing. In Digital Writing Technologies in Higher Education (pp. 347–364). Springer International Publishing. https://doi.org/10.1007/978-3-031-36033-6_22
Dawson, P., Henderson, M., Mahoney, P., Phillips, M., Ryan, T., Boud, D., & Molloy, E. (2019). What makes for effective feedback: Staff and student perspectives. Assessment & Evaluation in Higher Education, 44(1), 25–36. https://doi.org/10.1080/02602938.2018.1467877
Defianty, M. (2018). The practice of formative assessment by EFL teachers in secondary high school in Indonesia. University of Canberra.
Ding, L., & Zou, D. (2024). Automated writing evaluation systems: A systematic review of Grammarly, Pigai, and Criterion with a perspective on future directions in the age of generative artificial intelligence. Education and Information Technologies, 29(11), 14151–14203. https://doi.org/10.1007/s10639-023-12402-3
Faisal, F., & Carabella, P. A. (2023). Utilizing Grammarly in an academic writing process: Higher-education students’ perceived views. Journal of English Language Teaching and Linguistics, 8(1), 23–42. https://doi.org/10.21462/jeltl.v8i1.1006
Fallah, R., Chalak, A., & Heidari Tabrizi, H. (2021). Reconstruction of Iranian English foreign language teachers’ professional identity in online classes. Problems of Education in the 21st Century, 79(6), 858–879. https://doi.org/10.33225/pec/21.79.858
Fan, N., & Ma, Y. (2022). The effects of Automated Writing Evaluation (AWE) feedback on students’ English writing quality: A systematic literature review. Language Teaching Research Quarterly, 28, 53–73. https://doi.org/10.32038/ltrq.2022.28.03
Geng, J., Razali, A. B., Ismail, L., & Noordin, N. (2024). Effectiveness of automated writing evaluation program to enhance EFL undergraduates’ writing performance in China. Asia Pacific Education Review. https://doi.org/10.1007/s12564-023-09922-5
Han, T., & Sari, E. (2024). An investigation on the use of automated feedback in Turkish EFL students’ writing classes. Computer Assisted Language Learning, 37(4), 961–985. https://doi.org/10.1080/09588221.2022.2067179
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487
Herrington, A., & Moran, C. (2001). What happens when machines read our students’ writing? College English, 63(4), 480–499. https://doi.org/10.2307/378891
Hockly, N. (2019). Automated writing evaluation. ELT Journal, 73(1), 82–88. https://doi.org/10.1093/elt/ccy044
Hofslundsengen, H., Hagtvet, B. E., & Gustafsson, J.E. (2016). Immediate and delayed effects of invented writing intervention in preschool. Reading and Writing, 29(7), 1473–1495. https://doi.org/10.1007/s11145-016-9646-8
Huang, X., Xu, W., Li, F., & Yu, Z. (2024). A meta-analysis of effects of automated writing evaluation on anxiety, motivation, and second language writing skills. The Asia-Pacific Education Researcher, 33(4), 957–976. https://doi.org/10.1007/s40299-024-00865-y
Irons, A., & Elkington, S. (2021). Enhancing learning through formative assessment and feedback. Routledge. https://doi.org/10.4324/9781138610514
Jamalinesari, A., Rahimi, F., Gowhary, H., & Azizifar, A. (2015). The effects of teacher-written direct vs. indirect feedback on students’ writing. Procedia - Social and Behavioral Sciences, 192, 116–123. https://doi.org/10.1016/j.sbspro.2015.06.018
Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2), 254–284. https://doi.org/10.1037/0033-2909.119.2.254
Kumar, V., & Stracke, E. (2017). Settling students into community of practice. In S. Carter & D. Laurs (Eds.), Developing research writing: A handbook for supervisors and advisors (pp. 17–22). Routledge.
Li, J., Link, S., & Hegelheimer, V. (2015). Rethinking the role of automated writing evaluation (AWE) feedback in ESL writing instruction. Journal of Second Language Writing, 27, 1–18. https://doi.org/10.1016/j.jslw.2014.10.004
Li, Z. (2021). Teachers in automated writing evaluation (AWE) system-supported ESL writing classes: Perception, implementation, and influence. System, 99, 102505. https://doi.org/10.1016/j.system.2021.102505
Macdonald, N. H., Frase, L. T., Gingrich, P. S., & Keenan, S. A. (1982). The writer’s workbench: Computer aids for text analysis. Educational Psychologist, 17(3), 172–179. https://doi.org/10.1080/00461528209529254
McGarrell, H., & Verbeem, J. (2007). Motivating revision of drafts through formative feedback. ELT Journal, 61(3), 228–236. https://doi.org/10.1093/elt/ccm030
McMahan, E., Funk, R., Day, S. X., & Coleman, L. S. (2017). Literature and the writing process. Pearson.
Mehr, H. S. (2017). The impact of product and process approach on Iranian EFL learners’ writing ability and their attitudes toward writing Skill. International Journal of English Linguistics, 7(2), 158–166. https://doi.org/10.5539/ijel.v7n2p158
Nasution, A., & Fatimah, S. (2018). The use of pro writing aid web in editing students writing. Journal of English Language Teaching, 7(2), 362–368. https://doi.org/10.24036/jelt.v7i2.9802
Olsen, T., & Hunnes, J. (2024). Improving students’ learning—the role of formative feedback: Experiences from a crash course for business students in academic writing. Assessment & Evaluation in Higher Education, 49(2), 129–141. https://doi.org/10.1080/02602938.2023.2187744
Onozawa, C. (2010). A study of the process writing approach: A suggestion for an eclectic writing approach. Research Note, 10, 153–163. https://core.ac.uk/download/pdf/141876629.pdf
Oshima, A., & Hogue, A. (2006). Writing Academic English (4th ed.). Pearson Longman.
Pasand, P. G., & Haghi, E. B. (2013). Process-product approach to writing: The effect of model essays on EFL learners’ writing accuracy. International Journal of Applied Linguistics & English Literature, 2(1), 75–79. https://doi.org/10.7575/ijalel.v.2n.1p.75
Rahma, M., & Zen, E. L. (2023). Errors in students’ writing (Reports from ProWritingAid). Scope: Journal of English Language Teaching, 7(2), 202–209. https://doi.org/10.30998/scope.v7i2.15528
Ranalli, J. (2021). L2 student engagement with automated feedback on writing: Potential for learning and issues of trust. Journal of Second Language Writing, 52, 100816. https://doi.org/10.1016/j.jslw.2021.100816
Restika, I., Hanim, I., & Lastari, D. S. (2021). The effect of Ginger software on the tenth grade students’ writing skill. Globish: An English-Indonesian Journal for English, Education, and Culture, 10(2), 75–82. https://doi.org/10.31000/globish.v10i2.4635
Roscoe, R. D., Wilson, J., Johnson, A. C., & Mayra, C. R. (2017). Presentation, expectations, and experience: Sources of student perceptions of automated writing evaluation. Computers in Human Behavior, 70, 207–221. https://doi.org/10.1016/j.chb.2016.12.076
Ruiz‐Primo, M. A., Li, M., Wills, K., Giamellaro, M., Lan, M., Mason, H., & Sands, D. (2012). Developing and evaluating instructionally sensitive assessments in science. Journal of Research in Science Teaching, 49(6), 691–712. https://doi.org/10.1002/tea.21030
Rusinovci, X. (2015). Teaching writing through process-genre based approach. US-China Education Review, 5(10), 699–705. https://doi.org/10.17265/2161-623X/2015.10.006
Saadi, Z. K., & Saadat, M. (2015). EFL learners’ writing accuracy: Effects of direct and metalinguistic electronic feedback. Theory and Practice in Language Studies, 5(10), 2053–2063. https://doi.org/10.17507/tpls.0510.11
Saliu-Abdulahi, D., Hellekjær, G. O., & Hertzberg, F. (2017). Teachers’ (formative) feedback practices in EFL writing classes in Norway. Journal of Response to Writing, 3(1), 31–55. https://scholarsarchive.byu.edu/journalrw/vol3/iss1/3/
Sanosi, A. B. (2022). The impact of automated written corrective feedback on EFL learners’ academic writing accuracy. Journal of Teaching English for Specific and Academic Purposes, 10(2), 301–317. https://doi.org/10.22190/JTESAP2202301S
Schneider, M. C., & Randel, B. (2010). Research on characteristics of effective professional development programs for enhancing educators’ skills in formative assessment. In H. L. Andrade & G. J. Cizek (Eds.), Handbook of formative assessment (pp. 251–276). Routledge.
Seow, A. (2002). The writing process and process writing. In J. C. Richards & W. A. Renandya (Eds.), Methodology in Language Teaching: An Anthology of Current Practice (pp. 315–320). Cambridge University Press.
Shermis, M. D., Burstein, J., & Bursky, S. A. (2013). Introduction to automated essay evaluation. In M. D. Shermis & J. Burstein (Eds.), Handbook of automated essay evaluation (pp. 1–15). Routledge.
Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189. https://doi.org/10.3102/0034654307313795
Siswandi, S. (2016). Using a Whitesmoke checker as a technology to enhance English writing classroom. Indonesian Journal of Integrated English Language Teaching, 2(2), 239–252. https://doi.org/10.24014/ijielt.v2i2.2466
Swier, R. (2016). Ginger Software suite of writing services & apps. CALICO Journal, 33(2), 282–290. https://doi.org/10.1558/cj.v33i2.27069
Thomson, P. (2022). Refining your academic writing: Strategies for reading, revising and rewriting. Routledge. https://doi.org/10.4324/9781003031680
van der Kleij, F. M. (2020). Evaluation of the ‘Feedback Engagement Enhancement Tool’ to examine and enhance students’ engagement with feedback on their writing. Studies in Educational Evaluation, 66, 100907. https://doi.org/10.1016/j.stueduc.2020.100907
Wasike, B. N., Ongeti, K., & Syomwene, A. (2022). The effects of product approach to English language writing skills on students performance within selected Secondary Schools of Kenya. IOSR Journal of Computer Engineering (IOSR-JCE), 24(4), 1–7. https://doi.org/10.9790/0661-2404010107
Wiggins, G. (2016). Seven keys to effective feedback. In M. Scherer (Ed.), On Formative Assessment: Readings from Educational Leadership (EL Essentials) (pp. 24–35). ASCD.
Wiliam, D. (2012). Feedback: Part of a system. Feedback for Learning, 70(1), 30–34. http://hoelscherb.pbworks.com/w/file/fetch/58702168/Feedback-Part_of_a_system.pdf
Wingate, U. (2010). The impact of formative feedback on the development of academic writing. Assessment & Evaluation in Higher Education, 35(5), 519–533. https://doi.org/10.1080/02602930903512909
Woodworth, J., & Barkaoui, K. (2020). Perspectives on using automated writing evaluation systems to provide written corrective feedback in the ESL classroom. TESL Canada Journal, 37(2), 234–247. https://doi.org/10.18806/tesl.v37i2.1340
Xue, Y. (2024). Towards automated writing evaluation: A comprehensive review with bibliometric, scientometric, and meta-analytic approaches. Education and Information Technologies. https://doi.org/10.1007/s10639-024-12596-0
Yousofi, R. (2022). Grammarly deployment (in)efficacy within EFL academic writing classrooms: An attitudinal report from Afghanistan. Cogent Education, 9(1), 1–27. https://doi.org/10.1080/2331186X.2022.2142446
Yu, S. (2021). Giving genre-based peer feedback in academic writing: Sources of knowledge and skills, difficulties and challenges. Assessment & Evaluation in Higher Education, 46(1), 36–53. https://doi.org/10.1080/02602938.2020.1742872
Zhang, Z. (Victor). (2020). Engaging with automated writing evaluation (AWE) feedback on L2 writing: Student perceptions and revisions. Assessing Writing, 43, 100439. https://doi.org/10.1016/j.asw.2019.100439
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 NOBEL: Journal of Literature and Language Teaching
This work is licensed under a Creative Commons Attribution 4.0 International License.
