A Teacher-Made Test for an Opinion Paragraph: Insights from Design-Based Research (DBR)
DOI:
https://doi.org/10.51278/anglophile.v5i2.2033Keywords:
A Teacher-Made Test, Design-Based Research, Formative Assessment, Genre-Based ApproachAbstract
In English as a Foreign Language (EFL) teaching and learning, teachers frequently design their own tests to measure students’ skills, monitor progress, and evaluate instructional effectiveness. However, most previous research on teacher-made tests in EFL writing has centered on essay types such as descriptive, argumentative, narrative, expository, and comparison-contrast, leaving opinion paragraphs relatively underexplored. Addressing this gap, the present study describes the systematic development and validation of a teacher-made test specifically designed to assess opinion paragraphs. Conducted in a paragraph writing course at a private university in East Java, the study adopts a genre-based approach and draws on the design-based research (DBR) framework proposed by Cavallaro and Sembiante (2021). The instrument consists of two components: a writing prompt and an analytic scoring rubric. Its quality was ensured through a comprehensive validation process, including content and face validity (involving two writing instructors and eight students) and inter-rater reliability testing by two trained raters. The resulting test provides a cohesive, valid, and reliable formative assessment tool for evaluating EFL learners’ opinion paragraph writing. The inter-rater reliability coefficient (r = 0.85) indicates a strong positive correlation, supporting the consistency and reliability of the scoring rubric. This study not only contributes to the enhancement of teachers’ assessment literacy but also offers a practical model for developing and validating classroom-based writing assessments in EFL contexts.
References
Alshakhi, A. (2019). Revisiting the writing assessment process at a Saudi English language institute: Problems and solutions. English Language Teaching, 12(1), 176–185. https://doi.org/10.5539/elt.v12n1p176
Brown, H. Do., & Abeywickrama, P. (2019). Language assessment: Principles and classroom practices (Third Edit). Pearson Education, Inc.
Brown, T. D., Barnes, M., & Finefter-Rosenbluh, I. (2024). Teacher perspectives and experiences of assessment literacy in Victorian junior secondary schools. Australian Journal of Education, 68(1), 5–22. https://doi.org/10.1177/00049441231214022
Cavallaro, C. J., & Sembiante, S. F. (2021). Facilitating culturally sustaining, functional literacy practices in a middle school ESOL reading program: A design-based research study. Language and Education, 35(2), 160–179. https://doi.org/10.1080/09500782.2020.1775244
DeLuca, C., LaPointe-McEwan, D., & Luhanga, U. (2016). Approaches to classroom assessment inventory: A new instrument to support teacher assessment literacy. Educational Assessment, 21(4), 248–266. https://doi.org/10.1080/10627197.2016.1236677
Fan, T., Song, J., & Guan, Z. (2021). Integrating diagnostic assessment into curriculum: A theoretical framework and teaching practices. Language Testing in Asia, 11(1), 1–23. https://doi.org/10.1186/s40468-020-00117-y
Fitriyah, I., Bastomi, Y., Khotimah, K., & Gozali, I. (2022). Implementation of assessment for learning in online EFL writing class: A case of novice undergraduate teachers. LEARN Journal: Language Education and Acquisition Research Network, 15(2), 129–159.
Gashaye, S., & Degwale, Y. (2019). The content validity of high school English language teacher made tests: The case of Debre work preparatory school, East Gojjam, Ethiopia. International Journal of Research in Engineering, IT and Social Sciences, 9(11), 41–50.
Glušac, T., & Milić, M. (2022). Quality of written instructions in teacher-made tests of English as a foreign language. English Teaching and Learning, 46(1), 39–57. https://doi.org/10.1007/s42321-021-00079-1
Harris, L. R., Adie, L., & Wyatt-Smith, C. (2022). Learning progression–based assessments: A systematic review of student and teacher uses. Review of Educational Research, 92(6), 996–1040. https://doi.org/10.3102/00346543221081552
He, M., & Wang, L. (2024). Implementing assessment as learning in online EFL writing classes. RELC Journal, 1–15. https://doi.org/10.1177/00336882231224966
Hyland, K. (2019). Second language writing (Second Edi). Cambridge University Press.
Insuwan, C., & Thongrin, S. (2025). Empowering Thai EFL learners as critical thinkers and skilled writers : A genre-based approach with critical pedagogy. REFLections, 32(1), 487–520. https://doi.org/10.61508/refl.v32i1.280405
Jeong, H. (2017). Narrative and expository genre effects on students, raters, and performance criteria. Assessing Writing, 31, 113–125. https://doi.org/10.1016/j.asw.2016.08.006
Khotimah, K., Batunan, D. A., & Mukminatien, N. (2024). Teachers’ made writing assessment instrument: Pedagogical insight from process to product. Studies in English Language and Education, 11(1), 95–115. https://doi.org/10.24815/siele.v11i1.26774
Majeed, N. T., & Jasim, J. K. (2022). An evaluation of the English teacher-made tests for the fifth preparatory class of Iraqi schools. Journal of Tikrit University for Humanities, 29(3, 2), 1–28. https://doi.org/10.25130/jtuh.29.3.2.2022.22
Matsumoto-Royo, K., & Ramírez-Montoya, M. S. (2021). Core practices in practice-based teacher education: A systematic literature review of its teaching and assessment process. Studies in Educational Evaluation, 70(September), 1–13. https://doi.org/10.1016/j.stueduc.2021.101047
McKenney, S., & Reeves, T. (2018). Conducting educational design research (Second Edi). Routledge.
Misra, P. K. (2021). Learning and teaching for teachers. In Learning and Teaching for Teachers. Springer Nature Singapore. https://doi.org/10.1007/978-981-16-3077-4
Mukminatien, N., Yaniafari, R. P., El Khoiri, N., & Ariyanto, M. S. A. (2021). The rater reliability of an argumentative writing assessment using genre-based scoring rubric. In In N. Hayati, Suharyadi, S. Andreani, & U. P. Astuti (Eds.), The changing face of ELT: A festschrift for Prof. Ali Saukah and Prof. M. Adnan Latief (Vol. 11, Issue 1, pp. 175–191). Universitas Negeri Malang. http://scioteca.caf.com/bitstream/handle/123456789/1091/RED2017-Eng-8ene.pdf?sequence=12&isAllowed=y%0Ahttp://dx.doi.org/10.1016/j.regsciurbeco.2008.06.005%0Ahttps://www.researchgate.net/publication/305320484_SISTEM_PEmbetungan_Terpusat_Strategi_MelestarI
Nagao, A. (2022). A Genre-based Approach to teaching descriptive report Writing to Japanese EFL university students. Tesl-Ej, 26(3), 1–28. https://doi.org/10.55593/ej.26103a13
Pastore, S. (2023). Teacher assessment literacy: a systematic review. Frontiers in Education, 8(July), 1–25. https://doi.org/10.3389/feduc.2023.1217167
Pesiwarissa, R., Anaktototy, K., & Maruanaya, H. J. (2021). An analysis of EFL teacher-made tests Content knowledge, cognitive,and authentic evidences. MATAI: International Journal of Language Education, 2(1), 1–13. https://doi.org/10.30598/matail.v2i1.5485
Puspitasari, N. L., & Ulyasari, N. (2023). An analysis of validity and reliability of a teacher-made test on descriptive text : A case study to tenth grade office administration students at SMKN 3 Pontianak. Jurnal Sinestesia, 13(2), 1297–1303.
Rohmah, N. (2019). Validity and reliability study on teacher-made assessment for English mid-term examination. Eleventh Conference on Applied Linguistics (CONAPLIN 2018), 254(Conaplin 2018), 107–110. https://doi.org/10.2991/conaplin-18.2019.236
Santi, E., Haris Setiawan, M., & Khumaedi, M. (2019). Developing assessment instrument on writing on descriptive paragraph based on picture of junior high school students. Journal of Educational Research and Evaluation, 8(2), 116–122. https://doi.org/10.15294/jere.v8i2.36086
Schellekens, L. H., Bok, H. G. J., de Jong, L. H., van der Schaaf, M. F., Kremer, W. D. J., & van der Vleuten, C. P. M. (2021). A scoping review on the notions of assessment as learning (AaL), assessment for learning (AfL), and assessment of learning (AoL). Studies in Educational Evaluation, 71(October), 1–15. https://doi.org/10.1016/j.stueduc.2021.101094
Setiabudi, A., Mulyadi, & Puspita, H. (2019). An Analysis of Validity and Reliability of A Teacher-Made Test. Journal of English Education and Teaching (JEET), 3(4), 522–532.
Suskie, L. (2018). Assessing student learning: A common sense guide (Third Edit). Jossey-Bass.
Tardy, C. (2019). Genre-based writing: What every ESL teacher needs to know. University of Michigan Press ELT.
Tewachew, A., Shiferie, K., & Tefera, E. (2024). Practices of EFL teachers in test construction. Cogent Education, 11(1), 1–18. https://doi.org/10.1080/2331186X.2024.2412496
Tran, M. T. T. (2021). Use of self-regulated learning strategies in paragraph writing at Van Lang university. International Journal of TESOL & Education, 1(3), 1–13. http://eoi.citefactor.org/10.11250/ijte.01.03.001
Wang, L., & Lee, I. (2021). L2 learners’ agentic engagement in an assessment as learning-focused writing classroom. Assessing Writing, 50(October), 1–16. https://doi.org/10.1016/j.asw.2021.100571
Wang, Y., Derakhshan, A., Pan, Z., & Ghiasvand, F. (2023). Chinese EFL teachers’ writing assessment feedback literacy: A scale development and validation study. Assessing Writing, 56(April), 1–16. https://doi.org/10.1016/j.asw.2023.100726
Xiang, X., Yuan, R., & Yu, B. (2022). Implementing assessment as learning in the L2 writing classroom: A Chinese case. Assessment and Evaluation in Higher Education, 47(5), 727–741. https://doi.org/10.1080/02602938.2021.1965539
Yen, P. H., Thuy, P. T., Thao, L. T., Thi, N. A., Tra, N. H., & Thu, H. T. A. (2023). Multi-faceted identities of teacher assessors: A qualitative study in the Vietnamese educational context. Asian Journal of Social Sciences and Management Studies, 10(4), 132–141. https://doi.org/10.20448/ajssms.v10i4.5099
Zhai, X., & Razali, A. B. (2023). Triple method approach to development of a genre-based approach to teaching ESL/EFL writing: A systematic literature review by bibliometric, content, and scientometric analyses. SAGE Open, 13(1), 1–27. https://doi.org/10.1177/21582440221147255
Zou, M., Kong, D., & Lee, I. (2021). Teacher engagement with online formative assessment in EFL writing during COVID-19 pandemic: The case of China. Asia-Pacific Education Researcher, 30(6), 487–498. https://doi.org/10.1007/s40299-021-00593-7
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Mukminatus Zuhriyah, Nur Mukminatien, Soo Kum Yoke, Suhono Suhono
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
