An Application of Difficulty Level Analysis of Question Items in Language Learning Evaluation

Authors

  • Ni Putu Eka Maryani Dewi Universitas Pendidikan Ganesha, Indonesia
  • Ida Bagus Putrayasa Universitas Pendidikan Ganesha, Indonesia

DOI:

https://doi.org/10.51278/bse.v4i3.1681

Keywords:

Question Item Analysis, Difficulty Level, Learning Evaluation

Abstract

One important component of learning is the assessment or evaluation process. Most evaluations will use items as tests, but not necessarily all items used are of high quality due to unvalidated difficulty levels. This article aims to provide an understanding of item difficulty and how to measure it as well as the importance of analysing item difficulty in language learning tests. The method used in this article is a literature review that examines the application of analysing the difficulty level of test items in language learning and its importance for learning. The results obtained are that it is important to analyse the level of difficulty of the questions to determine the quality of the test so that it can be feedback for learning; increase the validity and reliability of the test, adjust students' abilities, and improve the quality of the test for the next time. The formula used in item analysis includes a difficulty index denoted by the letter P (proportion), with an interval of 0.30-0.70 said to be a good question (enough).

 

References

Arif, Muchamad. (2014). Implementation of the Anates Application in the form of multiple choice questions. Edutic Scientific Journal, Vol. 1, No. 1. ISSN 2407-4489.

Arikunto. Suharsimi. (2018). Basics of Educational Evaluation. In Jakarta: Bumi Aksara (p. 46).

Azis. (2016). Analysis of Teacher-Made Tests Field of Study Mathematics Class V SD 1 Katobengke. ISSN:2008-2157 Vol. 6 No. 1, 18.

Dewi, N. L., Sukamto, & Prasetyowati, D. (2023). Analysis of Diagnostic Assessment Results in Natural and Social Science Subjects in Grade IV Elementary School. Didactics: PGSD STKIP Subang Scientific Journal, Vol. 9, No. 02, 4979–499.

Dewi, S.S., Hariastuti, R.M., & Utami, A.U. (2019). Analysis of the Level of Difficulty and Differentiating Power of the 2018 Middle School Mathematics Olympiad (OMI) Questions. Transformation: Journal of Mathematics and Mathematics education. Vol. 3, No. 1, 15-26. https://doi.org/10.36526/tr.v3i1.388

Fahlevi, M. S., Zanthy, L. S. (2020). Analysis of Students' Difficulties in Completing Description Questions on Flat Side Building Material. Journal of Innovative Mathematics Learning, Vol. 3, No. 4. E-ISSN: 2614-2155.

Fatimah, L.U., & Alfath, K. (2019). Analysis of Question Difficulty, Discriminatory Power, and Distractor Functions. Journal of Islamic Communication and Education, Vol. 8, No. 2. TWO: https://doi.org/10.36668/jal.v8i2.115

Fitriani, Nani. (2021). Analysis of Level of Difficulty, Differentiating Power, and Effectiveness of Distracters on Maternal and Neonatal Emergency Awareness Training Questions. Paedagoria: Journal of Educational Studies, Research and Development, Vol. 12, No. 2. ISSN 2614-3674.

Formiawan, A., Wati, D. R. (2023). Follow-up Analysis of Cognitive Diagnostic Assessment Results for Natural Science Subjects. Al-Jahiz: Journal of Biology Education Research, Vol. 4, No. 2. E-ISSN: 2722-5275.

Himawan, R., Nurgiyantoro, B. (2022). Analysis of Final Odd Semester Assessment Practice Questions for Class VIII Indonesian Language Subjects at SMPN I Bambanglipuro Bantul Using the ITEMAN Program. Kembara: Scientific Journal of Language, Literature and Teaching, Vol. 8, No. 1, 160-180. E-ISSN: 2442-9287

Kartiningsih, E.D. (2015). Guide to Preparing Literature Studies. Institute for Research and Community Service, Majapahit Mojokerto Health Polytechnic.

Magdalena, I., Fauziah, S. N., Faziah, S. N., Nupus, F. S. (2021). Analysis of Validity, Reliability, Level of Difficulty, and Differential Power of Final Semester Exam Questions for Theme 7 Class III SDN Karet 1 Sepatan. Star: Journal of Education and Science, Vol. 3, No. 2; 198-214.

Mustofa, S. (2017). Analysis of TOEFL Test Items (Test of Arabic as a Foreign Language). Maulana Malik Ibrahim State Islamic University Malang.

Permatasari, Arvynda. (2014). Management of Online Evaluation of Student Learning Results. Journal of Educational Management. Vol. 24 No. 3.

Qomariyah, Lailatul. (2022). Analysis of the Level of Difficulty and Differentiating Power of TOAFL Questions at Hasyim Asy'ari University Tebuireng Jombang. Oral Arabiya: Journal of Arabic Language Education, Vol.6, No.1. E-ISSN 2623-2588. Doi:10.32699/liar.v6il.2549.

Rahman, T., Hamdu, G., Putri, A. R., Merliana, A. (2022). Technical Training on Analysis of Assessment Instruments Using Rasch Modeling for Elementary School Teachers. Abdidas Journal, Vol. 3, No. 6, 1029-1037.

Ratni. (2023). Analysis of the Level of Difficulty, Differentiating Power, and Effectiveness of Distracting Indonesian Language Test Questions in Elementary Schools. Prose: Journal of Primary School Teacher Education Research, Vol.1, No.1. Two: https://doi.org/10.35326/prosa.v8i4.4234

Saputra, H. D., Purwanto, W., Setiawan, D., Fernandez, D., Putra, R. (2022). Student Learning Outcomes: Test Item Analysis. Education: Journal of Education, Vol. 20, No. 1, 15-27.

Sari, V.N.I., Utomo, A.P.Y., Sumarwati. (2022). Quality of Indonesian Language Questions at SMP Muhammadiyah 1 Pontianak: Analysis of Question Items. Journal of Indonesian Language and Literature Education, Vol.11, No.2. e-ISSN 2503-3476

Son, A. L. (2019). Instrumentation of Mathematical Problem Solving Ability: Analysis of Reliability, Validity, Level of Difficulty, and Differential Power of Question Items. Echo of Wiralodra, Vol. 10, No. 1, 41-52. E-ISSN: 2622-2969

Sudijono, Anas. (2019). Introduction to Educational Evaluation (3 ed.). In MoDuluS: Civil Science World Communication Media, Vol. 1, Issue 1

Susanto, H., Rinaldi, A., Novalia. (2015). Validity Reliability Analysis of Level of Difficulty and Differentiating Power on Odd Semester Final Exam Questions for Mathematics Class XII IPS at SMA Negeri 12 Bandar Lampung 2014/2015 Academic Year. Al-Jabar: Journal of Mathematics Education, Vol.6, No.2. TWO: http://dx.doi.org/10.24042/ajpm.v6i2.50

Valen, A., & Satria, T. G. (2021). Analysis of the Level of Difficulty of PAS Questions (Final Semester Assessment) of Social Sciences Subjects in Elementary Schools. Basicedu Journal, Vol. 5, No. 4, 2199–2208. https://doi.org/10.31004/basicedu.v5i4.1149

Wulan H.J.A., & Aristia, R. (2018). Types of Instruments in Learning Evaluation. Muhammadiyah University of Sidoarjo.

Wiyasa, P.I., Laksana, I.K.D., Indrawati, N.L.K.M. (2019). Evaluating Quality of Tearcher-Developed English Test in Vocational High School: Content Validity and Item Analysis. Education Quarterly Review, Vol. 2, No. 2. SSRN: https://ssrn.com/abstract=3415235

Downloads

Published

2024-12-23

How to Cite

Ni Putu Eka Maryani Dewi, & Ida Bagus Putrayasa. (2024). An Application of Difficulty Level Analysis of Question Items in Language Learning Evaluation. Bulletin of Science Education, 4(3), 330–338. https://doi.org/10.51278/bse.v4i3.1681

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.