Article Sidebar

Download
PDF
Statistic
Read Counter : 20 Download : 2

Main Article Content

Abstract

This retrospective document-based audit evaluated a 25-item multiple-choice test on Honda automatic motorcycle tune-up knowledge using archived summary outputs from one administration to 35 Grade XI vocational students. The available records reported a mean score of 11.71 (SD = 5.32), Cronbach's alpha of 0.86, and an odd-even correlation of 0.75. Twenty-three items were classified as moderately difficult, item 19 as difficult, and item 23 as easy. Discrimination values ranged from 0.00 to 100.00 on the source scale; item 1 had the lowest value and item 11 the highest. Items 10 and 11 had the highest reported item-total correlations (0.820), whereas item 1 had a near-zero negative correlation (-0.039). Because the raw item-response matrix, calculation settings, and option-level frequencies were unavailable, the statistics could not be independently recalculated and distractor evidence was not used for definitive retention decisions. The findings indicate that relatively high total-score internal consistency can coexist with heterogeneous item functioning. Item 1 should receive priority review, while all item decisions should be confirmed through raw-data reanalysis, expert content review, revised-item pilot testing, and complementary practical performance assessment.

Keywords

Classical test theory item analysis multiple-choice assessment vocational education

Article Details

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Author Biographies

Rufi'i Rufi'i, Uiversitas Adi Buana Surabaya

Tidak Perlu

Sabariah Sabariah, Uiversitas Adi Buana Surabaya

Tidak Perlu

How to Cite
Yaqin, M. C. ., Rufi’i, R. ., & Sabariah, S. (2026). Retrospective Classical Item Audit of a Honda Automatic Motorcycle Tune-Up Test in Vocational Education. Jurnal Penelitian, 11(2), 82–93. https://doi.org/10.46491/jp.v20i2.2548

References

  1. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. American Educational Research Association.
  2. Díaz, N. V. M., Yoon, S. Y., Trytten, D., & Meier, R. (2023). Development and validation of the Engineering Computational Thinking Diagnostic for undergraduate students. IEEE Access, 11, 133099-133114. https://doi.org/10.1109/ACCESS.2023.3335931
  3. Gierl, M. J., Bulut, O., Guo, Q., & Zhang, X. (2017). Developing, analyzing, and using distractors for multiple-choice tests in education: A comprehensive review. Review of Educational Research, 87(6), 1082-1116. https://doi.org/10.3102/0034654317726529
  4. Hakim, S. R., Ekohariadi, Suparji, S., Harmanto, & Wiwin, E. (2024). Item test analyze of entrepreneurship readiness instrument for vocational school students in East Java Indonesia. Studies in Philosophy of Science and Education, 5(1), 41-47. https://doi.org/10.46627/sipose.v5i1.330
  5. Koskey, K. L. K., Makki, N., Ahmed, W., Garafolo, N. G., & Visco, D. P. (2020). Modification and validation of the mixed-format Engineering Concept Assessment for middle school students using many-facet Rasch measurement. School Science and Mathematics, 120(5), 309-321. https://doi.org/10.1111/ssm.12405
  6. Munawar, W. (2021). Assessment of competency based on dicotomic scoring to diagnose students’ skills in vocational learning in vocational schools. Journal of Vocational Education Studies, 4(1), 89. https://doi.org/10.12928/joves.v4i1.3823
  7. Navarro-González, M. C., Padilla, J., & Benítez, I. (2024). Analyzing measurement invariance for studying the gender gap in educational testing. European Journal of Psychological Assessment, 40(5), 412-426. https://doi.org/10.1027/1015-5759/a000820
  8. Ramadani, A. H., Ekohariadi, Anifah, L., Nugroho, Y. S., & Safitri, R. (2024). Development of performance assessment instruments for measuring drawing skills in vocational students competence in mechanical engineering expertise. International Journal of Recent Educational Research, 5(2), 268-279. https://doi.org/10.46245/ijorer.v5i2.551
  9. Salirawati, D., & Nugraheni, A. R. E. (2020). An analysis of validity of test items in chemistry final semester examination for vocational students majoring in computer and networking engineering in Bantul Regency. Asian Journal of Assessment in Teaching and Learning, 10(1), 32-40. https://doi.org/10.37134/ajatel.vol10.1.4.2020
  10. Setyaedhi, H. S., Rusijono, R., & Khotimah, K. (2024). Training and mentoring in the development of test instruments for measuring learning outcomes of Muhammadiyah school. International Journal of Community Service Learning, 7(3), 272-281. https://doi.org/10.23887/ijcsl.v7i3.63063
  11. Soeprijanto, S., Prohantoro, R., Pratama, R. A., & Ariefin, D. A. (2022). Needs analysis for developing project-based learning outcomes assessment models in electricity topic at the Center of Excellence Vocational High School. Jurnal Penelitian & Pengembangan Pendidikan Fisika, 8(2), 325-334. https://doi.org/10.21009/1.08214
  12. Taber, K. S. (2018). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Research in Science Education, 48(6), 1273-1296. https://doi.org/10.1007/s11165-016-9602-2
  13. Wahyuni, D. S. (2021). Developing competency-based assessment at vocational high school (VHS) in Bali. Jurnal Pendidikan Vokasi, 11(1). https://doi.org/10.21831/jpv.v11i1.37383
  14. Widiyanti, W., Dianawati, R., & Futachi, A. S. (2023). A cognitive assessment instrument for HOTS development in technical drawing subjects utilizing Quizziz learning platform. Jurnal Ilmu Pendidikan, 29(1), 1-6. https://doi.org/10.17977/um048v29i1p1-6
  15. Yusop, S. R. M., Rasul, M. S., Yasin, R. M., Hashim, H. U., & Jalaludin, N. A. (2022). An assessment approaches and learning outcomes in technical and vocational education: A systematic review using PRISMA. Sustainability, 14(9), 5225. https://doi.org/10.3390/su14095225