The Kirkpatrick model is utilized in Indonesian language-literature training programs for madrasa teachers in West Java

Faizal Arvianto; Rosita Rahma

doi:10.59672/ijed.v6i4.5693

Authors

Faizal Arvianto Universitas Timor
Rosita Rahma Universitas Pendidikan Indonesia

DOI:

https://doi.org/10.59672/ijed.v6i4.5693

Keywords:

Evaluation training program, Kirkpatrick model, Madrasa teachers

Abstract

An evaluation is required to determine whether a program has achieved its objectives. This process involves collecting data to inform decisions on whether the program should be continued, discontinued, or revised. This article evaluates the Indonesian Language and Literature Learning Evaluation Training program for madrasa teachers in West Java, employing the four levels of the Kirkpatrick evaluation model: reaction, learning, behavior, and results. Primary data were collected from training participants, while secondary data were obtained from evaluation tools created by the participants. Sampling was conducted using saturated and convenience sampling, with data collected via questionnaires, tests, and document analysis. The results indicate a positive reception from participants (reaction), a significant increase in cognitive scores from pre-test to post-test by 37.25% (learning), and a high rate of knowledge transfer, with 82% of participants producing highly appropriate evaluation instruments (results). These findings demonstrate that the training effectively bridged the gap between theoretical knowledge and classroom implementation. Based on these outcomes, the authors provide recommendations for program sustainability, including optimized scheduling, module development, intensive monitoring, and the establishment of periodic evaluation success criteria.

Downloads

Download data is not yet available.

References

Altowaijri, S., Rahman, A. U., Alfawareh, H. M., & Altowaijri, S. M. (2019). Program outcomes assessment and evaluation for continuous improvements. IJCSNS International Journal of Computer Science and Network Security, 19(4), 40. https://www.researchgate.net/publication/338611508

Antonie, R. (2011). The role of program evaluation in the decision-making process. Transylvanian Review of Administrative Sciences, 33E.

Azmy, A., & Setiarini, N. Y. (2023). Kirkpatrick model as evaluation training program for assessor: case study of government employee. International Journal of Management, Accounting and Economics, 10(9), 2383–2126. https://doi.org/10.5281/zenodo.10115328

Bates, R. (2004). A critical analysis of evaluation practice: the kirkpatrick model and the principle of beneficence. Evaluation and Program Planning, 27(3), 341–347. https://doi.org/10.1016/j.evalprogplan.2004.04.011

Bhat, Z. H., & Rainayee, R. A. (2025). Linking ‘positive reactions’ to utility reactions and trainee satisfaction: a structural equation modeling approach. International Journal of Training Research, 23(1), 20–46. https://doi.org/10.1080/14480220.2024.2314014

Caro, M. F., Flórez, E. P., & Muñoz, I. C. (2026). A formal model for assessing the learning outcomes of academic programs. Evaluation and Program Planning, 114, 102644. https://doi.org/10.1016/j.evalprogplan.2025.102644

Christie, C. A., & Fierro, L. A. (2010). Program evaluation. In International Encyclopedia of Education. Elsevier. https://doi.org/10.1016/B978-0-08-044894-7.01618-3

Coates, H. (2015). Assessment of learning outcomes BT - The european higher education area: between critical reflections and future policies (A. Curaj, L. Matei, R. Pricopie, J. Salmi, & P. Scott (eds.); pp. 399–413). Springer International Publishing. https://doi.org/10.1007/978-3-319-20877-0_26

Conole, G., & Oliver, M. (2006). Contemporary perspectives in e-learning research (1st Editio). Routledge. https://doi.org/10.4324/9780203966266

Cooper, D., & Schindler, P. (2014). Business research methods: 12th Edition (12th Editi). MCGRAW-HILL US HIGHER ED. https://books.google.co.id/books?id=AZ0cAAAAQBAJ

Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (fifth edition). Sage Publications, Inc.

Etikan, I. (2016). Comparison of convenience sampling and purposive sampling. American Journal of Theoretical and Applied Statistics, 5(1), 1. https://doi.org/10.11648/j.ajtas.20160501.11

Farjad, S. (2012). The evaluation effectiveness of training courses in university by kirkpatrick model (Case study: Islamshahr university). Procedia - Social and Behavioral Sciences, 46, 2837–2841. https://doi.org/10.1016/j.sbspro.2012.05.573

Frye, A. W., & Hemmer, P. A. (2012). Program evaluation models and related theories: AMEE Guide No. 67. Medical Teacher, 34(5), e288–e299. https://doi.org/10.3109/0142159X.2012.668637

Garvey, L., & Kiegaldie, D. (2023). Assessment and evaluation in nursing education: A simulation perspective bt - comprehensive healthcare simulation: Nursing (J. M. Kutzin, K. T. Waxman, C. M. Lopez, & D. Kiegaldie (eds.); pp. 143–153). Springer International Publishing. https://doi.org/10.1007/978-3-031-31090-4_14

Grassini, S., & Laumann, K. (2020). Questionnaire measures and physiological correlates of presence: A systematic review. Frontiers in Psychology, 11. https://doi.org/10.3389/fpsyg.2020.00349

Hosseini, S., Yilmaz, Y., Shah, K., Gottlieb, M., Stehman, C. R., Hall, A. K., & Chan, T. M. (2022). Program evaluation: An educator’s portal into academic scholarship. AEM Education and Training, 6(S1). https://doi.org/10.1002/aet2.10745

Ikramina, F., & Gustomo, A. (2014). Analysis of training evaluation process using kirkpatrick’s training evaluation model at pt. bank tabungan negara (Persero) Tbk. Journal of Business and Management, 3(1), 102–111.

Ilhami, M. R. (2024). Evaluation of the goals and objects of assessment of aspects of student learning through bloom’s taxonomy. International Journal of Health, Economics, and Social Sciences (IJHESS), 6(2 SE-Articles), 401–406. https://doi.org/10.56338/ijhess.v6i2.4968

Isma, N., & Yusuf, M. (2025). The influence of the implementation of extracurricular activities of the islamic propagation agency on the practice of religious worship at mutia rahma bulu cina middle school , hamparan perak district. 5(1), 211–215. https://doi.org/10.30596/jcositte.v1i1.xxxx

Jayaratne, K. S. U., Kumar Chaudhary, A., & Diaz, J. M. (2025). Knowledge testing options in pre-test post-test evaluation design: implications for extension program evaluation. Advancements in Agricultural Development, 6(4), 64–75. https://doi.org/10.37433/aad.v6i4.659

Jupri, T. J., Tinus, A., & Wurianto, A. B. (2025). Mengembangkan berpikir kritis melalui penilaian autentik berbasis hots di bidang ekonomi (Developing critical thinking through hots-based authentic assessment in economics). Indonesian Journal of Innovation Studies, 26(3 SE-Innovation in Economics, Finance and Sustainable Development), 10.21070/ijins.v26i3.1453. https://ijins.umsida.ac.id/index.php/ijins/article/view/1453

Khan, D., & Ali, S. (2022). Training evaluation models: Comparative analysis. Research Journal of Social Sciences & Economics Review, 3(4), 2707–9015. https://doi.org/10.36902/rjsser-vol3-iss4-2022

Khofifah, J. M., Nurdin, D., & Herawan, E. (2025). Enhancing teacher professionalism through academic supervision: A CIPP model evaluation. Indonesian Journal of Educational Development (IJED), 6(2), 380–392. https://doi.org/10.59672/ijed.v6i2.4727

Kirkpatrick, J. (2007). The hidden power of kirkpatrick’s four levels (Vol. 61).

Kus, M. (2025). Evolution of program evaluation: A historical analysis of leading theorists’ views and influences. Education Quarterly Reviews, 8, 142-155. https://doi.org/10.31014/aior.1993.08.01.561

Levy-Feldman, I. (2025). The role of assessment in improving education and promoting educational equity. Education Sciences, 15(2), 224. https://doi.org/10.3390/educsci15020224

Martens, D. M. (2023). Review of research and evaluation in education and psychology: integrating diversity with quantitative, qualitative, and mixed methods (6th Editio). Sage Publications, Inc.

Masuwai, A., Zulkifli, H., & Hamzah, M. I. (2024). Evaluation of content validity and face validity of secondary school Islamic education teacher self-assessment instrument. Cogent Education, 11(1). https://doi.org/10.1080/2331186X.2024.2308410

Mehale, K. D., Govender, C. M., & Mabaso, C. M. (2021). Maximising training evaluation for employee performance improvement. SA Journal of Human Resource Management, 19, 1–11. https://doi.org/10.4102/sajhrm.v19i0.1473

Moleong, L. J. (2018). Metode penelitian kualitatif (Qualitative Research Methods). PT. Remaja Rosdakarya.

Netzer, L., Gutentag, T., Kim, M. Y., Solak, N., & Tamir, M. (2018). Evaluations of emotions: Distinguishing between affective, behavioral and cognitive components. Personality and Individual Differences, 135, 13–24. https://doi.org/10.1016/j.paid.2018.06.038

Nollen, S. D., & Gaertner, K. N. (1991). Effects of skill and attitudes on employee performance and earnings. Industrial Relations: A Journal of Economy and Society, 30(3), 435–455. https://doi.org/10.1111/j.1468-232X.1991.tb00797.x

Owston, R. (2008). Handbook of research on educational communications and technology (D. Jonassen, M. J. Spector, M. Driscoll, M. D. Merrill, J. van Merrienboer, & M. P. Driscoll (eds.); 3rd Editio). Routledge. https://doi.org/10.4324/9780203880869

Ozogul, G., & Sullivan, H. (2009). Student performance and attitudes under formative evaluation by teacher, self and peer evaluators. Educational Technology Research and Development, 57(3), 393–410. http://www.jstor.org/stable/40388636

Pardo, R. (2011). The evaluation and optimization of trading strategies (2nd Editio). Wiley.

Philibert, I., Beernink, J. H., Bush, B. H., Caniano, D. A., Coyle, J. J., Gilhooly, J., Kraybill, D. E., Larson, D., Nace, M. C., Robertson, W. W., Rubin, J. D., Sanford, T., Chow, A., & Moran, S. (2018). Improving the improvement process: 5 dimensions of effective program evaluation and improvement. Journal of Graduate Medical Education, 10(1), 114–117. https://doi.org/10.4300/JGME-D-18-00071.1

Powell, C. G., & Bodur, Y. (2019). Teachers’ perceptions of an online professional development experience: implications for a design and implementation framework. Teaching and Teacher Education, 77, 19–30. https://doi.org/10.1016/j.tate.2018.09.004

Pratiwi, Y. A. I., & Wahjoedi, T. (2024). The influence of attitude, skill, and knowledge control on employee perfomance at pt. astha kencana mulia. INCOME: Innovation of Economics and Management, 2(3), 19–23. https://doi.org/10.32764/income.v2i3.3749

Pratomo, R. Y., & Shofwan, I. (2022). Implementation of education and training program evaluation. Edukasi, 16(2), 63–77. https://doi.org/10.15294/edukasi.v16i2.39863

Rallis, S. F., & Bolland, K. A. (2004). What is program evaluation? Generating knowledge for improvement. Archival Science, 4(1–2), 5–16. https://doi.org/10.1007/s10502-005-6988-4

Reed, M. S., Ferré, M., Martin-Ortega, J., Blanche, R., Lawford-Rolfe, R., Dallimer, M., & Holden, J. (2021). Evaluating impact from research: A methodological framework. Research Policy, 50(4), 104147. https://doi.org/10.1016/j.respol.2020.104147

Rianyansa, A. A., & Maisarah, I. (2024). Students’ perception of literature as a teaching strategies in enrich the EFL students’ vocabulary. Indonesian Journal of Educational Development (IJED), 5(2), 282–291. https://doi.org/10.59672/ijed.v5i2.3465

Rindarti, E. (2021). Implementasi coaching untuk meningkatkan kemampuan kepala madrasah melaksanakan evaluasi pembelajaran jarak jauh (Implementation of coaching to improve the ability of madrasah principals to carry out distance learning evaluations). Indonesian Journal of Educational Development, 2 Nomor 3(November), 401-415 https://doi.org/10.5281/zenodo.5680948 __. https://doi.org/10.5281/zenodo.5680948

Rouse, D. N. (2011). Employing kirkpatrick’s evaluation framework to determine the effectiveness of health information management courses and programs. Perspectives in Health Inforrmation Managemen, 8(Spring), 1c.

Satyani, I. A. P. (2020). Mewujudkan metamorfosis sd negeri 8 mas melalui manajemen keterlibatan masyarakat lokal dan global (Realizing the metamorphosis of 8 Mas State Elementary School through local and global community involvement management) . Indonesian Journal of Educational Development, 1(3), 417–428. https://doi.org/10.5281/zenodo.4285148

Shek, D. T. L., & Chak, Y. L. Y. (2012). Evaluation of the training program of the project p.a.t.h.s.: findings based on the perspective of the participants from different cohorts. The Scientific World Journal, 2012, 1–10. https://doi.org/10.1100/2012/687198

Shewchuk, S., Wallace, J., & Seibold, M. (2023). Evaluations of training programs to improve capacity in k*: a systematic scoping review of methods applied and outcomes assessed. Humanities and Social Sciences Communications, 10(1), 887. https://doi.org/10.1057/s41599-023-02403-5

Shivaraju, P., Manu, G., M, V., & Savkar, M. (2017). Evaluating the effectiveness of pre- and post-test model of learning in a medical school. National Journal of Physiology, Pharmacy and Pharmacology, 7(9), 1. https://doi.org/10.5455/njppp.2017.7.0412802052017

Steensma, H., & Groeneveld, K. (2010). Evaluating a training using the “four levels model.” Journal of Workplace Learning, 22(5), 319–331. https://doi.org/10.1108/13665621011053226

Sudirman, S., Ramdani, A., Doyan, A., Anwar, Y. A. S., Rokhmat, J., & Sukarso, A. (2023). Development of performance assessment on science practicum integrated with automated feedback to measure scientific attitude in university: A case study in Indonesia. Path of Science, 9(12), 3001–3010. https://doi.org/10.22178/pos.99-7

Sugandini, W., Suyasa, P. W. A., Divayana, D. G. H., & Ariawan, I. P. W. (2025). Rwa Bhineda concept and weighted product method in the Alkin-Provus evaluation model modified design. Indonesian Journal of Educational Development (IJED), 6(2), 547–560. https://doi.org/10.59672/ijed.v6i2.4944

Sugiyono. (2013). Metode penelitian pendekatan pendekatan kuantitatif, kualitatif, dan r&d (Research methods include quantitative, qualitative, and r&d approaches). Alfabeta.

Suklani, S. (2023). Evaluation model and its urgency on elementary education programs. Jurnal Obsesi : Jurnal Pendidikan Anak Usia Dini, 7(2), 1639–1650. https://doi.org/10.31004/obsesi.v7i2.4201

Taherdoost, H. (2019). What is the best response scale for survey and questionnaire design; Review of different lengths of rating scale / attitude scale / likert scale. International Journal of Academic Research in Management (IJARM), 8(1), 1–10. https://ssrn.com/abstract=3588604

Vehovar, V., Toepoel, V., & Steinmetz, S. (2016). Non-probability sampling. In The SAGE Handbook of Survey Methodology (pp. 329–345). SAGE Publications Ltd. https://doi.org/10.4135/9781473957893.n22

Widana, I. W., Sumandya, I. W., & Asih, N. P. R. T. (2023). Evaluative study: Literacy outreach program based on local wisdom at SDN 1 Apuan Bangli. JISAE: Journal of Indonesian Student Assessment and Evaluation, 9(1), 26 - 36. https://doi.org/10.21009/jisae.v9i1.32533

Yu, J.-E. (2025). Reliability and validity of applying kirkpatrick model for evaluating exercise rehabilitation program. Journal of Exercise Rehabilitation, 21(4), 200–209. https://doi.org/10.12965/jer.2550428.214

Zareisaroukolaei, M., Shams, G., RezaeiZadeh, M., & Ghahramani, M. (2024). Effectiveness evaluation indicators of organizational e-learning courses. Computers in Human Behavior Reports, 15, 100432. https://doi.org/10.1016/j.chbr.2024.100432

Zomorrodian, A., & Matei, L. (2010). Program evaluation: Its significance and priority for shaping and modification of public policies: A comparative analysis. Proceedings of ASBBS, 979–996.