Measuring TPACK in context: Validating a cross-contextually fair instrument for Indonesian teachers

Authors

  • Uwes Anis Chaeruman Universitas Negeri Jakarta
  • Suwarno Universitas Bina Nusantara
  • Santi Maudiarti Institut Parawisata Trisakti
  • I Gde Wawan Sudatha Universitas Pendidikan Ganesha

DOI:

https://doi.org/10.59672/ijed.v7i1.6354

Keywords:

Confirmatory analysis, Differential item functioning, In-service teachers, Pshycometric validation, Technological pedagogical content knowledge

Abstract

As technology integration has become increasingly central to contemporary education, the need for valid and contextually fair instruments for assessing teachers' Technological Pedagogical Content Knowledge (TPACK) has become more urgent. This study aimed to develop and comprehensively validate a TPACK self-assessment instrument for Indonesian in-service teachers. A total of 1,297 teachers selected through purposive and convenience sampling from diverse provinces, school levels, and geographic locations participated in the study. The 48-item instrument, distributed across seven TPACK dimensions (TK, CK, PK, PCK, TCK, TPK, and TPACK), employed a 4-point Likert scale. Psychometric evaluation followed a multistage approach: (a) construct validity via corrected item-total correlations, in which all items met the r ≥ .30 threshold (range: .57–.79); (b) internal consistency reliability using Cronbach's alpha, with all dimensions exceeding .70 (α = .78–.97); (c) exploratory factor analysis (EFA), which supported the theoretical factor structure (KMO = .968; Bartlett's χ² = 54,279.51, p < .001); (d) confirmatory factor analysis (CFA), which yielded marginal fit indices (CFI = .707; RMSEA = .107), suggesting the need for model refinement; and (e) differential item functioning (DIF) analysis, which revealed minimal gender-based bias but notable location-based DIF. Overall, the instrument demonstrated strong psychometric properties for measuring teachers' TPACK in the Indonesian context. The findings highlight the importance of refining TPACK instruments to ensure greater measurement fairness across diverse educational settings and support future teacher professional development initiatives.

Downloads

Download data is not yet available.

References

Agustika, G. N. S., & Diputra, K. S. (2025). Effectiveness of hybrid project-based learning with digital portfolios in enhancing mathematics pedagogical content knowledge. Indonesian Journal of Educational Development (IJED), 6(2), 293–308. https://doi.org/10.59672/ijed.v6i2.4923

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. American Educational Research Association.

Archambault, L. M., & Barnett, J. H. (2010). Revisiting technological pedagogical content knowledge: Exploring the TPACK framework. Computers & Education, 55(4), 1656–1662. https://doi.org/10.1016/j.compedu.2010.07.009

Astari, & Yulianto, D. (2025). Bridging the digital divide in education: Disparities in Google Classroom utilization and technical challenges among urban and rural teachers. Journal of Education Technology, 9(2). https://doi.org/10.23887/jet.v9i2.92897

Chai, C. S., Koh, J. H. L., & Tsai, C.-C. (2013). A review of technological pedagogical content knowledge. Educational Technology & Society, 16(2), 31–51.

Chai, C. S., Koh, J. H. L., & Tsai, C.-C. (2023). A review of technological pedagogical content knowledge. Educational Technology & Society, 26(2), 31–51.

Chang, C.-F., Annisa, N., & Chen, K.-Z. (2025). Pre-service teacher professional education program (PPG) and Indonesian science teachers’ TPACK development: A career-path comparative study. Education and Information Technologies, 30(7), 8689–8711. https://doi.org/10.1007/s10639-024-13160-6

Chen, X., Aryadoust, V., & Zhang, W. (2025). A systematic review of differential item functioning in second language assessment. Language Testing, 42(2), 213–238. https://doi.org/10.1177/02655322241290188

Effatpanah, F., Ravand, H., & Doebler, P. (2025). Differential item functioning analysis of Likert scales: An overview and demonstration of rating scale tree model. Psychological Reports. https://doi.org/10.1177/00332941241308806

Finch, W. H., & French, B. F. (2023). Effect sizes for estimating differential item functioning influence at the test level. Psych, 5(1), 133–147. https://doi.org/10.3390/psych5010013

Gulo, R. S., Niswanto, Ismail, & Handayani, N. (2026). Coaching-based academic supervision to enhance teachers’ pedagogical competence. Indonesian Journal of Educational Development (IJED), 6(4), 1294–1305. https://doi.org/10.59672/ijed.v6i4.5683

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (8th ed.). Cengage Learning.

Handayani, S., Hussin, M., & Norman, H. (2024). Evaluating teaching readiness using the TPACK model: Factor, reliability and validity analyses for Indonesian economics teacher candidates. Perspectives of Science and Education, 68(2), 679–698. https://doi.org/10.32744/pse.2024.2.41

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

Jordan, P. J., & Troth, A. C. (2020). Common method bias in applied settings: The dilemma of researching in organizations. Australian Journal of Management, 45(1), 3–14. https://doi.org/10.1177/0312896219871976

Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36. https://doi.org/10.1007/BF02291575

Karataş, F., & Ataç, B. A. (2025). When TPACK meets artificial intelligence: Analyzing TPACK and AI-TPACK components through structural equation modelling. Education and Information Technologies, 30(7), 8979–9004. https://doi.org/10.1007/s10639-024-13164-2

Kemendikbudristek. (2023). Buku saku Merdeka Belajar [Merdeka Belajar handbook]. Ministry of Education, Culture, Research, and Technology of the Republic of Indonesia.

Kline, R. B. (2016). Principles and practice of structural equation modeling (4th ed.). The Guilford Press.

Koehler, M. J., Mishra, P., & Cain, W. (2013). What is technological pedagogical content knowledge (TPACK)? Journal of Education, 193(3), 13–19. https://doi.org/10.1177/002205741319300303

Megawaty, M., Sulistiyo, U., Wachyuni, S., & Sofyan. (2025). Development of M.E.G.A: A self-assessment expert system to improve English correspondence skills for job-seeking university students. Indonesian Journal of Educational Development (IJED), 6(2), 393–407. https://doi.org/10.59672/ijed.v6i2.5099

Mishra, P., & Koehler, M. J. (2006). Technological pedagogical content knowledge: A framework for teacher knowledge. Teachers College Record, 108(6), 1017–1054.

Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.

Opesemowo, O. A. G. (2025). Exploring undue advantage of differential item functioning in high-stakes assessments: Implications on sustainable development goal 4. Social Sciences & Humanities Open, 11, 101257. https://doi.org/10.1016/j.ssaho.2024.101257

Oroh, S. S. A., Arsana, I. K. S., & Dolonseda, H. P. (2025). Self-efficacy as a moderator of the effect of techno-pedagogical competence on economics teachers’ readiness. Indonesian Journal of Educational Development (IJED), 6(3), 1116–1130. https://doi.org/10.59672/ijed.v6i3.4929

Paap, K. R., Anders-Jefferson, R. T., Balakrishnan, N., & Majoubi, J. B. (2023). The many foibles of Likert scales challenge claims that self-report measures of self-control are better than performance-based measures. Behavior Research Methods, 56(2), 908–933. https://doi.org/10.3758/s13428-023-02089-2

Petko, D., Mishra, P., & Koehler, M. J. (2025). TPACK in context: An updated model. Computers and Education Open, 8, 100244. https://doi.org/10.1016/j.caeo.2025.100244

Schmid, M., Brianza, E., Mok, S. Y., & Petko, D. (2024). Running in circles: A systematic review of reviews on technological pedagogical content knowledge (TPACK). Computers & Education, 214, 105024. https://doi.org/10.1016/j.compedu.2024.105024

Schmidt, D. A., Baran, E., Thompson, A. D., Mishra, P., Koehler, M. J., & Shin, T. S. (2009). Technological pedagogical content knowledge (TPACK): The development and validation of an assessment instrument for preservice teachers. Journal of Research on Technology in Education, 42(2), 123–149. https://doi.org/10.1080/15391523.2009.10782544

Shulman, L. S. (1986). Those who understand: Knowledge growth in teaching. Educational Researcher, 15(2), 4–14. https://doi.org/10.3102/0013189X015002004

Sofyan, S., Habibi, A., Sofwan, M., Yaakob, M. F. M., Alqahtani, T. M., Jamila, A., & Wijaya, T. T. (2023). TPACK–UotI: The validation of an assessment instrument for elementary school teachers. Humanities and Social Sciences Communications, 10(1), 55. https://doi.org/10.1057/s41599-023-01533-0

Thomas, S. (2022). Robert F. DeVellis & Carolyn T. Thorpe (2022). Scale development: Theory and applications (Book Review). Personnel Psychology, 75(1), 243–244. https://doi.org/10.1111/peps.12499

Valtonen, T., Sointu, E., Kukkonen, J., Mäkitalo, K., Hoang, N., Häkkinen, P., Järvelä, S., Näykki, P., Virtanen, A., Pöntinen, S., Kostiainen, E., & Tondeur, J. (2019). Examining pre-service teachers’ technological pedagogical content knowledge as evolving knowledge domains: A longitudinal approach. Journal of Computer Assisted Learning, 35(4), 491–502. https://doi.org/10.1111/jcal.12353

Widana, I. W., Sopandi, A. T., Suwardika, I. G. (2021). Development of an authentic assessment model in mathematics learning: A science, technology, engineering, and mathematics (STEM) approach. Indonesian Research Journal in Education, 5(1), 192-209. https://doi.org/10.22437/irje.v5i1.12992

Zieky, M. (1993). Practical questions in the use of DIF statistics in test development. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 337–347). Lawrence Erlbaum Associates.

Downloads

Published

2026-05-20

How to Cite

Chaeruman, U. A., Suwarno, Maudiarti, S. ., & Sudatha, I. G. W. . (2026). Measuring TPACK in context: Validating a cross-contextually fair instrument for Indonesian teachers. Indonesian Journal of Educational Development (IJED), 7(1), 410–423. https://doi.org/10.59672/ijed.v7i1.6354

Issue

Section

Articles