Gender fairness in measuring student agency: A Rasch DIF analysis
DOI:
https://doi.org/10.59672/ijed.v7i1.6114Keywords:
Differential item functioning, Gender fairness, Islamic secondary school, Rasch model, Student agencyAbstract
As student agency increasingly shapes educational policy and reform, ensuring that its assessment practices are fair across genders has become a pressing equity concern. This study examines the gender-based measurement fairness of a multidimensional student agency instrument using Rasch-based differential item functioning (DIF) analysis in an Islamic secondary school. The study involved 601 students in Grades 10–12 (301 male; 300 female) selected through a school-based total accessible sampling approach, comprising 96 male and 101 female students in Grade 10, 138 male and 124 female students in Grade 11, and 67 male and 75 female students in Grade 12. Data were collected using a 60-item student agency questionnaire measured on a four-point Likert scale covering eight regulatory, motivational, and future-oriented dimensions. Results show that the instrument operates largely equivalently for male and female students. Although several items exhibited statistically significant DIF, substantively meaningful DIF was limited, localised, and bidirectional, and did not accumulate at the dimensional level. Core regulatory dimensions demonstrated strong invariance across gender. These findings indicate that observed gender differences in agency scores are unlikely to reflect measurement bias but rather reflect contextual variations in the expression of agency within this educational setting.
Downloads
References
Ackerman, T. A., Bandalos, D. L., Briggs, D. C., Everson, H. T., Ho, A. D., Lottridge, S. M., Madison, M. J., Sinharay, S., Rodriguez, M. C., Russell, M., von Davier, A. A., & Wind, S. A. (2024). Foundational competencies in educational measurement. Educational Measurement: Issues and Practice, 43(3), 7–17. https://doi.org/10.1111/emip.12581
Adhikari, D. P. (2024a). Constructing student agency: The nexus between classroom activities and engagement. International Journal of Education and Practice, 12(3). https://doi.org/10.18488/61.v12i3.3759
Adhikari, D. P. (2024b). Constructing student agency: The nexus between classroom activities and engagement. International Journal of Education and Practice, 12(3), 819–830. https://doi.org/10.18488/61.v12i3.3759
Bandura, A. (2001). Social cognitive theory: An agentic perspective. Annual Review of Psychology, 52(1), 1–26. https://doi.org/10.1146/annurev.psych.52.1.1
Bandura, A. (2006). Toward a psychology of human agency. Perspectives on Psychological Science, 1(2), 164–180. https://doi.org/10.1111/j.1745-6916.2006.00011.x
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). Routledge.
Boone, W. J., & Staver, J. R. (2020). Advances in Rasch analyses in the human sciences. In Advances in Rasch Analyses in the Human Sciences. https://doi.org/10.1007/978-3-030-43420-5
Boone, W. J., Yale, M. S., & Staver, J. R. (2014). Rasch analysis in the human sciences. In Rasch Analysis in the Human Sciences. https://doi.org/10.1007/978-94-007-6857-4
Brandt, W. C. (2024). Measuring student success skills: A review of the literature on student agency. Competencies of the future. In National Center for the Improvement of Educational Assessment.
Cavazzoni, F., Fiorini, A., & Veronese, G. (2022). How do we assess how agentic we are? A literature review of existing instruments to evaluate and measure individuals’ agency. Social Indicators Research, 159(3), 1125–1153. https://doi.org/10.1007/s11205-021-02791-8
Cook-Sather, A. (2020). Student voice across contexts: Fostering student agency in today’s schools. Theory Into Practice, 59(2), 182–191. https://doi.org/10.1080/00405841.2019.1705091
Creswell, J. W., & Creswell, J. D. (2022). Research Design: qualitative, quantitative, and mixed methods approaches. SAGE Publications.
Deakin Crick, R., Huang, S., Ahmed Shafi, A., & Goldspink, C. (2015). Developing resilient agency in learning: The internal structure of learning power. British Journal of Educational Studies, 63(2), 121–160. https://doi.org/10.1080/00071005.2015.1006574
Dutz, R., Hubner, S., & Peus, C. (2022). When agency “fits” regardless of gender: Perceptions of applicant fit when job and organization signal male stereotypes. Personnel Psychology, 75(2), 441–483. https://doi.org/10.1111/peps.12470
Eagly, A. H., Nater, C., Miller, D. I., Kaufmann, M., & Sczesny, S. (2020). Gender stereotypes have changed: A cross-temporal meta-analysis of U.S. public opinion polls from 1946 to 2018. American Psychologist, 75(3), 301–315. https://doi.org/10.1037/amp0000494
Ellemers, N. (2018). Gender stereotypes. Annual Review of Psychology, 69(1), 275–298. https://doi.org/10.1146/annurev-psych-122216-011719
Firdoos, A., Naz, F. L., & Masud, Z. (2023). Impact of cultural norms and social expectations for shaping gender disparities in educational attainment in Pakistan. Qlantic Journal of Social Sciences and Humanities, 4(3), 166–172. https://doi.org/10.55737/qjssh.311246563
Folberg, A. M., Zhu, M., He, Y., & Ryan, C. S. (2022). The primacy of nurturance and dominance/assertiveness: Unidimensional measures of the big two mask gender differences in subdimensions. International Review of Social Psychology, 35(1). https://doi.org/10.5334/irsp.690
Gartzia, L. (2022). Self and other-reported workplace traits: A communal gap of men across occupations. Journal of Applied Social Psychology, 52(8), 568–587. https://doi.org/10.1111/jasp.12848
Gegenfurtner, A. (2020). Testing the gender similarities hypothesis: differences in subjective task value and motivation to transfer training. Human Resource Development International, 23(3), 309–320. https://doi.org/10.1080/13678868.2018.1449547
Guna, B. W. K., Yuwantiningrum, S. E., Firmansyah, S, Muh. D. A., & Aslan, A. (2024). Building morality and ethics through Islamic religious education in schools. IJGIE (International Journal of Graduate of Islamic Education), 5(1), 14–24. https://doi.org/10.37567/ijgie.v5i1.2685
Gustafsson Sendén, M., Klysing, A., Lindqvist, A., & Renström, E. A. (2019). The (Not so) changing man: dynamic gender stereotypes in sweden. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.00037
Hentschel, T., Heilman, M. E., & Peus, C. V. (2019). The multiple dimensions of gender stereotypes: A current look at men’s and women’s characterizations of others and themselves. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.00011
Jo, Y., Park, S., & Jung, W. (2022). Development of tools to measure student agency for middle and high school students. Korean Association For Learner-Centered Curriculum And Instruction, 22(11), 189–211. https://doi.org/10.22251/jlcci.2022.22.11.189
Kosakowska-Berezecka, N., Bosson, J. K., Jurek, P., Besta, T., Olech, M., Vandello, J. A., Bender, M., Dandy, J., Hoorens, V., Jasinskaja-Lahti, I., Mankowski, E., Venäläinen, S., Abuhamdeh, S., Agyemang, C. B., Akbaş, G., Albayrak-Aydemir, N., Ammirati, S., Anderson, J., Anjum, G., … Żadkowska, M. (2023). Gendered self-views across 62 countries: A test of competing models. Social Psychological and Personality Science, 14(7), 808–824. https://doi.org/10.1177/19485506221129687
Kurnaz, F. B., & Yildiz, H. (2023). Investigating the sources of differential item functioning: A sample critical thinking motivation scale. International Journal of Assessment Tools in Education, 10(3), 434–453. https://doi.org/10.21449/ijate.1279152
Lee, S. (2025). Making sense of ‘student agency’: The subjectivity of the learner in globalized curriculum reform and the case of South Korea. Journal of Philosophy of Education, 59(3–4), 510–526. https://doi.org/10.1093/jopedu/qhaf015
Linacre, J. M. (2023). A User’s Guide to Winsteps? Ministep: Rasch-model computer programs. In Program Manual 5.5.1.
Ma, A., Rosette, A. S., & Koval, C. Z. (2022). Reconciling female agentic advantage and disadvantage with the CADDIS measure of agency. Journal of Applied Psychology, 107(12), 2115–2148. https://doi.org/10.1037/apl0000550
Marín, V. I., Tur, G., Castañeda, L., Peguera-Carré, M. C., Orellana, M. L., Villagrá, S., & Carrera, X. (2025). Agencia y aprendizaje en la Educación Superior: Una revisión sistemática. Universitas Tarraconensis Revista de Ciències de l Educació, (1), e4035. https://doi.org/10.17345/ute.2025.4035
Nabunya, P., Curley, J., & Ssewamala, F. M. (2021). Gender norms, beliefs and academic achievement of orphaned adolescent boys and girls in uganda. The Journal of Genetic Psychology, 182(2), 89–101. https://doi.org/10.1080/00221325.2021.1873727
Pumbay, M. (2018). Role of gender differences, agency and aspirations in women’s medical career decisions: evidence from Pakistan. International Institute of Social Studies.
Rosette, A. S., Koval, C. Z., Ma, A., & Livingston, R. (2016). Race matters for women leaders: Intersectional effects on agentic deficiencies and penalties. The Leadership Quarterly, 27(3), 429–445. https://doi.org/10.1016/j.leaqua.2016.01.008
Russell, M., & Kaplan, L. (2021). An intersectional approach to differential item functioning: reflecting configurations of inequality. Practical Assessment, Research and Evaluation, 26.
Sczesny, S., Nater, C., & Eagly, A. H. (2018). Agency and communion. In Agency and Communion in Social Psychology (pp. 103–116). Routledge. https://doi.org/10.4324/9780203703663-9
Shim, J.-M. (2021). Religiosity and individual agency: Denominational affiliation, religious action, and Sense of Control (SOC) in Life. Religions, 12(2), 117. https://doi.org/10.3390/rel12020117
Storms, C. (2019). Gender Differences: A result of differences in the brain or socialization? Locus: The Seton Hall Journal of Undergraduate Research, 2(1). https://doi.org/10.70531/2573-2749.1018
Stuhler, O. (2024). The gender agency gap in fiction writing (1850 to 2010). Proceedings of the National Academy of Sciences, 121(29). https://doi.org/10.1073/pnas.2319514121
Suhardita, K., Widana, I. W., Degeng, I. N. S., Muslihati, M., & Indreswari, H. (2024). Sharing behavior in the context of altruism is a form of strategy for building empathy and solidarity. Indonesian Journal of Educational Development (IJED), 5(3), 316-324. https://doi.org/10.59672/ijed.v5i3.4145
Widana, I. W. (2022). Meta-analysis: The relationship between self-regulated learning and mathematical critical reasoning. Education.Innovation.Diversity, 1(4), 64-75. https://doi.org/10.17770/eid2022.1.6739
Winda, W., & Surawan, S. (2025). Transformasi pendidikan Islam dalam mendorong self-regulated learning siswa madrasah: Studi empiris di MTs Mumtaz Palangka Raya (Transformation of Islamic education in encouraging self-regulated learning of madrasah students: An empirical study at MTS Mumtaz Palangka Raya). ARZUSIN, 5(3), 1560–1571. https://doi.org/10.58578/arzusin.v5i3.6052
Wu, A. D., Liu, Y., Stone, J. E., Zou, D., & Zumbo, B. D. (2017). Is difference in measurement outcome between groups differential responding, bias or disparity? A methodology for detecting bias and impact from an attributional stance. Frontiers in Education, 2. https://doi.org/10.3389/feduc.2017.00039
Ye, S. (2024). Fundamental attribution error in the classroom: Why and how bias hurts? Lecture Notes in Education Psychology and Public Media, 61(1), 27–34. https://doi.org/10.54254/2753-7048/61/20240427
Yu, Z., & Deng, X. (2022). A meta-analysis of gender differences in e-learners’ self-efficacy, satisfaction, motivation, attitude, and performance across the world. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.897327
Zeiser, K., Scholz, C., & Cirks, V. (2018). Maximizing student agency: Implementing and measuring student-centered learning practices. American Institutes for Research.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Novi Sylvia, Ahman, Yusi Riksa Yustiana, Deni Hadiana
This work is licensed under a Creative Commons Attribution 4.0 International License.
This is an Open Access article distributed under the terms of Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material.
