EduVa: Prototyping and testing AI-powered interactive LMS with adaptive modules and assessments
DOI:
https://doi.org/10.59672/ijed.v7i2.6253Keywords:
Adaptive learning system, Artificial intelligence in education, Higher education, Learning management system, Usability testingAbstract
The rapid integration of artificial intelligence (AI) in higher education has increased the demand for adaptive Learning Management Systems (LMS) capable of delivering personalized learning at scale. However, empirical studies covering the full lifecycle of designing, prototyping, and testing AI-powered LMS remain limited, particularly in developing regions. This study aimed to design, prototype, and test EduVa LMS (Education Virtual Assistant), an AI-powered interactive LMS with adaptive modules and AI-driven assessments, implemented across ten private universities in East Nusa Tenggara, Indonesia. A Design Science Research (DSR) approach integrated with the ADDIE model guided the development process. A total of 360 participants were involved, including experts, students, and lecturers. Validation results showed a Content Validity Index (CVI) of 0.80, confirming content validity. Usability testing using the System Usability Scale (SUS) yielded mean scores of 82.4 (students) and 85.8 (lecturers). Adaptive performance analysis indicated 82.1% assessment accuracy, 3.7 content adjustments per session, and an 87.9% completion rate. A strong correlation (r = 0.81, p < .01) was found between AI assessments and learning objectives. The findings demonstrate that the EduVa LMS is valid, usable, and effective for implementing adaptive learning.
Downloads
References
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023). Revolutionizing education with AI: Exploring the transformative potential of ChatGPT. Contemporary Educational Technology, 15(3), 429.
Akour, M., & Alenezi, M. (2022). Higher education future in the era of digital transformation. Education Sciences, 12(11), 784.
Alauri, H. A., Watson, S., & Watson, W. (2021). Learning technology models that support personalization within blended learning environments in higher education. TechTrends, 65, 62–78.
Alotaibi, N. S. (2024). The Impact of AI and LMS Integration on the Future of Higher Education. Sustainability, 16(23), 10357.
Amin, S., Uddin, M. I., Alarood, A. A., & Mashwani, W. K. (2023). Smart e-learning framework for personalized adaptive learning and sequential path recommendations using reinforcement learning. IEEE Access, PP, 1. https://doi.org/10.1109/ACCESS.2023.3305584
Anoir, L., Khaldi, M., & Erradi, M. (2024). Symbiotic evolution : The inextricable relation between the web and e-learning. 2(1), 10–18.
Apoki, U. C., Hussein, A. M. A., Al-chalabi, H. K. M., Badica, C., & Mocanu, M. L. (2022). The role of pedagogical agents in personalised adaptive learning : A review. 1–17.
Atif, Amara & Jha, Meena & Richards, Deborah & Bilgin, A. (2021). Artificial Intelligence (AI)-enabled remote learning and teaching using Pedagogical Conversational Agents and Learning Analytics. Intelligent Systems and Learning Data Analytics in Online Education, 3–29. https://doi.org/10.1016/B978-0-12-823410-5.00013-9
Ayeni, O. O., Mohd, N., Hamad, A., Chisom, O. N., Osawaru, B., & Adewusi, O. E. (2024). AI in education : A review of personalized learning and educational technology.
Azadi, N. A., Ziapour, A., Lebni, J. Y., Irandoost, S. F., Abbas, J., & Chaboksavar, F. (2021). The effect of education based on health belief model on promoting preventive behaviors of hypertensive disease in staff of the Iran University of Medical Sciences. Archives of Public Health. https://doi.org/10.1186/s13690-021-00594-4
Chan, C. K. Y. (2023). A comprehensive AI policy education framework for university teaching and learning. International Journal of Educational Technology in Higher Education, 20(1), 38.
Chaudhry, I. S., Sarwary, S. A. M., Refae, G. A. El, Chabchoub, H., King, S., & Hui, F. (2023). Time to revisit existing student ’ s performance evaluation approach in higher education sector in a new era of ChatGPT a case study. Cogent Education, 10(1), 1–30. https://doi.org/10.1080/2331186X.2023.2210461
Chiu, T. K. F. (2024). Future research recommendations for transforming higher education with Generative AI. Computers & Education: Artificial Intelligence, 6, 100197.
Chiu, T. K. F., Xia, Q., Zhou, X., Sing, C., & Cheng, M. (2023). Computers and education: Artificial Intelligence Systematic literature review on opportunities , challenges , and future research recommendations of artificial intelligence in education. Computers and Education: Artificial Intelligence, 4(December 2022), 100118. https://doi.org/10.1016/j.caeai.2022.100118
Contrino, M. F., Millán, M. R., Villegas, P. V., & Hernández, J. M. (2024). Using an adaptive learning tool to improve student performance and satisfaction in online and face ‑ to ‑ face education for a more personalized approach. https://doi.org/10.1186/s40561-024-00292-y
Cross, J., Robinson, R., Devaraju, S., Vaughans, A., Hood, R., Honnavar, P., Naik, S., & Sebastian, R. (2023). Transforming medical education : Assessing the Integration of ChatGPT Into faculty workflows at a caribbean medical school. 15(7). https://doi.org/10.7759/cureus.41399
Dai, Y., Liu, A., & Lim, C. P. (2023). Reconceptualizing ChatGPT and generative AI as a student-driven innovation in higher education. Procedia CIRP.
Dogan, M. E., & Dogan, T. G. (2023). Applied sciences the use of artificial intelligence ( AI ) in Online learning and distance education processes : A systematic review of empirical studies.
du Plooy, E., Casteleijn, D., & Franzsen, D. (2024). Personalized adaptive learning in higher education: A scoping review. Heliyon, 10(12), 39630.
Elsayed, S. (2023). Towards mitigating ChatGPT’s negative impact on education: Optimizing question design through bloom’s taxonomy. IEEE Region 10 Symposium (TENSYMP), 1(6).
Farazouli, A., Cerratto-pargman, T., Bolander-laksov, K., Farazouli, A., Cerratto-pargman, T., Bolander-laksov, K., Farazouli, A., & Cerratto-pargman, T. (2024). Assessment & Evaluation in Higher Education Hello GPT ! Goodbye home examination ? An exploratory study of AI chatbots impact on university teachers ’ assessment practices Hello GPT ! Goodbye home examination ? An exploratory study of AI chatbots impact on university teachers ’ assessment practices. Assessment & Evaluation in Higher Education, 49(3), 363–375. https://doi.org/10.1080/02602938.2023.2241676
Furqon, M., Sinaga, P., Liliasari, L., & Riza, L. S. (2023). The impact of Learning Management System ( LMS ) Usage on Students. 12(2), 1082–1089. https://doi.org/10.18421/TEM122
Gligorea, I.; Cioca, M.; Oancea, R.; Gorski, A.-T.; Gorski, H.; Tudorache, P. (2023). Adaptive learning using artificial intelligence in e-learning: A literature review. Education Sciences, 13, 1216.
Gupta, P. A., Kulkarni, T., & Toksha, B. (2022). AI-based predictive models for adaptive learning systems. https://doi.org/10.1201/9781003184157-6
Hashim, S., Omar, M. K., Jalil, H. A., Hashim, S., Omar, M. K., & Jalil, H. A. (2022). Trends on technologies and artificial intelligence in education for personalized learning : Systematic literature review trends on technologies and artificial intelligence in education for personalized learning : Systematic literature review. 1(1), 884–903. https://doi.org/10.6007/IJARPED/v11-i1/12230
Huang, F., Teo, T., & Zhou, M. (2020). Factors affecting Chinese university students’ continuance intention to use e-learning system: An extended TAM model. Education and Information Technologies, 25(5), 3137–3154.
Lin, H. (2022). Understanding adoption of artificial intelligence- enabled language e-learning system : an empirical study of UTAUT model Chih-Feng Ho. 16(1), 74–94.
Naatonis, R. N., Igon, S. S., Ariesto, E., & Malahina, U. (2026). Integration of adaptive ai and collaborative gamification : A contextualized personalization model to enhance student engagement in cloud-based learning. 16(2). https://doi.org/10.18178/ijiet.2026.16.2.2526
Naveed, Q. N., Choudhary, H., Ahmad, N., Alqahtani, J., & Qahmash, A. I. (2023). Mobile learning in higher education: A systematic literature review. Sustainability (Switzerland), 15(18). https://doi.org/10.3390/su151813566
Nouman, N., Shaikh, Z. A., & Wasi, S. (2024). A novel personalized learning framework with interactive e-mentoring. IEEE Access, PP(1), 1. https://doi.org/10.1109/ACCESS.2024.3354167
Olatunbosun, O., et al. (2026). A systematic review of artificial intelligence in higher education institutions (HEIs): Functionalities, challenges, and best practices. Education Sciences, 16(2), 185.
Prahani, B. K., Alfin, J., Saphira, H. V., Hariyono, E., & Suprapto, N. (2021). Learning Management System ( LMS ) Research During 1991 – 2021 : How Technology Affects Education. 1.
Sajja, R., Sermet, Y., Cikmaz, M., & Cwiertny, D. (2024). Artificial intelligence-enabled intelligent assistant for personalized and adaptive learning in higher education. 1–23.
Susanto, Y., Marselina, S., & Nur Halijah, S. (2026). AI integration in history education: Perceptions of teachers and students in Palangka Raya. Indonesian Journal of Educational Development (IJED), 6(4), 1218–1232. https://doi.org/10.59672/ijed.v6i4.5470
Suwardika, G., Sopandi, A. T., Indrawan, I. P. O., & Masakazu, K. (2026). AI-enhanced flipped classroom design thinking to improve self-efficacy in open distance learning. Indonesian Journal of Educational Development (IJED), 6(4), 1159–1172. https://doi.org/10.59672/ijed.v6i4.5702
Tang, K.Y.; Chang, C.Y.; Hwang, G. J. (2023). Trends in artificial intelligence-supported e-learning: A systematic review and co-citation network analysis (1998–2019). Interactive Learning Environments, 31, 2134–2152.
Tang, K., Chang, C., & Hwang, G. (2021). Trends in artificial intelligence-supported e- learning : a systematic review and co-citation network analysis ( 1998 – 2019 ). Interactive Learning Environments, 0(0), 1–19. https://doi.org/10.1080/10494820.2021.1875001
Tendulkar, A.; Vaz, A.; Palaniappan, S. (2023). AI-based digital model in teaching and learning, support development of critical thinking, and problem solving for smart universities. In Advancements in AI, Blockchain Technology, and IoT in Higher Education. Apple Academic Press, 27–51.
Tudorache, P. (2023). education sciences Adaptive Learning Using Artificial Intelligence in e-Learning : A Literature Review.
Widana, I. W., Sopandi, A. T., Suwardika, I. G. (2021). Development of an authentic assessment model in mathematics learning: A science, technology, engineering, and mathematics (STEM) approach. Indonesian Research Journal in Education, 5(1), 192-209. https://doi.org/10.22437/irje.v5i1.12992
Widana, I. W. (2022). Meta-analysis: The relationship between self-regulated learning and mathematical critical reasoning. Education.Innovation.Diversity, 1(4), 64-75. https://doi.org/10.17770/eid2022.1.6739
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Sumarlin Sumarlin, Skolastika Siba Igon, Remerta Noni Naatonis, Dewi Anggraini, Heni Heni
This work is licensed under a Creative Commons Attribution 4.0 International License.
This is an Open Access article distributed under the terms of Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material.
