Development and validation of the AI-enhanced Self-Regulated Learning (AI-SRL) scale
DOI:
https://doi.org/10.5944/ried.45452Keywords:
AI, AIED, self-regulated learning, AI-SRL, AI-SRL scaleAbstract
The integration of Artificial Intelligence (AI) into educational settings offers new opportunities for enhancing self-regulated learning (SRL) among students. However, current tools lack precision in measuring how AI influences learners' self-regulatory capabilities. This study introduces the AI-Enhanced Self-Regulated Learning (AI-SRL) Scale, designed to assess SRL in AI-supported educational environments. Through a rigorous scale development process involving a literature review, expert consultation, and systematic validation, we developed a comprehensive measurement instrument. The development employed a two-phase validation approach with separate samples for exploratory and confirmatory factor analyses. The final validated scale comprises 22 items organized into five dimensions: AI Competence, Learning Awareness, Learning Strategies, Engagement and Efficiency, and Ethical Collaboration. These factors capture the multifaceted nature of how students regulate their learning when using AI tools, from technical proficiency to ethical considerations. The scale demonstrated strong psychometric properties, with excellent internal consistency and robust construct validity. This validated instrument has practical applications for educators aiming to optimize AI integration in their classrooms, researchers investigating the intersection of AI and SRL, and institutions developing AI-enhanced curricula. The AI-SRL Scale provides a reliable framework for assessing how effectively students leverage AI tools while maintaining their self-regulatory capabilities, thereby contributing to more effective and responsible AI implementation.
Downloads
References
Adams, D., Chuah, K.-M., Devadason, E., & Azzis, M. S. A. (2024). From novice to navigator: Students’ academic help-seeking behaviour, readiness, and perceived usefulness of ChatGPT in learning. Education and Information Technologies, 29(11), 13617-13634. https://doi.org/10.1007/s10639-023-12427-8
Anggoro, K. J., & Pratiwi, D. I. (2023). Fostering self-assessment in English learning with a generative AI platform: A case of Quizizz AI. Studies in Self-Access Learning Journal, 14(4), 489-501. https://doi.org/10.37237/140406
Baker, R. S. (2023). AI and self-regulated learning theory: What could be on the horizon? Computers in Human Behavior, 147, 107849. https://doi.org/10.1016/j.chb.2023.107849
Bauer, E., Greiff, S., Graesser, A. C., Scheiter, K., & Sailer, M. (2025). Looking beyond the hype: Understanding the effects of AI on learning. Educational Psychology Review, 37(2). https://doi.org/10.1007/s10648-025-10020-8
Bećirović, S., Polz, E., & Tinkel, I. (2025). Exploring students’ AI literacy and its effects on their AI output quality, self-efficacy, and academic performance. Smart Learning Environments, 12, 29. https://doi.org/10.1186/s40561-025-00384-3
Biju, N., Abdelrasheed, N. S. G., Bakiyeva, K., Prasad, K. D. V., & Jember, B. (2024). Which one? AI-assisted language assessment or paper format: An exploration of the impacts on foreign language anxiety, learning attitudes, motivation, and writing performance. Language Testing in Asia, 14, 45. https://doi.org/10.1186/s40468-024-00322-z
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6. https://doi.org/10.3389/fpubh.2018.00149
Boguslawski, S., Deer, R., & Dawson, M. G. (2025). Programming education and learner motivation in the age of generative AI: Student and educator perspectives. Information and Learning Sciences, 126(1/2), 91–109. https://doi.org/10.1108/ILS-10-2023-0163
Büyüköztürk, Ş. (2018). Sosyal bilimler için veri analizi el kitabı. Pegem Akademi Yayıncılık. https://doi.org/10.14527/9789756802748
Chang, D. H., Lin, M. P.-C., Hajian, S., & Wang, Q. Q. (2023). Educational design principles of using AI chatbot that supports self-regulated learning in education: Goal setting, feedback, and personalization. Sustainability, 15(17), 12921. https://doi.org/10.3390/su151712921
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024). Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations. Asia Pacific Journal of Management, 41(2), 745-783. https://doi.org/10.1007/s10490-023-09871-y
Chiu, T. K. F. (2024). A classification tool to foster self-regulated learning with generative artificial intelligence by applying self-determination theory: A case of ChatGPT. Educational Technology Research and Development, 72(4), 2401-2416. https://doi.org/10.1007/s11423-024-10366-w
Chiu, T. K. F., Moorhouse, B. L., Chai, C. S., & Ismailov, M. (2023). Teacher support and student motivation to learn with artificial intelligence (AI) based chatbot. Interactive Learning Environments, 1-17. https://doi.org/10.1080/10494820.2023.2172044
Creswell, J. W. (2014). Research design: Qualitative, quantitative and mixed methods approaches (4th ed.). SAGE.
Dahri, N. A., Yahaya, N., Al-Rahmi, W. M., Aldraiweesh, A., Alturki, U., Almutairy, S., Shutaleva, A., & Soomro, R. B. (2024). Extended TAM based acceptance of AI-powered ChatGPT for supporting metacognitive self-regulated learning in education: A mixed-methods study. Heliyon, 10(8), e29317. https://doi.org/10.1016/j.heliyon.2024.e29317
DeVellis, R. F. (1991). Scale development: Theory and applications. SAGE.
Eisinga, R., te Grotenhuis, M., & Pelzer, B. (2013). The reliability of a two-item scale: Pearson, Cronbach, or Spearman-Brown? International Journal of Public Health, 58(4), 637-642. https://doi.org/10.1007/s00038-012-0416-3
Fabrigar, L. R., & Wegener, D. T. (2012). Exploratory factor analysis. Oxford University Press. https://doi.org/10.1093/acprof:osobl/9780199734177.001.0001
Field, A. P. (2018). Discovering statistics using IBM SPSS statistics (5th ed.). SAGE.
Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7(3), 286-299. https://doi.org/10.1037/1040-3590.7.3.286
George, D., & Mallery, P. (2003). SPSS for Windows step by step: A simple guide and reference, 11.0 update (4th ed.). Allyn & Bacon.
Gerlich, M. (2025). AI tools in society: Impacts on cognitive offloading and the future of critical thinking. Societies, 15(1), 6. https://doi.org/10.3390/soc15010006
Gkintoni, E., Antonopoulou, H., Sortwell, A., & Halkiopoulos, C. (2025). Challenging cognitive load theory: The role of educational neuroscience and artificial intelligence in redefining learning efficacy. Brain Sciences, 15(2), 203. https://doi.org/10.3390/brainsci15020203
Glick, D., Miedijensky, S., & Zhang, H. (2024). Examining the effect of AI-powered virtual-human training on STEM majors’ self-regulated learning behavior. Frontiers in Education, 9, 1465207. https://doi.org/10.3389/feduc.2024.1465207
Grüneke, T., Guggenberger, T., Hofmeister, S., & Stoetzer, J. C. (2024). AI-enabled self-regulated learning: A multi-layer taxonomy development. In Proceedings of the 32nd European Conference on Information Systems (ECIS 2024), Paphos, Cyprus. (ISBN 978-1-958200-10-0). https://aisel.aisnet.org/ecis2024/track13_learning_teach/track13_learning_teach/4
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis (7th ed.). Pearson.
Hertzog, M. A. (2008). Considerations in determining sample size for pilot studies. Research in Nursing & Health, 31, 180–191. https://doi.org/10.1002/nur.20247
Hill, R. (1998). What sample size is ‘enough’ in Internet survey research? Interpersonal Computing and Technology: An Electronic Journal for the 21st Century, 6, 1–10.
Hilpert, J. C., Greene, J. A., & Bernacki, M. (2023). Leveraging complexity frameworks to refine theories of engagement: Advancing self-regulated learning in the age of artificial intelligence. British Journal of Educational Technology, 54(5), 1204-1221. https://doi.org/10.1111/bjet.13340
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
Huang, A. Y. Q., Lu, O. H. T., & Yang, S. J. H. (2023). Effects of artificial intelligence-enabled personalized recommendations on learners’ learning engagement, motivation, and outcomes in a flipped classroom. Computers & Education, 194, 104684. https://doi.org/10.1016/j.compedu.2022.104684
Isaac, S., & Michael, W. B. (1995). Handbook in research and evaluation: A collection of principles, methods, and strategies useful in the planning, design, and evaluation of studies in education and the behavioral sciences (3rd ed.). EdITS Publishers.
Jin, S.-H., Im, K., Yoo, M., Roll, I., & Seo, K. (2023). Supporting students’ self-regulated learning in online learning using artificial intelligence applications. International Journal of Educational Technology in Higher Education, 20, 37. https://doi.org/10.1186/s41239-023-00406-5
Johanson, G. A., & Brooks, G. P. (2009). Initial scale development: Sample size for pilot studies. Educational and Psychological Measurement, 70(3), 394-400. https://doi.org/10.1177/0013164409355692
Jolliffe, I. (2014). Principal component analysis. In N. Balakrishnan, T. Colton, B. Everitt, & W. W. Piegorsch (Eds.), Wiley StatsRef: Statistics Reference Online. John Wiley & Sons. https://doi.org/10.1002/9781118445112.stat06472
Kaiser, H. F., & Rice, J. (1974). Little jiffy, mark IV. Educational and Psychological Measurement, 34(1), 111-117. https://doi.org/10.1177/001316447403400115
Kline, P. (2014). An easy guide to factor analysis. Routledge. https://doi.org/10.4324/9781315788135
Kong, S. C., & Yang, Y. (2024). A human-centered learning and teaching framework using generative artificial intelligence for self-regulated learning development through domain knowledge learning in K-12 settings. IEEE Transactions on Learning Technologies, 17, 1562-1573. https://doi.org/10.1109/TLT.2024.3392830
Lai, J. W. (2024). Adapting self-regulated learning in an age of generative artificial intelligence chatbots. Future Internet, 16(6), 218. https://doi.org/10.3390/fi16060218
Lan, M., & Zhou, X. (2025). A qualitative systematic review on AI empowered self-regulated learning in higher education. npj Science of Learning, 10(1). https://doi.org/10.1038/s41539-025-00319-0
Li, Y., Sadiq, G., Qambar, G., & Zheng, P. (2025). The impact of students’ use of ChatGPT on their research skills: The mediating effects of autonomous motivation, engagement, and self-directed learning. Education and Information Technologies, 30(4), 4185-4216. https://doi.org/10.1007/s10639-024-12981-9
Liang, J., Wang, L., Luo, J., Yan, Y., & Fan, C. (2023). The relationship between student interaction with generative artificial intelligence and learning achievement: Serial mediating roles of self-efficacy and cognitive engagement. Frontiers in Psychology, 14, 1285392. https://doi.org/10.3389/fpsyg.2023.1285392
Liu, Z. M., Hwang, G. J., Chen, C. Q., Chen, X. D., & Ye, X. D. (2024). Integrating large language models into EFL writing instruction: Effects on performance, self-regulated learning strategies, and motivation. Computer Assisted Language Learning, 1-25. https://doi.org/10.1080/09588221.2024.2389923
Mohamed, A. M., Shaaban, T. S., Bakry, S. H., Guillén-Gámez, F. D., & Strzelecki, A. (2025). Empowering the faculty of education students: Applying AI’s potential for motivating and enhancing learning. Innovative Higher Education, 50(2), 587–609. https://doi.org/10.1007/s10755-024-09747-z
Molenaar, I., Mooij, S. de, Azevedo, R., Bannert, M., Järvelä, S., & Gašević, D. (2023). Measuring self-regulated learning and the role of AI: Five years of research using multimodal multichannel data. Computers in Human Behavior, 139, 107540. https://doi.org/10.1016/j.chb.2022.107540
Mooney, C. Z., & Duval, R. D. (1993). Bootstrapping: A nonparametric approach to statistical inference. SAGE. https://doi.org/10.4135/9781412983532
Morgado, F. F. R., Meireles, J. F. F., Neves, C. M., Amaral, A. C. S., & Ferreira, M. E. C. (2017). Scale development: Ten main limitations and recommendations to improve future research practices. Psicologia: Reflexão e Crítica, 30(1). https://doi.org/10.1186/s41155-016-0057-1
Muthén, L. K., & Muthén, B. O. (2017). Mplus: Statistical analysis with latent variables: User’s guide (Version 8). Muthén & Muthén.
Ng, D. T. K., Tan, C. W., & Leung, J. K. L. (2024). Empowering student self-regulated learning and science education through ChatGPT: A pioneering pilot study. British Journal of Educational Technology, 55(4), 1328-1353. https://doi.org/10.1111/bjet.13454
O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers, 32(3), 396-402. https://doi.org/10.3758/BF03200807
Panadero, E. (2017). A review of self-regulated learning: Six models and four directions for research. Frontiers in Psychology, 8, 422. https://doi.org/10.3389/fpsyg.2017.00422
Pintrich, P. R. (1999). The role of motivation in promoting and sustaining self-regulated learning. International Journal of Educational Research, 31(6), 459-470. https://doi.org/10.1016/S0883-0355(99)00015-4
Pintrich, P. R. (2000). The role of goal orientation in self-regulated learning. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 451-502). Academic Press. https://doi.org/10.1016/B978-012109890-2/50043-3
Schunk, D. H., & Zimmerman, B. J. (2012). Self-regulation and learning. In I. B. Weiner, G. E. Miller, & W. M. Reynolds (Eds.), Handbook of psychology: Vol. 7. Educational psychology (2nd ed., pp. 59-78). John Wiley & Sons. https://doi.org/10.1002/9781118133880.hop207003
Seo, K., Tang, J., Roll, I., Fels, S., & Yoon, D. (2021). The impact of artificial intelligence on learner–instructor interaction in online learning. International Journal of Educational Technology in Higher Education, 18(1), 54. https://doi.org/10.1186/s41239-021-00292-9
Sun, J. (2005). Assessing goodness of fit in confirmatory factor analysis. Measurement and Evaluation in Counseling and Development, 37(4), 240-256. https://doi.org/10.1080/07481756.2005.11909764
Teeluckdharry, N., Teeroovengadum, V., & Seebaluck, A. (2021). Scale development in marketing research. In R. Nunkoo, V. Teeroovengadum, & C. M. Ringle (Eds.), Handbook of research methods for marketing management (pp. 17-50). Edward Elgar. https://doi.org/10.4337/9781788976954.00007
Tinajero, C., Mayo, M. E., Villar, E., & Martínez-López, Z. (2024). Classic and modern models of self-regulated learning: Integrative and componential analysis. Frontiers in Psychology, 15, 1307574. https://doi.org/10.3389/fpsyg.2024.1307574
Walter, Y. (2024). Embracing the future of artificial intelligence in the classroom: The relevance of AI literacy, prompt engineering, and critical thinking in modern education. International Journal of Educational Technology in Higher Education, 21(1), 15. https://doi.org/10.1186/s41239-024-00448-3
Wang, C. Y., & Lin, J. J. H. (2023). Utilizing artificial intelligence to support analyzing self-regulated learning: A preliminary mixed-methods evaluation from a human-centered perspective. Computers in Human Behavior, 144, 107721. https://doi.org/10.1016/j.chb.2023.107721
Wu, X. Y., & Chiu, T. K. F. (2025). Integrating learner characteristics and generative AI affordances to enhance self-regulated learning: A configurational analysis. Journal of New Approaches in Educational Research, 14(1). https://doi.org/10.1007/s44322-025-00028-x
Xia, Q., Chiu, T. K. F., Chai, C. S., & Xie, K. (2023). The mediating effects of needs satisfaction on the relationships between prior knowledge and self-regulated learning through artificial intelligence chatbot. British Journal of Educational Technology, 54(4), 967–986. https://doi.org/10.1111/bjet.13305
Yot-Domínguez, C., & Marcelo, C. (2017). University students’ self-regulated learning using digital technologies. International Journal of Educational Technology in Higher Education, 14, 38. https://doi.org/10.1186/s41239-017-0076-8
Zimmerman, B. J. (1989). Models of self-regulated learning and academic achievement. In B. J. Zimmerman & D. H. Schunk (Eds.), Self-regulated learning and academic achievement: Theory, research, and practice (pp. 1-25). Springer. https://doi.org/10.1007/978-1-4612-3618-4_1
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Mehmet Ali Ayaz, Fatih Karataş, Erkan Yüce
This work is licensed under a Creative Commons Attribution 4.0 International License.
The articles that are published in this journal are subject to the following terms:
1. The authors grant the exploitation rights of the work accepted for publication to RIED, guarantee to the journal the right to be the first publication of research understaken and permit the journal to distribute the work published under the license indicated in point 2.
2. The articles are published in the electronic edition of the journal under a Creative Commons Attribution 4.0 International (CC BY 4.0) license. You can copy and redistribute the material in any medium or format, adapt, remix, transform, and build upon the material for any purpose, even commercially. You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
3. Conditions for self-archiving. Authors are encouraged to disseminate electronically the OnlineFirst version (assessed version and accepted for publication) of its articles before publication, always with reference to its publication by RIED, favoring its circulation and dissemination earlier and with this a possible increase in its citation and reach among the academic community.
