Generative Artificial Intelligence agent in scientific research. An explanatory analysis of classroom learning
DOI:
https://doi.org/10.5944/ried.28.2.43545Keywords:
Generative Artificial Intelligence agents, learning, scientific researchAbstract
There is a lack of knowledge regarding the capacity, usefulness and effectiveness of some technological resources, such as intelligent agents with artificial intelligence in educational contexts for scientific research. This motivates the development and analysis of a new pedagogical strategy that uses generative intelligent agents with artificial intelligence in the construction of research projects. Therefore, the objective is to verify the effectiveness of a new pedagogical procedure and the design of activities that employ generative intelligent agents with artificial intelligence to enhance learning in scientific research. The method used was explanatory with a quasi-experimental longitudinal and prospective design. Four project steps and their respective hypotheses were established, instruments were developed and validated and applied to a sample of 111 study elements organized into one comparison group and two intervention groups. A repeated measures ANOVA analysis was conducted. Significant differences were demonstrated in the progress of the intervention groups compared to the comparison group in learning, research idea development by identifying research gaps and objectives; study formulation by identifying bibliographic references and study context; research design by determining the method and methodological procedure; and data analysis by interpreting descriptive-level data. The new methodology used and assisted by artificial intelligence yielded satisfactory overall results.
Downloads
References
Aldana, G. M., Babativa, D. A., Caraballo, G. J., & Rey, C. A. (2020). Escala de actitudes hacia la investigación (EACIN): Evaluación de sus propiedades psicométricas en una muestra colombiana. Revista CES Psicología, 13(1), 89-103. https://doi.org/10.21615/cesp.13.1.6
Alhayani, B., Mohammed, H. J., Chaloob, I. Z., & Ahmed, J. S. (2021). Effectiveness of artificial intelligence techniques against cyber security risks apply of IT industry. Materials Today: Proceedings, 44, 3356-3361. https://doi.org/10.1016/j.matpr.2021.02.531
Ayala, O. (2020). Competencias informacionales y competencias investigativas en estudiantes universitarios. Revista Innova Educación, 2(4), 668-679. https://doi.org/10.35622/j.rie.2020.04.011
Baker, R. S. (2016). Stupid Tutoring Systems, Intelligent Humans. International Journal of Artificial Intelligence in Education, 26(2), 600-614. https://doi.org/10.1007/s40593-016-0105-0
Bozkurt, A., Junhong, X., Lambert, S., Pazurek, A., Crompton, H., Koseoglu, S., Farrow, R., Bond, M., Nerantzi, C., Honeychurch, S., Bali, M., Dron, J., Mir, K., Gray, B. C., Stewart, B. P., Costello, E., Mason, J., Stracke, C. M., Romero-Hall, E., ... Brooks, C. (2023). Speculative futures on ChatGPT and generative artificial intelligence (AI): A collective reflection from the educational landscape. Asian Journal of Distance Education, 18(1), 53-130. https://doi.org/10.5281/zenodo.7636568
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., ... Amodei, D. (2020). Language Models are Few-Shot Learners. arXiv. https://doi.org/10.48550/arXiv.2005.14165
Carvajal, I. C. M. (2023). Inteligencia artificial (IA) en la investigación científica: Sistematización y reflexiones sobre experiencias educativas. Revista EDUCARE - UPEL-IPB - Segunda Nueva Etapa 2.0, 27(3), 112-137. https://doi.org/10.46498/reduipb.v27i3.2050
DataScientest. (2023). Inteligencia artificial: definición, historia, usos y peligros. DataScientest. https://datascientest.com/es/inteligencia-artificial-definicion
Dathathri, S., Madotto, A., Lan, Z., Fung, P., & Neubig, G. (2019). Plug and play language models: A simple approach to controlled text generation. arXiv. https://arxiv.org/abs/1912.02164
Díaz, L. A. (2024). El uso de la inteligencia artificial en la investigación científica. Revista Historia de la Educación Latinoamericana, 26(43), 1-15. https://doi.org/10.19053/uptc.01227238.18014
García-Peñalvo, F. J. (2020). Learning Analytics as a Breakthrough in Educational Improvement. In D. Burgos (Ed.), Radical Solutions and Learning Analytics: Personalised Learning and Teaching Through Big Data (pp. 1-15). Springer Singapore. https://doi.org/10.1007/978-981-15-4526-9_1
García-Peñalvo, F. J. (2023). Redefiniendo la relación del profesorado con la inteligencia artificial. II Congreso Internacional de Educación. https://bit.ly/46Y8Y77
García-Peñalvo, F. J., Llorens-Largo, F., & Vidal, J. (2024). La nueva realidad de la educación ante los avances de la inteligencia artificial generativa. RIED. Revista Iberoamericana de Educación a Distancia, 27(1), 9-39. https://doi.org/10.5944/ried.27.1.37716
García Rosado, L. F. (2024). Inteligencia artificial, una mirada desde la asignatura de Metodología de la investigación científica: Relato de experiencia docente. Educación Superior, (37), 11-34. https://doi.org/10.56918/es.2024.i37.pp11-34
González Sánchez, J. L., Villota García, F. R., Moscoso Parra, A. E., Garces Calva, S. W., & Bazurto Arévalo, B. M. (2023). Aplicación de la Inteligencia Artificial en la Educación Superior. Dominio de las Ciencias, 9(3), 1097-1108. https://doi.org/10.23857/dc.v9i3.3488
Gruetzemacher, R., & Paradice, D. (2022). Deep Transfer Learning & Beyond: Transformer Language Models in Information Systems Research. ACM Computing Surveys, 54(10s), 1-30. https://doi.org/10.1145/3505245
Jia, K., Wang, P., Li, Y., Chen, Z., Jiang, X., Lin, C. L., & Chin, T. (2022). Research landscape of artificial intelligence and e-learning: A bibliometric research. Frontiers in Psychology, 13, 795039. https://doi.org/10.3389/fpsyg.2022.795039
Kotler, P., Kartajaya, H., & Setiawan, I. (2021). Marketing 5.0: Technology for Humanity. John Wiley & Sons.
Lalaleo, F. R., Carrera, F. A., & Martínez, A. P. (2024). La IA como herramienta de apoyo en la investigación científicas en los docentes investigadores del ISTE. Espíritu Emprendedor TES, 8(1), 97-110. https://doi.org/10.33970/eetes.v8.n1.2024.377
Lang, C., Siemens, G., Wise, A. F., Gašević, D., & Merceron, A. (Eds.). (2022). The Handbook of Learning Analytics. Society for Learning Analytics Research (SoLAR). https://doi.org/10.18608/hla22
Litardo, J. T., Wong, C. R., Ruiz, S. M., & Benites, K. P. (2023). Retos y oportunidades docente en la implementación de la inteligencia artificial en la educación superior ecuatoriana. South Florida Journal of Development, 4(2), 867-889. https://doi.org/10.46932/sfjdv4n2-020
Liu, Y., Chen, L., & Yao, Z. (2022). The application of artificial intelligence assistant to deep learning in teachers’ teaching and students’ learning processes. Frontiers in Psychology, 13, 929175. https://doi.org/10.3389/fpsyg.2022.929175
López Martín, E. (2023). El papel de la inteligencia artificial generativa en la publicación científica. Educación XXI, 27(1), 9-15. https://doi.org/10.5944/educxx1.39205
Ma, W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014). Intelligent tutoring systems and learning outcomes: A meta-analysis. Journal of Educational Psychology, 106(4), 901-918. https://doi.org/10.1037/a0037123
McCarthy, J., Minsky, M. L., Rochester, N., & Shannon, C. E. (1955). A proposal for the Dartmouth summer research project on artificial intelligence. AI Magazine, 27(4), 12-14. https://doi.org/10.1609/aimag.v27i4.1904
McCulloch, W. S., & Pitts, W. (1943). A logical calculus of the ideas immanent in nervous activity. The Bulletin of Mathematical Biophysics, 5(4), 115-133. https://doi.org/10.1007/bf02478259
Morales-Chan, M. (2023). Explorando el potencial de Chat GPT: una clasificación de Prompts efectivos para la enseñanza. Paper GES. https://biblioteca.galileo.edu/tesario/handle/123456789/1348
Nilsson, N. J. (1982). Artificial intelligence: Engineering, science, or slogan? AI Magazine, 3(1), 2-17. https://doi.org/10.1609/aimag.v3i1.359
Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning and Teaching, 6(1), 1-22. https://doi.org/10.37074/jalt.2023.6.1.9
Salmerón Moreira, Y. M., Luna Álvarez, H. E., Murillo Encarnación, W. G., & Pacheco Gómez, V. A. (2023). El futuro de la Inteligencia Artificial para la educación en las instituciones de Educación Superior. Revista Conrado, 19(93), 27-34.
Sánchez, O. V. G. (2023). Uso y percepción de ChatGPT en la educación superior. Revista de Investigación en Tecnologías de la Información, 11(23), 98-107. https://doi.org/10.36825/RITI.11.23.009
Sandino, M., Espinoza, M. J., & Berrios, R. (2019). Microprogramación del componente de investigación de mercados. Proyecto curricular para docencia. Universidad Nacional Autónoma de Nicaragua UNAN León.
Sari, J. M., & Purwanta, E. (2021). The Implementation of Artificial Intelligence in Creative Learning Based on Stem in the Era of Society 5.0. Tadris: Jurnal Keguruan dan Ilmu Tarbiyah, 6(2), 433-440. https://doi.org/10.24042/tadris.v6i2.10135
Supo, J., & Zacarías, H. (2020). Metodología de la investigación científica. Seminarios de investigación científica (3ra ed.). Sociedad Hispana de Investigación Científica, Editorial BIOESTADISTICO EEDU EIRL.
Turing, A. M. (1950). Computing Machinery and Intelligence. Mind, 59(236), 433-460. https://doi.org/10.1093/mind/lix.236.433
UNESCO IESALC. (2020). COVID-19 y educación superior: De los efectos inmediatos al día después; Análisis de impactos, respuestas políticas y recomendaciones. https://www.iesalc.unesco.org/wp-content/uploads/2020/05/COVID-19-ES-130520.pdf
UNESCO. (2021). El aporte de la inteligencia artificial y las TIC avanzadas a las sociedades del conocimiento: Una perspectiva de derechos, apertura, acceso y múltiples actores. https://unesdoc.unesco.org/ark:/48223/pf0000375796
UNESCO IESALC. (2023). ChatGPT e Inteligencia artificial en la educación superior. Guía de inicio rápida. https://www.iesalc.unesco.org/wp-content/uploads/2023/05/ChatGPT-e-Inteligencia-artificial-en-la-educacion-superior.-Gui%CC%81a-de-inicio-ra%CC%81pida.pdf
Vera, F. (2023). Integración de la Inteligencia Artificial en la Educación superior: Desafíos y oportunidades. Transformar, 4(1), 17-34. https://doi.org/10.56219/dialectica.v1i21.2322
Villarroel, J. J. G. (2021). Implicancia de la inteligencia artificial en las aulas virtuales para la educación superior. Orbis Tertius-UPAL, 5(10), 31-52. https://doi.org/10.59748/ot.v5i10.98
Yang, S. J., Ogata, H., Matsui, T., & Chen, N. S. (2021). Human-centered artificial intelligence in education: Seeing the invisible through the visible. Computers and Education: Artificial Intelligence, 2, 100008. https://doi.org/10.1016/j.caeai.2021.100008
Yilmaz, R., Yurdugül, H., Karaoğlan Yilmaz, F. G., Şahin, M., Sulak, S., Aydin, F., Tepgeç, M., Terzi Müftüoğlu, C., & Oral, Ö. (2022). Smart MOOC integrated with intelligent tutoring: A system architecture and framework model proposal. Computers and Education: Artificial Intelligence, 3, 100092. https://doi.org/10.1016/j.caeai.2022.100092
Yu, W., & Sup, W. (2021). Artificial intelligence for the development of university education management. Frontiers in Educational Research, 4(1), 120-125. https://doi.org/10.25236/FER.2021.040120
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education–where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 1-27. https://doi.org/10.1186/s41239-019-0171-0
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Roberto Berrios Zepeda, Lorgia Márquez Mora
This work is licensed under a Creative Commons Attribution 4.0 International License.
The articles that are published in this journal are subject to the following terms:
1. The authors grant the exploitation rights of the work accepted for publication to RIED, guarantee to the journal the right to be the first publication of research understaken and permit the journal to distribute the work published under the license indicated in point 2.
2. The articles are published in the electronic edition of the journal under a Creative Commons Attribution 4.0 International (CC BY 4.0) license. You can copy and redistribute the material in any medium or format, adapt, remix, transform, and build upon the material for any purpose, even commercially. You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
3. Conditions for self-archiving. Authors are encouraged to disseminate electronically the OnlineFirst version (assessed version and accepted for publication) of its articles before publication, always with reference to its publication by RIED, favoring its circulation and dissemination earlier and with this a possible increase in its citation and reach among the academic community.
