Multidimensional research on university engagement using a mixed method approach



Palabras clave:

Learner engagement, classroom environment, higher education, perception test


The commitment or academic implication (engagement) of university
students has become a fundamental element for their welfare and academic
performance and, furthermore, it is also related to their professional future
and social commitment. For this reason, the definition of the concept and the
provision of assessment strategies and tools are essential to know the learning
experiences that lead to enhancing the academic involvement of the students.
To develop our research, we have used a mixed quantitative and qualitative
methodology: exploratory and confirmatory factor analysis on the one hand,
and discussion groups using the nominal groups technique on the other hand.
We have set three different objectives: first, to delve into the multidimensional
model of the construct; second, to validate a questionnaire that allows for
evaluation of the students’ perception of the learning methodologies used in
the classroom; and third, to check the manageability of the nominal groups
as a qualitative method of analysis. The results demonstrate that our new
proposal provides a statistically valid instrument aimed at determining the
perceptions of own engagement and an effective, efficient and motivating
qualitative method for students. However, regarding the multidimensionality
of the construct, contrary to the more accepted theoretical point of view that
considers three dimensions of engagement (behaviour, cognition and emotion),
our results only reveal two dimensions (cognitive-emotional and behavioural).
In the discussion and comments section we give possible explanations for this


Los datos de descargas todavía no están disponibles.

Biografía del autor/a

Helena Benito Mundet, Universitat de Girona

Departamento de Empresa

Facultad de Ciencias Económicas y Empresariales

Esther Llop Escorihuela, Universitat de Girona

Departamento de Biología, Bioquimica y Biología Molecular

Facultat de Ciencias

Marta Verdaguer Planas, Universitat de Girona

Departamento de Ingeniería Química, Agraria y Tecnología alimentaria

Escuela Politécnica Superior

Joaquim Comas Matas, Universitat de Girona

Departamento de Ingeniería Química, Agraria y Tecnología alimentaria

Facultad de Ciencias

Ariadna Lleonart Sitjar, Universitat de Girona

Departamento de Pedagogía

Facultad de Ciencias de la Educación y Psicología

Marta Orts Alis, Instituto Vives Vives

Departamento de Arte

Anna Amadó Codony, Universitat de Girona

Departamento de Psicología

Facultad de Ciencias de la Educación y Psicología

Carles Rostan Sánchez, Universitat de Girona

Departamento de Psicología

Facultad de Ciencias de la Educación y Psicología


Ahlfeldt, S., Mehta, S., & Sellnow, T. (2005). Measurement and analysis of student engagement in university classes where varying levels of PBL methods of instruction are in use. Higher Education Research & Development, 24(1), 5-20.

Altbach, P.G., Reisberg, L., & Rumbley, L.E. (2009). Trends in Global Higher Education: Tracking an Academic Revolution. UNESCO 2009 World Conference on Higher Education, Paris, 5-8 July 2009.

Ansari, J.A.N., & Khan, N.A. (2020) Exploring the role of social media in collaborative learning the new domain of learning. Smart Learn. Environ, 7(9). 00118-7

Appleton, J.J., Christenson, S.L., & Furlong, M.J. (2008). Student engagement with school: Critical conceptual and methodological issues of the construct. Psychology in the Schools, 45(5), 369-386. pits.20303

Appleton, J.J., Christenson, S.L., Kim, D., & Reschly, A.L. (2006). Measuring cognitive and psychological engagement: Validation of the Student Engagement Instrument. Journal of School Psychology, 44(5), 419-431. jsp.2006.04.002

Archambault, I., Janosz, M., Fallu, J.S., & Pagani, L.S. (2009). Student engagement and its relationship with early high school dropout. Journal of Adolescence, 32(3), 651-670.

Barkley, E.F. (2010). Student engagement techniques: A handbook for college faculty. Jossey-Bass.

Batista-Foguet, J.M., Coenders, G., & Alonso, J. (2004). Análisis factorial

confirmatorio. Su utilidad en la validación de cuestionarios relacionados con la salud. Medicina Clínica, 122 (S1), 21-7.

Ben-Eliyahu, A., Moore, D., Dorph, R., & Schunn, C.D. (2018) Investigating the multidimensionality of engagement: Affective, behavioral, and cognitive engagement across science activities and contexts. Contemporary Educational Psychology, 53, 87-105.

Bond, M., Buntins, K., Bedenlier, S., Zawacki-Richter, O., & Kerres, M. (2020). Mapping research in student engagement and educational technology in higher education: a systematic evidence map. International Journal of Educational Technology in Higher Education, 17(2). s41239-019-0176-8

Brugmann, R., Côté, N., Postma, N., Shaw E.A., Pal, D., & Robinson, J.B. (2019). Expanding student engagement in sustainability: Using SDG- and CEL- Focused inventories to transform curriculum at the University of Toronto. Sustainability, 11(2), 530. https://doi. org/10.3390/su11020530

Capella, E., Kim, H.Y., Neal, J.W., & Jackson, D.R. (2013). Classroom peer relationships and behavioral engagement in elementary school: The role of social network equity. American Journal of Community Psychology, 52(3-4), 367-379.

Carpio, L., Momplet, V., Plasencia, M., San Gabino, Y., Canto, M., & Pérez, O. (2016). Estrategia metodológica para incrementar las investigaciones sobre Medicina Natural y Tradicional en Villa Clara. Revista Educación Médica del Centro, 8(S1), 31-45.

Collie, R.J., Holliman, A.J., & Martin, A.J. (2017). Adaptability, engagement and academic achievement at university. Educational Psychology, 37(5), 632-647. 231296

Converse, J.M., & Presser, S. (1986) Survey Questions: Handcrafting the Standardized Questionnaire. Sage Pubblication.

Christenson, S.L., Reschly, A.L., & Wylie, C. (Eds.). (2012). Handbook of Research on Student Engagement. Springer. 2018-7

Delbecq, A.L., & Van de Ven, A.H. (1971). A group process model for problem, identification and program planning. The Journal of Applied Behavioral Sciences, 7(4), 466-492.

Deslauriers, L., McCarty, L.S., Miller, K., Callaghan, K., & Kestin, G. (2018). Measuring actual learning versus feeling of learning in response to being actively engaged in the classroom. Proceedings of the National Academy of Sciences, 116 (39), 19251-19257.

Duers, L.E. (2017). The learner as co- creator: A new peer review and self- assessment feedback form created by student nurses. Nurse Education Today, 58, 47–52. nedt.2017.08.002

Farrell, O., & Brunton, J. (2020). A balancing act: a window into on line student engagement experiences. International Journal of Educational Technology in Higher Education, 17, 1-19. 00199-x

Fernández-Zabala, A., Goñi, E., Camino, I., & Zulaika, L.M. (2016). Family and school context in school engagement. European Journal of Psychology of Education, 9(2), 47-55.

Finn, J.D. (1989). Withdrawing from School. Review of Educational Research, 59(2), 117-142. 10.3102/00346543059002117

Fredricks, J.A., Blumenfeld, P.C., & Paris, A.H. (2004). School Engagement: Potential of the Concept, State of the Evidence. Review of Educational Research, 74(1), 59-109.

Frederiks, J.A., Reschly, A., & Christenson, S. L. (2019). Handbook of Students Engagement intervention: Working with Disengaged Students. Elsevier.

Groves R.M., & Couper, M.P. (1998). Nonresponse in Household Interview Surveys. John Wiley & Sons.

Hammersley, M. (2007). Media bias in reporting social research?: the case of reviewing ethnic inequalities in education. Routlegde.

Henderson, D.X., & Greene, J. (2014). Using mixed methods to explore resilience, social connectedness, and re-suspension among youth in community-based alternative-to-suspension program. International Journal of Child, Youth and Family Studies, 5(3), 433-446.

Kahu, E.R. (2013). Framing Student Engagement in Higher Education. Studies in Higher Education, 38(5), 758-773.

Krause, K.R., & Coates, H. (2008). Students’ engagement in first‐year university. Assessment & Evaluation in Higher Education, 33(5), 493-505. https://

Lam, S.F., Jimerson, S., Shin, H., Cefai, C., Veiga, F.H., Hatzichristou, C., Polychroni, F. Kikas, E., Wong, BPH., Stanculescu, E., Basnett, J., Duck, R., Farrell, P., Liu, Y., Negovan, V., Nelson, B., Yang, H., & Zollneritsch, J. (2016). Cultural universality and specificity of student engagement in school: The results of an international study from 12 countries. British Journal of Educational Psychology, 86, 137-153. https://doi. org/10.1111/bjep.12079

LaNasa S.M., Cabrera, A.F., & Trangsrud, H. (2009). The construct validity of student engagement: A confirmatory factor analysis approach. Research Higher Education, 50, 315-332.

Lee, J., & Shute, VJ. (2010). Personal and Social-Contextual Factors in K–12 Academic Performance: An Integrative Perspective on Student Learning. Educational Psychologist, 45(3), 185-202. 93471

Macfarlane, B., & Tomlinson, M. (2017). Critiques of student engagement. Higher Education Policy, 30(1), 5-21. https://doi. org/10.1057/s41307-016-0027-3

Mandernach, B.J. (2015). Assessment of Student Engagement in Higher Education: A Synthesis of Literature and Assessment Tools. International Journal of Learning, Teaching and Educational Research, 12(2), 1-14.

Martin, A.J., Mansour, M., & Malmberg, L-E. (2020) What factors influence students’ real-time motivation and engagement? An experience sampling study of high school students using mobile technology, Educational Psychology, 40(9). 1113-1135. 018.1545997

McMahon, B., & Portinelli, J. (2004). Engagement for what? Beyond popular discourses of student engagement. Leadership and Policy in Schools, 3(1) 59-76.

Montoya, O. (2007). Aplicación del análisis factorial a la investigación de mercados. Caso de estudio. Scientia et Technica, 1(35), 281-286. https://doi. org/10.22517/23447214.5443

Mu, L., & Cole, J. (2019) B Behavior-based student typology: A view from student transition from high school to college. Research in Higher Education, 60(8), 1171-1194. S11162-019-09547-X

Nepal, R., & Rogerson, A. M. (2020). From theory to practice of promoting student engagement in business and law-related disciplines: The case of undergraduate economics education. Education Sciences, 10(8), 205. https://

Newmann, F., Wehlage, G. G., & Lamborn, S. D. (1992). The significance and sources of student engagement. In F. Newmann (Ed.), Student engagement and achievement in American secondary schools (pp. 11–39). Teachers College Press.

Ouimet, J. A., & Smallwood, R. A. (2005). Assessment Measures: CLASSE-- The Class-Level Survey of Student Engagement. Assessment Update, 17(6), 13-15.

Pérez-Gil, J.A., Chacón, S., & Moreno, R., (2000). Validez de constructo: el uso de análisis factorial exploratorio- confirmatorio para obtener evidencias de validez. Psicothema, 12(2), 442-446.

Pike, G. R., & Kuh, G. D. (2005). A typology of student engagement for American Colleges and Universities. Research in Higher Education, 46(2), 185-209. https://

Phelps, E. (2004). The human amygdala and awareness: Interactions between emotion and cognition. In M.S. Gazzaniga (Ed.), The cognitive neurosciences (p. 1005- 1015). MIT Press.

Phillips, D.C. (2009). A Quixotix Quest? Philosophical Issues in Assessing the Quality of Educational Research. In P. B. Walter, A. Lareau, S. H. & Ranis (2009). Education Research on Trial: Policy Reform and the Call for Scientific Rigor. Routhledge.

Reschly, A. L., Huebner, E. S., Appleton, J. J., & Antaramian, S. (2008) (2008). Engagement as flourishing: The contribution of positive emotions and coping to adolescents’ engagement at school and with learning. Psychology in the Schools, 45(5), 427-445.

Rodríguez-Fernández, A., Ramos-Díaz, E., Ros, I., & Zuazagoitia, A. (2018). Implicación escolar de estudiantes de secundaria: La influencia de la resiliencia, el autoconcepto y el apoyo social percibido. Educación XX1, 21(1). 87-108, educxx1.20177

Schaufeli, W.B., Martínez, I., Marqués- Pinto, A., Salanova, M., & Bakker, A. (2002). Burnout and engagement in university students: A cross-national study. Journal of Cross-Cultural Studies, 33, 464-481. https://doi. org/10.1177%2F0022022102033005003

Schnitzler, K., Holzberger, D., & Seidel, T. (2020) Connecting Judgment Process and Accuracy of Student Teachers: Differences in Observation and Student Engagement Cues to Assess Student Characteristics. Frontiers in Education, 10, 1-28.

Schlechty, P.C. (2002) Working on the Work: An Action Plan for Teachers, Principals, and Superintendents. Jossey-Bass.

Seppälä, P., Mauno, S., Feldt, T., Hakanen, J., Kinnunen, U., Tolvanen, A., & Schaufeli, W. (2008). The Construct validity of the Utrecht Work Engagement Scale: Multisample and Longitudinal Evidence. Journal of Happiness Studies, 10, 459-481.

Shernoff, D.J. (2013). Optimal learning environments to promote student engagement. Springer.

Shernoff, D.J., Kelly, S., Tonks, S.M., Anderson, B., Cavanagh, R., Sinha, S., & Abdi, B. (2016). Student engagement as a function of environmental complexity in high school classrooms. Learning and Instruction, 43, 42-60.

Skinner, E. A., & Pitzer, J. R. (2012). Developmental dynamics of student engagement, coping, and everyday resilience. In S. L. Christenson, A. L. Reschly, & C. Wylie (Eds.), Handbook of research on student engagement (pp. 21– 44). Springer.

Storbeck, J., & Clore, G.L. (2007). On the interdependence of cognition and emotion. Cognition and Emotion, 21 (6), 1212-1237. https://doi. org/10.1080/02699930701438020

Theiss-Morse, E., & Hibbing, J.R. (2005) Citizenship and civic engagement. Annual Review of Political Science, 8, 227-249. polisci.8.082103.104829

Tourangeau, R., & Smith, T.W. (1996). Asking sensitive questions. The impact of data collection mode, questions format and context. Public Opinion Quarterly, 60, 275-304.

Tourangeau, R., & Yan, T. (2007) Sensitive questions in surveys. Psychological Bulletin, 133(5), 859-883. https://doi. org/10.1037/0033-2909.133.5.859

Van Uden, J.M., Ritzen, H., & Pieters, J.M. (2014). Engaging students: The role of teacher beliefs and interpersonal teacher behaviour in fostering student engagement in vocational education. Teaching and Teacher Education, 37, 1765-1776. tate.2013.08.005

Veiga, F. H., Robu, V., Conboy, J., Ortiz, A., Carvalho, C., & Galvão, D. (2016). Students’ engagement in school and family variables: A literature review. Estudos de Psicologia, 33(2), 187-197.

Wang, J., Hefetz, A., & Liberman, G. (2017). Applying structural equation modelling in educational research. Culture and Education, 29(3), 563-618. https://doi.or g/10.1080/11356405.2017.1367907

Wiggins, B.L., Eddy, S.L., Wener-Fligner, L., Freisem, K., Grunspan, D.Z., Theobald, E.J., Timbrook, J., & Crowe, AJ. (2017). ASPECT: A Survey to Assess Student Perspective of Engagement in an Active-Learning Classroom. Life Sciences Education, 16(2), 1-13.

Zyngier, D. (2007). (Re)conceiving student engagement: What the students say they want. Putting young people at the centre of the conversation. LEARNing Landscapes, 1(1),93-116.

Zyngier, D. (2008). (Re)conceptualising student engagement: Doing education not doing time. Teaching and Teacher Education, 24(7), 1765-1776. https://doi. org/10.1016/j.tate.2007.09.004