The impact of a scientific argumentation electronic rubric on the blended learning methodology

Authors

DOI:

https://doi.org/10.5944/ried.21.1.18827

Keywords:

argumentation, self-evaluation, educational innovation, preservice teachers, scoring rubric, higher education

Abstract

The technological innovations and their impact on education is a curricular content in the initial training of the degrees in Education. The rapid changes in technological development make the contents of this training obsolete, thus we need to train in scientific and technological arguments to deal with innovations that do not yet exist. This involves developing digital skills and a scientific and technological argumentation with new methodologies and technologies that help to enhance these competencies. The present study aims to measure the impact produced by a methodology and e-rubric of argumentation -extracted from the Toulmin model- together with the self-evaluation of the processes of argumentation and the qualifications of 30 students of the Pedagogy degree with b-learning. With this aim, a mixed research is proposed: On the one hand, a qualitative analysis  of 262 annotations  given by the students to two exercises of argumentation (one with and another without the e-rubric) on two similar cases of technological innovation; and on the other hand, a quantitative and correlational analysis of the self-assessment by students and its correlation with the teacher assessments  using the Wilcoxon statistic. The outcomes allowed to verify the positive impact of the argumentation e-rubric, and how this correlates (Z = -2.440, Z = -3.276 and Z = -2.783) with the best grades, allowing for  more elaborate argumentations.

Downloads

Author Biographies

Daniel Cebrián Robles, Málaga University

Professor School of Engineering of the University of Málaga. Industrial Engineer, Doctor in Renewable Energies and Fluids, Master in ICT applied to education, Doctorate in Education (Innovation and Educational Research). Member ENCIC Group and developer of CoRubric and OVA. Research Fellow Harvard University (USA) 2013 and MIT (USA) 2016. He has given lectures and workshops on CoRubric and OVA in Spanish and foreign universities (Ecuador, Mexico, Paraguay, MIT -EEUU-).

Manuel Cebrián de la Serna, Málaga University

Professor of Educational Technology. Lines: a) Educational vs. technological innovation; B) University teaching c) Practicum. 10 years as director of various training services for teachers -1994-2003- (ICE, Educational Innovation and Virtual Teaching Service). Director of the research group Gtea, Junta de Andalucía (SEJ-462). He has led different R & D & I projects with university partners in Central Asia, Europe, the USA and Latin America (erubrica.org). Editor revistapracticum.com.

María Jesús Gallego Arrufat, Granada Univesity

Professor of Educational Technology. Faculty of Education Sciences. Principal investigator and member of research teams in Educational Technology, Teacher Training and Higher Education. She was coordinator of the Doctorate and Masters in Research and Innovation in Curriculum and Training at the University of Granada. She is the editor of Journal for Educators, Teachers and Trainers, JETT. Her research activity is focused on: practicum, computer mediated communication (CMC), e-assessment and rubrics, online educational leadership

Jesús Quintana Contreras, Guadalajara University

Full Professor, PhD in Innovation and Educational Research by the University of Málaga, Member of the Academic Corps in Educational Innovation 641-SEP and professor with Profile PRODEP, current Director of the Division of Legal and Social Studies CUCI. He has given different lectures on the impact of ICT in Teaching in Europe and America

References

Bartolomé, A.R. (2004). Blended-learning. Conceptos básicos. Píxel-Bit. Revista De Medios y Educación, (23), 7-20. https://doi.org/10.12795/pixelbit

Buendía Eisman, L., Colás Bravo, P., & Hernández Pina, F. (1998). Métodos de investigación en psicopedagogía. Madrid: McGraw-Hill.

Bulgren, J. A., Ellis, J. D., & Marquis, J. G. (2014). The use and effectiveness of an argumentation and evaluation intervention in science classes. Journal of Science Education and Technology, 23(1), 82-97.

Calle, M., Soto, J. D., Torres, L., Garcia, L., et al., (2016). Improving argumentative skills for engineering students in two different Colombian regions. In The International Scientific Conference eLearning and Software for Education, 3, 138-141. Bucharest: Carol I National Defence University. doi:10.12753/2066-026X-16-197

Cebrián-Robles, D., Blanco-López, A., & Noguera Valdemar, J. (2016). El uso de anotaciones sobre vídeos en abierto como herramienta para analizar las concepciones de los estudiantes de pedagogía sobre un problema ambiental. Indagatio Didactica, 8(1), 158-174.https://goo.gl/bGDMMH

Cebrián-Robles, D.; Serrano Angulo, J., & Cebrián-de-la-Serna, M., (2014). Federated e-rubric service to facilitate self-regulated learning in the European university model. European Educational Research Journal. (13) 5, 575-583.https://doi.org/10.2304/eerj.2014.13.5.575

Cebrián-de-la-Serna, M. & Bergman, M. (2014). Evaluación formativa con e-rúbrica: aproximación al estado del arte. REDU. Revista de docencia universitaria. V 12 (1) 15-22. https://doi.org/10.4995/redu.2014.6427

Cebrián-de-la-Serna, M.; Serrano-Angulo, J., & Ruiz-Torres, M. (2014). Las e-Rúbricas en la evaluación cooperativa del aprendizaje en la Universidad. Comunicar, 43.153-161.https://doi.org/10.3916/C43-2014-15.

Chowning, J. T., Griswold, J. C., Kovarik, D. N., & Collins, L. J. (2012). Fostering critical thinking, reasoning, and argumentation skills through bioethics education. PloS one, 7(5), e36791. https://doi.org/10.1371/journal.pone.0036791

Drysdale, J. S., Graham, C. R., Spring, K. J., & Halverson, L. R. (2013). An analysis of research trends in dissertations and theses studying blended learning. The Internet and Higher Education, 17, 90-100. doi:10.1016/j.iheduc.2012.11.003

Gallego-Arrufat, M.J., & Raposo-Rivas, M. (2014). Compromiso del estudiante y percepción del proceso evaluador basado en rúbricas. REDU. Revista De Docencia Universitaria, 12(1), 197-215.

García-Aretio, L. (2012). Blended, ¿mezcla o integración?(12,7). Blog Contextos universitarios mediados. Recuperado de http://aretio.hypotheses.org/135.

García Aretio, L. (2009). ¿Por qué va ganando la educación a distancia? Madrid: UNED.

Hafner, J., & Hafner, P. (2003). Quantitative analysis of the rubric as an assessment tool: An empirical study of student peer‐group rating. International Journal of Science Education, 25 (12), 1509-1528.https://doi.org/10.1080/0950069022000038268

Hernández-Sampieri, R., Fernández-Collado, C. y Baptista-Lucio, P. (2006). Metodología de la Investigación. Ciudad: Editorial McGraw-Hill. 4º Edición.

Hortigüela-Alcalá, D., Pérez-Pueyo, Á., & López-Pastor, V. (2015).Implicación y regulación del trabajo del alumnado en los sistemas de evaluación formativa en educación superior. Relieve, 21(1) doi:10.7203/relieve.21.1.5171

Ibáñez-Cubillas, P., Gallego-Arrufat, M.J., & Gámiz-Sánchez, V.M. (2016). The experience of flipped classroom in higher education. A case study in the University of Granada. EDULEARN16 Proceedings. 8th International Conference on Education and New Learning Technologies (pp.2816-2824). Barcelona.

Iordanou, K., & Constantinou, C. P. (2014). Developing pre-service teachers' evidence-based argumentation skills on socio-scientific issues. Learning and Instruction, 34, 42-57.http://doi.org/10.1016/j.learninstruc.2014.07.004

Jung, J. (2015). A Study on the Effects of the Rubric on Concurrent Discussion in Web-Based Environment. Paper presented at the International Conference on Cognition and Exploratory Learning in the Digital Age, CELDA2015. IADIS. Greater Dublin: Ireland.

Kathpalia, S. S., & See, E. K. (2016). Improving argumentation through student blogs. System, 58, 25-36. http://doi.org/10.1016/j.system.2016.03.002

Kuhn, D., Cheney, R., & Weinstock, M. (2000). The development of epistemological understanding. Cognitive Development, 15(3), 309-328. http://doi.org/10.1016/S0885-2014(00)00030-7

Lawson, T., Çakmak, M., Gündüz, M., &Busher, H. (2015). Research on teaching practicum – a systematic review. European Journal of Teacher Education, 38(3), 392-407. doi:10.1080/02619768.2014.994060

Lysaght, Z. (2015). Assessment for learning and for self-regulation. International Journal of Emotional Education, 7(1), 20-34.http://search.proquest.com/docview/1680253200

Martínez-Figueira, E., Tellado-González, F., & Raposo-Rivas, M. (2013).

La rúbrica como instrumento para la autoevaluación: Un estudio piloto.

REDU. Revista De Docencia Universitaria, 11(2), 373-390.

Nussbaum, E. M., Sinatra, G. M., &Poliquin, A. (2008). Role of epistemic beliefs and scientific argumentation in science learning. International Journal of Science Education, 30(15), 1977-1999.

Özçinar, H. (2015). Scaffolding computer-mediated discussion to enhance moral reasoning and argumentation quality in pre-service teachers. Journal of Moral Education, 44(2), 232-251.http://dx.doi.org/10.1080/03057240.2015.1043875

Pérez-Torregrosa, A.B., Gallego-Arrufat, M.J., & Gámiz-Sánchez, V.M (2016). Self Assessment with Electronic Rubrics of Undergraduates in the Practicum in Spain and Greece. Paper presented at the ECER 2016, Leading Education: The Distinct Contributions of Educational Research and Researchers. European Educational Research Association, EERA.

Pértega Díaz, S., & Pita Fernández, S. (2006). Métodos no paramétricos para la comparación de dos muestras. Cad Aten Primaria, 13, 109-113.

Prieto, A., Díaz, D., & Santiago, R. (2014). Metodologías Inductivas: El desafío de enseñar mediante el cuestionamiento y los retos. Barcelona: Océano.

Quinlan, A. (2006). A complete guide to rubrics: Assessmen tmade easy for teachers, K-college. EEUU: Rowman &Little field Education.

Raposo-Rivas, M., Cebrián-de-la-Serna, M., & Martínez-Figueira, S. (2013). The electronic rubric to value skills on ICT subjects. European Educational Research Journal. 5(13), 584-594, https://doi.org/10.2304/eerj.2014.13.5.584

Razali, N. M., & Wah, Y. B. (2011). Power comparisons of shapiro-wilk, kolmogorov-smirnov, lilliefors and anderson-darling tests. Journal of statistical modeling and analytics, 2(1), 21-33.

Reddy, Y. M., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & Evaluation in Higher Education, 35(4), 435-448. doi:10.1080/02602930902862859

Rojas, V. M. N. (2011). Metodología de la Investigación. Bogotá: Ediciones de la U

Sánchez, A.B. (2004). Un modelo para blended-learning aplicado a la formación en el trabajo. Compartimos prácticas ¿compartimos saberes? Revista Iberoamericana de Educación a distancia, 7 (1-2), 113.

Sampson, V., & Blanchard, M. R. (2012). Science teachers and scientific argumentation: Trends in views and practice. Journal of Research in Science Teaching, 49(9), 1122-1148. doi:10.1002/tea.21037

Søndergaard, H., & Mulder, R.A. (2012). Collaborative learning through formative peer review: Pedagogy, programs and potential. Computer Science Education, 22(4), 343-367. https://doi.org/10.1080/08993408.2012.728041

Stapleton, P., & Wu, Y. A. (2015). Assessing the quality of arguments in students' persuasive writing: A case study analyzing the relationship between surface structure and substance. Journal of English for Academic Purposes, 17, 12-23.

Tirado-Morueta, R., Pérez-Rodríguez, M.A., & Aguaded-Gómez, I. (2011). Blended e-learning en universidades andaluzas. Aula Abierta, 39(2), 47-58.

Toulmin, S.E. (1958). The uses of argument (2003rd ed.)- Cambridge: CUP.

Trahtemberg, L. (2000). El impacto previsible de las nuevas tecnologías en la enseñanza y la organización escolar. Revista Iberoamericana de Educación, (24), 37-62.http://rieoei.org/rie24f.htm

Zabalza-Beraza, M. (2017). El Prácticum y las prácticas externas en la formación universitaria. Practicum, 1(1). https://goo.gl/4I7h55

Published

2018-01-02

How to Cite

Cebrián Robles, D., Cebrián de la Serna, M., Gallego Arrufat, M. J., & Quintana Contreras, J. (2018). The impact of a scientific argumentation electronic rubric on the blended learning methodology. RIED-Revista Iberoamericana de Educación a Distancia, 21(1), 75–94. https://doi.org/10.5944/ried.21.1.18827

Similar Articles

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 > >> 

You may also start an advanced similarity search for this article.