El Proceso de Implementación de Analíticas de Aprendizaje

José A. Ruipérez-Valiente

Resumen


Con el despegue de la popularidad del área de analítica de aprendizaje durante la última década, numerosas investigaciones han surgido y la opinión pública se ha hecho eco de esta tendencia. Sin embargo, la realidad es que el impacto que ha tenido en la práctica ha sido bastante bajo, y se está produciendo poca transferencia a las instituciones educativas. Una de las posibles causas es la elevada complejidad del campo, y que no existan procesos claros; por ello, en este trabajo, se propone un pragmático proceso de implementación de analíticas de aprendizaje en cinco etapas: 1) entornos de aprendizaje, 2) recolección de datos en crudo, 3) manipulación de datos e ingeniería de características, 4) análisis y modelos y 5) aplicación educacional. Además, se revisan una serie de factores transversales que afectan esta implementación, como la tecnología, ciencias del aprendizaje, privacidad, instituciones y políticas educacionales. El proceso que se detalla puede resultar de utilidad para investigadores, analistas de datos educacionales, educadores e instituciones educativas que busquen introducirse en el área. Alcanzar el verdadero potencial de las analíticas de aprendizaje requerirá de estrecha colaboración y conversación entre todos los actores involucrados en su desarrollo, que permita su implementación de forma sistemática y productiva.


Palabras clave


analítica de aprendizaje; minería de datos educacionales; metodología; tecnología educativa; educación informada por datos; ciencia de datos

Texto completo:

HTML PDF EPUB

Referencias


Aldowah, H., Al-Samarraie, H., & Fauzy, W. M. (2019). Educational data mining and learning analytics for 21st century higher education: A review and synthesis. Telematics and Informatics, 37(January), 13–49. https://doi.org/10.1016/j.tele.2019.01.007

Arnold, K. E., Lynch, G., Huston, D., Wong, L., Jorn, L., & Olsen, C. W. (2014). Building institutional capacities and competencies for systemic learning analytics initiatives. In Proceedings of the Fourth International Conference on Learning Analytics And Knowledge (pp. 257–260).

Berg, A., Scheffel, M., Drachsler, H., Ternier, S., & Specht, M. (2016). The dutch xAPI experience. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (pp. 544–545).

Blikstein, P., & Worsley, M. (2016). Multimodal learning analytics and education data mining : using computational technologies to measure complex learning tasks. Journal of Learning Analytics, 3(2), 220–238. https://doi.org/http://dx.doi.org/10.18608/jla.2016.32.11

Bollen, J., Van de Sompel, H., Hagberg, A., Bettencourt, L., Chute, R., Rodriguez, M. A., & Balakireva, L. (2009). Clickstream data yields high-resolution Maps of science. PLoS ONE, 4(3). https://doi.org/10.1371/journal.pone.0004803

Breslow, L., Pritchard, D. E., DeBoer, J., Stump, G. S., Ho, A. D., & Seaton, D. T. (2013). Studying Learning in the Worldwide Classroom: Research into edX’s First MOOC. Research and Practice in Assessment, 8, 13–25.

Campbell, J. P., & Oblinger, D. G. (2007). Academic Analytics. Educause Review, (October), 1–20. Retrieved from https://er.educause.edu/articles/2007/7/academic-analytics-a-new-tool-for-a-new-era

Chatti, M. A., Dyckhoff, A. L., Schroeder, U., & Thüs, H. (2012). A reference model for learning analytics. International Journal of Technology Enhanced Learning, 4(5/6), 318. https://doi.org/10.1504/IJTEL.2012.051815

Chen, C. M., Lee, H. M., & Chen, Y. H. (2005). Personalized e-learning system using Item Response Theory. Computers and Education, 44(3), 237–255. https://doi.org/10.1016/j.compedu.2004.01.006

Clow, D. (2012). The learning analytics cycle: closing the loop effectively. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 134–138). https://doi.org/10.1145/2330601.2330636

Daniel, J. (2012). Making Sense of MOOCs: Musings in a Maze of Myth, Paradox and Possibility. Journal of Interactive Media in Education, Perspectiv. https://doi.org/10.1145/2316936.2316953

de Laat, M., & Schreurs, B. (2013). Visualizing Informal Professional Development Networks: Building a Case for Learning Analytics in the Workplace. American Behavioral Scientist, 57(10), 1421–1438. https://doi.org/10.1177/0002764213479364

Demchenko, Y., Laat, C. De, Membreel A, & Al., E. (2014). Defining architecture components of the Big Data Ecosystem. In Collaboration Technologies and Systems (CTS). In International Conference on IEE (p. 104:112). Retrieved from http://www.uazone.org/demch/papers/bddac2014-bd-ecosystem-archi-v05.pdf

Drachsler, H., & Kalz, M. (2016). The MOOC and learning analytics innovation cycle (MOLAC): A reflective summary of ongoing research and its challenges. Journal of Computer Assisted Learning, 32(3), 281–290. https://doi.org/10.1111/jcal.12135

Drachsler, Hendrik, & Greller, W. (2016). Privacy and analytics - it’s a DELICATE issue a checklist for trusted learning analytics. In Proceedings of the sixth international conference on learning analytics & knowledge (pp. 89–98). ACM. https://doi.org/10.1145/2883851.2883893

Ferguson, R. (2012). Learning analytics: drivers, developments and challenges. International Journal of Technology Enhanced Learning, 4(5–6), 304–317. https://doi.org/10.1504/IJTEL.2012.051816

Freire, M., Serrano-laguna, Á., Iglesias, B. M., Martínez-ortiz, I., Moreno-ger, P., & Fernández-manjón, B. (2016). Game Learning Analytics: Learning Analytics for Serious Games. In Learning, Design, and Technology: An International Compendium of Theory, Research, Practice, and Policy (pp. 1–29). Springer. https://doi.org/10.1007/978-3-319-17727-4

Friend Wise, A., & Williamson Schaffer, D. (2015). Why theory matters more than ever in the age of big data. Journal of Learning Analytics, 2(2), 5–13. https://doi.org/10.18608/jla.2015.22.2

Gasevic, D., Dawson, S., Mirriahi, N., & Long, P. D. (2015). Learning Analytics – A Growing Field and Community Engagement. Journal of Learning Analytics, 2(1), 1–6. https://doi.org/10.18608/jla.2015.21.1

Gašević, D., Dawson, S., & Siemens, G. (2015). Let’s not forget : Learning analytics are about learning. TechTrends, 59(1), 64–71. https://doi.org/10.1007/s11528-014-0822-x

Greller, W., & Drachsler, H. (2012). Translating learning into numbers: A generic framework for learning analytics. Educational Technology and Society, 15(3), 42–57.

Hoel, T., & Chen, W. (2014). Learning Analytics Interoperability - Looking for low-hanging fruits. In Workshop Proceedings of the 22nd International Conference on Computers in Education, ICCE 2014 (pp. 253–263).

Hsiao, I.-H., Huang, P.-K., & Murphy, H. (2017). Integrating programming learning analytics across physical and digital space. IEEE Transactions on Emerging Topics in Computing.

Jaques, N., Conati, C., Harley, J., & Azevedo, R. (2014). Predicting Affect from Gaze Data during Interaction with an Intelligent Tutoring System. In Proceedings 12th International Conference, Intelligent Tutoring Systems 2014, Honolulu, HI, USA. (pp. 29–38). Springer International Publishing.

https://doi.org/10.1007/978-3-319-07221-0_4

Jobs, S. (2005). You’ve got to find what you love. Stanford News. Retrieved from http://news.stanford.edu/news/2005/june15/jobs-061505.html (last accessed December 29, 2019)

Kaul, A., Maheshwary, S., & Pudi, V. (2017). Autolearn—Automated feature generation and selection. In 2017 IEEE International Conference on Data Mining (ICDM) (pp. 217–226).

Kizilcec, R. F., & Cohen, G. L. (2017). Eight-minute self-regulation intervention raises educational attainment at scale in individualist but not collectivist cultures. Proceedings of the National Academy of Sciences, 114(17), 4348–4353. https://doi.org/10.1073/pnas.1611898114

Koedinger, K. R., Kim, J., Jia, J. Z., McLaughlin, E. A., & Bier, N. L. (2015). Learning is not a spectator sport: doing is better than watching for learning from a MOOC. In Proceedings of the Second ACM Conference on Learning@Scale (pp. 111–120). https://doi.org/10.1145/2724660.2724681

Leitner, P., Khalil, M., & Ebner, M. (2017). Learning Analytics: Fundaments, Applications, and Trends. Learning Analytics: Fundaments, Applications, and Trends, Studies in Systems, Decision and Control, 94(February), 1–23. https://doi.org/10.1007/978-3-319-52977-6

Lopez, G., Seaton, D. T., Ang, A., Tingley, D., & Chuang, I. (2017). Google BigQuery for education: Framework for parsing and analyzing edX MOOC data. In L@S 2017 - Proceedings of the 4th (2017) ACM Conference on Learning at Scale (pp. 181–184). https://doi.org/10.1145/3051457.3053980

Macarini, L. A., Ochoa, X., Cechinel, C., Rodés, V., Dos Santos, H. L.,

Alonso, G. E., … Díaz, P. (2019). Challenges on implementing learning analytics over countrywide K-12 data. ACM International Conference Proceeding Series, 441–445. https://doi.org/10.1145/3303772.3303819

Mangaroska, K., Vesin, B., & Giannakos, M. (2019). Cross-platform analytics: A step towards personalization and adaptation in education. In 9th International Learning Analytics & Knowledge Conference (LAK19) (pp. 71–75). https://doi.org/10.1145/3303772.3303825

Milligan, C., Littlejohn, A., & Margaryan, A. (2013). Patterns of engagement in connectivist MOOCs. MERLOT Journal of Online Learning and Teaching, 9(2), 149–159.

Monroy, C., Snodgrass Rangel, V., & Whitaker, R. (2014). A Strategy for Incorporating Learning Analytics into the Design and Evaluation of a K-12 Science Curriculum. Journal of Learning Analytics, 1(2), 94–125. https://doi.org/10.18608/jla.2014.12.6

Paquette, L., Carvalho, A. M. J. a De, Baker, R., & Ocumpaugh, J. (2014). Reengineering the Feature Distillation Process : A Case Study in the Detection of Gaming the System. Proceedings of the 7th International Conference on Educational Data Mining (EDM), 284–287.

Pardo, A., & Siemens, G. (2014). Ethical and privacy principles for learning analytics. British Journal of Educational Technology, 45(3), 438–450. https://doi.org/10.1111/bjet.12152

Park, Y., & Jo, I. (2015). Development of the Learning Analytics Dashboard to Support Students ’ Learning Performance Learning Analytics Dashboards ( LADs ). Journal of Universal Computer Science, 21(1), 110–133.

Prinsloo, P., Archer, E., Barnes, G., Chetty, Y., & Zyl, D. Van. (2019). Big(ger) Data as Better Data in Open Distance Learning Paul. International Review of Research in Open and Distributed Learning, 16(1), 284–306.

R, S., V.Vaidhehi, V. V., & Easwaran Iyer, N. (2015). Survey of Learning Analytics based on Purpose and Techniques for Improving Student Performance. International Journal of Computer Applications, 111(1), 22–26. https://doi.org/10.5120/19502-1097

Ramasubramanian, K., & Singh, A. (2017). Feature Engineering. In Machine Learning Using R (pp. 181–217). Springer.

Redondo, D., Muñoz-Merino, P. J., Ruipérez-Valiente, J. A., Delgado Kloos, C., Pijeira Díaz, H. J., & Santofimia Ruiz, J. (2015). Combining Learning Analytics and the Flipped Classroom in a MOOC of maths. In International Workshop on Applied and Practical Learning Analytics (pp. 71–79). Retrieved from http://ceur-ws.org/Vol-1599/9WAPLA_2015.pdf

Reich, J., & Ruipérez-Valiente, J. A. (2019). The MOOC pivot. Science, 363(6423), 130–131. https://doi.org/10.1126/science.aav7958

Rezaei, M. S., & Yaraghtalaie, M. (2019). Next learning topic prediction for learner’s guidance in informal learning environment. International Journal of Technology Enhanced Learning, 11(1), 62–70. https://doi.org/10.1504/IJTEL.2019.096738

Romero, C., Ventura, S., & García, E. (2008). Data mining in course management systems: Moodle case study and tutorial. Computers & Education, 51(1), 368–384. https://doi.org/10.1016/j.compedu.2007.05.016

Ros, S., Hernández, R., Robles-Gomez, A., Caminero, A. C., Tobarra, L., & Ruíz, E. S. (2013). Open service-oriented platforms for personal learning environments. IEEE Internet Computing, 17(4), 26–31.

Ruiperez-Valiente, J.A., Munoz-Merino, P. J., Gascon-Pinedo, J. A., & Kloos, C. D. (2016). Scaling to Massiveness With ANALYSE: A Learning Analytics Tool for Open edX. IEEE Transactions on Human-Machine Systems. https://doi.org/10.1109/THMS.2016.2630420

Ruipérez-Valiente, J.A., Muñoz-Merino, P. J., Leony, D., & Delgado Kloos, C. (2015). ALAS-KA: A learning analytics extension for better understanding the learning process in the Khan Academy platform. Computers in Human Behavior, 47. https://doi.org/10.1016/j.chb.2014.07.002

Ruiperez-Valiente, Jose A., Cobos, R., Muñoz-Merino, P. J., Andújar, Á., & Delgado Kloos, C. (2017). Early Prediction and Variable Importance of Certificate Accomplishment in a MOOC. In Fifth European MOOCs Stakeholders Summit. Madrid, Spain.

Ruipérez-Valiente, José A, Muñoz-Merino, P. J., & Delgado Kloos, C. (2017). Detecting and Clustering Students by their Gamification Behavior with Badges: A Case Study in Engineering Education. International Journal of Engineering Education, 33(2-B), 816–830.

Ruipérez-Valiente, José A, Muñoz-Merino, P. J., Gascón-Pinedo, J. A., &

Delgado Kloos, C. (2016). Scaling to Massiveness with ANALYSE: A Learning Analytics Tool for Open edX. IEEE Transactions on Human-Machine Systems, 47(6), 909–914.

https://doi.org/10.1109/THMS.2016.2630420

Serrano-Laguna, Á., Martínez-Ortiz, I., Haag, J., Regan, D., Johnson, A., & Fernández-Manjón, B. (2017). Applying standards to systematize learning analytics in serious games. Computer Standards & Interfaces, 50, 116–123.

Shute, V., & Zapata-Rivera, D. (2012). Adaptive educational systems. In Adaptive Technologies for Training and Education (pp. 7–27). Retrieved from http://books.google.com/books?hl=en&lr=&id=mOlPSl6iJaIC&oi=fnd&pg=PA7&dq=Adaptive+Educational+Systems&ots=i9wDCR_zkc&sig=Sb-l4gFHsItZup0ZpSuUYZRCBKc

Siemens, G., & Baker, R. S. J. d. (2012). Learning Analytics and Educational Data Mining: Torwards Communication and Collaboration. Proceedings of the 2nd International Conference on Learning Analytics and Knowledge - LAK ’12, 252–254. https://doi.org/10.1145/2330601.2330661

Slade, S., & Prinsloo, P. (2013). Learning Analytics: Ethical Issues and Dilemmas. American Behavioral Scientist, 57(10), 1510–1529. https://doi.org/10.1177/0002764213479366

Thomas, S. (2016). Future Ready Learning. Reimagining the Role of Technology in Education. Office of Educational Technology, US Department of Education. ERIC.

Tsai, Y. S., & Gasevic, D. (2017). Learning analytics in higher education - Challenges and policies: A review of eight learning analytics policies. In Seventh international learning analytics & knowledge conference (pp. 233–242). https://doi.org/10.1145/3027385.3027400

van der Zee, T.,& Reich, J. (2018). Open Education Science. AERA Open, 4(3), 2332858418787466.Veeramachaneni, K., Reilly, U. O., & Taylor, C. (2014). Towards feature engineering at scale for data from massive open online courses. ArXiv Preprint ArXiv:1407.5238.

Viberg, O., Hatakka, M., Bälter, O., & Mavroudi, A. (2018). The current landscape of learning analytics in higher education. Computers in Human Behavior, 89(October 2017), 98–110. https://doi.org/10.1016/j.chb.2018.07.027

Wang, S., & Wu, C. (2011). Application of context-aware and personalized recommendation to implement an adaptive ubiquitous learning system. Expert Systems with Applications, 38(9), 10831–10838. https://doi.org/10.1016/j.eswa.2011.02.083

Wolff, A., Moore, J., Zdrahal, Z., Hlosta, M., & Kuzilek, J. (2016). Data literacy for learning analytics. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (pp. 500–501). ACM. https://doi.org/10.1145/2883851.2883864




DOI: https://doi.org/10.5944/ried.23.2.26283

Enlaces refback

  • No hay ningún enlace refback.




RIED. Revista Iboeroamericana de Educación a Distancia
(La Revista Iberoamericana de la Educación Digital)
Director/Editor : Lorenzo García Aretio
UNED, Facultad de Educación
C/ Juan del Rosal, 14
28040 Madrid (Spain).
ried@edu.uned.es
ISSN :1138-2783
E-ISSN : 1390-3306
Depósito Legal : M- 36.279 -1997
Edita: Asociación Iberoamericana de Educación Superior a Distancia (AIESAD).
 Madrid (España).

Reconocimiento NoComercial (by-nc): Se permite la generación de obras derivadas siempre que no se haga un uso comercial. Tampoco se puede utilizar la obra original con finalidades comerciales.
SÍGUENOS EN:

https://2.bp.blogspot.com/-wtzwURZeg6I/V_y8vM5DmdI/AAAAAAABKKQ/y_fW6U2dW3cOLG6z-tUwJ9u1Pwt9ltXHACLcB/s320/blogger_b_logo.jpg https://4.bp.blogspot.com/-Q3lAzaCezXA/V_TZ0BTuIkI/AAAAAAABKF4/wP8QRQVCPiQnk0sE7nEDnZHY5F03AOjbgCLcB/s200/twitrer_120%2B%25281%2529.jpg https://4.bp.blogspot.com/-4So1RLxqN7Q/VHMWABdXX9I/AAAAAAAAb4E/mV00Ac5Gm-Q/s1600/fb_icon_325x325.png https://1.bp.blogspot.com/-S7ecZmnt3os/Vzmf77J7EfI/AAAAAAABEYc/g3MJ_0z_noUtAiLS7MRRHXgzOkGbZbfUACLcB/s200/scholar_logo_lg_2011.gif

Colaboran con RIED:

https://2.bp.blogspot.com/-VKcDNIR3Sqk/V_aPanb6P0I/AAAAAAABKIA/XSdUeendX2wJ_afKOCIIkxkZjW0ZnT0vACLcB/s320/logoCUED.jpg       https://3.bp.blogspot.com/-wxw5W-VCRGA/WAnp69yeyuI/AAAAAAABKgo/LHi490KturcyZQE7KnlK2ZT9taWEUXkgQCLcB/s320/logo-AM2.01.png    Alteridad