Estudios e Investigaciones
An effective video-based learning approach: a solution for complex university subjects
Una propuesta efectiva de aprendizaje basado en videos: solución para asignaturas universitarias complejas
An effective video-based learning approach: a solution for complex university subjects
RIED-Revista Iberoamericana de Educación a Distancia, vol. 27, núm. 1, 2024
Asociación Iberoamericana de Educación Superior a Distancia
How to cite: Gómez-Ortega, A., Macías-Guillén, A., Sánchez-de-Lara, M. A., & Delgado-Jalón, M. L. (2024). An effective video-based learning approach: a solution for complex university subjects.
[Una propuesta efectiva de aprendizaje basado en videos: solución para asignaturas universitarias complejas]. RIED-Revista Iberoamericana de Educación a Distancia,
27(1), 345-372. https://doi.org/10.5944/ried.27.1.37569
Abstract: This research presents a tool that offers an agile solution for university subjects perceived by students to be significantly complex. The tool combines, on the one hand, video-based learning and, on the other hand, a system for assessing difficulty prior to the production of videos. As a starting point, student feedback was used to obtain a map of subject difficulty. Based on the identifying markers on this map, a set of ad hoc videos was prepared to address the key and most difficult issues. After using these videos in their preparation in the subject, students completed a satisfaction survey, which was qualitatively validated by experts and quantitatively validated with a Cronbach's alpha test. The results of this survey reflect the usefulness of the designed learning proposal and the interest aroused in the students. Likewise, through statistical analysis, an improvement in the academic performance of students with access to these videos compared to the control group was revealed. Using an accounting subject for a pilot test has enabled the construction of a learning proposal that can be extrapolated to any field of knowledge. The proposed system thus contributes an effective teaching process for students and allows them to be protagonists in their own academic training.
Keywords: difficulty map, visual learning, accounting, feedback, higher education.
Resumen: Esta investigación presenta una herramienta que ofrece una ágil solución para aquellas asignaturas universitarias percibidas por los estudiantes con mayor complejidad. La herramienta combina, por un lado, el aprendizaje basado en videos y, por otro, un sistema de baremación de la dificultad, previo a la elaboración de los videos. Como punto de partida, se utiliza el feedback del estudiante para la obtención de un mapa de dificultad de la asignatura. A partir de las balizas identificativas de este mapa, se ha elaborado ad hoc un conjunto de videos para abordar las cuestiones clave y de mayor dificultad. Tras utilizar estos videos en la preparación de la materia, los estudiantes han realizado una encuesta de satisfacción, validada cualitativamente por expertos y cuantitativamente por el test Alpha de Cronbach. Los resultados de la encuesta reflejan la utilidad de la propuesta de aprendizaje diseñada y el interés despertado en los estudiantes. Asimismo, mediante un análisis estadístico, se pone de manifiesto una mejora en el rendimiento académico de aquellos que sí tuvieron acceso a estos videos, en comparación con el grupo de control. Utilizando como prueba piloto una asignatura de contabilidad, se ha conseguido llegar a una propuesta de aprendizaje que resulta extrapolable a cualquier ámbito de conocimiento. El sistema propuesto contribuye a un proceso de enseñanza eficaz para los estudiantes y les otorga el rol de protagonistas en su propia formación académica.
Palabras clave: mapa de dificultad, aprendizaje visual, contabilidad, retroalimentación, enseñanza superior.
INTRODUCTION
Initially, this educational research was inspired by continuous efforts to solve two problems in an effective way. On the one hand, difficulties to understand are inherent in accounting matters (Fogarty, 2020; Zhao, 2019); on the other hand, there is a considerable lack of time with regard to teaching all the content included in the teacher’s guide for the subject of Financial Accounting II. However, using this subject as a pilot test, a learning proposal has been derived that can be extrapolated to any field of knowledge.
In a global context where virtuality is positioning itself as a necessary modality to achieve the goals of higher education, in terms of improving the coverage and quality of education that guarantee the continued presence and graduation of students (Segovia-García et al., 2022), the COVID-19 pandemic situation arose suddenly. This was undoubtedly the most exceptional scenario that society has had to face recently and led to the closure of academic institutions worldwide (Caurcel & Crisol, 2022), driving the university community to develop different strategies to adapt to this new situation (Cleland et al., 2020; Martín-Cuadrado et al., 2021).
Information technology-enabled learning became the heart of education during the COVID-19 crisis, and many teachers have expressed their desire for evidence-based best practice guides and examples in this area (Sangster et al., 2020). This has given rise to the essential need to remedy the difficulty raised by its presence in teaching, further reinforcing our need to develop material adjusted for this purpose through videos on more complex issues based on the feedback of the students, thus converting them into active collaborators in creating material concurrent with the circumstances of the moment.
Video has unique characteristics that make it an effective approach for improving learning outcomes and student satisfaction, given its flexibility and high motivational potential, enabling it to partially improve and replace traditional learning approaches (Yousef et al., 2014a).
Video-based learning has proven to be an effective teaching tool for teachers in the development of collaborative critical debates, public promotion of teaching practice, and theoretical research related to practical problems (Brame, 2016; Ljubojevic et al., 2014; Kay 2012; Sablić et al., 2021; Vedder-Weiss et al., 2019). Regarding the subject of accounting, Camacho-Miñano et al. (2016) find that multimedia resources are a motivating and valid didactic instrument for learning financial accounting.
Additionally, the “frequently asked questions” instrument is increasingly being used to reduce response times; these are lists of questions and answers that arise regularly, within a specific context and related to a certain topic (Villaseñor, 2014). Undoubtedly, they can become a useful methodological tool in the academic field to meet certain information needs. Hence, they were the germ of the idea that led to the present investigation of questions that are more complex for students and that are raised more frequently when approaching the subject.
Learning based on training videos appears recurrently in the literature (Sablić et al., 2021, Yousef et al., 2014b). However, we have not found any research that combines this teaching methodology with a previous system for assessing difficulty.
The purpose of this research does not lie solely in showing a video-based learning activity through customary training videos. This research aims to contribute to the literature showing the process that leads to the improvement in teaching practice in higher education through the creation of a training asset prepared by teachers and based on student feedback. In relation to feedback, numerous authors analyze this central component of the learning process as a tool, which, more than a corrective instrument, should be understood as one capable of helping students classify their doubts, as well as a means for improving learning, that is, a way of measuring their knowledge, skills and understanding (Chugh et al., 2022; Evans, 2013; Nicol et al., 2014; Scott, 2014).
Currently, there is evidence of a change in the feedback representations focused on student transmission; students are increasingly positioning themselves as active actors in feedback processes (Winstone et al., 2022). This work focuses precisely on this direction; feedback received from students and directed to teachers to ensure they are aware of students’ learning difficulties.
The objective of this experience is to reinforce the teaching-learning process in complex university subjects through collaboration between students and teachers, that is, to generate accessible material that can positively influence the motivation of students, thereby demonstrating the effectiveness of this multimedia resource while contrasting it with perceptions.
Based on this objective, the present study aims to test the following hypotheses:
The first hypothesis conditions the structure of the satisfaction survey to enable analysis of its results from the triple perspective of its usefulness in deepening the preparation of the material, its usefulness as a tool that complements the common material of the subject and, its usefulness as a process designed to be a teaching methodology.
The second hypothesis is evaluated by means of a statistical analysis of students' qualifications, that is, of the sample group with access to the videos and of the control group without such access.
METHODOLOGY
In this section, the entire process followed in the development of the project is explained including its phases, the students who participated and the tools used in its development.
Procedure
The subject that has been used as a pilot test, Financial Accounting II, in the degree of Business Administration and Management, suffers from two problems that need to be addressed. On the one hand, the subject has very broad content that requires a large number of hours of work in the classroom; on the other hand, the reiteration of very common doubts that students raise in individual tutorials is evident. The subject in question consists of five topics, each with a very important and practical function.
The project is developed in three stages, which are represented in Figure 1.
The first stage is the stage of feedback. At the end of each of the topics, students were given a questionnaire to complete. As a result of this first phase, the difficulty map of the subject was obtained, providing identification beacons for the issues that entailed greater complexity for the students. In addition, this offered a reinforcement and improvement tool for the students, since it allowed them to check in which parts of each topic they had failed the most and thus had more questions to resolve.
In the second stage, the problem is addressed and the videos are made. This took place in the following academic year. In this course, these videos were used for the first time as support material for a group of students, a pilot group, with whom we were able to verify their usefulness. In addition, because the teaching modality was not totally face-to-face due to COVID-19, it was possible to reinforce these students' material in an interactive and dynamic way.
Finally, the third stage includes the analysis of results. This took place in the third class, which is the object of this study. New recordings were made for all the videos with a professional technical service, and these were made available to a wide group of students who studied the subject. These students completed a satisfaction survey that made it possible to evaluate the degree of usefulness of this project and its possible application in other subjects. In the present study, an analysis of the results achieved by the students was performed to compare the qualifications obtained in these groups and in others without these videos, which were considered to be the control groups.
Participants
The main idea is to involve students in each of the phases that make up the project. Having been carried out over three academic years, this study was able to differentiate four groups of students with different roles depending on the phase of the project.
Instrument
This section explains the tools used in each of the phases of the project.
Preparation of questionnaires for obtaining student feedback
The starting point of the project is the development of a questionnaire to be completed by the students at the end of each topic. This system allowed us to collect the necessary information for the later elaboration of the videos. These questionnaires were parameterized through the free access Socrative platform, which allows interactions with students through different functionalities. They contain three clearly differentiated parts:
The first part contains a self-assessment system on the knowledge acquired on the topic (see Annex I, where an example for Topic 3 on financial instruments is shown).
In the second part, students indicate the degree of difficulty of the different questions addressed in the topic using a Likert scale from 1 to 5 (see Annex II, where an example for Topic 3 on financial instruments is shown).
Finally, a third party could openly express doubts and comments on the topic.
To check the reliability of the responses of the students, a Cronbach's alpha test was performed on the self-assessment questions and the scale of the degree of difficulty. Table 1 shows how for the questionnaires across all the topics a minimum result of 0.7 is reached. Acceptable values range between 0.70 and 0.95 (Bland & Altman, 1997; Hair et al., 2019; Reyes-Menéndez et al., 2019), which indicate a low dispersion in recorded responses and a certain homogeneity or trend.
Case Processing Summary | Reliability statistics | ||||
Topic | N | % | Cronbach's alpha | N of elements | |
Topic 1 | Valid cases | 130 | 94.2 | 0.820 | 18 |
Topic 2 | Valid cases | 100 | 94.3 | 0.711 | 17 |
Topic 3 | Valid cases | 95 | 94.1 | 0.711 | 17 |
Topic 4 | Valid cases | 87 | 87.9 | 0.732 | 16 |
Topic 5 | Valid cases | 75 | 84.3 | 0.727 | 16 |
Elaboration of the videos
The production of the videos took place in two phases. In the first phase, the teachers participating in the project recorded the videos by their own means through free access tools. This first recording was the one that was made available to students for the first time, in their second class, to obtain their first impression thereof. In the second phase, in order to make a professional recording of the videos, funding was obtained in the 1st Call for Teaching Innovation Projects of the Faculty of Legal and Social Sciences of the Rey Juan Carlos University.
These videos were posted on a YouTube channel to share their links with the students in a virtual classroom of the university. The videos can be viewed via the links in Table 2.
TOPIC | LINK |
TOPIC 1. Property, plant and equipment. | |
TOPIC 1.1 The calculation of impairment | https://youtu.be/l3MGI953bPY |
TOPIC 1.2 The recalculation of the amortization fee after impairment | https://youtu.be/SP32ENY50sY |
TOPIC 1.3 Reversal of impairment and reversal limits | https://youtu.be/nfNWPoX-3z4 |
TOPIC 2. Intangible assets. | |
TOPIC 2.1 Final result of the expenses of R&D in balance. Part 1 | https://youtu.be/l_0xRovF4Nc |
TOPIC 2.1 Final result of the expenses of R&D in balance. Part 2 | https://youtu.be/CnrUmTsa9vg |
TOPIC 2.2 Difference between transfer rights and lease expenses | https://youtu.be/xAOob-fw0Fc |
TOPIC 2.3 Goodwill | https://youtu.be/UkgAE3-RnPg |
TOPIC 3. Financial instruments I. | |
TOPIC 3.1 Dilution effect | https://youtu.be/HkZcpPsfCeI |
TOPIC 3.2 Securities and premiums in fixed income | https://youtu.be/AkPIiLVqfn0 |
TOPIC 3.3 Profitability accrued and not due before purchase | https://youtu.be/6kz8fOL4fT8 |
TOPIC 4: Financial instruments II. | |
TOPIC 4.1 Amortized cost as an evaluation criterion. Part 1 | https://youtu.be/PNvZea7Qd3o |
TOPIC 4.1 Amortized cost as an evaluation criterion. Part 2 | https://youtu.be/Xik_bZEcAHM |
TOPIC 4.2 Explicit and implicit interest rate | https://youtu.be/cpyqa_xylFU |
TOPIC 4.3 Accrued interest due and not due | https://youtu.be/GFfPuyACXhk |
Satisfaction questionnaire for evaluating the usefulness of the videos
The satisfaction questionnaire given to the students underwent qualitative validation by three expert reviewers in educational innovation from three different public universities1. Table 3 summarizes the validation process.
INITIAL | REVIEWER 1 | REVIEWER 2 | REVIEWER 3 | COMMON | FINAL |
QUESTION 1 | ✔ | ◼ | ✔ | ◼ | QUESTION 1 |
+ | + | + | + | QUESTION 2 | |
QUESTION 2 | ✔ | ✔ | ✔ | ✔ | QUESTION 3 |
+ | + | + | + | QUESTION 4 | |
+ | + | + | + | QUESTION 5 | |
+ | + | QUESTION 6 | |||
+ | + | QUESTION 7 | |||
QUESTION 3 | ✔ | ✔ | ✔ | ✔ | QUESTION 8 |
QUESTION 4 | ✔ | ✔ | ✔ | ✔ | QUESTION 9 |
QUESTION 5 | ✔ | ✔ | ✔ | ✔ | QUESTION 10 |
QUESTION 6 | ✔ | ◼ | ◼ | ◼ | QUESTION 11 |
QUESTION 7 | ◼ | ✔ | ✔ | ◼ | QUESTION 12 |
QUESTION 8 | ◼ | ✔ | ◼ | ◼ | QUESTION 13 |
QUESTION 9 | ✔ | ✔ | ◼ | ◼ | QUESTION 14 |
+ | + | + | + | QUESTION 15 | |
+ | + | QUESTION 16 | |||
QUESTION 10 | ✔ | ✔ | ✔ | ✔ | QUESTION 17 |
QUESTION 11 | ✔ | ✔ | ✔ | ✔ | QUESTION 18 |
QUESTION 12 | ✔ | ✔ | ✔ | ✔ | QUESTION 19 |
Likewise, this satisfaction survey was quantitatively validated via a Cronbach's alpha test, yielding a result of 0.925 for a total of 106 students. Acceptable values range between 0.70 and 0.95 (Bland & Altman, 1997; Hair et al., 2019; Reyes-Menéndez et al., 2019), which indicate a low dispersion in the survey responses. Annex III lists the questions on the final questionnaire.
RESULTS
In this section, the results achieved in each of the phases of the project are analyzed.
Evaluation of student feedback and obtaining the map of difficulty of the subject
Starting with the information gathering phase, the results were analyzed, differentiating each of the three parts of the questionnaire and obtaining the generated difficulty map. All this information comprised the basis for the development of the videos.
Analysis of the responses obtained from the self-assessment
In this first part, the students had to answer five questions of a theoretical-practical nature on each topic. The results obtained are detailed in Table 4 and show that in general, across all the subjects, an average of three correct answers was not reached, indicating the degree of difficulty that this subject may entail for students.
Descriptive statistics | |||||
Correct answers | N | Min | Max | Mean | Dev. |
TOPIC 1 | 138 | 0 | 5 | 2.72 | 1.25 |
TOPIC 2 | 107 | 0 | 5 | 2.54 | 1.35 |
TOPIC 3 | 106 | 0 | 5 | 2.72 | 1.45 |
TOPIC 4 | 98 | 0 | 5 | 2.84 | 1.34 |
TOPIC 5 | 89 | 0 | 5 | 2.74 | 1.18 |
From a statistical point of view, the greatest dispersion is found in Topic 3, which is where more doubts may arise. If these results are assessed by topic, few questions reach a percentage of 75% correct answers.
Analysis of the difficulty rating questions
In this second section, students identify the degree of difficulty of the items that make up each topic using a Likert scale from 1 to 5, where 1 is the least complex and 5 is the most complex.
Regarding Topic 1, corresponding to tangible fixed assets, according to the answers in Table 5, none of the responses to the above items falls below 3 as a medium degree of difficulty. Therefore, we estimate that the degree of difficulty of this topic is medium-high. If we delve into the contents that create more difficulty, we observe that two in particular are close to 4. These points correspond to the subsequent valuation of nonfinancial assets, specifically, the problem of the reversal of the impairment of value and its accounting record.
TOPIC 1 | TOPIC 2 | TOPIC 3 | TOPIC 4 | TOPIC 5 | |||||||||||
N | Mean | Dev. | N | Mean | Dev. | N | Mean | Dev. | N | Mean | Dev. | N | Mean | Dev. | |
LIK 1 | 133 | 3,16 | 1,01 | 104 | 2,98 | 1,01 | 95 | 3,19 | 1,10 | 90 | 2,72 | 1,10 | 79 | 2,67 | 0,93 |
LIK 2 | 132 | 3,35 | 0,95 | 101 | 3,10 | 0,85 | 95 | 3,00 | 1,15 | 90 | 2,88 | 1,16 | 79 | 3,11 | 1,03 |
LIK 3 | 132 | 3,02 | 0,99 | 101 | 3,22 | 0,95 | 95 | 3,33 | 1,00 | 90 | 3,27 | 1,07 | 77 | 2,56 | 0,92 |
LIK 4 | 132 | 3,14 | 1,09 | 101 | 3,49 | 0,84 | 95 | 3,69 | 0,92 | 89 | 3,53 | 0,91 | 77 | 3,16 | 0,97 |
LIK 5 | 132 | 3,32 | 0,98 | 101 | 3,27 | 1,02 | 95 | 3,28 | 1,02 | 89 | 3,24 | 1,01 | 77 | 3,16 | 1,04 |
LIK 6 | 132 | 3,29 | 1,06 | 101 | 3,23 | 0,97 | 95 | 3,45 | 0,98 | 89 | 3,36 | 1,07 | 76 | 2,91 | 1,09 |
LIK 7 | 131 | 3,47 | 0,96 | 100 | 3,39 | 0,99 | 95 | 3,41 | 0,94 | 88 | 3,42 | 1,12 | 75 | 2,84 | 1,09 |
LIK 8 | 130 | 3,55 | 0,97 | 100 | 3,37 | 0,98 | 95 | 3,29 | 0,99 | 88 | 3,32 | 1,09 | 75 | 2,77 | 1,03 |
LIK 9 | 130 | 3,86 | 1,02 | 100 | 3,59 | 1,03 | 95 | 3,43 | 1,03 | 88 | 3,64 | 0,98 | 75 | 3,57 | 1,08 |
LIK 10 | 130 | 3,39 | 1,08 | 100 | 3,19 | 0,93 | 95 | 3,53 | 1,02 | 87 | 3,55 | 0,89 | 75 | 3,16 | 1,05 |
LIK 11 | 130 | 3,24 | 1,10 | 100 | 3,05 | 1,10 | 95 | 3,48 | 1,04 | 87 | 3,45 | 0,93 | 75 | 3,27 | 0,92 |
LIK 12 | 130 | 3,37 | 0,99 | 100 | 3,46 | 1,02 | 95 | 3,83 | 0,97 | - | - | - | - | - | - |
LIK 13 | 130 | 3,72 | 1,04 | - | - | - | - | - | - | - | - | - | - | - | - |
When analyzing the results obtained in Topic 2 on intangible assets, in general, we observe a degree of difficulty greater than three, which is medium-high. The concepts that are more complex refer to the subsequent evaluation. Therefore, the videos that are made for the previous topic are also useful for this topic. Another point that is difficult for students to understand is the assessment of research and development expenses and their activation process. The continuous changes and regulatory developments regarding goodwill, as well as the difference between transfer rights and rental expenses, are other points to which special attention is given in the development of the videos.
Topic 3, financial instruments, is one of the most complex topics in the course, as found when analyzing the self-assessment exercises. In this topic, the classification and characteristics of these financial instruments are studied, establishing the differences between shares and debt securities. These are the operations with shares, specifically, capital increases, which students perceive to have a high degree of difficulty. Specifically, more detailed explanations of the dilution effect generated in these extensions are needed, an aspect that is included in question LIK3.4 (Topic 3, question 4) in Table 5. When the representative debt values are studied, the students need to reinforce the calculation of their initial assessment, reflected in question LIK3.12. Specifically, students allude to difficulty when profitability is announced or accrued before the acquisition.
The results obtained in the assessment of Topic 4 referring to financial assets and liabilities at amortized cost reflect a medium-high degree of difficulty. The concepts that generate the greatest complexity are related to the amortized cost valuation criterion, the difference between implicit and explicit interest, and their accounting record. This information is recorded in questions LIK 4.4, LIK4.9 and LIK4.10.
Topic 5, in which the contents of net worth are explained, is generally the one that students perceive to have the least complexity. As Table 5 shows, there are fewer points in which the average degree of difficulty of 3 is exceeded. The issue that needs a more detailed explanation is the concept of refundable and nonrefundable grants and their accounting record when financing a nonfinancial asset.
Open question analysis
As Figure 2 illustrates, in the open question posed, the concepts that are more complex for the students are once again revealed in a free and unconditional way via questions from teachers. The responses recorded are typified by a search for links or common denominators.
As additional questions, they highlight the need to increase the number of exercises to be performed or to provide diagrams to facilitate understanding. This further justifies the use of videos as a tool in this project.
Obtaining the difficulty map
To allow complexity assessment in a visual way, the difficulty map was constructed for each of the topics that make up the subject. For its elaboration, a series of criteria has been established that allows us to designate different colors akin to a traffic light, as Table 6 shows.
Established criteria | Result |
PART ONE: self-assessment | |
Records in correct answer (in%) | |
Over 50 | Green |
Between 30 and 50 (or equal) | Yellow |
Less than or equal to 30 | Red |
Records in wrong answer (in%) | |
Less than or equal to 10 | Green |
Between 10 and 30 (or equal) | Yellow |
Over 30 | Red |
SECOND PART: Degree of difficulty. Only if responses > 30% | |
Likert 1 and 2 | Green |
Likert 3 | Yellow |
Likert 4 and 5 | Red |
PART THREE: open question (in%) | |
Related concepts less than or equal to 2 | Green |
Related concepts between 2 and 10 | Yellow |
Related concepts equal to or greater than 10 | Red |
Figure 3 presents the resulting map for Topic 3 on financial instruments, showing the overall result for each question raised, which indicates low, medium, or high difficulty according to whether the color is green, yellow or red, respectively. To do this, previously defined criteria were applied to the recorded responses.
For example, for question 3, a low degree of difficulty is obtained because a percentage greater than 50% is registered concerning the correct answer and a percentage less than 10% was registered for each of the incorrect answers.
Satisfaction survey results
Once the videos are made available to students, it is necessary to acquire their opinions of their usefulness in students’ preparation in the subject. For this, a satisfaction survey was carried out; 106 responses were obtained, which we analyze below.
Regarding their perception of the subject, 62.26% of the students perceive it as difficult or very difficult, entailing work of more than 10 hours a week for 91.51% of respondents. The video tool, based on student difficulty rating, can reduce the degree of complexity of a subject in any field of knowledge without the need to significantly increase the time invested. Such videos have a predefined teaching orientation that guides students in their preparation. For instance, 80% of the students affirm that these videos allow them to deepen their learning of and preparation in the topics, and 85.85% consider their experience with the videos useful or very useful. Regarding technical quality, there is greater dispersion; on a scale of 1 to 5, 21% show a rating of 3, although, in general, students rating the format as high and professional quality total 77.36%.
These percentages indicate a real assessment, as more than 82% of the students claim that they have viewed all the videos or have left only one or two of them pending.
Notably, 82% of the students found them interesting or very interesting, reinforcing the usefulness of this methodology, given that none of the respondents deemed them a waste of time.
Finally, the positive perception of the degree of usefulness of the video tool reached 91% in the responses, a starting point for the promotion of the use of these applicable materials in both remote and face-to-face teaching.
Based on all the above results combined with the data obtained, we can therefore confirm that Hypothesis 1, “Students positively value the usefulness of video-based learning and its contribution to their preparation in the subject”, is supported.
Evaluation of grades achieved without videos and with videos
First, Table 7 shows the main descriptive statistics differentiating the scores of students in the control group without access to the videos and those with it. The results are shown for both the ordinary call (May), the extraordinary call (June) and the final grade of the entire group while accounting for both.
Mean | Dev. | Min | Max | ||
No access to videos | May | 5.19 | 2.18 | 1 | 9.6 |
Jun | 5.06 | 1.72 | 0.75 | 8.75 | |
End | 5.81 | 1.96 | 0.75 | 9.6 | |
Access to videos | May | 5.30 | 2.89 | 0.38 | 10 |
Jun | 6.04 | 1.81 | 1.01 | 9.2 | |
End | 7.73 | 2.04 | 0.74 | 10 |
According to the data in the above table, for both calls, improvement occurred among the groups of students with access to the videos. This improvement is reflected in a more significant way if the final grades obtained by each group of students are compared. In Figure 4, these final grades are graphically compared by category.
At the global level, among the groups of students with access to the videos, there was less absenteeism during exams, which may indicate greater security among students who have this tool in their preparation in the subject. Likewise, there is a lower percentage of failure and a higher volume of passing. Notably, the highest scores are practically not recorded for the control groups. In addition, as Figure 4 shows, there is a very significant and pronounced change in the trend between failure and passing for the groups of students with access to the videos.
Statistically validating this comparison of results, Table 8 shows the results of the test of the difference of means among the final grades of students with or without access to the videos. Likewise, the results are shown for each call and each group, differentiated according to each of the three teachers.
Variable | No access to videos |
Access to videos |
Difference of means test (p value) |
||
Mean | Dev. | Mean | Dev. | ||
Final_total | 5.81 | 1.96 | 6.73 | 2.03 | -4.43*** (0.00) |
Final_Teach_1 | 5.82 | 1.72 | 6.40 | 1.72 | -1.57* (0.06) |
Final_Teach_2 | 6.70 | 1.85 | 8.44 | 1.58 | -5.30*** (0.00) |
Final_Teach_3 | 4.80 | 1.88 | 5.85 | 1.83 | -3.14*** (0.00) |
May_Teach_1 | 4.98 | 2.02 | 3.57 | 2.56 | 3.27*** (0.00) |
May_Teach_2 | 6.29 | 2.03 | 7.98 | 2.23 | -4.01*** (0.00) |
May_Teach_3 | 4.17 | 1.98 | 4.75 | 2.06 | -1.50* (0.07) |
Jun_Teach_1 | 5.24 | 1.46 | 6.47 | 1.61 | -3.42*** (0.00) |
Jun_Teach_2 | 5.54 | 2.17 | 7.70 | 1.28 | -2.79*** (0.00) |
Jun_Teach_3 | 4.66 | 1.59 | 4.36 | 1.76 | -1.96** (0.03) |
According to the above data, the final grades obtained by students were higher on average in the groups with access to the videos, except for those of Teacher 1 in the May call. Furthermore, across all cases, the results are statistically significant.
Given this reiteration in the improvement in results for the groups with access to the videos, it seems reasonable to affirm that the video tool, based on the subject’s difficulty, contributes to an improvement in students' performance.
Accordingly, the results obtained, both the descriptive findings and the difference of means test results, support Hypothesis 2, posited at the beginning of the study.
DISCUSSION
Video-based learning is becoming increasingly common in this era in which educational technology and multimedia learning are valued in society (Madariaga et al., 2021). Likewise, the literature suggests that its impact on the quality of learning requires involving students "during" the video design process. Along these lines, in this research, students were involved as the most important actors in the process; their feedback was considered a starting point, since they are the ones who best know what content is most difficult for them. They are thus precisely the ones who have positively valued the usefulness of the videos and their contribution to their preparation in the subject.
According to Campoverde-Luque et al. (2022), to achieve significant knowledge transfer, it is necessary for teachers to be properly equipped with digital tools and manage the resolution of exercises effectively and online; this notion reinforces the learning proposal based on videos presented in this research. In addition, to build this knowledge, there must be professional training in innovative methodological strategies, and that knowledge should be linked to practice (Bravo & Cáceres, 2006; Barrera et al., 2017), the main objective of these elaborate videos. The preparation of material obtained through this methodological process contributes to a reduction in the perceived difficulty, as well as to an improvement in results.
In relation to difficulty, Han and Ellis (2019) describe a methodology for developing the understanding of complex scientific concepts consisting of three stages: (1) identify the sources of misunderstanding of scientific concepts among students; (2) implement an effective instructional design to teach difficult and abstract scientific concepts; and (3) locate actionable elements in the experiences of students and their learning to find ways to impact the quality of their results. In line with this, a process has been carried out that can improve teaching practice in higher education when addressing content with a high degree of difficulty consisting of three stages: (1) collect information directly from students' feedback and by assessing their degree of complexity through a "map of difficulty"; (2) once the most complex issues have been identified, address them through training videos prepared ad hoc, as in the above study; and (3) analyze the impact of the results, both in terms of satisfaction levels and ratings. The relevance of this methodology is that it can be completely extrapolated to any area of knowledge and educational level.
The present research confirms that this method, whose videos address highly focused questions and are adapted to specific learning objectives, allows students to delve into their preparation in focal topics. In contrast, it is less effective for them if these questions are formulated in a more generic way, in line with Schworm and Renkl (2007) and Renkl and Scheiter (2017).
Regarding the technical quality of videos in education, Dong and Goh (2015) analyze how to integrate videos into a teaching program, describe the technical requirements when producing such videos and advise, among other issues, on the quality thereof. The successful integration of video into a curriculum must be guided by the understanding of this technology. Videos must be credible and of good quality. In the methodology of this study, this perception was taken into account; the videos were first made by teachers and then later rerecorded by professionals in this field, ensuring the videos were perceived by more than 77% of students to be high-quality and professional.
In a previous study, Kim et al. (2021) have analyzed self-regulated learning strategies in an asynchronous online course, finding that an increase in students’ engagement predicts their course performance. Additionally, the results of both the descriptive analysis and test of difference of means in the present study confirm improvements in both the motivation and academic performance of students. However, this study does not include a prediction study akin to that of Kim et al. (2021), opening a future line of research comparing the results of the above questionnaires with academic results to predict behavior. Such research can be completed by including, as a variable, the role of the emotions and socioemotional profiles of students in multimedia learning environments.
CONCLUSIONS
Following several years of a total break with previous teaching models and in a global context where virtuality is positioning itself as a necessary and complementary modality, we must maintain the adaptations and advances with respect to the previous methodologies, procedures and available resources. This means resuming teaching activities as they were previously carried out and incorporating improvements that have been proven advantageous for teaching quality (Medina López et al., 2021). In this context, information technology-enabled learning has become the heart of education since the COVID-19 crisis, with many teachers expressing their desire for good practice guides based on evidence and examples in their subjects (Cleland et al., 2020; Sangster et al., 2020). Notably, multimedia resources are a valid educational resource and, in a certain way, innovative, concerning instruction in university subjects, as long as they are oriented to specific knowledge objectives, as they constitute a very motivating element for students in the EEES framework ( Camacho-Miñano et al., 2016).
Giannakos et al. (2016) state that video-based learning has tremendous potential, when it is pedagogically appropriate and purposefully designed, to facilitate teaching and learning. To use video as a pedagogical tool, it is necessary to examine its impact on students’ overall experience, given that the way in which intelligent learning can improve the didactic potential of video systems is of vital importance.
The emergence of digital tools has created new learning conditions, allowing an educational transformation (Rodríguez et al., 2023). In line with this, we have analyzed the usefulness of applying video instruction based on difficulty in complex subjects, using, as a pilot test, the subject of Financial Accounting II, to show that such instruction can be extrapolated to any field of knowledge. This work was openly presented to students through questionnaires specially elaborated for this purpose, enabling their analysis of the degree of difficulty of the different contents and allowing the final selection of the videos to be made. Once these videos were made and viewed by the students, we analyzed their impact and usefulness through two different methods: analysis of the results of a satisfaction survey subsequently carried out with the students and statistical analysis of the results in terms of the grades among students with or without (the control group) access to these videos for their preparation in the subject.
The first conclusion obtained is that videos are a very useful tool for students, providing them with complementary material adapted to their most frequent learning difficulties, which allows them to prepare for a subject with greater autonomy and greater chances of success. The second conclusion is that this system can be perfectly extrapolated to any subject; it is very interesting for teachers since it allows the identification of scales of difficulty in their subjects to address them in the best possible way.
In line with Gil-Galván and Gil-Galván (2021), this study is committed to the continuous development of the teaching process and the implementation of new methodologies that enable students to be protagonists in their own intellectual growth. Given all of the above, the results of this study should broaden the horizon of this project and be applied in related subjects, and even enable other teachers to implement the video tool in other areas of knowledge, thus providing greater robustness to the results obtained.
REFERENCES
Barrera, H. M., Barragán, T. M., & Ortega, G. E. (2017). La realidad educativa ecuatoriana desde una perspectiva docente. Revista Iberoamericana de Educación, 75(2), 9-20. https://doi.org/10.35362/rie7522629
Bland, J. M., & Altman, D. G. (1997). Statistics notes: Cronbach's alpha. BMJ, 314, 572. https://doi.org/10.1136/bmj.314.7080.572
Brame, C. J. (2016). Effective educational videos: Principles and guidelines for maximizing student learning from video content. CBE—Life Sciences Education, 15(es6), 1-6. https://doi.org/10.1187/cbe.16-03-0125
Bravo, G., & Cáceres, M. (2006). El proceso de enseñanza-aprendizaje desde una perspectiva comunicativa. Revista Iberoamericana de Educación, 38(7), 1-7. https://doi.org/10.35362/rie3872607
Camacho Miñano, M. D. M., Urquía Grande, E., Pascual Ezama, D., & Rivero Menéndez, M. J. (2016). Recursos multimedia para el aprendizaje de Contabilidad Financiera en los grados bilingües. Educación XX1, 19(1), 63-89. https://doi.org/10.5944/educxx1.15578
Campoverde-Luque, R. I., Zambrano-Torres, R. D. R., Arellano-Pintado, M. S., & Cantos-Arellano, T. M. (2022). Implementación de la Propuesta BCC: Aplicación de la práctica contable desde la virtualidad en el proceso de enseñanza-aprendizaje en la asignatura de contabilidad. 593 Digital Publisher CEIT, 7(4-2), 157-174. https://doi.org/10.33386/593dp.2022.4-2.1212
Caurcel Cara, M. J., & Crisol Moya, E. (2022). Ciberacoso en estudiantes universitarios antes y durante el confinamiento por la COVID-19. Educación XX1, 25(1), 67-91. https://doi.org/10.5944/educxx1.30525
Chugh, R., Macht, S., & Harreveld, B. (2022). Supervisory feedback to postgraduate research students: a literature review. Assessment & Evaluation in Higher Education, 47(5), 683-697. https://doi.org/10.1080/02602938.2021.1955241
Cleland, J., McKimm, J., Fuller, R., Taylor, D., Janczukowicz, J., & Gibbs, T. (2020). Adapting to the impact of COVID-19: Sharing stories, sharing practice. Medical Teacher, 42(7), 772-775. https://doi.org/10.1080/0142159X.2020.1757635
Dong, C., & Goh, P. S. (2015). Twelve tips for the effective use of videos in medical education. Medical Teacher, 37(2), 140-145. https://doi.org/10.3109/0142159X.2014.943709
Evans, C. (2013). Making Sense of Assessment Feedback in Higher Education. Review of Educational Research, 83(1), 70-12. https://doi.org/10.3102/0034654312474350
Fogarty, T. J. (2020). Accounting education in the post-COVID world: looking into the Mirror of Erised. Accounting Education, 29(6), 563-571. https://doi.org/10.1080/09639284.2020.1852945
Giannakos, M. N., Sampson, D. G., & Kidziński, Ł. (2016) Introduction to smart learning analytics: foundations and developments in video-based learning. Smart Learning Environments, 3(1), 1-9. https://doi.org/10.1186/s40561-016-0034-2
Gil-Galván, R., & Gil-Galván, F. J (2021). Percepciones de los estudiantes universitarios sobre las competencias adquiridas mediante el aprendizaje basado en problemas. Educación XX1, 24(1), 271-295. https://doi.org/10.5944/educxx1.26800
Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019). When to use and how to report the results of PLS-SEM. European Business Review, 31(1), 2-24. https://doi.org/10.1108/EBR-11-2018-0203
Han, F., & Ellis, R. A. (2019). Using phenomenography to tackle key challenges in science education. Frontiers in Psychology, 10, 1414. https://doi.org/10.3389/fpsyg.2019.01414
Kay, R. H. (2012). Exploring the use of video podcasts in education: A comprehensive review of the literature. Computers in Human Behavior, 28(3), 820-831. https://doi.org/10.1016/j.chb.2012.01.011
Kim, D., Jo, I. H., Song, D., Zheng, H., Li, J., Zhu, J., Huang, X., Yan, W., & Xu, Z. (2021). Self-regulated learning strategies and student video engagement trajectory in a video-based asynchronous online course: a Bayesian latent growth modeling approach. Asia Pacific Education Review, 22(2), 305-317. https://doi.org/10.1007/s12564-021-09690-0
Ljubojevic, M., Vaskovic, V., Stankovic, S., & Vaskovic, J. (2014). Using Supplementary Video in Multimedia Instruction as a Teaching Tool to Increase Efficiency of Learning and Quality of Experience. International Review of Research in Open and Distributed Learning, 15(3), 275-291. https://doi.org/10.19173/irrodl.v15i3.1825
Madariaga, L., Nussbaum, M., Gutiérrez, I., Barahona, C., & Meneses, A. (2021). Assessment of user experience in video-based learning environments: From design guidelines to final product. Computers & Education, 167, 104176. https://doi.org/10.1016/j.compedu.2021.104176
Martín-Cuadrado, A. M., Lavandera-Ponce, S., Mora-Jaureguialde, B., Sánchez-Romero, C., & Pérez-Sánchez, L. (2021). Working methodology with public universities in Peru during the pandemic—continuity of virtual/online teaching and learning. Education Sciences, 11(7), 351. https://doi.org/10.3390/educsci11070351
Medina López, A., Delgado Jalón, M. L., & Cámara Sánchez, A. (2021). Consequences of covid-19 in higher education. Online or presential teaching? Journal of Management and Business Education, 4(3), 275-288. https://doi.org/10.35564/jmbe.2021.0016
Nicol, D., Thomson, A., & Breslin, C. (2014). Rethinking feedback practices in higher education: a peer review perspective. Assessment & Evaluation in Higher Education, 39(1), 102-122. https://doi.org/10.1080/02602938.2013.795518
Renkl, A., & Scheiter, K. (2017). Studying visual displays: How to instructionally support learning. Educational Psychology Review, 29(3), 599-621. https://doi.org/10.1007/s10648-015-9340-4
Reyes-Menéndez, A., Saura, J. R., & Martínez-Navalón, J. G. (2019). The impact of e-WOM on hotels management reputation: exploring tripadvisor review credibility with the ELM model. IEEE Access, 7,68868-68877. https://doi.org/10.1109/ACCESS.2019.2919030
Rodríguez, M., Huerta, P., Valencia, C., Montano, E., & Ortega, Y. (2023). Innovación educativa con redes sociales aplicada a la asignatura de Salud Pública. Educación Médica, 24(3), 100798. https://doi.org/10.1016/j.edumed.2023.100798
Sablić, M., Mirosavljević, A., & Škugor, A. (2021). Video-based learning (VBL)—past, present and future: An overview of the research published from 2008 to 2019. Technology, Knowledge and Learning, 26(4), 1061-1077. https://doi.org/10.1007/s10758-020-09455-5
Sangster, A., Stoner, G., & Flood, B. (2020). Insights into accounting education in a COVID-19 world. Accounting Education, 29(5), 431-562. https://doi.org/10.1080/09639284.2020.1808487
Schworm, S., & Renkl, A. (2007). Learning argumentation skills through the use of prompts for self-explaining examples. Journal of Educational Psychology, 99(2), 285. https://doi.org/10.1037/0022-0663.99.2.285
Scott, S. V. (2014). Practising what we preach: towards a student-centred definition of feedback. Teaching in Higher Education, 19(1), 49-57. https://doi.org/10.1080/13562517.2013.827639
Segovia-García, N., Said-Hung, E., & García Aguilera, F. (2022). Educación Superior virtual en Colombia: factores asociados al abandono. Educación XX1, 25(1), 197-218. https://doi.org/10.5944/educxx1.30455
Vedder-Weiss, D., Segal, A., & Lefstein, A. (2019). Teacher face-work in discussions of video-recorded classroom practice: Constraining or catalyzing opportunities to learn? Journal of Teacher Education, 70(5), 538-551. https://doi.org/10.1177/0022487119841895
Villaseñor Rodríguez, I. (2014). Las preguntas frecuentes como herramienta metodológica para el estudio del fenómeno de las necesidades de información: el caso de las bibliotecas universitarias madrileñas. In J. Ríos Ortega & C. A. Ramírez Vázquez, (Coord.), Naturaleza y método de la investigación bibliométrica y de la información (173-179). Universidad Nacional Autónoma de México. https://ru.iibi.unam.mx/jspui/handle/IIBI_UNAM/CL380
Winstone, N., Boud, D., Dawson, P., & Heron, M. (2022). From feedback-as-information to feedback-as-process: a linguistic analysis of the feedback literature. Assessment & Evaluation in Higher Education, 47(2), 213-230. https://doi.org/10.1080/02602938.2021.1902467
Yousef, A. M. F., Chatti, M. A., & Schroeder, U. (2014a). The state of video-based learning: A review and future perspectives. International Journal on Advances in Life Sciences, 6(3), 122-135.
Yousef, A. M. F., Chatti, M. A., & Schroeder, U. (2014b). Video-based learning: A critical analysis of the research published in 2003-2013 and future visions. In eLmL 2014, The Sixth International Conference on Mobile, Hybrid, and On-line Learning, 112-119.
Zhao, F. (2019). Using Quizizz to integrate fun multiplayer activity in the accounting classroom. International Journal of Higher Education, 8(1), 37-43. https://doi.org/10.5430/ijhe.v8n1p37
ANNEX
Notes