Keywords: Educative technology, short serious games, competencies.
However, despite the efforts made by teachers in elementary school, it is clear – based on the ENLACE (the Spanish initials for the National Assessment of Academic Achievement in Schools) results– that elementary school students’ level of education is barely improving with regard to basic topics in mathematics, science, and Spanish (Secretaría de Educación Pública [SEP], 2013).
There is a need to integrate more efficient mechanisms in a non-formal environment for students, and increase learning opportunities beyond the classroom. Video games are a mechanism with great potential.
One aspect that needs solving in order to achieve better learning methods is the production of educational content. In recent years, this problem has become a topic of discussion among the international research community (Ibrahim & Jaafar, 2009), and the use of serious games has been proposed as a way to reduce the gap. Researchers have published multiple models and frameworks, including development processes.
The implementation of the “Business-Academia-Government Linkage Model for the Development of IT Capabilities of Human Resources” project (known in Spanish as “Modelo de Vinculación Empresa-Academia-Gobierno para el Desarrollo en Capacidades de Capital Humano en Tecnologías de la Información”) identified the need to convert a set of competencies (and areas of knowledge) into learning needs in order to produce educational digital resources (Velázquez, Álvarez, Garza, Sicilia, Mora, & Muñoz, 2011). At that time, our research team carried out a first approach to competency-based decomposition, resulting in the production of about one thousand learning objects.
From the experience gained during the product quality management in the project, it has been identified that those educational digital resources produced with ad hoc processes do not guarantee efficient completion of development or quality resource production, and neither do they ensure that the learning needs are implemented entirely to facilitate the adoption of competencies, because that development depends on the degree of experience of developers in different areas of knowledge (pedagogy, digital content design, game design, process management, etc.) (Barajas, A., Álvarez, F., Muñoz, J., Santaolaya, R., & Collazos, C., 2014; Álvarez-Rodríguez, Barajas-Saavedra, & Muñoz-Arteaga, 2014).
This paper presents the improved and formalized process to achieve this transformation by addressing the problems related to the correct fulfillment of the learning needs (learning content, learning activities, expected learning, pedagogical aspects and competencies) through the use of the process called “Competency-based Decomposition” (CBD), which, as said in the previous paragraphs, is a proven, successful way to accomplish the production of digital educational resources – in this case, short serious games.
The following sections present the basic concepts and definitions used in this research to design the CBD process.
This section presents a review of the literature of competencies related to serious games, in order to establish theoretical concepts that support this research. Furthermore, the definitions and concepts form the foundation for the development of short serious games.
The behaviorist approach stresses the importance of observing successful and effective job performers and determining what differentiates them from their less successful counterparts.
The generic approach is aimed more at identifying the common abilities that explain variations in performance.
The definition of competency in the cognitive approach includes all of the individuals’ mental resources used to master tasks, acquire knowledge and perform well.
Any definition of the term "competency" should include a combination of three elements: a) information, b) skill development and, c) turning it into action, in a unique situation. The best way to observe a competency is in the combination of these three aspects, which means that all competencies require the mastery of specific information, while calling for the development of a skill, or rather a skill set, derived from information processes, but in a problem situation that is a real unique situation where competition can be generated (Díaz, 2006).
The learning needs of the individual or group of individuals.
The social and cultural context of the individual or group of individuals.
The learning methodology (includes consideration of the learning model and learning styles). This aspect covers the aspects "Pedagogic considerations", "Learner specification" and "Context" proposed by De Freitas & Jarvis (2006) and De Freitas & Oliver (2006).
Considerations for gameplay and the story (Zyda, 2005).
The level of fidelity, interactivity, immersion, fun, etc.
Considerations for game-based learning (Martens, Diener, & Steffen, 2008).
Considerations for the inclusion of material in formal classes.
Context-based considerations for the implementation of digital educational resources (De Freitas & Jarvis, 2006).
Challenging content that generates competition between students using the game.
This section shows the main ideas of the reviewed articles related to this research.
The article by Tejada (2005) emphasizes that education should appoint a special economic resource for the production of learning materials, and stresses the importance of using digital learning resources. It also establishes the means and strategies for assessment of learning by competencies.
Dávila Balcarce et al. (Dávila & Velásquez, 2007) show the positive results of an evaluation of two collaborative games as a methodological resource for education. It is also stressed that for the improvement of the tested game applications for learning, it is necessary to create better educational content.
Garrido (2013) states that video games are a systems environment that shows one way to configure a set of features that are pedagogically desirable and expected.
Almiron & Porro (2014) established that the use of ICT in education is a good learning strategy. They also established that students have changed and they are not subjects for the current teaching system.
The literature review reveals that there is a need for the production of digital educational resources. Such is the case that a number of assessment tools are proposed at different educational levels, and different actors are involved in the teaching-learning process (teachers, professionals who are evaluated, students, and even parents). However, no paper proposes a way to properly develop resources and the literature makes the assumption that the production of educational (digital) resources is a competency that teachers have already fully acquired.
Therefore, this paper proposes a mechanism that ensures that this competency is acquired by those who design or produce educational (digital) resources, so that students receive and adopt competencies and learning outcomes.
The following sections present the CBD process, its application, and an example of its use including the results of its application to a real subject.
The CBD process is a mechanism used to match a formal competency with non-formal content, identifying the aspects and factors that should be implemented in the production of the game so it may satisfactorily cover the expected competencies for a given school grade and thus the quality of the serious game and the fulfilment of the learning needs may be guaranteed. This procedure sets out to completely cover the content and outcomes that make up a subject in a syllabus, thus ensuring the appropriation of knowledge and learning outcomes for a particular competency.
To perform the CBD it is necessary to complete the following steps for each subject to be analyzed (figure 1).
Identify the Standards, Goals and Graduate Profiles (SGGP) of the subject analyzed. This step is very important as the products of the subsequent steps must be aligned to these elements.
Identify the contents and expected outcomes of the syllabus.
Group, in areas of knowledge, the contents and expected outcomes in accordance with the SGGP.
Organize knowledge areas in accordance with the SGGP.
Identify competencies from the grouping of knowledge areas.
Organize competencies and their knowledge areas in accordance with the SGGP.
All of the above are “competencies for life”, which, from a software engineering perspective, are very complex to manage and measure due to their multifactorial nature.
The following paragraphs show the application of this CBD process, used in this research to identify all the competencies for sixth-grade mathematics in order to produce games.
This section will show step-by-step the process used to apply the CBD using the sixth-grade mathematics syllabus in elementary schools in Mexico.
The following figures show the standards (Figure 2), goals (Figure 3) and graduate profiles (Figure 4) from the syllabus analyzed.
The Mathematics Curriculum Standards present a vision of a population that knows how to use mathematical knowledge. This includes the set of expected outcomes of students in four school periods, leading to high levels of mathematical literacy.
Number sense and algebraic thinking.
Attitude towards the study of mathematics.
Moving from everyday language to mathematical language to explain procedures and results.
Broadening and deepening knowledge so that the understanding and efficient use of mathematical tools are favored.
Moving from requesting help in solving problems towards self-help.
Figure 2. Standards for the study of mathematics for elementary education, established in the 2011 syllabus published by the Mexican Ministry of Education (Secretaría de Educación Pública [SEP], 2011).
identify sets of quantities that vary proportionately or irregularly, calculate missing values and percentages, and apply the constant factor of proportionality (with natural numbers) in simple cases.
During this period, the curriculum standards are centered on three thematic axes: number sense and algebraic thinking; shape, space and measure; and information handling.
After the third period, students know how to communicate and interpret natural numbers, fractional or decimal numbers as well as solve problems using conventional algorithms for addition and multiplication, calculate perimeters and areas, and describe and build solid figures. They use reference systems to locate points in the plane or interpret maps. They also perform collecting, organizing, analyzing and data presentation processes.
Based on the teaching methodology proposed for study in this course, students are expected to also acquire mathematical knowledge and skills, and develop attitudes and values that are essential in the construction of mathematical competence.
1.1.1. Reads, writes and compares natural, fractional and decimal numbers.
1.2.1. Solves addition problems with fractional or decimal numbers, using conventional algorithms.
1.2.1. Solves problems that involve multiplying or dividing natural numbers using conventional algorithms.
1.3.2. Solves problems that involve multiplying or dividing fractional or decimal numbers using conventional algorithms.
All the subjects that make up a school grade may be found in SEP (2011). Each grade is divided into blocks.
Each block is made up at its first level by the central axis, at its second level by the topics, and at its third level by the contents. This can be seen in Table 1. It should be noted that there are only three axes in the figure. This is due to the fact that the fourth axis (“Attitude towards the study of mathematics”) is implicitly evaluated by the other three axes.
In order to perform this step, you must review in detail the contents and expected outcomes. For example, as may be observed in Table 1, in the “Number sense and algebraic thinking” axis there are two sections of content: 1) Addition problems and 2) Multiplication problems; so they can be grouped into an area of knowledge called “Operations”.
Solve problems involving reading, writing and comparing natural, fractional and decimal numbers, specifying the comparison criteria.
Solve addition problems with natural, decimal and fractional numbers involving two or more transformations.
Describe routes and calculate the real distance from one point to another on maps.
Read, write and compare natural, fractional and decimal numbers. Explain comparison criteria.
Solve addition problems with natural, decimal and fractional numbers, with varying problem structure. Study or reaffirm conventional algorithms.
Solve multiplication problems with fractional or decimal values using informal procedures.
Identify the axes of symmetry of a figure (polygonal or non-polygonal) and mutually symmetrical shapes, using different resources.
Choose a code to communicate the location of objects in a grid. Establish common codes for locating objects.
Calculate real distances through rough measurement from one point to another or a map.
Calculate percentage amounts by various methods (applying a "per 100, n" association, implementing a common or decimal fraction, using 10% as the base).
Read data in tables and circle graphs to answer diverse questions.
As in the previous step, the areas of knowledge must be reviewed. For example, areas of knowledge 5, 6 and 11, according to the SGGP, can be grouped in one competency.
The process of organizing the knowledge areas resulted in the creation of “groups” that will later become competencies.
The last step is to create a map of the competencies and their areas of knowledge. This map can be created using a chart or a table.
Figure 5 shows a graphic template for displaying the results of the CBD process.
This section presents the results of the application of the CBD process in sixth-grade mathematics. From the application of the CBD process in mathematics for the sixth grade of elementary school, the following areas of knowledge and competencies were identified.
Figure 6. The result of the CBD applied in sixth-grade mathematics in elementary school.
After the production phase of the short serious games, the team proceeded to test them in order to study the impact on learning for students exposed to this learning strategy. The participants were a group of 29 students from the sixth grade of elementary school at the “Federal Rural Cuauhtémoc” elementary school located in La Paz, Ojuelos, Jalisco. The children from this school, and the school itself, have many needs, so the use of IT to access information helps to alleviate some of them.
Tests were- designed for initial and control evaluations. The tests were designed to evaluate students’ level of knowledge in the following areas: areas, handling of solid figures, fractions, shapes and polygons, and the cross product.
The group of students was selected. The group was divided into two parts, taking into account that in both groups, the students’ average grade must be equally distributed, meaning that the group was divided according to the average grades of the students.
An initial evaluation was applied to all students.
The test group used games in one-hour sessions twice a week for four weeks.
At the end of eight sessions, a control test was applied to identify the impact of game use.
The collected data was analyzed with SPSS software.
The collected data allows trends in students’ scores to be determined before and after they use short serious games. The overall findings are graphically depicted in figure 7 where the dotted line displays the results obtained during the initial examination. The solid line displays the results of the evaluation performed after the use of short serious games.
Figure 7. Students’ overall results in the different areas of knowledge tested.
As the reader can see, there are improvements in four knowledge areas, this is due to the fact that students achieved a higher level of acquisition of the competencies implemented in the short serious games they used.
The cross product game, which shows a decrease in the acquisition of the competency, was developed with a question bank instead of randomly-generated problems, so the students memorized this question bank and did not achieve the intended competency acquisition.
The correct implementation of the competencies and the characteristics of the short serious games are extremely important because this is the only way to guarantee that users will achieve a higher level of adoption of the competencies implemented in the games.
As the reader can see, the cross product game did not achieve its purpose of facilitating student adoption of the competency due to a deviation in its development.
The CBD process enables clear identification of the competencies to be implemented in short serious games, as in many cases this aspect is not taken into account during the development process (if a development process exists). The CBD process takes common elements in the syllabus as inputs, and turns them into programmable and measurable competencies (learning needs) for short serious games.
Once the competencies have been identified, the short serious game development process is capable of building high-quality software products that are based on those learning needs and follow the correct implementation of the competencies.
This research has created and tested, with real-world students, a large set of short serious games, and achieved an improvement in competency adoption due to the correct implementation of learning needs into the games.
To create a process that makes it easier for teachers and pedagogues to transform a syllabus into competencies and areas of knowledge and develop all the materials and resources needed to teach.
To test the process on a real subject and develop a set of short serious games from the identified competencies and areas of knowledge.
To test the developed short serious games with real students to determine if there is any improvement.
Finally, we can say objectives have been fulfilled given that we created the CBD process and applied it to a real subject, developed a set of short serious games and tested these games with students.
The next step in this research is to use this CBD process to review a bachelor’s degree to ensure this process can be applied in any context.
De Freitas, S., & Jarvis, S. (2006). A framework for developing serious games to meet learner needs. I ’06: Proceedings of the International Conference on Interservice/Industry Training, Simulation and Education.