Micro‐adaptivity: protecting immersion in didactically adaptive digital educational games

The idea of utilizing the rich potential of today's computer games for educational purposes excites educators, scientists and technicians. Despite the significant hype over digital game‐based learning, the genre is currently at an early stage. One of the most significant challenges for research and development in this area is establishing intelligent mechanisms to support and guide the learner, and to realize a subtle balance between learning and gaming, and between challenge and ability on an individual basis. In contrast to traditional approaches of adaptive and intelligent tutoring, the key advantage of games is their immersive and motivational potential. Because of this, the psycho‐pedagogical and didactic measures must not compromise gaming experience, immersion and flow. In the present paper, we introduce the concept of micro‐adaptivity, an approach that enables an educational game to intelligently monitor and interpret the learner's behaviour in the game's virtual world in a non‐invasive manner. On this basis, micro‐adaptivity enables interventions, support, guidance or feedback in a meaningful, personalized way that is embedded in the game's flow. The presented approach was developed in the context of the European Enhanced Learning Experience and Knowledge TRAnsfer project. This project also realized a prototype game, demonstrating the capabilities, strengths and weaknesses of micro‐adaptivity.     

Assessing the educational values of digital games

Abstract   In recent years, digital games have assumed an important place in the lives of children and adolescents. Effective content design is crucial to the success of digital game-based learning. Therefore, the tool for assessing the effectiveness of game design is accordingly very important for parents and teachers, so that they may encourage or discourage students to play. The purpose of this study is to develop an assessment tool to examine the educational values of digital games. In the first phase of this research, the research team developed the indices for assessing the educational values of digital games. An expert panel consisting of game scholars and professional game designers was established to construct the indices for evaluating digital games in three focus group discussions. Seventy-four game evaluation indices were sorted into seven categories: mentality change, emotional fulfilment, knowledge enhancement, thinking skill development, interpersonal skill development, spatial ability development and bodily coordination. In the second phase of the research, the game designers were asked to assess certain games by using the 74 indices. Meanwhile, the game scholars were also asked to evaluate the same pool of games by the same indices. The assessments by both the scholars and designers were then compared and the similarities were found. This research provided a preliminary framework for future game designers, parents and teachers in assessing educational values of digital games.     

Learning adaptivity in support of flipped learning: An ontological problem‐solving approach

In recent years, flipped learning has received tremendous attention from educational practitioners and researchers. However, this study argues that existing e‐learning systems mainly serve for learning management and content delivery purposes, although they lack support for flipped learning. As an innovative educational approach, flipped learning requires more pedagogical elements, such as integrated instructional design and adaptive content delivery, to achieve effective direct instruction. This study aims to create a learning adaptivity design to support effective learning in the flipped individual learning space in which the teacher is absent. Because teaching involves various pedagogical and content knowledge sources, we propose a conceptual model of teaching as a function of the knowledge triad of Guideline (G), Teaching Activity (T), and Material (M). To realize this conceptualization, an ontological problem‐solving approach is used for knowledge‐based systems development to integrate the relevant knowledge sources. The knowledge model is created using the Protégé platform to develop OWL‐based domain ontology, task ontology, and SWRL‐based semantic rules to enable inference in the GTM triad for learning adaptivity. The case illustration shows that the knowledge‐based system prototype can adaptively guide student learning in the flipped individual learning space with the knowledge sources integrated.     

Not just fun, but serious strategies: Using meta-cognitive strategies in game-based learning

The purpose of this study is to explore the effects of the meta-cognitive strategies on the academic and gaming achievements. Exploring the effects of those achievements on the social problem solving of students is also of interest. For this purpose, the MMORPG Gersang was used. The participants, consisting of ninth graders, played the game until they all reached the third level to ensure that they have the same gaming ability prior to gaming for the study. Three meta-cognitive strategies were developed: self-recording, modeling and thinking aloud. Those strategies are specially related to gaming activities and applied in pre-gaming activities, gaming activities, and post-gaming activities. Three meta-cognitive strategies were set as independent variables. The social problem solving ability was set as a mediating variable, and academic achievement and scores in the game were chosen as dependent variables. The path between meta-cognitive strategies and both academic achievement and game performance by mediating social problem solving abilities were discovered. The social problem solving ability, which is the mediating variable, affects the academic achievement and the game performance very strongly. These results imply that a commercial game playing in conjunction with meta-cognitive strategies can be an effective way to increase students’ performance both in learning and gaming by keeping them involved. Talking and observation activities such as thinking aloud and modeling are more effective than writing activities in enhancing the students’ achievements both in learning and gaming.     

Enjoy and learn with educational games: Examining factors affecting learning performance

Educational games have enhanced the value of instruction procedures in institutions and business organizations. Factors that increase students' adoption of learning games have been widely studied in past; however, the effect of these factors on learners' performance is yet to be explored. In this study, factors of Enjoyment, Happiness, and Intention to Use were chosen as important attitudes in learning educational games and increasing learning performance. A two-step between group experiment was conducted: the first study compared game-based learning and traditional instruction in order to verify the value of the game. 41 Gymnasium (middle school) students were involved, and the control and experimental groups were formed based on a pretest method. The second study, involving 46 Gymnasium students, empirically evaluates whether and how certain attitudinal factors affect learners' performance. The results of the two-part experiment showed that a) the game demonstrated good performance (as compared to traditional instruction) concerning the gain of knowledge, b) learners' enjoyment of the game has a significant relation with their performance, and c) learners' intention to use and happiness with the game do not have any relation with their performance. Our results suggest that there are attitudinal factors affecting knowledge acquisition gained by a game.     

Personalising learning: Exploring student and teacher perceptions about flexible learning and assessment in a flipped university course

Flexible teaching and learning and the ‘flipped classroom’ are current buzzwords in higher education in Australia and elsewhere in the world. They are reflections of the progressive change in higher education over the last few decades towards more student-and learning centred pedagogies and practices, which are made possible through new technologies and more delivery of online and blended (combination of face-to-face and online components) courses. The increasing personalising and flexibility of learning in higher education requires equal attention spent to assessment practices to ensure a cohesive learning experience. This paper provides the findings and conclusions of a study about a flipped classroom, which also included flexible assessment components. The study showed that students enjoy and are more engaged in a flipped classroom, prefer a blended learning to a fully online learning approach, want and require clear structure and guidelines, and strongly value flexible assessment through more choices and control. The main concern of higher education teachers is the time commitment and lack of institutional support for flipping classrooms and providing flexible assessment. It is argued that personalising learning requires more personalising of assessment, and that it is mainly the responsibility of teachers and institutions to develop ‘flexible students’.     

Multiplayer online games as educational tools: Facing new challenges in learning

This paper outlines a proposal for the development of educational multiplayer online games based on the activity theory, as an alternative to the current trend in multiplayer gaming and a means of promoting collaboration among students. In order to examine whether online games are engaging for learners, we consider multiple factors regarding game play – such as frequency of game use, gender differences, identification with the characters, and game preferences – as well as some psychosocial factors that may influence learning – such as academic performance, self-esteem, and computer self-efficacy. This paper suggests that online multiplayer educational games should be approached as a complex learning system, based on the principles of activity theory, where the Subjects would interact with other Subjects, Objects and Tools of the game, under specified Rules and create Communities through division of labor, leading to the expected learning outcome. Thus, we suggest taking into account some important issues concerning the Subjects that the activity theory refers to, such as gender differences in playing games, academic performance, self-esteem and computer self-efficacy.     

Mobile game-based learning in secondary education: engagement, motivation and learning in a mobile city game

Using mobile games in education combines situated and active learning with fun in a potentially excellent manner. The effects of a mobile city game called Frequency 1550, which was developed by The Waag Society to help pupils in their first year of secondary education playfully acquire historical knowledge of medieval Amsterdam, were investigated in terms of pupil engagement in the game, historical knowledge, and motivation for History in general and the topic of the Middle Ages in particular. A quasi-experimental design was used with 458 pupils from 20 classes from five schools. The pupils in 10 of the classes played the mobile history game whereas the pupils in the other 10 classes received a regular, project-based lesson series. The results showed those pupils who played the game to be engaged and to gain significantly more knowledge about medieval Amsterdam than those pupils who received regular project-based instruction. No significant differences were found between the two groups with respect to motivation for History or the Middle Ages. The impact of location-based technology and game-based learning on pupil knowledge and motivation are discussed along with suggestions for future research.     

Flow,social interaction anxiety and salivary cortisol responses in serious games: A quasi-experimental study

Serious games are supposed to instigate engagement and, in turn, improve learning. High engagement is frequently connected with a positive affective state and a high flow state. However, the alleged link between a learner’s affective state, his/her flow state and learning outcomes has not been investigated in detail in the context of serious games. Even less information is available on how serious games may influence markers of physiological arousal. To fill this gap, participants of this exploratory study (N = 171) played one of the six different serious game-based treatments, while we measured their affect, flow, cortisol secretion and learning achievement. The treatments were supposed to generate different levels of engagement and cortisol responses, because some of them were designed for a single user, while others were team-based, featuring so-called social-evaluative threat (ST) components. Our results revealed that flow was positively related to positive affect and negatively to negative affect. While flow and positive affect were related to learning gains, almost no relationship between either of these three variables and cortisol levels was found. Negative affect and cortisol were elevated in social interaction anxious males in team-based conditions. This study contributes to the limited body of research on the relationship between engagement and learning in serious games. We provide new perspectives on the relationships between flow, positive/negative affect and cortisol. Our findings highlight the fact that team-based serious games with ST components may have adverse effects on learners, particularly males, with high social interaction anxiety.     

Measuring with Murray: Touchscreen technology and preschoolers' STEM learning

American students rank well below international peers in the disciplines of science, technology, engineering, and mathematics (STEM). Early exposure to STEM-related concepts is critical to later academic achievement. Given the rise of tablet-computer use in early childhood education settings, interactive technology might be one particularly fruitful way of supplementing early STEM education. Using a between-subjects experimental design, we sought to determine whether preschoolers could learn a fundamental math concept (i.e., measurement with non-standard units) from educational technology, and whether interactivity is a crucial component of learning from that technology. Participants who either played an interactive tablet-based game or viewed a non-interactive video demonstrated greater transfer of knowledge than those assigned to a control condition. Interestingly, interactivity contributed to better performance on near transfer tasks, while participants in the non-interactive condition performed better on far transfer tasks. Our findings suggest that, while preschool-aged children can learn early STEM skills from educational technology, interactivity may only further support learning in certain contexts.     

Training and assessing numerical abilities across the lifespan with intelligent systems: The example of Baldo

Baldo is an intelligent system that can be used to assess and train numerical abilities across the lifespan, especially for children and elderly. Baldo includes digital and tangible materials to propose activities, built on the game-based learning approach, strongly grounded on well-known and experimentally supported theories about numerical and mathematical cognition. Moreover, Baldo has a special module devoted to motivational and affective dimensions related to mathematic cognition and a tutoring system to select specific activities that are adequate to the actual and potential level of the people involved in the training pathway.     

Customization in educational computer games and its effect on learning: Experimental study with primary school children

The instructional effects of customization features in child learning games have rarely been examined. This value-added study addresses the existing gap with regards to user-initiated cosmetic customization of environment elements (i.e., non-avatar customization). Participants (N = 143; M_age = 9.41) studied a biological topic for about 20 min: either using the experimental version of a learning game with customization features, or from a control version without them. Null results were found as concerns between-group differences: both for motivation-related variables and learning outcome measures. These findings indicate that user-initiated cosmetic customization features can be omitted by game designers, especially in settings where children are assigned specific instructional materials from which to study.     

The influence of virtual presence: Effects on experienced cognitive load and learning outcomes in educational computer games

Does the immersive design of an educational gaming environment affect learners’ virtual presence and how much do they learn? Does virtual presence affect learning? This study tries to answer these questions by examining the differences in virtual presence and learning outcomes in two different computer-based multimedia environments: a gaming environment with high immersive design vs. hypertext learning environment with low immersive design. As the main focus, the effect of virtual presence on learning is also explained and tested. By identifying virtual presence as a variable that may determine learning, it is argued that computer gaming environments present a new challenge for researchers to investigate, particularly, the effects of virtual presence on the immersive design of games in order to help designers to predict which instructional configurations will maximize learning performance. In general, results revealed that the high-immersive gaming environment leads to the strongest form of virtual presence but also decreased learning. Although regression analyses indicate that virtual presence positively influences trivial- and non-trivial learning outcomes, learners who learned in a low-immersive environment outperformed the gaming group. A mediation analysis showed that the relation between virtual presence and non-trivial learning outcomes is partly mediated through increased cognitive load.     

Laptopers in an educational practice: Promoting the personal learning situation

In this article an ethnographical study of laptopers’ activities during lectures in a university milieu is analyzed as different kinds of involvements. Through interviews and observations we have focused on how these involvements influence the laptopers’ alignment towards the educational practice. The analysis shows the importance of separating the educational practice and the personal learning situation. Studying students’ learning intentions, rather than certain laptop related activities, we get a deeper understanding of the role the laptop can take during learning activities. Five general characteristics of laptoping are found. Negotiating the laptops’ different roles in the educational practice opens up for an understanding of the students personal learning situation as being more than just listening to a lecturer. Additionally, competent integration of digital tools into the learning situation extends the dimensions of the lecture beyond the lecturing hours and personal note taking. Such knowledge is vital for creating foundations for digital competency in a digitized society.     

Building virtual cities,inspiring intelligent citizens: Digital games for developing students’ problem solving and learning motivation

This study investigates the effectiveness digital game-based learning (DGBL) on students’ problem solving, learning motivation, and academic achievement. In order to provide substantive empirical evidence, a quasi-experimental design was implemented over the course of a full semester (23 weeks). Two ninth-grade Civics and Society classes, with a total of 44 students (15–16 years old), were randomly assigned to one of two conditions: an experimental group (incorporating DGBL) and a comparison group (taught using traditional instruction). Two-way mixed ANOVA was employed to evaluate changes in problem solving ability and compare the effectiveness the two strategies, while ANCOVA was used to analyze the effects on learning motivation and academic achievement. The results of this study are summarized as follows: (1) The DGBL strategy was clearly effective in promoting students’ problem solving skills, while the control group showed no improvement. Additionally, data from the mid-test and post-test demonstrate that, as a higher order thinking skill, problem-solving requires a full semester to develop. (2). DGBL resulted in better learning motivation for students in the experimental group as compared to learners receiving TI. (3) Contrary to some suggestions that digital games could inhibit academic achievement, no statistically significant difference was found between the two groups. Most importantly, the quantitative improvement in problem-solving and learning motivation suggest that DGBL can be exploited as a useful and productive tool to support students in effective learning while enhancing the classroom atmosphere. Future research in DGBL should emphasize the evaluation of other higher order elements of the cognitive domain in terms of academic achievement outcomes and skills, such as critical and creative thinking.     

Student interactions in online discussion forums: their perception on learning with business simulation games

Digital technology offers new teaching methods with controversial results over learning. They allow students to develop a more active participation in their learning process although it does not always drive to unequivocal better learning outcomes. This study aims to offer additional evidence on the contribution of business simulation games to students’ learning outcomes, considering student interactions in online discussion forums. We conducted a qualitative research with the online discussion forums of 5 different courses at bachelor and master levels, which involves 41 students’ teams. The final sample was composed of 3681 messages posted by the students. The results reveal that some generic and specific managerial skills exert a positive influence on learning outcomes. Students mostly highlighted teamwork, decision-making, information processing, reaching agreements, and dealing with uncertainty as the most relevant contributions of the game towards their learning. These results have instructional and pedagogical implications for determining the best way to enhance students’ motivation and learning outcomes when using digital technology methods, which involves recommendations that affect their design and monitoring.     

An implementation of design-based learning through creating educational computer games: A case study on mathematics learning during design and computing

This mixed-method case study examined the potential of computer-assisted, math game making activities in facilitating design-based math learning for school children. Sixty-four middle school children participated in Scratch-based, math game making activities. Data were collected via activity and conversation observation, artifact analysis, interviewing, and survey. The study findings indicated that participants developed significantly more positive dispositions toward mathematics after computer game making. The study also found that experience-driven game design processes helped to activate children's reflection on everyday mathematical experiences. Mathematical thinking and content experience were intertwined within the process of computer game authoring. On the other hand, children designers were involved in game-world and story crafting more than mathematical representation. And it was still challenging for them to perform computer game coding with abstract reasoning.     

All work and no play: Measuring fun,usability, and learning in software for children

This paper describes an empirical study of fun, usability, and learning in educational software. Twenty five children aged 7 and 8 from an English primary school participated. The study involved three software products that were designed to prepare children for government initiated science tests. Pre and post tests were used to measure the learning effect, and observations and survey methods were used to assess usability and fun. The findings from the study demonstrate that in this instance learning was not correlated with fun or usability, that observed fun and observed usability were correlated, and that children of this age appeared to be able to differentiate between the constructs used to describe software quality. The Fun Sorter appears to be an effective tool for evaluating products with children. The authors discuss the implications of the results, offer some thoughts on designing experiments with children, and propose some ideas for future work.     

Learning immunology in a game: Learning outcomes,the use of player characters,immersion experiences and visual attention distributions

This study contributed to the current body of literature on game-based learning by investigating the way playing an educational game, Humunology, affected learning about the immune system and examining further the association between game immersion and visual attention distribution. A total of 79 undergraduate and graduate students participated, and data were collected both in situ and ex situ. The results showed that the students learned through playing Humunology, and the analyses of the use of player characters indicated that the game design facilitated gameplay behaviours that are consistent with the science content. The use of the eye-tracking method also revealed that students who were more immersed in playing Humunology paid more attention to areas related to player characters. The interpretations and limitations are discussed further.