Challenging games help students learn: An empirical study on engagement,flow and immersion in game-based learning

In this paper, we investigate the impact of flow (operationalized as heightened challenge and skill), engagement, and immersion on learning in game-based learning environments. The data was gathered through a survey from players (N = 173) of two learning games (Quantum Spectre: N = 134 and Spumone: N = 40). The results show that engagement in the game has a clear positive effect on learning, however, we did not find a significant effect between immersion in the game and learning. Challenge of the game had a positive effect on learning both directly and via the increased engagement. Being skilled in the game did not affect learning directly but by increasing engagement in the game. Both the challenge of the game and being skilled in the game had a positive effect on both being engaged and immersed in the game. The challenge in the game was an especially strong predictor of learning outcomes. For the design of educational games, the results suggest that the challenge of the game should be able to keep up with the learners growing abilities and learning in order to endorse continued learning in game-based learning environments.     

Impacts of behavioral engagement and self-monitoring on the development of mental models through serious games: Inferences from in-game measures

The present study investigated the potential of serious games for the acquisition of complex cognitive skills by assessing learners’ mental model development, operationalized as an increase in Mental Model Accuracy (MMA). Furthermore, we assessed behavioral engagement and self-monitoring as two specific engagement types within the gameplay process and analyzed their impact on mental model development. German undergraduate students (N = 97) played a serious game developed to foster practical money skills. We obtained pre- and post-gaming measures of MMA to analyze the development of mental models by applying a structural assessment method. Unobtrusive measures of behavioral engagement and self-monitoring were obtained by computerized collection of participants’ in-game activities. Although we did not find a significant increase in overall MMA through playing, the degree of self-monitoring had a significant and positive effect on post-gaming MMA, even beyond the effect of initial MMA. Behavioral engagement had no impact on mental model development; however, it was positively related to self-monitoring behavior. The results are discussed in light of findings from research on self-regulated learning and controversial notions regarding the effect of behavioral engagement in serious games. In addition to insights into gameplay processes that affect mental model development through serious games, the present study also has practical implications in stressing the importance for game designers to provide learners with the opportunity to engage in self-monitoring behavior while playing a serious game.     

Flow,social interaction anxiety and salivary cortisol responses in serious games: A quasi-experimental study

Serious games are supposed to instigate engagement and, in turn, improve learning. High engagement is frequently connected with a positive affective state and a high flow state. However, the alleged link between a learner’s affective state, his/her flow state and learning outcomes has not been investigated in detail in the context of serious games. Even less information is available on how serious games may influence markers of physiological arousal. To fill this gap, participants of this exploratory study (N = 171) played one of the six different serious game-based treatments, while we measured their affect, flow, cortisol secretion and learning achievement. The treatments were supposed to generate different levels of engagement and cortisol responses, because some of them were designed for a single user, while others were team-based, featuring so-called social-evaluative threat (ST) components. Our results revealed that flow was positively related to positive affect and negatively to negative affect. While flow and positive affect were related to learning gains, almost no relationship between either of these three variables and cortisol levels was found. Negative affect and cortisol were elevated in social interaction anxious males in team-based conditions. This study contributes to the limited body of research on the relationship between engagement and learning in serious games. We provide new perspectives on the relationships between flow, positive/negative affect and cortisol. Our findings highlight the fact that team-based serious games with ST components may have adverse effects on learners, particularly males, with high social interaction anxiety.     

A multilevel analysis of the effects of external rewards on elementary students' motivation,engagement and learning in an educational game

This study investigated the effects of external rewards on fifth graders' motivation, engagement and learning while playing an educational game. We were interested in exploring whether the feedback-rich environment of the game could mitigate the predicted negative effects of external rewards. Data of students' engagement and learning were collected and analyzed at multiple levels. A quasi-experimental design was used to examine the effect of external rewards in one group (n = 50) compared to a control group without such rewards (n = 56). According to the results, the external rewards did not undermine students' motivation (e.g., at proximal and distal levels), however they did not foster disciplinary engagement. On the other hand, students in the reward condition showed significantly larger gains in conceptual understanding (proximal) and non-significantly larger gains in achievement (distal). These results suggest that the predicted negative consequences of external rewards may be addressed in this new generation of learning environments. Future research and contributions of the study are provided.     

Play games or study? Computer games in eBooks to learn English vocabulary

This study investigated how Chinese undergraduate college students studying English as a foreign language learned new vocabulary with inference-based computer games embedded in eBooks. The investigators specifically examined (a) the effectiveness of computer games (using inferencing) in eBooks, compared with hardcopy booklets for vocabulary retention, and (b) the relationship between students' performance on computer games and performance on a vocabulary test. A database recorded students' game playing behaviors in the log file. Students were pre- and post-tested on new vocabulary words with the Vocabulary Knowledge Scale. Participants learned significantly more vocabulary (p < .0005) in the computer game condition (web-based text and computer games) than in the control condition (their usual study method, hardcopy text, lists of words and multiple-choice questions). Students' scores in the games correlated significantly with their vocabulary post-test scores (r = .515, p < .01).     

Situational determinants of cognitive,affective, and compassionate empathy in naturalistic digital interactions

Empathy is apparent in computer-mediated communication (CMC), yet little is known about the situational predictors of empathic responses when interacting digitally. We used a diary methodology to explore: (1) the degree three types of empathy (cognitive, affective, and compassionate) are experienced in students' everyday (text- and image-based) dyadic digital interactions; (2) which situational factors are important for (different types of) empathy in CMC; and (3) how empathy reported in everyday CMC affects participants' perceptions of their empathy in CMC and face-to-face (FtF) contexts. One hundred student volunteers (50 women, M_age = 22.57 years) completed a “digital interaction diary” for three consecutive days, yielding 1939 observations. Participants reported significantly more cognitive than affective empathy, and significantly greater affective than compassionate empathy. Several situational variables (e.g., number of communications, recipient) were related to empathy overall, while others (e.g., subject, mood) contributed to discrete contextual profiles for the empathy subtypes. Empathy reported in the diaries predicted a more favourable ratio of perceived CMC to FtF empathy, particularly for those lower in baseline trait empathy. These findings help elucidate the multidimensional experience of empathy in CMC interactions.     

Learning and engagement in a gamified course: Investigating the effects of student characteristics

The current study investigated college students' experiences of a gamified informatics course. We surveyed 139 students aged 18–31 years (M = 20 years, SD = 1.5) enrolled in an undergraduate informatics course focused on social networking technologies. Surveys were conducted at 3 time points during the course (beginning, middle, and end). Overall, we found positive trends with respect to students' perceptions of gamification's impact on their learning, achievement, and engagement in the course material. Although students who played and identified variously with recreational games were more alike than not, we did uncover one notable difference with respect to how students' gaming frequency impacted their engagement in the course. Nongamers expressed somewhat less motivation to do well in the course than frequent gamers. For all other measures of engagement, however, nongamers appeared to be equally engaged by the gamified format of the course as gamers. There were virtually no differences between male and female students' perceptions of gamification. This study contributes new insight into the conditions under which gamification succeeds or fails in educational settings. These insights will be useful to designers and instructors of gamified learning environments as they seek to engage and support a variety of learners.     

Content structure is king: An empirical study on gratifications,game genres and content type on Twitch

While video games have been widely investigated from the perspective of play, an emerging online media phenomenon is the spectating of video game play, captivating millions of users daily. This study investigates the relationship of video game genres, content type and viewer gratification in the context of live gaming. To study this phenomenon, we employ an online questionnaire study (N = 1097) to investigate six categories of gratifications: affective, information seeking, learning to play, personal integrative, social integrative & tension release motivations and their relationship with game genres and stream types. The results of this study demonstrate that “the medium is the message”, highlight the importance of archetypal structure (i.e. the type of streamed content) over content topic (i.e. the genre of games being streamed), and help to build a better understanding of user generated content and the democratization of media.     

How teachers integrate a math computer game: Professional development use,teaching practices,and student achievement

As more attention is placed on designing digital educational games to align with schools' academic aims (e.g., Common Core), questions arise regarding how professional development (PD) may support teachers' using games for instruction and how such integration might impact students' achievement. This study seeks to (a) understand how teachers use PD resources (e.g., technology personnel and game‐use workshops) for integration; (b) determine how teachers integrate games into their instruction; and (c) examine how those teaching practices are associated with student achievement. This mixed method study used survey and interview responses from elementary school teachers (n = 863) with access to PD resources for implementing a math game intervention and standardized math‐test scores from their second‐ through sixth‐grade students (n = 10,715). Findings showed few teachers sought PD assistance for integration, but many desired such support. Some reported using integrative practices (i.e., referencing game and using game‐generated progress reports) to identify struggling students, whereas several found integration challenging. Teachers' reordering of game objectives to align with lessons and viewing of game‐based PD videos were associated with increased student math achievement in our OLS‐analysis. However, this result was no longer statistically significant within a school fixed‐effects model, suggesting school differences may influence how strongly teachers' practices are associated with student achievement.     

Using blogs to support learning during internship

Blogging has been recommended as a suitable tool for learning during internship due to its associated usefulness in collaborative learning, reflection, communication, and social support. In this study, blogging was incorporated into the internship activities of two discipline-specific groups of interns: information management (n = 53) and nursing (n = 28). In examining the behavior, perceptions and processes of blogging among interns from the two disciplines, a mixed-methods design was used to obtain quantitative and qualitative data through structured interviews and blogging entries. Results revealed that the interns engaged regularly in the writing and reading of their own blogs, and commented on others’ blog-writing. The interns perceived blogs to be useful during internship in providing an avenue for knowledge construction, problem solving, reflection, and communicating their emotions. Positive perceptions were not influenced by discipline background, frequency of use, or blogging platform. Qualitative analyses of blog contents indicated that the students engaged in cognitive, metacognitive-reflective, affective, and social-collaborative learning processes in blogging. Higher engagement was found in cognitive and metacognitive processes. Responses to open-ended probes suggest that pedagogical factors (e.g., grading system, supervision) may also have influenced students’ blogging behaviors and perceptions. Overall, this study offers evidence to support the use of blogging during internship as computer-based support for learning.     

Let’s play together: Effects of video-game play on intergenerational perceptions among youth and elderly participants

In this paper, we report on a longitudinal study that investigates the effects of video-game play on intergenerational perceptions amongst youths and the elderly after participating in a program involving regular interaction sessions over two months. Each pair of participants, consisting of one youth and one elderly, was randomly assigned to either the video-game condition (n = 38, 19 from each age group) or the non-video-game condition (n = 36, 18 each). Attraction, intergroup anxiety, attitudes, and game enjoyment were measured through pre-test and post-test surveys to investigate changes in perceptions. Results showed that participants in the video-game condition reported more positive changes in intergroup anxiety and attitudes, compared to participants in the non-video-game condition. Mediation analyses showed that specific attraction towards their interaction partner mediated the effects of video-game play on attitudes and intergroup anxiety towards the general members of the other age group. In addition, the results showed that game enjoyment played an important role in developing positive intergenerational perceptions only for the elderly, but not for the youth participants in the video-game condition. We discuss implications with respect to options to enhance intergenerational perceptions and communication for youth and elderly cohorts in today’s hyper-ageing society.     

Exploring the influence of game design on learning and voluntary use in an online vascular anatomy study aid

This research explores the educational impact of an online study aid-game for studying human vascular anatomy (n = 24) versus a similar non-game study aid (n = 22) and how it relates to medical students' demographic traits and voluntary use over a 35-day period. Hierarchical linear regression models revealed that study aid success rate (a metric for assessing performance through the study aids) was a significant predictor of anatomy test improvement with the game (β = 0.41, p = 0.05), but not for the non-game (β = 0.14, p = 0.56). Our analyses suggest that game mechanics encouraged more specific problem-solving strategies than did the control study aid, leading to greater predictability of learning outcomes. There was a non-significant trend among game treatment participants, who were more likely to complete study tasks than those assigned to the control treatment (p = 0.11). It would appear that students' studying habits had the greatest influence (though opposite in both tools) on level of engagement in study aid use. However, contrary to expectations, self-reported gaming habits did not impact participation. Overall, these findings support the integration of game design into undergraduate study aids as a means of increasing use of supplementary educational tools and assessing knowledge.     

The interplay between immersion and appeal in video games

Immersion and appeal are considered to be necessary constituents of the player experience. In this article their relationship is examined through a 2 × 2 factorial study (n = 173) in the context of two games, a first-person shooter and a massively multi-player online role-playing game, and in the context of two types of players: experienced players who have never played the game in one of the genres in question, and experienced players who have played one of the games in question. It is found that immersion and appeal are linearly correlated, and the repercussions of this finding are discussed.     

Sexism in online video games: The role of conformity to masculine norms and social dominance orientation

Sexism toward women in online video game environments has become a pervasive and divisive issue in the gaming community. In this study, we sought to determine what personality traits, demographic variables, and levels of game play predicted sexist attitudes towards women who play video games. Male and female participants (N = 301) who were players of networked video games were invited to participate in an anonymous online survey. Social dominance orientation and conformity to some types of masculine norms (desire for power over women and the need for heterosexual self-presentation) predicted higher scores on the Video Game Sexism Scale (i.e., greater sexist beliefs about women and gaming). Implications for the social gaming environment and female gamers are discussed.     

Effects of constructing versus playing an educational game on student motivation and deep learning strategy use

In this study the effects of two different interactive learning tasks, in which simple games were included were described with respect to student motivation and deep strategy use. The research involved 235 students from four elementary schools in The Netherlands. One group of students (N = 128) constructed their own memory ‘drag and drop’ game, whereas the other group (N = 107) played an existing ‘drag and drop’ memory game. Analyses of covariance demonstrated a significant difference between the two conditions both on intrinsic motivation and deep strategy use. The large effect sizes for both motivation and deep strategy use were in favour of the construction condition. The results suggest that constructing a game might be a better way to enhance student motivation and deep learning than playing an existing game. Despite the promising results, the low level of complexity of the games used is a study limitation.     

Do emotions matter in technology training? Exploring their effects on individual perceptions and willingness to learn

Due to the growing importance of enterprise resource planning (ERP) systems in organizations today, many universities and corporate training programs now incorporate such systems into their curricula using novel tools, such as ERP simulation games. To improve the understanding of individuals' learning patterns, we extend prior cognition based models by incorporating emotions. Moreover, we highlight the role of perceived radicalness, which mediates the relationship between emotions and individuals' willingness to learn. The proposed research model draws from the appraisal tendency framework and includes four distinct classes of emotions: challenge, achievement, loss, and deterrence. The model was tested via a lab experiment in which participants (N = 145) played an ERP simulation game. The hypothesized links were tested using structural equation modeling. Anger and excitement were negatively associated with perceived radicalness. Anxiety was positively associated with perceived radicalness and the positive effect of happiness on perceived radicalness was insignificant. Finally, perceived radicalness was positively related to individuals' willingness to learn. Results indicate that perceived radicalness is an important mechanism via which classes of emotions impact students' ERP learning behaviors. In addition, negative emotions have greater effects on radicalness perceptions compared to positive emotions.     

A case study of computer gaming for math: Engaged learning from gameplay?

Employing mixed-method approach, this case study examined the in situ use of educational computer games in a summer math program to facilitate 4th and 5th graders’ cognitive math achievement, metacognitive awareness, and positive attitudes toward math learning. The results indicated that students developed more positive attitudes toward math learning through five-week computer math gaming, but there was no significant effect of computer gaming on students’ cognitive test performance or metacognitive awareness development. The in-field observation and students’ think-aloud protocol informed that not every computer math drill game would engage children in committed learning. The study findings have highlighted the value of situating learning activities within the game story, making games pleasantly challenging, scaffolding reflections, and designing suitable off-computer activities.     

Effectiveness of virtual reality-based instruction on students' learning outcomes in K-12 and higher education: A meta-analysis

The purpose of this meta-analysis is to examine overall effect as well as the impact of selected instructional design principles in the context of virtual reality technology-based instruction (i.e. games, simulation, virtual worlds) in K-12 or higher education settings. A total of 13 studies (N = 3081) in the category of games, 29 studies (N = 2553) in the category of games, and 27 studies (N = 2798) in the category of virtual worlds were meta-analyzed. The key inclusion criteria were that the study came from K-12 or higher education settings, used experimental or quasi-experimental research designs, and used a learning outcome measure to evaluate the effects of the virtual reality-based instruction.Results suggest games (FEM = 0.77; REM = 0.51), simulations (FEM = 0.38; REM = 0.41), and virtual worlds (FEM = 0.36; REM = 0.41) were effective in improving learning outcome gains. The homogeneity analysis of the effect sizes was statistically significant, indicating that the studies were different from each other. Therefore, we conducted moderator analysis using 13 variables used to code the studies. Key findings included that: games show higher learning gains than simulations and virtual worlds. For simulation studies, elaborate explanation type feedback is more suitable for declarative tasks whereas knowledge of correct response is more appropriate for procedural tasks. Students performance is enhanced when they conduct the game play individually than in a group. In addition, we found an inverse relationship between number of treatment sessions learning gains for games.With regards to the virtual world, we found that if students were repeatedly measured it deteriorates their learning outcome gains. We discuss results to highlight the importance of considering instructional design principles when designing virtual reality-based instruction.     

Teacher-created video instruction in the elementary classroom—Its impact on students and teachers

Despite the proliferation of multimedia devices in elementary classrooms, there is limited research examining teacher-created video instruction, particularly regarding its effect on academic growth and engagement. This study investigated the effect of teacher-created computer-based video instruction (CBVI) using iPads on students' academic, behavioural and affective learning in elementary classrooms. The study used a repeated-measures design with counterbalancing to measure the effects of CBVI during mathematics lessons on student achievement scores, time on-task and attitudes towards learning. Three year three classes (n = 49) completed three lessons, each using a different mode of instruction: CBVI created by the class teacher, CBVI created by a stranger, and a traditional live lesson delivered by the class teacher. Results were analysed using a Linear Mixed Model. No significant growth in performance was detected during video instruction, however a significant growth result was achieved for the traditional live teaching mode (p < 0.001), possibly attributable to the longer duration of experimental session. Behavioural engagement was considerably higher during CBVI lessons than live lessons and students preferred their teacher's voice during CBVI. Three teachers were interviewed to examine how CBVI affected teaching and learning, with two main themes emerging: (1) positive impacts of CBVI upon students; and (2) positive impacts on teacher wellbeing. This research indicates benefits for students and teachers when using teacher-created CBVI. Further research is needed to better understand the factors that influence cognitive development of students using CBVI and to also further explore the effect of CBVI on teacher wellbeing.