Does peer assessment promote student learning? A meta-analysis

Abstract

In recent years, there has been an increasing use of peer assessment in classrooms and other learning settings. Despite the prevailing view that peer assessment has a positive effect on learning across empirical studies, the results reported are mixed. In this meta-analysis, we synthesised findings based on 134 effect sizes from 58 studies. Compared to students who do not participate in peer assessment, those who participate in peer assessment show a .291 standard deviation unit increase in their performance. Further, we performed a meta-regression analysis to examine the factors that are likely to influence the peer assessment effect. The most critical factor is rater training. When students receive rater training, the effect size of peer assessment is substantially larger than when students do not receive such training. Computer-mediated peer assessment is also associated with greater learning gains than the paper-based peer assessment. A few other variables (such as rating format, rating criteria and frequency of peer assessment) also show noticeable, although not statistically significant, effects. The results of the meta-analysis can be considered by researchers and teachers as a basis for determining how to make effective use of peer assessment as a learning tool.     

Assessment training effects on student assessment skills and task performance in a technology-facilitated peer assessment

This study examines the impact of an assessment training module on student assessment skills and task performance in a technology-facilitated peer assessment. Seventy-eight undergraduate students participated in the study. The participants completed an assessment training exercise, prior to engaging in peer-assessment activities. During the training, students reviewed learning concepts, discussed marking criteria, graded example projects and compared their evaluations with the instructor’s evaluation. Data were collected in the form of initial and final versions of students’ projects, students’ scoring of example projects before and after the assessment training, and written feedback that students provided on peer projects. Results of data analysis indicate that the assessment training led to a significant decrease in the discrepancy between student ratings and instructor rating of example projects. In addition, the degree of student vs. instructor discrepancy was highly predictive of the quality of feedback that students provided to their peers and the effectiveness of revisions that they made to their own projects upon receiving peer feedback. Smaller discrepancies in ratings were associated with provision of higher quality peer feedback during peer assessment, as well as better revision of initial projects after peer assessment.     

基于同侪互评的在线学习评价研究综述

在线同侪互评是一种形成性评价策略。它通过学习者之间相互给予评分或反馈来改善学习成果,对学习者的学习成绩、态度及高阶思维能力等方面能够产生重要的影响。首先回顾了近10年来国际在线同侪互评的主要文献．从概念与内涵、程序与方法、系统与工具,以及效果与影响等四个方面综述了现有研究成果。而后,展望未来研究可能聚焦于：同侪互评与其他网络教学策略整合、同侪互评与教师评价结合运用、同侪评语分析等主题。     

英语专业一年级学生学习策略与学习成绩的相关性研究

近年来,学习策略的研究逐渐发展成熟,学习策略的使用可以提高语言学习的成效。本文调查了英语专业一年级105名学生的学习策略择用状况,分析了学习策略运用与学习成绩的相关性。研究主要采用问卷调查,并将学习策略的运用与各科英语课程的学年期末考试成绩作相关分析,其结果表明学生使用频率最高的是情感策略,性别在单词记忆、词语运用、寻求帮助和英语提问等方面的策略择用上具有显著差异,学习策略运用仅与综合英语成绩有相关性,而对其他课程没有任何影响。本研究结果将为教师的教学改革提供参考和启示。     

外语写作过程中同学互评的实验研究

英语写作评改是英语过程写作的重要组成部分。本文对本校不同类学生互评写作的教学及实践进行对比、分析和研究。结果表明：在英语过程写作教学中广泛应用互评技能确实从多方面丰富了英语写作课堂教学,而且写与改相结合的教学不但激发了学生写作兴趣,也使他们的写作效果有了极大的改观与提高。     

Bring your own device – a snapshot of two Australian primary schools

Background: The use of 1:1 and Bring Your Own Device strategies in schools is in its infancy and little is known about how mobile devices such as tablets are being used to support educational practice.

Purpose: In this article, two suburban primary schools in Sydney, Australia were focused on with an aim to understand how mobile device strategies were developed and implemented and how the devices were being used in the schools.

Design and method: This qualitative study uses a case study method. It draws upon questionnaires, interviews and classroom observations, and builds upon previous research in English and Australian schools.

Findings: Results of the research indicate that the devices have only recently been incorporated into the school and suggest that their usage has been generally embraced by both school staff and parents. Key issues highlighted by these two schools included the importance of the school’s vision and uncertainty about the differences between models of provision. Participant responses also referenced some positive impacts on classroom practice, which amplify constructivist pedagogy: there were examples of device use extending student learning by supporting peer assessment, collaboration, research skills and projects.     

An empirical review of anonymity effects in peer assessment,peer feedback,peer review,peer evaluation and peer grading

Abstract

Peer assessment has proven to have positive learning outcomes. Importantly, peer assessment is a social process and some claim that the use of anonymity might have advantages. However, the findings have not always been in the same direction. Our aims were: (a) to review the effects of using anonymity in peer assessment on performance, peer feedback content, peer grading accuracy, social effects and students’ perspective on peer assessment; and (b) to investigate the effects of four moderating variables (educational level, peer grading, assessment aids, direction of anonymity) in relation to anonymity. A literature search was conducted including five different terms related to peer assessment (e.g., peer feedback) and anonymity. Fourteen studies that used a control group or a within group design were found. The narrative review revealed that anonymous peer assessment seems to provide advantages for students’ perceptions about the learning value of peer assessment, delivering more critical peer feedback, increased self-perceived social effects, a slight tendency for more performance, especially in higher education and with less peer assessment aids. Some conclusions are that: (a) when implementing anonymity in peer assessment the instructional context and goals need to be considered, (b) existent empirical research is still limited, and (c) future research should employ stronger and more complex research designs.     

Developing an Eating Disorder Peer Advocate Program on Campus: A Report on the Eating Disorder Awareness and Advocacy Program (EDAAP)

ABSTRACT

This article describes the development and implementation of a peer advocate program for eating disorders and body image outreach on a college campus. Empirical and conceptual literature on the use of peer educators and peer advocates in college student mental health is reviewed. Peer advocate program mission, history, implementation, and training components are described. Learning outcome assessment findings of peer advocate learning are discussed. A counseling center perspective on benefits, challenges, and limitations of facilitating this peer advocate program is shared.     

Peer groups and behaviour problems

Abstract

The study evaluated the effect of a programme for elementary school students with behaviour problems integrated into the regular classroom. The programme combined in-class social skills training and specific educational activities with peers, namely cooperative learning and tutoring by a prosocial peer. The innovative aspect is that the social status and affiliations of children with behaviour problems are key components in the matching of children during peer support. The goal is to improve social behaviour and to change peer perception through interventional strategies, therefore improving social reputation. Pre-test/post-test control group design was used. Results from traditional analysis indicated no significant difference between treatment and control groups after the programme. A modest effect size showed a relative improvement for students with behavioural disorders who participated in social skills training. Results are discussed in terms of the role of friends in the intervention programme.     

Effects of flipped classrooms integrated with MOOCs and game-based learning on the learning motivation and outcomes of students from different backgrounds

ABSTRACT

This study aimed to investigate the effect of flipped classrooms integrated with massive open online courses (MOOCs) and game-based learning on the learning motivation and learning outcomes of students from different backgrounds (in terms of gender, grade, self-confidence indicators in mathematics, and roles played in the game-based learning process). Surveys and a semi-structured open questionnaire were used for data collection, including a basic information questionnaire (to understand the participants’ backgrounds), a questionnaire on learning motivation (the Motivated Strategies for Learning Questionnaire, MSLQ), a test of learning achievements in mathematics, and a semi-structured open-ended questionnaire (to understand the learners’ feelings). Quantitative analysis results showed that flipped classrooms integrated with MOOCs and game-based learning can enhance students’ learning motivation and outcomes. Specifically, compared with students with high self-confidence in learning mathematics, students with low and medium levels of self-confidence showed significantly greater improvement in overall learning motivation. Significantly more enhancements were found for the expectation component of “soldiers” (students with relatively lower learning achievements) than for “generals” (students with higher learning achievements). Furthermore, students in the eighth grade showed significantly greater progress in academic performance than did students in the seventh grade.     

Scaffolding strategies for wiki‐based collaboration: Action research in a multicultural Japanese language program

Wikis can be used to encourage and support collaborative constructivist learning. However, their effectiveness depends upon the use of scaffolding strategies to guide the students in their use. This action research investigated three scaffolding strategies for wiki‐based multicultural Japanese language learning: worked examples, grouping and peer assessment. It was found that the use of a template explaining the learning objectives and expected learning process was more effective than detailed worked examples. It was also found that heterogeneous grouping and internal and external peer review were important factors and that wiki‐based collaborative learning can be culture laden and in conflict with traditional teaching and learning.     

‘Just enough to make you take it seriously’: exploring students’ attitudes towards peer assessment

The use of peer learning and peer assessment has gained considerable interest in higher education driven by both its educational value and by its ability to provide students with the opportunity to develop important transferrable skills. This paper reports on the use of peer learning and peer assessment with a cohort of four-year undergraduate physiotherapy students and an 18 month taught post-graduate teacher education programme. The study observed the students’ engagement in the process, surveyed their opinions on the activity at the end of the experience and conducted one focus group discussion with a subset of students from each cohort. The study found that the vast majority of respondents felt that the experience was valuable and enjoyable. However, when asked to indicate whether it was a fairer method of assessment there were more varied responses. Similarly when asked whether their peers should have a greater say in their overall grade the majority disagreed. Views on the educational value of the experience appeared to differ between the two cohorts of students. The study highlights the influence of a prevailing assessment cultures on students’ engagement in peer learning which requires consideration when including such pedagogical approaches.     

Peer assessment effects on the self-assessment process of first-year undergraduates

Peers carry potential in enhancing students’ self-assessment development, but few studies have explored how peer scaffolding is enacted in the process. This qualitative study explores peer assessment effects on the self-assessment process of 11 first-year undergraduates and the factors limiting peer influence. Drawing on the data from students’ journals, follow-up interviews, observations of in-class formative peer assessment activities and teacher interviews, we ascertained that peers could aid the self-assessment process by enriching student understanding of quality, refining subjective judgement and deepening self-reflection. Yet, peer influence could be reduced by distrust, tensions in feedback communication, competition and lack of readiness for peer learning. Implications for effective use of peers in supporting self-assessment development are discussed.     

The impact of an alternative professional development model on teacher practices in formative assessment and student learning

Among contemporary means of enhancing student learning, formative assessment is perhaps one of the most important and effective. While formative assessment ideas and practices have been shown to have a proven record enhancing student learning, these practices are slow to be fully integrated into teachers’ day-to-day classroom practices. This study describes a collaborative effort among university faculty and public school partners to train teachers in the skills and practices of formative assessment. Regarding teachers’ involvement in the formative assessment professional development, findings highlight that 1) teachers’ participation in the professional development efforts did strengthen their understanding of both general knowledge of formative assessment and the use of formative assessment practices, 2) teachers’ plans to use the strategies in the future were related to their understanding of these strategies, and 3) in-depth and comprehensive understanding of formative assessment practices were critical to concrete applications of such practices in their classrooms. With respect to the impact on student learning, an overall effect size of .41 was found for teachers who utilized a formative assessment strategy compared with district averages for similar learning objectives when the practices were not used.     

English as a symbol of internationalization in higher education: a case study of Vietnam

Vietnam universities have experienced remarkable changes brought about by their internationalization policies. The switch to English as a medium of instruction (EMI) for some academic programs was one of these critical changes. Literature has reported numerous issues related to EMI, including inadequate language proficiency of teaching staff. This paper looks at a qualitative research study on how a government university from Vietnam employs different strategies to enhance teachers’ English proficiency. The study reveals that the introduction of new supporting systems, assessment bodies, recruitment criteria and institutional strategies on training, monitoring and motivation have created cultural change within the teacher community. This cultural change, which includes elements such as self-directed learning, peer learning, professionalism, and ‘open-to-change’ attitudes, has been perceived by both leaders and teachers to be conducive to teachers’ language learning. The findings presented in this paper seek to contribute to the formulation or adjustment of policies related to educational reforms, such as curriculum reform, teacher recruitment and teacher professional development in non-English-speaking countries.     

Assessment and the co-regulation of learning in the classroom

ABSTRACT

This paper examines the processes of regulation of student learning that are associated with formative assessment in the classroom. It discusses the concept of co-regulation and presents a model of co-regulation developed in a situated perspective on classroom learning. This model conceptualises co-regulated learning as resulting from the joint influence of student self-regulation and of sources of regulation in the learning environment: namely, the structure of the teaching/learning situation, the teacher’s interventions and interactions with students, the interactions between students, and the tools used for instruction and for assessment. Examples of research showing how co-regulation functions are discussed, in particular students’ use of tools for self-assessment and peer assessment, and the role of teacher–student interactions that encourage active student participation in formative assessment.     

促进学习的评价:在线开放课程中同伴互评投入度研究

后疫情时代,提质增效是在线开放课程内涵式发展的重要抓手。重申促进学习的评价,强调学习者的深度参与,探究学习者参与同伴互评的特点及现存问题具有重要的现实意义。文章基于国内一门在线开放课程,采用学习分析技术从结构化与非结构化数据入手,分析在线开放课程同伴互评过程中学习者的投入度,并进一步探究同伴互评投入度与学习绩效的关系。研究结果表明,在线开放课程中学习者同伴互评的行为投入及认知投入不高,但是参与同伴互评能够识别更有动力通过课程的学习者,且其认知投入度能够预测其学习绩效。基于FBM(学习行为模型)模型提出促进同伴互评投入度的两阶段干预策略,从而提高学习者参与同伴互评的投入度,并为教师及平台提供更具针对性的策略建议。     

'In Most Classes You Sit Around Very Quietly at a Table and get Lectured at…': Debates,assessment and student learning

This paper details a collaborative action research enquiry undertaken while both authors worked at the University of Glasgow. It explores the use of class debates as a teaching method in an International Management Honours course as the framing context for developing students' capacity to assess their own and each other's learning through the debates. In addition, issues of assessment for grading purposes are signalled and explored with the students. The collaborating partners in the study were a Management Studies lecturer and a Higher Education Studies lecturer, who worked together on the framework for the debates, reflected on the unfolding process together, and collected and analysed evidence. This case suggests that the debates enabled students to develop a critical view of the topics under discussion and to acquire a number of 'transferable skills', for example, team work. On peer grading, students were ambivalent. While self-and peer assessment appears to work well for formative purposes, summative peer assessment may not be welcomed by students.     

Effects of integrating mobile technology-assisted peer assessment into flipped learning on students’ dance skills and self-efficacy

ABSTRACT

Dance courses aim to not only intensify learners’ dance skills, but also cultivate their personal dancing features, self-confidence, self-reflection ability, creative power, appreciation ability, to name just a few, in order to attain much higher level artistic performance. In the present study, an approach which integrates mobile peer assessment into flipped learning is proposed. Moreover, a 9-week experiment was conducted to explore the effects of the approach on students’ dance skills, self-efficacy, and learning satisfaction. The results indicated that the students learning with the integrated mobile peer assessment and flipped learning approach had better dance skills than those learning with the conventional flipped learning approach and traditional instruction. In terms of self-efficacy, the students learning with the conventional flipped learning approach outperformed those learning with the proposed approach and traditional instruction. In terms of learning satisfaction, the conventional flipped learning approach outperformed the traditional instruction. Discussion and suggestions are provided accordingly. It is suggested that teachers who want to incorporate flipped learning into dance courses may decide whether to combine peer assessment according to the teaching objectives.     

Student perspectives on formative peer assessment: an attempt to deepen learning?

Peer assessment is a common form of shared learning in which students provide feedback on each others work. Peer assessment takes many forms; and involves students and tutors taking various roles at different stages of the process. This study explores the views and opinions of undergraduate students in relation to their perceptions and experiences of formative peer assessment introduced as a learning development opportunity for the first time. The study found that on the whole formative peer assessment was a positive experience in enhancing students learning and development. However, consideration needs to be taken to address individual learning styles, as a limited number of students found the process to be less useful. Consequently, when tutors are constructing peer assessment strategies they should be cognisant at the planning stage of the variety of learning styles that are evident in order to maximise the development opportunities this can bring to students.