Small group discussion as a key component in online assessment training for enhanced student learning in web-based peer assessment

The purpose of this study is to examine the effect of online assessment training, with synchronous group discussion as a key component, on subsequent web-based peer assessment results. Participants included 81 college students, mostly women, taking a business writing class. After initial submission of a draft counter-offer letter, they completed online assessment training by engaging in a consensus-seeking, synchronous group discussion of the rubric-based ratings they gave to sample counter-offer letters. They then engaged in web-based assessment of randomly assigned peer counter-offer letters and upon receiving peer feedback, submitted revision of their own counter-offer letter. The discussion groups were randomly assigned to either anonymous (using a pseudo name) or identified conditions (using real name). Findings indicate that the quality of student counter-offer letters improved after online assessment training, and improved even more after web-based peer assessment. There were no significant differences between anonymous discussion groups and identified groups.     

The validity and students’ experiences of peer assessment in a large introductory class of gene technology

Although studies have examined the validity of peer assessment, research including students’ own experiences of peer assessment is scarce. The present study aims to improve assessment practices in a context with a highly traditional assessment culture. The aim is first to examine the validity of peer assessment by analysing the compatibility of student and teacher evaluation and explore the differences between minor and major students’ evaluations. Second, the study examines students’ experiences of peer assessment. Peer assessment was implemented in a large bioscience course with 79 student participants. After the peer assessment, the students provided feedback. The results indicate that student subject understanding can be supported through a proper assessment practice. Peer assessment was successful in an introductory class with minor and major students, and most students experienced it as supportive of their learning.     

The effects of autonomy support on student engagement in peer assessment

Although peer assessment is widely implemented in higher education, not all students are highly engaged in it. To enhance student engagement in peer assessment, we designed and developed a web-based tool, autonomy-supportive peer assessment (ASPA), to support students’ need for autonomy when they conducted peer assessment. Students’ sense of autonomy, and their behavioral, emotional, and cognitive engagement in peer assessment were examined via interviews and surveys. We also examined students’ academic performances, including their improvement from initial to revised essays and the quality of feedback they provided. Survey results indicated that the ASPA group (1) experienced a slightly higher sense of autonomy than the non-ASPA group, and (2) spent much more time on each evaluation criterion than the non-ASPA group. Interviews suggested that both the ASPA and non-ASPA groups were engaged in peer assessment. However, there were no statistically significant differences between the two groups in behavioral, emotional, cognitive engagement, and academic performances.     

Peer conferences in calculus: the impact of systematic training

This paper describes an intervention for improving the quality of peer assessment conferences in calculus. Although a body of work highlights the learning benefits of peer assessment, few papers have described the nature of student conversations during peer conferences/assessment in detail. This paper provides deeper insight into what those conversations actually look like, and shows the impact of systematic training on conferences. The study took place over two consecutive semesters of introductory college calculus, and analyses show that students had considerably improved conversations after training. The improved conversations consisted of much more on-topic talk and productive feedback; after training, students provided more feedback related to processes (communication and underlying reasoning) than products (correctness or incorrectness).     

Outcomes of synergetic peer assessment: first-year experience

Active participation in learning activities and reviewing assessment activity can facilitate learners engaged in these processes. This case study reports student experiences of the process of peer assessment with teacher guidance in a group project for a first-year nursing course with 153 students. Twenty groups of students were assigned roles in exploring one of the two scenarios: one involved analysing diabetes mellitus and the other considered colorectal carcinoma, in each case covering provision of acute nursing care in hospitals and preparing health promotion strategies in a community. Each group also provided comments to the group that worked on the other scenario, based on prearranged assessment criteria. After receiving comments from their peer group, each group was then allowed to revise their drafts prior to final submission. The teacher’s input would be offered, if the peer feedback was inaccurate or insufficient. A survey was conducted to explore the learning experiences, and three semi-structured focus group interviews were conducted to triangulate findings with the survey. The first-year students expressed the need for both peer feedback and the lecturer’s direct guidance.     

The development of science activities via on-line peer assessment: the role of scientific epistemological views

This study implemented an online peer assessment learning module to help 36 college students with the major of pre-school education to develop science activities for future instruction. Each student was asked to submit a science activity project for pre-school children, and then experienced three rounds of peer assessment. The effects of the online peer assessment module on student learning were examined, and the role of Scientific Epistemological Views (SEVs) in the learning process was carefully investigated. This study found that student peers displayed valid scoring that was consistent with an expert’s marks. Through the online peer assessment, the students could enhance the design of science activities for future instruction; for instance, the science activities became more creative, science-embedded, feasible and more suitable for the developmental stage of pre-school children. More importantly, students with more sophisticated (constructivist-oriented) SEVs tended to progress significantly more for designing science activities with more fun, higher creativity and greater relevancy to scientific knowledge, implying that learners with constructivist-oriented SEVs might benefit more from the online peer assessment learning process. These students also tended to offer more feedback to their peers, and much of the peer feedback provided by these students was categorized as guiding or helping peers to carefully appraise and plan their science activity projects. This study finally suggested that an appropriate understanding regarding the constructivist epistemology may be a prerequisite for utilizing peer assessment learning activities in science education.     

Synchronous discussion between assessors and assessees in web-based peer assessment: impact on writing performance,feedback quality,meta-cognitive awareness and self-efficacy

Research on peer assessment in higher education has been conducted for decades. However, ways to improve the quality of peer feedback and optimise student’ benefits through peer assessment remain a puzzle. The present study aimed to examine the impacts of synchronous discussion between assessors and assessees on writing performance, qualitative feedback quality, meta-cognitive awareness and self-efficacy in web-based peer assessment. A total of 64 undergraduate students participated in the study and were randomly assigned into either the experimental or control group. Participants in the experimental group conducted synchronous discussion after the first round of peer assessment, while students in the control group did not conduct any synchronous discussion. The results revealed that synchronous discussion between the assessors and assessees significantly improved the students’ writing performance, especially content writing skills, affective and meta-cognitive feedback quality, meta-cognitive awareness and self-efficacy. Practical implications, limitations and future directions are discussed based on these findings.     

A Cohort-Driven Assessment Task for Scientific Report Writing

A formative assessment task was developed to improve the scientific report writing skills of university students. Students undertaking this task typically possessed varying levels of scientific literacy and were drawn from a cohort of mixed abilities. The assessment task involved the construction of a scientific report that included feedback from instructor to students before final submission of the assessment piece. After initial submission of a scientific report, the instructor developed a cohort-specific marking scheme based on the deficiencies that were evident within the class group. Using a mixture of peer and self-review against specific criteria, the students were required to resubmit an amended report. This resulted in elevated marks compared with those that would have been obtained after first submission, thus rewarding the student for the application of feedback. This technique proved to be efficient for both parties and also resulted in improvement of skills of the entire student population, regardless of the ability of the student prior to the assessment task. Using this methodology, students of varying aptitudes were able to measure their own skill improvement against tangible criteria, and enjoy a degree of learning success independent of the ranking within their group.     

The role of anonymity in peer assessment

This quasi-experimental study aimed to examine the impact of anonymity and training (an alternative strategy when anonymity was unattainable) on students’ performance and perceptions in formative peer assessment. The training in this study focused on educating students to understand and appreciate formative peer assessment. A sample of 77 students participated in a peer assessment activity in three conditions: a group with participants’ identities revealed (Identity Group), a group with anonymity provided (Anonymity Group) and a group with identities revealed but training provided (Training Group). Data analysis indicated that both the Anonymity Group and Training Group outperformed the Identity Group on projects. In terms of perceptions, however, the Training Group appreciated the value of peer assessment more and experienced less pressure in the process than the other two groups.     

Peer assessment in university teaching: evaluating seven course designs

Peer assessment is understood to be an arrangement with students assessing the quality of their fellow students’ writings and giving feedback to each other. This multiple‐case study of seven designs of peer assessment focuses on the contribution of peer assessment to the acquisition of undergraduates’ writing skills. Its aim is to arrive at an optimal design of peer assessment. Factors included in this study are: the quality of peer assessment activities, the interaction between students in oral peer feedback, students’ learning outcomes, and their evaluation of peer assessment. Most students took assessing the work of their fellow students seriously, and included the peer feedback in the revision of their work. In most conversations, students provided feedback in an evaluative manner. In others, the interaction was more exploratory. For peer assessment, we recommend a combination of written and oral peer feedback.     

Oral presentations in higher education: a comparison of the impact of peer and teacher feedback

In this paper the authors analyse the competency of a sample of economics and business students in orally presenting academic content, as well as the changes that occurred after receiving feedback. The students’ presentations were videotaped, and a total of 96 were analysed at three stages: pre-test, post-test and follow-up. The participants were divided into two groups. In one, each student received feedback from a peer as part of a peer assessment with rubric activity. In the other, they received feedback from the teacher immediately after their presentation. In the post-test, the peer assessment with rubric students improved by 10% in the valuation of their presentation, while the teacher feedback students only improved by 5%. These results support the idea that undergraduates’ evaluations of their peers can be effective in improving oral presentation skills, especially when they are provided with some support instruments (videos and rubrics). However, the improvements in the peer assessment with rubric group were not maintained in the follow-up re-test. This suggests that a single session of peer assessment with rubric is insufficient to generalise any improvements in the said competency. The implications of these results with regard to the implementation of methods of formative peer assessment in higher education are discussed.     

Peer assessment effects on the self-assessment process of first-year undergraduates

Peers carry potential in enhancing students’ self-assessment development, but few studies have explored how peer scaffolding is enacted in the process. This qualitative study explores peer assessment effects on the self-assessment process of 11 first-year undergraduates and the factors limiting peer influence. Drawing on the data from students’ journals, follow-up interviews, observations of in-class formative peer assessment activities and teacher interviews, we ascertained that peers could aid the self-assessment process by enriching student understanding of quality, refining subjective judgement and deepening self-reflection. Yet, peer influence could be reduced by distrust, tensions in feedback communication, competition and lack of readiness for peer learning. Implications for effective use of peers in supporting self-assessment development are discussed.     

Faculty-student engagement in teaching observation and assessment: a Hong Kong initiative

There is now a worldwide focus on the quality of university teaching and yet there is general dissatisfaction in universities with the student evaluation of teaching system. Peer observation of teaching seems to hold much promise in the assessment of teaching quality, but such observation pays little attention to the quality of teaching as perceived by students. One approach to overcome this deficiency is for faculty and students to also partner in the assessment of a faculty member’s teaching, with a student trained in observation and feedback techniques acting as a peer in the observation process. This paper describes and evaluates an ongoing student consultant initiative at Lingnan University in Hong Kong. It presents faculty and student observations in terms of the benefits to faculty regarding potential enhancement of university teaching, and the benefits to students especially in terms of close collaboration with faculty and training in consultation techniques. The paper notes that the student consultant initiative has been more popular with students than faculty, and recommends further investigation of the potential of such programmes in Hong Kong higher education.     

Bias in student evaluations: Are my peers out to get me?

The use of peer evaluations to evaluate performance is commonplace, especially in higher education. Yet, researchers and educators have long expressed concerns about the accuracy of such ratings. While research has found student peer evaluations to be consistent with instructor evaluations, rater bias is inherent in all evaluations, and students are not exempt from this. This study examines task completion and identity threat to determine if experience and identity play a role in shaping student peer evaluations. A sample of MBA students evaluated their peers before and after completing a course presentation. Results showed that students’ peer evaluations were significantly “lower” or more critical after having completed the presentation themselves. This study illuminates the importance of experience and training in the implementation of performance evaluations.     

The effect of peer assessment on project performance of students at different learning levels

Peer assessment has been increasingly integrated in educational settings as a strategy to foster student learning. Yet little has been studied about how students at different learning levels may benefit from peer assessment. This study examined how peer-assessment and students’ learning levels influenced students’ project performance using a two-way factorial design. One hundred and thirty teacher education students participated in this quasi-experimental study. When working on a technology-integrated lesson plan project, the experimental group completed an online peer assessment process while the control group followed the discussion method. Students’ learning levels were measured and divided into low, average and high achieving according to the quality of their draft lesson plans. Data analysis suggested that the impact of peer assessment on students’ lesson plan project seemed to vary according to students’ learning levels. While low- and average-achieving students showed significantly improved performance right after the integration of a peer assessment model, the model seemed to have had less impact on the performance of high-achieving students. Significance, implications and limitations of findings are discussed.     

Student perspectives on formative feedback as part of writing portfolios

Despite the crucial role that students play in formative assessment practices, student perspectives on such practices are relatively under-researched. Through a qualitative analysis of 128 reflection notes written by student teachers of English, this article investigates the students’ perceptions of formative feedback as part of portfolio assessment at two teacher education institutions in Norway. As such, it contributes to bridging the gap between research and practice. Students received peer and teacher feedback on assignments and wrote reflection notes during the semester. Findings show that students are positive towards teacher feedback and highlight the significance of teacher praise. Main objections raised against peer feedback concern the lack of constructive criticism. However, positive attitudes towards peer discussion groups suggest that they may be a more effective way of implementing peer assessment than formalised written peer commentary. Student reflections suggest that a failure to understand the task and the feedback is a possible hindrance to successfully revising assignments. Overall, students’ positive attitudes towards the portfolio process, which includes multiple drafting, suggest that students in higher education would benefit from more opportunities to revise and resubmit their work, yet they need adequate practice in providing peer feedback, and interpreting and implementing feedback in general.     

Peer assessment accounting for student agreement

Peer assessment has been gaining significant ground as a means of fostering an environment of accountability and responsibility for group projects in higher education. A popular peer assessment method assigns individual grades via a linear relationship to peer assessment scores. Using this method, a group member who receives his or her group’s average peer assessment score is assigned the instructor‐given group grade; the group member who receives a total peer assessment score of zero is assigned an individual grade of zero. Unfortunately, applying this method often requires time‐consuming exploratory data analysis because of the potential for the method to yield a high spread of grades, including grades over 100%. The present study proposes a modification, which accounts for the degree of student agreement. When the modified procedure results in a change from the group grade, the direction of change is always the same, but with smaller magnitude, requiring less subsequent data analysis and instructor time demands. Easy‐to‐modify SAS code for applying the method is presented in the Appendix.     

Student perceptions of assessment and student self-efficacy in competence-based education

The purpose of this study was to provide insight into the interplay between student perceptions of competence-based assessment and student self-efficacy, and how this influences student learning outcomes. Results reveal that student perceptions of the form authenticity aspect and the quality feedback aspect of assessment do predict student self-efficacy, confirming the role of mastery experiences and social persuasions in enhancing student self-efficacy as stated by social cognitive theory. Findings do not confirm mastery experiences as being a stronger source of self-efficacy information than social persuasions. Study results confirm the predictive role of students’ self-efficacy on their competence outcomes. Mediation analysis results indicate that student’s perceptions of assessment have an indirect effect on student’s competence evaluation outcomes through student’s self-efficacy. Study findings highlight which assessment characteristics, positively influencing students’ learning, contribute to the effectiveness of competence-based education. Limitations of the study and directions for future research are indicated.     

Group peer assessment for summative evaluation in a graduate-level statistics course for ecologists

Peer assessment is often used for formative learning, but few studies have examined the validity of group-based peer assessment for the summative evaluation of course assignments. The present study contributes to the literature by using online technology (the course management system Moodle^?) to implement structured, summative peer review based on an anchored rubric in an ecological statistics course taught to graduate students. We found that grade discrepancies between students and the instructor were fairly common (60% of assignments), relatively low in value (mean = 3.3 ± 2.5% on assignments that had discrepancies) and proportionally higher for criteria related to interpretation of statistical results and code quality and organisation than for criteria related to the successful completion of analysis or instructional tasks (e.g. fitting particular statistical methods, de-identification of one’s submission). Students reported that the peer assessment process increased their exposure to alternative ways of approaching statistical and computational problem-solving, but there were concerns raised about the fairness of the process and the effectiveness of the group component. We conclude with some recommendations for implementing peer assessment to maximise student learning and satisfaction.     

Conventional or sustainable? Chinese university students’ thinking about feedback used in their English lessons

Feedback has been increasingly conceptualised as a dialogical process where students interpret the provided information through interaction with comment providers and use it to enhance their learning. A major challenge for the development of sustainable feedback is closely related to how students think about it. This study explored how 25 Chinese university students made sense of instructor and peer feedback following their English group presentations. The findings reveal that most of the participants perceived more judging and encouraging functions of feedback than its improving functions, which reflected their conventional thinking about feedback. Variation also existed in the perceived functions of instructor and peer feedback. Imbalanced power relations, face, group harmony and instructors’ feedback practice as well as students’ past learning and assessment experiences appeared to inhibit the participants from viewing feedback in a sustainable way. This study sheds light on college students’ complex thinking about feedback in a non-Anglophone context which has been neglected in the feedback literature, and has implications for educators and researchers in facilitating sustainable feedback in the Chinese context and the non-Chinese contexts where Chinese students study.