The importance and degree of implementation of the European standards and guidelines for internal quality assurance in universities: the views of Portuguese academics

Abstract

The article aims at critically discussing the role and position of a buffer agency from the point of view of some of its different tasks, viz. accreditation, quality audit, support of academic leadership and internal quality enhancement The contribution seeks to illuminate the conflicting roles of a buffer orgamsation in the light of these tasks and pressures from the government and higher education institutions. It concludes that the different roles can support and complement each other, and that change is best accomplished by emphasising support in the early stages of the establishment of a national quality assurance system.     

Academic achievement standards and quality assurance

Quality assurance processes have been applied to many aspects of higher education, including teaching, learning and assessment. At least in the latter domain, quality assurance needs its fundamental tenets critically scrutinised. A common but inadequate approach has been to identify and promote learning environment changes ‘likely to improve’ learning outcomes. They are simply labelled ‘quality assurance’ without establishing their effectiveness. Part of the problem is that the case for quality assurance has been largely taken as self-evident. Originally, quality assurance principles were developed in domains outside higher education. In those, auditable product, service and other standards play a central role. Although external processes do not directly transfer to higher education, their underlying principles offer perspectives and pointers for reconceptualising quality assurance and improving assessment and grading. Quality assurance should be grounded in authoritative and properly formulated academic achievement standards applied to actual student works, performances and course grades.     

Staff student partnership in assessment: enhancing assessment literacy through democratic practices

In recent years, research and practice focused on staff and students working in partnership to co-design learning and teaching in higher education has increased. However, within staff–student partnerships a focus on assessment is relatively uncommon, with fewer examples evident in the literature. In this paper, we take the stance that all assessment can be oriented for learning, and that students’ learning is enhanced by improving their level of assessment literacy. A small study in a Scottish university was undertaken that involved a range of different adaptations to assessment and feedback, in which students were invited to become partners in assessment. We argue that a partnership approach, designed to democratise the assessment process, not only offered students greater agency in their own and their peers’ learning, but also helped students to enhance their assessment literacy. Although staff and students reported experiencing a sense of risk, there was immense compensation through increased motivation, and a sense of being part of an engaged learning community. Implications for partnership in assessment are discussed and explored further. We assert that adopting staff–student partnership in assessment and more democratic classroom practices can have a wide range of positive benefits.     

Developing student understanding of assessment standards: a nested hierarchy of approaches

Following recent moves at government level apparently aimed at reversing the recent integration of nursing into higher education, the authors consider this latest hurdle for nurse education within the historical context of the developing nursing curriculum. This paper traces a pattern (and some future indicators) from the various obstacles and constraints which have inhibited the progress of nursing in its troubled search for full professional status.     

论新课标情境下的学生角色及其实现

基础教育新课程标准的颁发与实施,凸显了研究学生角色的重要性、必要性与紧迫性,也为研究学生角色提供了机遇和可能。新课标情境下,“学生”仅仅是制度身份,学生不能仅仅定位为“受教育者”角色,而是多重角色的整合。实现新课标情境下的学生角色,就是促成传统意义上的学生角色向新课标意义上的学生角色的转换,这是新课程标准实施必须正确应对的挑战,应积极探索学生角色转换的途径。     

论学生评教及高校教学质量保障体系的改善

学生评教是高校教学质量保障的一项根本制度,它的建立使学生拥有了表达教学意愿的常规渠道,有助于高校树立服务学生的办学宗旨。我国高校开展学生评教工作的时间不长,在实际工作中还存在学生代人评教、形式意义大于实质意义、评教结果被误用、制度设计存在漏洞等问题。为此,应从树立正确的学生评教观、构建科学的学生评教制度、借鉴国外的先进经验等方面,改进我国高校的学生评教制度,完善我国高校教学质量保障体系。     

Strengthening internal quality assurance as a lever for enhancing student learning experiences and academic success: lessons from Namibia

Higher education plays an important role in the social, economic and political development of any given nation. In the Namibian context, quality assurance systems have been put in place at both national and institutional levels through the establishment of national quality assurance agencies and units responsible for quality in institutions. A critical literature analysis of quality assurance systems in higher education shows that although they claim to strike a balance between improvement and accountability, external quality assurance mechanisms tend to have an accountability and compliance focus and to promote managerialisation and bureaucratisation of academia. This article argues that internal quality assurance systems, built on a strong quality culture, tend to be more effective in enhancing the quality of student learning experience and academic success than externally driven quality assurance. Thus, to promote genuine quality, more energy must be invested in external quality assurance capacitating and strengthening internal quality assurance systems.     

A longitudinal assessment of college student engagement in good practices in undergraduate education

The purpose of this study was to determinewhether student engagement in three goodeducational practices (cooperation with peers,active learning, faculty-student interaction)increased between 1983 and 1997 in response tothe calls to improve the quality ofundergraduate education in the United States.The data source was 73,050 students whocompleted the College Student ExperiencesQuestionnaire. The results from multipleregression and effect size analyses showed thatthe frequency of involvement in these goodpractices did not change over time. Variationin the scores of the three indicators acrossyears and types of institution(doctoral-granting universities, comprehensiveuniversities, liberal arts colleges) wasminimal indicating a stable pattern with onlyrandom fluctuations during this 15 yearperiod.     

The influence of student gender on the assessment of undergraduate student work

The aim of this study was to investigate the influence of perceived student gender on the feedback given to undergraduate student work. Participants (n = 12) were lecturers in higher education and were required to mark two undergraduate student essays. The first student essay that all participants marked was the control essay. Participants were informed that the control essay was written by Samuel Jones (a male student). Participants then marked the target essay. Although participants marked the same essay, half of the participants (n = 6) were informed that the student essay was written by Natasha Brown (a female student), while the remaining participants were informed that it was written by James Smith (a male student). In-text and end-of-text feedback were qualitatively analysed on six dimensions: academic style of writing; criticality; structure, fluency and cohesion; sources used; understanding/knowledge of the subject; and other. Analysis of feedback for both the control and target essay revealed no discernible differences in the number of comments (strengths of the essay, areas for improvement) made and the content and presentation of these comments between the two groups. Pedagogical implications pertaining to the potential impact of anonymous marking on feedback processes are discussed.     

Student perceptions of assessment and student self-efficacy in competence-based education

The purpose of this study was to provide insight into the interplay between student perceptions of competence-based assessment and student self-efficacy, and how this influences student learning outcomes. Results reveal that student perceptions of the form authenticity aspect and the quality feedback aspect of assessment do predict student self-efficacy, confirming the role of mastery experiences and social persuasions in enhancing student self-efficacy as stated by social cognitive theory. Findings do not confirm mastery experiences as being a stronger source of self-efficacy information than social persuasions. Study results confirm the predictive role of students’ self-efficacy on their competence outcomes. Mediation analysis results indicate that student’s perceptions of assessment have an indirect effect on student’s competence evaluation outcomes through student’s self-efficacy. Study findings highlight which assessment characteristics, positively influencing students’ learning, contribute to the effectiveness of competence-based education. Limitations of the study and directions for future research are indicated.     

Comparing student,instructor, classroom and institutional data to evaluate a seven-year department-wide science education initiative

We compared seven unrelated data-sets to evaluate a major education improvement initiative. Perceptions of students in 54 course sections were surveyed regarding the helpfulness of 39 specific teaching or learning strategies, and relative workloads and enthusiasm were compared to their other courses. Classes were observed using an established protocol, instructors completed a teaching practices inventory, and their experience with evidence-based pedagogies was established. A graduation exit survey provided longitudinal indications of changes prior to the study, and institutional student ratings of instruction were obtained. This study sought to determine whether improvements were consistently revealed by these data, how perceptions depended upon class size, course improvement model and instructor experience, and whether student ratings captured consistent perceptions about effectiveness. Overall, results compared favourably. Student perceptions and observed effectiveness depended mainly upon class size and improvement strategy. Students found experiences more effective in courses taught by experienced instructors and in classes observed to be more active. Relative workloads were not correlated with any measure of effectiveness while relative enthusiasm was higher in courses perceived to be more effective. Student ratings were consistent with other data-sets, although they did not provide information specific enough for informing further improvements.     

Fair and equitable assessment practices for all students

This paper focuses on promoting fairness and equity in student assessment practices. The researchers used questionnaires and interviews and the study encompassed a total of 3312 individuals representing a range of stakeholders. The paper is presented in two parts: fairness and discrimination, and challenging policy and practice. Five key principles emerged. Educators must strive to address the personal impact of assessment practices on individual students and their families. Assessment must be differentiated to accommodate the ability, social, cultural and linguistic background of students. All members of school communities must challenge the complacency associated with accepting indefensible assessment practices. The frequency, intensity and intrusiveness of assessments must not be overwhelming for students and their families. Finally, assessment must not be used to counter inappropriate student behaviour or reward desired behaviour. Implications for practice are presented. Additionally, the authors describe changes to policy and practice that occurred as a result of the study.     

提高高校学生干部素质的探索

学生干部是学校与广大学生联系的纽带和桥梁,是学生中的骨干力量,是学校开展学生工作的得力助手。提高学生干部素质要做好几项工作：严把学生干部的选拔关;培养和提高学生干部道德素质和工作能力;调动学生干部的积极性;规范学生干部考核制度。     

Measuring teaching quality and student engagement in South Korea and The Netherlands

Six observation scales for measuring the skills of teachers and 1 scale for measuring student engagement, assessed in South Korea and The Netherlands, are sufficiently reliable and offer sufficient predictive value for student engagement. A multigroup confirmatory factor analysis shows that the factor loadings and intercepts of the scales are the same, within acceptable boundaries, in both countries. Therefore, we can compare the average scores of teachers in both countries in a reliable and valid way. The 289 Dutch teachers score significantly better on “creating a safe and stimulating learning climate” and “intensive and activating teaching” and almost significantly on “efficient classroom management”. We find no significant differences in “clear and structured instruction”. The 375 South Korean teachers perform significantly better than the Dutch teachers on “teaching learning strategies” and almost significantly on “differentiating instruction”. Furthermore, we find better student engagement in South Korea.     

Formative self-and peer assessment for improved student learning: the crucial factors of design,teacher participation and feedback

Self and peer-assessment are becoming central aspects of student-centred assessment processes in higher education. Despite increasing evidence that both forms of assessment are helpful for developing key capabilities in students, such as taking more responsibility for their own learning, developing a better understanding of the subject matter, assessment criteria and their own values and judgements, and developing critical reflection skills, both forms of assessment are still not the norm at universities. This paper provides the findings of a two-year study of formative self and peer-assessment at an Australian university. The study supports other research showing that students tend to regard formative self and peer-assessment as beneficial for gaining more insights about the assessment process and for improving their own work. We argue that self and peer-assessment requires careful design and implementation for it to be an effective tool for formative assessment processes; and that the development of students’ capacities for giving feedback, and the continuous and timely involvement of the teacher, are central aspects for successful self and peer-assessment. The move to self and peer-assessment is not simple for teachers and students but is worthwhile and necessary for twenty-first century higher education.     

Embedding external referencing of standards into higher education: collaborative relationships are the key

External referencing of assessment and students’ achievement standards is a growing priority area within higher education, which is being pressured by government requirements to evidence outcome attainment. External referencing benefits stakeholders connected to higher education by helping to assure that assessments and standards within courses are appropriate and comparable among institutions. External referencing takes many forms, which have different resourcing requirements, outcomes, and operational strengths and challenges. This paper describes the External Referencing of Standards (ERoS) approach developed, tested and adopted by a university consortium. ERoS draws on the strengths of existing methodologies to produce an evolved model that is effective, efficient, transparent and open, capability building and sustainable. The model enables participants to communicate directly and construct peer relationships, and findings suggest this is a significant design strength. The process facilitates capability building, such that participants garnered insights valuable to enact quality assurance and enhancement of existing courses, and fosters connections that facilitate collaboration and peer-learning. ERoS successfully used open source collaborative tools to review work samples, which can be used to benchmark costed systems.