Academics’ conceptions of assessment and their assessment practices

The present study focuses; firstly, on analysing academics’ conceptions of the purpose of assessment; secondly, on their assessment practices; and thirdly, on the relationship between their conceptions and practices. The data consisted of interviews with 28 pharmacy teachers. The analysis resulted in a continuum of categories of conceptions, from reproductive conceptions with an emphasis on measuring the reproduction of correct information, to more transformational conceptions with an emphasis on the development of students’ thinking and understanding. Although broad variation in assessment practices was recognised, teachers mostly described the use of traditional forms of assessment. Analysis of the relationship between conceptions and practices revealed high consistency between conceptions and practices.     

The effect of high-stakes examination systems on teacher beliefs: Egyptian teachers’ conceptions of assessment

Egypt is currently attempting to introduce a greater formative use of assessment while maintaining a public examination system. This study investigates teacher beliefs about the purposes of assessment in Egypt, using the Teachers’ Conceptions of Assessment (TCoA) inventory. The TCoA inventory elicits responses about four main factors: Improvement, School Accountability, Student Accountability and Irrelevance. A large sample of (n?=?507) Egyptian pre-service and in-service teachers completed an Arabic version of the TCoA inventory. Confirmatory factor analysis was used to test the Egyptian teachers’ responses against the pre-existing New Zealand model, which was found to be inadmissible. Consequently, an ecologically rational three-factor model was found. The model yielded a strong positive relationship between Improvement and Student Accountability, consistent with previous studies. It is argued that greater changes to the examination system are required if teacher beliefs are expected to be more positive about the priority of formative, improvement-oriented uses of assessment.     

Students’ views of oral performance assessment in mathematics: straddling the ‘assessment of’ and ‘assessment for’ learning divide

This paper explores the views of a group of students who took an oral performance assessment in a first-year mathematics module. Such assessments are unusual for most subjects in the UK, but particularly within the generally homogenous assessment diet of undergraduate mathematics. The evidence presented here resonates with some, but not all, of the existing literature on oral assessment and suggests that, despite concerns about anxiety and fairness, students see oral assessments as encouraging a focus on understanding, being relatively authentic and reactive to their needs. We argue that, suitably implemented, oral assessment may be a viable assessment method for straddling the ‘assessment for’ and ‘assessment of’ learning divide in higher education.     

Why school based assessment is not a universal feature of high stakes assessment systems?

Accepting that school based assessment may have the potential to bring additional reliability to the assessment outcomes of an educational system, this research uses Generalizability Theory to address the question “why school based assessment is not a universal feature of high stakes assessment systems”? Three major issues are identified: (a) there is a conflict between the psychometric model and classroom assessment practice; (b) different schools are not equally effective; and, (c) teachers’ judgments are frequently accused of being biased. The role of public examination boards is discussed in this context.     

Conceptualising teachers’ assessment literacies in an era of curriculum and assessment reform

Teacher assessment literacy is a phrase that is often used but rarely defined. Yet understanding teacher assessment literacy is important in an international curriculum and assessment reform context that continues to challenge teachers’ assessment practices. In this article situated examples of classroom assessment literacies are analysed using Bernstein’s (Pedagogy, symbolic control and identity: Theory, research and critique, Taylor and Francis, London, 1996; Br J Sociol Educ 20(2):157–173, 1999) theoretical tools of vertical and horizontal discourses, classification and framing. Drawing on a sociocultural view of learning, the authors define teacher assessment literacies as dynamic social practices which are context dependent and which involve teachers in articulating and negotiating classroom and cultural knowledges with one another and with learners, in the initiation, development and practice of assessment to achieve the learning goals of students. This conceptualisation of assessment literacy aims to make explicit some underpinning theoretical constructs of assessment literacy to inform dialogue and decision making for policy and practice to benefit student learning and achievement.     

A collaborative assessment of students’ placement learning

The research informing this paper set out to investigate the qualitative experiences of students, supervisors and tutors involved in a summative collaborative assessment of placement learning on an undergraduate professional qualifying programme in the UK. Analysis of data gathered through semi-structured interviews provides valuable insights into its use. In particular, engagement in a collaborative assessment brings a degree of exposure for all concerned. Participants need to feel ‘able’ to participate, and ability to participate is linked to notions of agency and autonomy. Collaborative assessment design needs to acknowledge power relations and include strategies to reduce imbalances. The importance of recognising and working with the complexities of assessment should not be underestimated. Criterion referencing offers a guide to support consistency but can also falsely present assessment as mechanistic and instrumental. The research shows that it is in the ‘doing’ of assessment that a ‘shared language’ is developed. It demonstrates the value of active student engagement in assessment in relation to the construction and use of theory, developing reflective practice and assessment literacy. The collaborative assessment provides students with the opportunity to experience a ‘performance of understanding’ in a community of practice that, whilst pressured, reflects ‘real’ professional life.     

Improving teachers’ assessment literacy through professional development

This study examined the effects of professional development on teachers’ assessment literacy between two groups of teachers: (1) teachers who were involved in ongoing and sustained professional development in designing authentic classroom assessment and rubrics; and (2) teachers who were given only short-term, one-shot professional development workshops in authentic assessment. The participating teachers taught Year 4 and 5 English, science, and mathematics. The findings showed that the assessment literacy of teachers who were involved in ongoing, sustained professional development had increased significantly during the second year of study. These teachers had also gained a better understanding of authentic assessment.     

Psychological assessment and dyslexia: parents’ perspectives

The purpose of this paper is to explore parents’ perceptions of the process of having their child assessed for dyslexia by an independent Educational Psychologist and the affective impact on the child or young person. The research was carried out as part of an evaluation of the services offered by the Northern Ireland Dyslexia Centre (NIDC). The methodology involved the use of a postal survey questionnaire with both qualitative and quantitative outcomes. Findings are discussed in the context of strategies for promoting partnerships with parents and affective-academic pathways for learners with dyslexia.     

‘I’m an assessment illiterate’: towards a shared discourse of assessment literacy for external examiners

The quality assurance ‘regime’ that spans the higher education sector internationally is underpinned by a number of unchallenged assumptions. Nowhere is this more apparent than within the external examiner system in the UK, an instrument for the professional self-regulation of higher education. One such assumption is that external examiners are assessment literate. Within higher education assessment literacy is a concept in its infancy, but one that has the capacity to reverse the deterioration of confidence in academic standards. Whilst the concept is becoming integrated into the sectorial vernacular, its fluid and negotiated nature is under-conceptualised. The primary aim of this article lies in investigating the extent of external examiners’ assessment literacy and to use this as a base to initiate a discussion surrounding the development of a shared discourse of assessment literacy, thereby providing a tool for greater conceptualisation.     

Should assessment reflect only pupils’ knowledge?

In order to realise increasingly complex objectives of compulsory education, it is necessary to have in place appropriate teaching concepts as well as assessment and testing guidelines. The question, however, is what should be assessed: levels of acquired knowledge, skills or attitudes? Should assessment be only a measure of the educational process outcomes, or should it also measure the process of knowledge acquisition itself? How should assessment be carried out in order to respect the principle of fairness and justice? In this paper, we will present results of a research project in which we were interested to find out what teachers would assess if it were up to them to decide. Our survey was conducted on a representative sample of primary school teachers in Slovenia. In spite of clear regulations prescribing that teachers should only assess pupils’ progress in relation to the defined objectives and knowledge standards, teachers underlined the necessity to also consider other aspects of children’s development.     

The standards for academics’ standards-based assessment practices

The use of standards-based assessment (SBA) has gained prominence in higher education due to a wide range of research evidence that supports its effectiveness in improving learning and teaching. Although the concept is widely used in academic discourse and practice, it has multiple interpretations which have led to diverse assessment practices to the extent that some of these depart from the principles of SBA. To help build a common understanding of what constitutes SBA practices, we explored the construct of academic SBA practices using both theoretical and empirical approaches. We developed a tool, based on the principles of SBA emerging from practices noted in the literature and identified from focus groups. We used factor analysis to extract the dimensions of the construct and to establish empirical evidence for the utilisation of the tool using a data set of 410 academics who engaged in self-assessment. Results showed that a six-factor model is the most parsimonious among other models. We used these dimensions to develop a framework for describing academic SBA practices. The use of the framework and tool has critical implications for curriculum design, professional practice and development, and policy articulation.     

Students’ assessment preferences, perceptions of assessment and their relationships to study results

The purposes of this study are to gain more insight into students’ actual preferences and perceptions of assessment, into the effects of these on their performances when different assessment formats are used, and into the different cognitive process levels assessed. Data were obtained from two sources. The first was the scores on the assessment of learning outcomes, consisting of open ended and multiple choice questions measuring the students’ abilities to recall information, to understand concepts and principles, and to apply knowledge in new situations. The second was the adapted Assessment Preferences Inventory (API) which measured students’ preferences as a pre-test and perceptions as a post-test. Results show that, when participating in a New Learning Environment (NLE), students prefer traditional written assessment and questions which are as closed as possible, assessing a mix of cognitive processes. Some relationships, but not all the expected ones, were found between students’ preferences and their assessment scores. No relationships were found between students’ perceptions of assessment and their assessment scores. Additionally, only forty percent of the students had perceptions of the levels of the cognitive processes assessed that matched those measured by the assessments. Several explanations are discussed.     

Students’ conceptions of assessment: Links to outcomes

Students conceive of assessment in at least four major ways (i.e., assessment makes students accountable; assessment is irrelevant because it is bad or unfair; assessment improves the quality of learning; and assessment is enjoyable). A study in New Zealand of 3469 secondary school students’ conceptions of assessment used a self‐report inventory and scores from a standardised curriculum‐based assessment of reading comprehension. Four inter‐correlated conceptions based on 11 items were found with good psychometric properties. A path‐model linking the four correlated conceptions with student achievement in reading, while taking into account student ethnicity, student sex, and student year, had good psychometric properties. The conception that assessment makes students accountable loaded positively on achievement while the three other conceptions (i.e., assessment makes schools accountable, assessment is enjoyable, and assessment is ignored) had negative loadings on achievement. These findings are consistent with self‐regulation and formative assessment theories, such that students who conceive of assessment as a means of taking responsibility for their learning (i.e., assessment makes me accountable) will demonstrate increased educational outcomes.     

Teachers’ experiences with a state-mandated kindergarten readiness assessment

This study used an embedded mixed method design to examine teachers’ experiences with a state-mandated kindergarten readiness assessment during its inaugural year. Participants were 143 kindergarten teachers from one county in a Midwestern state. In general, teachers did not perceive the Kindergarten Readiness Assessment as useful for one of its intended purposes of guiding instruction. Our findings did not indicate an adversity to assessment in general. Rather, perceptions that the new KRA was less useful for practice seemed to stem from administration issues, problems with the content assessed by the KRA, and participants’ misunderstandings regarding the purpose of the KRA. Furthermore, participants reported that the KRA took away valuable time needed to help students adjust to their first time in formal schooling and needed to create a classroom community. Implications for creating and implementing kindergarten readiness and other assessments as well as preparing teachers to use readiness assessments are discussed.     

‘One assessment doesn’t serve all the purposes’ or does it? New Zealand teachers describe assessment and feedback

Within the Asia-Pacific community, the New Zealand Ministry of Education has been one of few educational authorities to adopt an Assessment for Learning (AfL) framework and actively promote formative uses of assessment. This paper reports the results of a qualitative study in which eleven New Zealand secondary teachers in two focus groups discussed their conceptions of assessment and feedback. These data were examined to see how teachers defined and understood assessment and feedback processes to identify how these conceptions related to AfL perspectives on assessment. Categorical analysis of these data found teachers identified three types of assessment (formative, classroom teacher–controlled summative and external summative) with three distinct purposes (improvement, reporting and compliance, irrelevance). Feedback was seen as being about learning, grades and marks, or behaviour and effort; these types served the same purposes as assessment with the addition of an encouragement purpose. This study showed that although these New Zealand teachers appeared committed to AfL, there was still disagreement amongst teachers as to what practices could be deemed formative and how to best implement these types of assessment. Additionally, even in this relatively low-stakes environment, they noted tension between improvement and accountability purposes for assessment.