A Web-based model for developing assessment literacy of secondary in-service teachers

This research investigates the effect of a web-based model, named ‘Practicing, Reflecting, and Revising with Web-based Assessment and Test Analysis system (P2R-WATA) Assessment Literacy Development Model,’ on enhancing assessment knowledge and perspectives of secondary in-service teachers, and adopts a single group experimental research design. The WATA system provides teachers with personalized learning resources and situated environment to practice assembling, administering tests on-line, and appraising test-related statistical information to reflect and revise test items. The sample consisted of forty-seven secondary in-service mathematics and science teachers in a summer program for 36 h within six weeks. This research collects and analyzes quantitative data, including the pre-test and post-test of teachers’ knowledge and perspectives on assessment. The major results generally confirm the effectiveness of P2R-WATA model. Firstly, the assessment knowledge of the participants has improved after training, especially for teachers with low-level prior knowledge. Secondly, the findings also reveal that there is a significant improvement on teachers’ assessment perspectives.     

Web-based Assessment and Test Analyses (WATA) system: development and evaluation

This study introduces the development of a Web‐based assessment system, the Web‐based Assessment and Test Analyses (WATA) system, and examines its impacts on teacher education. The WATA system is a follow‐on system, which applies the Triple‐A Model (assembling, administering, and appraising). Its functions include (1) an engine for teachers to administer and manage testing, (2) an engine for students to apply tests, and (3) an engine for generating test results and analyses for teachers. Two studies were undertaken to assess the usefulness and potential benefits of the WATA system for teacher education. In the first study, 47 in‐service teachers were asked to assess the functions of the WATA system. The results indicated that they were satisfied with the Triple‐A Model of the WATA system. In the second study, 30 pre‐service teachers were required to use the WATA system during the teacher‐training program. After 4 months of experience in using the WATA system, the pre‐service teachers' perspectives of assessment have been changed significantly. The findings of these two studies might provide some guidance to help those who are interested in the development of Web‐based assessment and intend to infuse information technology into teacher education.     

A novel approach for enhancing student reading comprehension and assisting teacher assessment of literacy

For students of English as a Foreign Language (EFL), reading exercises are critical not only for developing strong reading comprehension, but also for developing listening, speaking, and writing skills. Prior research suggests that social, collaborative learning environments are best suited for improving language ability. However, opportunities for English learners to collaboratively practice reading comprehension are minimal, and due to resource constraints and a lack of accurate evaluation methods, English instructors rarely assess student literacy effectively. In response to these problems, we propose a Tag-based Collaborative reading learning System (TACO) that makes use of Web 2.0 Internet social tagging techniques to provide a collaborative environment for reading English. We test our system’s ability to both improve reading comprehension and aid teachers in accurately assessing literacy by conducting a three-month trial with 56 participating Taiwanese high school students from February to May 2009. During this period, post-testing results show a significant improvement in reading scores among participants in our tag-based system, and survey feedback from teachers suggests an improved capacity for literacy assessment.     

The development of pre-service teachers' knowledge: A contemplative approach

This study investigates the effects of meditation on enhancing pre-service teacher knowledge based on the framework of technological pedagogical content knowledge (TPACK) by deepening the reflective process. Participants were students enrolled in an ICT literacy course during the fall 2014 semester. Pre- and post-course surveys indicated that the teachers had significant growth in TPACK and other types of teacher knowledge and in the depth of their reflective practice. Post-course interviews indicated positive effects from their reflective practice, showing that meditation helped the teachers prepare themselves for learning, conduct cognitive and affective tasks, and improve self-efficacy and inner strength. Several implications were noted for the future direction of teacher education programs and research.     

Measuring Information and Communication Technology Literacy using a performance assessment: Validation of the Student Tool for Technology Literacy (ST2L)

This paper reports the validation scores of the Student Tool for Technology Literacy (ST²L), a performance-based assessment based on the National Educational Technology Standards for Students (NETS*S) used to measure middle grade students Information and Communication Technology (ICT) Literacy. Middle grade students (N = 5884) from school districts across the state of Florida were recruited for this study. This paper first provides an overview of various methods to measure ICT literacy and related constructs, and provides documented evidence of score reliability and validity. Following sound procedures based on prior research, this paper provides validity and reliability evidence for the ST²L scores using both item response theory and testlet response theory. This paper examines both the internal and external validity of the instrument. The ST²L, with minimal revision, was found to be a sound measure of ICT literacy for low-stakes assessment purposes. A discussion of the results is provided with emphasis on the psychometric properties of the tool and some practical insights on with whom the tool should be used in future research and practice.     

Courseware development model (CDM): The effects of CDM on primary school pre-service teachers' achievements and attitudes

The main purpose of this study is to design a “Courseware Development Model” (CDM) and investigate its effects on pre-service teachers' academic achievements in the field of geography and attitudes toward computer-based education (ATCBE). The CDM consisted of three components: content (C), learning theory, namely, meaningful learning (ML), and multimedia (M). The CDM is designed to show the synthesis of the C and M components under ML. In this study, an experimental design including pre-test and post-test groups is used to define the efficiency of the CDM. There are 31 pre-service teachers in the control group, 28 pre-service teachers in the meaningful learning theory group-ML, and 30 pre-service teachers in GTC group that uses geography teaching courseware-GTC based on the CDM. The results of the analysis indicate that the courseware is quite effective, improving pre-service teachers' academic achievements as well as their ATCBE scores. The results also suggest that the new model has an appropriate structure for courseware design.     

The use of innovative ICT in the active pursuit of literacy

This paper investigates classroom interventions using a particular form of multimedia information and communication technology (ICT), and looks to study gains in pupil learning that accrue from its use. The research takes place in eight UK schools with 219, 11‐year‐old children (eight Year 6 classes). Work within the Literacy Hour is detailed in order to evaluate the effectiveness of a multimedia broadband educational communications system. The Literacy Hour is part of the UK Government's National Literacy Strategy: guideline requirements of schools to spend an hour a day on literacy to meet centrally established and monitored targets. The research data include pre‐ and post‐test assessments, along with 48 interviews with classroom teachers and pupils. The children are presented with a series of journalistic tasks and classroom activities that they resolve through the use of a compact and coordinated information system. The outcomes demonstrate that children can become self‐directive and very active – exploratory – learners in a very short period of time. They quickly enjoy the freedom and control that the system permits and through which they can be shown to enhance particular literacy skills. The lessons to be learned relate to the management and organisation of classroom teaching in the face of systems that promote rapid devolution of learning to the learner.     

The influence of the instruction of visual design principles on improving pre-service teachers’ visual literacy

This study investigated whether the instruction of visual design principles had an influence on pre-service teachers’ perception and analysis (interpretation) of visual materials. In addition, the relationships between pre-service teachers’ visual intelligence and their perception and analysis (interpretation) of visual materials were also explored. Participants were 86 pre-service teachers who took a one-credit required educational technology course at a mid-western university in the United States. Some participants were absent in the weeks when data were collected, resulting in a total of 59 responses included in data analysis. Findings implied that the instruction of visual design principles could possibly improve pre-service teachers’ visual literacy. Suggestions for future research were discussed.     

Implementation of Web-based dynamic assessment in facilitating junior high school students to learn mathematics

This research adopts the Graduated Prompting Assessment Module of the WATA system (GPAM-WATA) and applies it to the remedial teaching of junior high school mathematics. The theoretical basis of the development of GPAM-WATA is the idea of ‘graduated prompt approach’ proposed by Campione and Brown, 1985, Campione and Brown, 1987. In GPAM-WATA, when examinees fail to answer items correctly, they obtain instructional prompts (IPs) in a graduated way. This research developed the contents of IPs based on the mathematical problem-solving theory of Mayer (1992, pp. 458–460). A quasi-experimental design was adopted. Ninety-six junior high school seventh graders from three different classes participated in this research. The three classes were randomly divided into the GPAM-WATA group (n = 31), the N-WBT group (n = 31) and the PPT group (n = 34). All students received traditional mathematics instruction from the same teacher. After traditional mathematics instruction, all students took the pre-test of the summative assessment. The students in the three different groups then respectively received remedial teaching in the form of GPAM-WATA, normal Web-based test (N-WBT), and paper-and-pencil test (PPT). After the remedial teaching, all students took the post-test of the summative assessment. The results indicate that compared with other groups, performing remedial teaching using GPAM-WATA has significantly better effectiveness. Moreover, it is found that the IPs in GPAM-WATA are effective in remedial teaching for not only those students most lacking in different types of mathematical problem-solving knowledge but also all the other students.     

microLESSONS in teacher education: Examining pre-service teachers’ pedagogical beliefs

It is a challenge for teacher educators to shift pre-service teachers away from traditional pedagogical beliefs towards constructivist ones. At the National Institute of Education in Singapore, microLESSONS is introduced into the instructional technology course of the teacher education program to provide pre-service teachers with opportunities to adopt constructivist instructional approaches towards the design of multimedia learning packages. Based on a class of pre-service teachers in the Diploma in Education program, this paper examines how participation in the microLESSONS series changes pre-service teachers’ pedagogical beliefs. Although the study shows that the beliefs of pre-service teachers are resistant to change and are unlikely to be affected by a short, one-off constructivist-based practical experience provided by the microLESSONS series, the series may have enhanced their confidence in designing and developing multimedia learning packages based on constructivist principles. The series has also given them a better understanding of the diverse use of technology for enhancing teaching and learning.     

The impact of synchronous inter-networked teacher training in Information and Communication Technology integration

This paper summarises the outcomes of research that recorded and interpreted change in pre-service teachers’ pedagogical beliefs when immersed in unique synchronous networked collaboration. The pre-service teachers were involved in the design and implementation of synchronous networked tasks, supported by the theoretical and pragmatic application of ‘informed’ Information and Communications Technology (ICT) integration. The pre-service teachers’ use of digital technology graduated from a didactic, broadcast delivery of information to more constructivist strategies that involved interaction, collaboration and ‘good’ learning. Moreover, the pre-service teachers gained competencies during a 12-week programme that led to the development of a suggested framework for ICT task development able to effectively promote and support improvements in learning.     

An adaptive testing system for supporting versatile educational assessment

With the rapid growth of computer and mobile technology, it is a challenge to integrate computer based test (CBT) with mobile learning (m-learning) especially for formative assessment and self-assessment. In terms of self-assessment, computer adaptive test (CAT) is a proper way to enable students to evaluate themselves. In CAT, students are assessed through a process that uses item response theory (IRT), a well-founded psychometric theory. Furthermore, a large item bank is indispensable to a test, but when a CAT system has a large item bank, the test item selection of IRT becomes more tedious. Besides the large item bank, item exposure mechanism is also essential to a testing system. However, IRT all lack the above-mentioned points. These reasons have motivated the authors to carry out this study. This paper describes a design issue aimed at the development and implementation of an adaptive testing system. The system can support several assessment functions and different devices. Moreover, the researchers apply a novel approach, particle swarm optimization (PSO) to alleviate the computational complexity and resolve the problem of item exposure. Throughout the development of the system, a formative evaluation was embedded into an integral part of the design methodology that was used for improving the system. After the system was formally released onto the web, some questionnaires and experiments were conducted to evaluate the usability, precision, and efficiency of the system. The results of these evaluations indicated that the system provides an adaptive testing for different devices and supports versatile assessment functions. Moreover, the system can estimate students’ ability reliably and validly and conduct an adaptive test efficiently. Furthermore, the computational complexity of the system was alleviated by the PSO approach. By the approach, the test item selection procedure becomes efficient and the average best fitness values are very close to the optimal solutions.     

Pre-service teachers’ skills and perceptions about the use of virtual learning environments to improve teaching and learning

This paper explores data retrieved from Educational Immersive Virtual Worlds to describe pre-service teachers’ skills and perceptions about the simulation tasks. This project had 10 participants who were immersed for 3 years in the Technology and Pedagogical Models in Immersive Worlds island, a multi-user virtual environment in Second Life and Open Simulator. In this project, we evaluated how three-dimensional virtual environments can facilitate the achievement of teaching and learning processes. Based on quantitative and qualitative methodologies, two data collection instruments were applied. Through observation grids and personal log books, professional performance of the 18 pedagogical challenges implemented was collected. The statistical analysis shows that the students improved their technology skills and educational aspects about good practices in classes, regardless of the type of platform used. The analysis through Constant Comparing Method reported a positive assessment of the use of virtual environments, especially about the use of teaching strategies. Main conclusions regarding the pedagogical context reflect the importance of peer assessment on teaching performance, as well as the complexity of role-plays as intellectual challenges to enhance pre-service teachers’ skills. The main difficulties identified during the development of the activities were technical in nature, reporting hardware and connectivity issues.     

Mini-VLAT: A Short and Effective Measure of Visualization Literacy

The visualization community regards visualization literacy as a necessary skill. Yet, despite the recent increase in research into visualization literacy by the education and visualization communities, we lack practical and time-effective instruments for the widespread measurements of people's comprehension and interpretation of visual designs. We present Mini-VLAT, a brief but practical visualization literacy test. The Mini-VLAT is a 12-item short form of the 53-item Visualization Literacy Assessment Test (VLAT). The Mini-VLAT is reliable (coefficient omega = 0.72) and strongly correlates with the VLAT. Five visualization experts validated the Mini-VLAT items, yielding an average content validity ratio (CVR) of 0.6. We further validate Mini-VLAT by demonstrating a strong positive correlation between study participants' Mini-VLAT scores and their aptitude for learning an unfamiliar visualization using a Parallel Coordinate Plot test. Overall, the Mini-VLAT items showed a similar pattern of validity and reliability as the 53-item VLAT. The results show that Mini-VLAT is a psychometrically sound and practical short measure of visualization literacy.     

高职《C#程序设计》课程形成性考核档案研究

为实现学生职业技能和职业素养双提高,文章提出了建立高职计算机课程形成性考核档案袋的建议。以《C#程序设计》课程为例,说明课程形成性考核档案袋中形成性考核档案计划、形成性考核项目成绩登记表、阶段测试成绩登记表、拓展项目成绩登记表、平时考核成绩登记表、课程成绩汇总计算表等6张形成性考核表格的设计和应用,并说明了各项形成性考核成绩的登记和汇总计算方法,实践证明建立高职计算机课程形成性考核档案对工作过程项目化教学的适应性。     

Preparing pre-service teachers to integrate technology in education: A synthesis of qualitative evidence

This study reviewed qualitative studies that focused on strategies to prepare pre-service teachers to integrate technology into their lessons. A meta-ethnography approach was utilized to locate, critically appraise, and synthesize the results of these studies. Based on an extensive search in the Web of Science, 19 articles were included in this synthesis. The results were divided into two parts: (1) key themes explicitly related to the preparation of pre-service teachers (e.g., using teacher educators as role models, learning technology by design, scaffolding authentic technology experiences), and (2) conditions necessary at the institutional level (e.g., technology planning and leadership, co-operation within and between institutions, training staff). To present how these key themes related to each other, an overarching model was developed. By interpreting the results of the review, recommendations were discussed for pre-service teacher technology training and future research.     

Teaching in flipped classrooms: Exploring pre-service teachers' concerns

To effectively promote the student-centered movement, it is important to understand pre-service teacher concerns about teaching in technology-integrated flipped classrooms. This study surveyed more than 470 pre-service teachers' concerns on teaching with flipped learning instruction. To understand the role of individual differences, personal characteristics such as self-efficacy for teaching, teacher knowledge, and other demographics were investigated. The results indicated the pre-service teachers had mostly self-concerns. Self-efficacy and non-technological teacher knowledge were associated with most stages of concern. Females had more awareness and management concerns; non-science pre-service teachers had more information, personal, and collaboration concerns; seniors had the highest awareness for flipped classrooms, and the effects of other personal characteristics on stages of concern were identified. The significant findings draw implications for teacher educators and teacher education programs in updating curriculum and instruction so as to equip pre-service teachers with the essential knowledge and skills for teaching effectively in 21st century classrooms.     

School experience course with multimedia in teacher education

Abstract This paper describes an interactive and self-paced multimedia tutorial programme that provides pre-service teachers with a complete range of school system and teaching strategies. Situated learning has been used as the theoretical framework to produce the multimedia tutorial for a pre-service teachers' School Experience course. The programme allows pre-service teachers to implement approaches appropriate for teaching a K-12 curriculum. Two methods of information delivery were investigated: traditional lecturing and multimedia. The results show that using the multimedia tutorial leads to a positive difference in the School Experience course over participants in traditional lecturing. Pre-service teachers who participated in the multimedia group responded positively to a multimedia approach. This study concludes that using multimedia in teacher education enriches pre-service teachers' learning and provides them with an opportunity to view and critique various teaching methods and classroom activities collectively.