Enhancing problem-based learning designs with a single e-learning scaffolding tool: Two case studies using challenge FRAP

Problem-based learning (PBL) is a powerful instructional approach. By working through assessable complex problem-solving tasks learners can be encouraged to actively engage in investigation and inquiry and to use high level cognitive thought processes to solve real-life problems in professional contexts. A critical element of a successful PBL design is the inclusion of instructional support, such as scaffolding, to guide and assist the learner through the reasoning process that is crucial to successful problem-solving. The e-learning tool ‘Challenge FRAP’ (Form for the Recording of the Analysis of Problems) is client-based public domain authoring software which facilitates the use of scaffolding, the provision of progressive feedback and can promote student reflection at key decision-making points. This paper illustrates the benefits of such an e-learning scaffolding tool through two PBL case studies; one group-based PBL task in science and technology and one self-directed PBL task in plant pathology.     

Enhancing problem-solving expertise by means of an authentic, collaborative, computer supported and problem-based course

Instructional designs, embedding learning in meaningful contexts such as problem-based learning (PBL) are increasingly used for fostering expertise to prepare students for the demands of the future workplace. However, cognitive outcomes of these curricula in terms of expertise outcomes are not always conclusive. Based on the instructional implications resulted from research in the field of expertise development in general and in PBL curricula more specifically, we constructed and implemented a refined PBL design. With this redesign, we aimed for a more advanced level of (a) knowledge acquisition and use, (b) reasoning directionality, (c) diagnostic and problem solving accuracy. The aim of the present research was to compare the outcomes of a ‘traditional’ and a ‘refined’ PBL learning environment. For that purpose we measured the effects of the redesign on the students’ expertise profile. An experiment was conducted in a second year course on International Marketing. In the study 75 students participated. Using a multidimensional coding scheme, constructed on the basis of results of expertise research, we analysed students’ problem-solving performance. The results of this analysis indicate hat the experimental students outperformed the control students in various aspects of expertise when analyzing the problem: The experimental group demonstrated a more extensive use of domain-specific concepts and inferences, more inductive reasoning, and both diagnoses and solutions of higher quality.     

Case study of a problem-based learning course of project management for senior engineering students

The analysis of the current state of the Ukrainian system of engineering education indicates the prevalence of traditional teaching–learning approaches in contrast to the modern needs of the labour market. Many universities across the world use the problem/project-based learning (PBL) which is an effective approach for the development of design and management skills of engineering students. The paper describes a detailed structure of a PBL course in project management and practical experience related to its implementation in an engineering degree programme at Bohdan Khmelnytsky National University of Cherkasy. Also, the results of surveys carried out in order to study the students’ generic competences’ development and perception of the PBL process are presented. The results show that students understand the diversity of PBL aspects and the influence of the PBL approach on their professional characteristics such as teamwork, ability of self-directed learning, communication and problem-solving skills.     

Designing groups in problem-based learning to promote problem-solving skill and self-directedness

The effect of group size in problem-based learning(PBL) on the problem-solving skill, self-directedness,and technical knowledge of 72 students in a dentaleducation program was examined. Pretest measures onself-directedness and technical knowledge wereadministered to the 72 students. Equal numbers ofstudents with low, medium, and high levels ofself-directedness were randomly assigned to small,medium, and large PBL groups. Students thenparticipated in a three-week PBL experience, whichinvolved analyzing a patient case. After PBL wascompleted, posttest measures on self-directedness,technical knowledge, and problem-solving skill wereassessed. Students' reactions to the PBL experiencewere also measured. Analysis of the data found thatthe development of self-directedness varied with groupsize. Students' self-directedness increased in smalland medium size groups, but decreased in large groups. A significant difference was found between the mediumand large groups on this measure. Furthermore,students in small groups rated 5 of 12 aspects of PBLsignificantly higher than did those in large groups,and students in medium size groups rated 10 of 12aspects of PBL significantly higher than did those inlarge groups. Implications of these findings forinstructional design theory, practice, and researchare discussed.     

Problem-Based Learning: What and How Do Students Learn?

Problem-based approaches to learning have a long history of advocating experience-based education. Psychological research and theory suggests that by having students learn through the experience of solving problems, they can learn both content and thinking strategies. Problem-based learning (PBL) is an instructional method in which students learn through facilitated problem solving. In PBL, student learning centers on a complex problem that does not have a single correct answer. Students work in collaborative groups to identify what they need to learn in order to solve a problem. They engage in self-directed learning (SDL) and then apply their new knowledge to the problem and reflect on what they learned and the effectiveness of the strategies employed. The teacher acts to facilitate the learning process rather than to provide knowledge. The goals of PBL include helping students develop 1) flexible knowledge, 2) effective problem-solving skills, 3) SDL skills, 4) effective collaboration skills, and 5) intrinsic motivation. This article discusses the nature of learning in PBL and examines the empirical evidence supporting it. There is considerable research on the first 3 goals of PBL but little on the last 2. Moreover, minimal research has been conducted outside medical and gifted education. Understanding how these goals are achieved with less skilled learners is an important part of a research agenda for PBL. The evidence suggests that PBL is an instructional approach that offers the potential to help students develop flexible understanding and lifelong learning skills.     

Making inquiry-based science learning visible: the influence of CVS and cognitive skills on content knowledge learning in guided inquiry

ABSTRACT

Many science curricula and standards emphasise that students should learn both scientific knowledge and the skills associated with the construction of this knowledge. One way to achieve this goal is to use inquiry-learning activities that embed the use of science process skills. We investigated the influence of scientific reasoning skills (i.e. conceptual and procedural knowledge of the control-of-variables strategy) on students’ conceptual learning gains in physics during an inquiry-learning activity. Eighth graders (n?=?189) answered research questions about variables that influence the force of electromagnets and the brightness of light bulbs by designing, running, and interpreting experiments. We measured knowledge of electricity and electromagnets, scientific reasoning skills, and cognitive skills (analogical reasoning and reading ability). Using structural equation modelling we found no direct effects of cognitive skills on students’ content knowledge learning gains; however, there were direct effects of scientific reasoning skills on content knowledge learning gains. Our results show that cognitive skills are not sufficient; students require specific scientific reasoning skills to learn science content from inquiry activities. Furthermore, our findings illustrate that what students learn during guided inquiry activities becomes visible when we examine both the skills used during inquiry learning and the process of knowledge construction. The implications of these findings for science teaching and research are discussed.     

合作学习理论在高职商务英语教学中的融入与应用

在高职院校商务英语的教学实践中运用合作学习理论进行教学,采取以提高交际能力为中心的学生主体教学摸式,强调发挥学生的主动性和积极性,促使其认知结构转化与重组,达到完善语言认知结构和培养语言交际能力,不仅有助于学生获得商务专业知识,掌握实用语言技巧,也有助于他们分析问题并通过沟通与合作解决问题能力的提高,从而激发学生创新能力,培养学生成为合格的商务英语人才。     

促进深度学习的教学推理:实践逻辑与策略选择

学生的深度学习是以学生的知识理解与运用为价值取向,以培养学生的高阶思维能力和问题解决能力为目标的一种学习。但知识论证不充足、知识点状分布、绝对真理知识观等表层知识教学已偏离了学习的本质及价值,产生了知识教学阻滞深度学习的困局。教学推理是教师根据已知教学条件及个体情境认知,确定问题并生成教学策略的连续性思维活动。它克服了以往僵化的教学方式,为促进深度学习提供可能逻辑。其中,学科知识逻辑能促进学习触及知识的意义世界,学生经验逻辑能促进学习进入学生的心灵世界,实践自为逻辑能促进学习关联自我的生活世界。最后,促进深度学习的教学推理策略应着力于以"批判与交融"为取向的教学理解,形成以"联结与转化"为纽带的教学逻辑,开展以"假设与证据"为核心的课堂论证教学,创设以"推断与评估"为特质的教学情境。     

Using Assessment to Induct Students and Staff into the PBL Tutorial Process

The introduction of a new problem-based Graduate Medical Course with over 230 students and more than 200 staff required a systematic process for induction into the PBL philosophy and tutorial process. The 4SAT (4 Step Assessment Task) was designed for use as an instrument for formative and summative assessment of reasoning ability, elements of the PBL tutorial (group) process and individual learning outcomes. The instrument was developed through evaluative cycles based upon staff and student feedback, reflection and peer review. The 4SAT has face validity with the learning process and emphasises reasoning and integration of knowledge. An unexpected out come of its development was its use as a powerful tool to induct staff and students into the PBL group processes, scaffold development of hypothetico-deductive reasoning and provide guidance on the depth and breadth of learning expected in the course.     

Disciplinary Foundations for Solving Interdisciplinary Scientific Problems

Problem-solving has been one of the major strands in science education research. But much of the problem-solving research has been conducted on discipline-based contexts; little research has been done on how students, especially individuals, solve interdisciplinary problems. To understand how individuals reason about interdisciplinary problems, we conducted an interview study with 16 graduate students coming from a variety of disciplinary backgrounds. During the interviews, we asked participants to solve two interdisciplinary science problems on the topic of osmosis. We investigated participants’ problem reasoning processes and probed in their attitudes toward general interdisciplinary approach and specific interdisciplinary problems. Through a careful inductive content analysis of their responses, we studied how disciplinary, cognitive, and affective factors influenced their interdisciplinary problems-solving. We found that participants’ prior discipline-based science learning experiences had both positive and negative influences on their interdisciplinary problem-solving. These influences were embodied in their conceptualization of the interdisciplinary problems, the strategies they used to integrate different disciplinary knowledge, and the attitudes they had toward interdisciplinary approach in general and specific interdisciplinary problems. This study sheds light on interdisciplinary science education by revealing the complex relationship between disciplinary learning and interdisciplinary problem-solving.     

Case study of a problem-based learning course of physics in a telecommunications engineering degree

Active learning methods can be appropriate in engineering, as their methodology promotes meta-cognition, independent learning and problem-solving skills. Problem-based learning is the educational process by which problem-solving activities and instructor's guidance facilitate learning. Its key characteristic involves posing a ‘concrete problem’ to initiate the learning process, generally implemented by small groups of students. Many universities have developed and used active methodologies successfully in the teaching–learning process. During the past few years, the University of the Basque Country has promoted the use of active methodologies through several teacher training programmes. In this paper, we describe and analyse the results of the educational experience using the problem-based learning (PBL) method in a physics course for undergraduates enrolled in the technical telecommunications engineering degree programme. From an instructors’ perspective, PBL strengths include better student attitude in class and increased instructor–student and student–student interactions. The students emphasised developing teamwork and communication skills in a good learning atmosphere as positive aspects.     

Chinese business students’ changes in beliefs and strategy use in a constructively aligned PBL course

This study adopted a longitudinal retrospective case study approach to investigate Chinese business students’ transitional learning experience in a problem-based learning (PBL) course with innovative assessment practices. The study focused on students’ beliefs and strategy use in a constructively aligned PBL course for business communication. Eight students who had made notable progress were chosen for retrospective analysis. The data included 48 journal entries, interviews, and writing samples collected at different stages of the course. This study identified taxonomies of participants’ beliefs about learning and writing, their perceptions of assessment, and their strategy use for learning. It also examined changes in beliefs, perceptions, and strategy use to determine the nature of the students’ learning experience in this PBL course. Findings suggest a recognised need to design PBL courses that align social constructivist learning principles with students’ beliefs and strategies. The results also highlight the importance of developing appropriate assessment rubrics to enhance student engagement with PBL learning for improved outcomes.     

Improvement in Generic Problem-Solving Abilities of Students by Use of Tutor-less Problem-Based Learning in a Large Classroom Setting

Problem-based learning (PBL) was originally introduced in medical education programs as a form of small-group learning, but its use has now spread to large undergraduate classrooms in various other disciplines. Introduction of new teaching techniques, including PBL-based methods, needs to be justified by demonstrating the benefits of such techniques over classical teaching styles. Previously, we demonstrated that introduction of tutor-less PBL in a large third-year biochemistry undergraduate class increased student satisfaction and attendance. The current study assessed the generic problem-solving abilities of students from the same class at the beginning and end of the term, and compared student scores with similar data obtained in three classes not using PBL. Two generic problem-solving tests of equal difficulty were administered such that students took different tests at the beginning and the end of the term. Blinded marking showed a statistically significant 13% increase in the test scores of the biochemistry students exposed to PBL, while no trend toward significant change in scores was observed in any of the control groups not using PBL. Our study is among the first to demonstrate that use of tutor-less PBL in a large classroom leads to statistically significant improvement in generic problem-solving skills of students.     

Learning analytics application to examine validity and generalizability of game-based assessment for spatial reasoning

Game-based assessment (GBA), a specific application of games for learning, has been recognized as an alternative form of assessment. While there is a substantive body of literature that supports the educational benefits of GBA, limited work investigates the validity and generalizability of such systems. In this paper, we describe applications of learning analytics methods to provide evidence for psychometric qualities of a digital GBA called Shadowspect, particularly to what extent Shadowspect is a robust assessment tool for middle school students' spatial reasoning skills. Our findings indicate that Shadowspect is a valid assessment for spatial reasoning skills, and it has comparable precision for both male and female students. In addition, students' enjoyment of the game is positively related to their overall competency as measured by the game regardless of the level of their existing spatial reasoning skills.

Practitioner notes

What is already known about this topic:

• Digital games can be a powerful context to support and assess student learning.
• Games as assessments need to meet certain psychometric qualities such as validity and generalizability.
• Learning analytics provide useful ways to establish assessment models for educational games, as well as to investigate their psychometric qualities.

What this paper adds:

• How a digital game can be coupled with learning analytics practices to assess spatial reasoning skills.
• How to evaluate psychometric qualities of game-based assessment using learning analytics techniques.
• Investigation of validity and generalizability of game-based assessment for spatial reasoning skills and the interplay of the game-based assessment with enjoyment.

Implications for practice and/or policy:

• Game-based assessments that incorporate learning analytics can be used as an alternative to pencil-and-paper tests to measure cognitive skills such as spatial reasoning.
• More training and assessment of spatial reasoning embedded in games can motivate students who might not be on the STEM tracks, thus broadening participation in STEM.
• Game-based learning and assessment researchers should consider possible factors that affect how certain populations of students enjoy educational games, so it does not further marginalize specific student populations.

     

Problem-Based Learning: Effects on the Early Acquisition of Cognitive Skill in Medicine

In this article, I present a longitudinal study comparing problem-solving performance for medical students trained using 2 different approaches to medical education. The first approach is the traditional medical education that involves lectures supplemented by laboratory exercises. The second approach is problem-based learning (PBL). In PBL, students learn basic science in small groups in the context of authentic patient problems. Because an expected outcome of medical education is to move students along the path from naive laypersons to novice physicians, the effects of these approaches should be understood in terms of how they affect the early acquisition of cognitive skill. The results indicate that there are important cognitive benefits of the PBL approach.     

An intelligent mobile location-aware book recommendation system that enhances problem-based learning in libraries

Despite rapid and continued adoption of mobile devices, few learning modes integrate with mobile technologies and libraries' environments as innovative learning modes that emphasize the key roles of libraries in facilitating learning. In addition, some education experts have claimed that transmitting knowledge to learners is not the only educational goal, as cultivating problem-solving skills is also essential. By integrating the problem-based learning (PBL) model with book resources in libraries, one can identify the advantages of libraries in supporting e-Learning, resulting in innovative and valuable research. Therefore, this study presents a novel intelligent mobile location-aware book recommendation system (IMLBRS) with map-based guidance to support cooperative PBL in a real-library environment. Using map navigation and book recommendation functionalities, learners can search for books associated with problem-solving with increased ease and efficiency, thereby helping learners increase their PBL performance in a library environment. Experimental results reveal that learning performance during PBL supported by the proposed IMLBRS for book searches is superior to learning performance during PBL supported by the online public access catalogue (OPAC). Experimental results also show that the proposed system facilitates better learning performance for learners with a field-dependent learning style than for learners with a field-independent learning style. Moreover, the proposed system facilitates learner contemplation, cooperative learning, and library user education as learners interact with a real-library environment and peers during cooperative PBL.     

Integrating Clinical Reasoning Skills in a Pre-professional Undergraduate Human Anatomy Course

Clinically integrated curricula in health science education has been shown to promote the development of problem-solving schema and positively impact knowledge acquisition. Despite its’ purported benefits, this type of curricula can impose a high cognitive load, which may negatively impact novice learners’ knowledge acquisition and problem-solving schema development. Introducing explicit clinical reasoning instruction within pre-professional undergraduate basic science courses may limit factors that increase cognitive load, enhance knowledge acquisition, and foster developing clinical problem-solving skills. This study, conducted over the Fall and Spring semesters of the 2018–2019 school year, sought to evaluate whether the implementation of a clinical reasoning instructional intervention within a clinically integrated pre-professional undergraduate general human anatomy course influenced students’ acquisition of anatomical knowledge and development of clinical problem-solving skills. Results of the study were mixed regarding the acquisition of anatomical knowledge. Both the intervention and comparison groups performed similarly on multiple choice examinations of anatomical knowledge. However, the clinical reasoning intervention positively impacted students’ ability to apply clinical reasoning skills to anatomically based clinical case studies. Results from M\mixed between-within subjects analysis of variance comparing scores on Written Clinical Reasoning Assessments revealed a significant interaction between time and group affiliation, with the groups receiving the interventions outperforming the comparison groups: Fall, P < 0.001; Spring, P < 0.001. The results of this study may imply that explicit clinical reasoning instruction within a clinically integrated undergraduate Human Anatomy course could hold potential for fostering students’ early clinical reasoning skills.