Medical educators: How they define themselves – Results of an international web survey

Background: Little is known about medical educators’ self-definition.

Aims: The aim of this study is to survey an international community of medical educators focusing on the medical educators’ self-definition.

Methods: Within a comprehensive, web-based survey, an open question on the participants’ views of how they would define a “medical educator” was sent to 2200 persons on the mailing list of the Association for Medical Education in Europe. The free text definitions were analysed using qualitative thematic analysis.

Results: Of the, 2200 medical educators invited to participate, 685 (31.1%) provided a definition of a “medical educator”. The qualitative analysis of the free text definitions revealed that medical educators defined themselves in 13 roles, primarily as “Professional Expert”, “Facilitator”, “Information Provider”, “Enthusiast”, “Faculty Developer”, “Mentor”, “Undergraduate and Postgraduate Trainer”, “Curriculum Developer”, “Assessor and Assessment Creator”, and “Researcher”.

Conclusions: Our survey revealed that medical educators predominantly define themselves as “Professional Experts” and identified 12 further self-defined roles of a medical educator, several of which not to have been reported previously. The results can be used to further the understanding of our professional identity.     

Grappling with complexity: Medical students’ reflective writings about challenging patient encounters as a window into professional identity formation

Aim: Clerkship-specific interactive reflective writing (IRW)-enhanced reflection may enhance professional identity formation (PIF), a fundamental goal of medical education. PIF process as revealed in students? reflective writing (RW) has been understudied.

Methods: The authors developed an IRW curriculum within a Family Medicine Clerkship (FMC) and analyzed students? reflections about challenging/difficult patient encounters using immersion-crystallization qualitative analysis.

Results: The qualitative analysis identified 26 unique emergent themes and five distinct thematic categories (1. Role of emotions, 2. Role of cognition, 3. Behaviorally responding to situational context, 4. Patient factors, and 5. External factors) as well as an emergent PIF model from a directed content analysis. The model describes students? backgrounds, emotions and previous experiences in medicine merging with external factors and processed during student?patient interactions. The RWs also revealed that processing often involves polarities (e.g. empathy/lack of empathy or encouragement/disillusionment) as well as dissonance between idealized visions and lived reality.

Conclusions: IRW facilitates and ideally supports grappling with the lived reality of medicine; uncovering a “positive hidden curriculum” within medical education. The authors propose engaging learners in guided critical reflection about complex experiences for meaning-making within a safe learning climate as a valuable way to cultivate reflective, resilient professionals with “prepared” minds and hearts for inevitable challenges of healthcare practice.     

Development of cognitive processing and judgments of knowledge in medical students: Analysis of progress test results

Background: Beside acquiring knowledge, medical students should also develop the ability to apply and reflect on it, requiring higher-order cognitive processing. Ideally, students should have reached higher-order cognitive processing when they enter the clinical program. Whether this is the case, is unknown. We investigated students’ cognitive processing, and awareness of their knowledge during medical school.

Methods: Data were gathered from 347 first-year preclinical and 196 first-year clinical students concerning the 2008 and 2011 Dutch progress tests. Questions were classified based upon Bloom’s taxonomy: “simple questions” requiring lower and “vignette questions” requiring higher-order cognitive processing. Subsequently, we compared students’ performance and awareness of their knowledge in 2008 to that in 2011 for each question type.

Results: Students’ performance on each type of question increased as students progressed. Preclinical and first-year clinical students performed better on simple questions than on vignette questions. Third-year clinical students performed better on vignette questions than on simple questions. The accuracy of students’ judgment of knowledge decreased over time.

Conclusions: The progress test is a useful tool to assess students’ cognitive processing and awareness of their knowledge. At the end of medical school, students achieved higher-order cognitive processing but their awareness of their knowledge had decreased.     

Interprofessional learning through shadowing: Insights and lessons learned

Background: Interprofessional education (IPE) aims to improve patient outcomes. Interprofessional shadowing improves students’ knowledge of different roles and attitudes toward other professionals.

Aim: This study evaluates (1) how pre-clinical medical students describe the roles of the healthcare professionals they shadowed, and (2) whether shadowing can be used to introduce medical students to the benefits of interprofessional collaboration, and if so, in what ways.

Methods: Second-year medical students shadow another discipline and write a reflection on the shadowed discipline (SD)’s role and collaboration in patient care. A non-proportional stratified random sample of these reflections was coded during an iterative process. Any number of the 13 possible codes could be assigned to each reflection. Codes relevant to the research questions underwent narrative analysis.

Results: The most frequent codes were “specific function of SD” (88%), “SD’s general purpose” (86%), and “value of SD’s role” (68%). One-third of reflections referenced “communication,” and one-third mentioned “teamwork.” Insights gained included an appreciation for interprofessional care and a global perspective on patient care, extending beyond the inpatient encounter.

Conclusion: Through shadowing, students achieve several IPE core competencies and a broader perspective on patient care. Shadowing is an effective pedagogical method for IPE in the pre-clerkship curriculum.     

What works best in a general practice specific OSCE for medical students: Mini-CEX or content-related checklists?

Abstract

Aim: To develop and pilot a General Practice (GPr) OSCE assessing medical students dealing with patient encounters, which are typical for GPr and to compare different measurement instruments (global ratings, content-specific checklists).

Methods: A blueprint based on Entrusted Professional Activities was used to develop prototypical OSCE stations. Four stations were tested with voluntary medical students. Students were videotaped and assessed with self-developed content-specific checklists, a global rating for communication skills, and mini-CEX. Results were compared according to students’ phases of studies.

Results: All three measurements were able to discriminate between clinical and pre-clinical students. Clearest results were achieved by using mini-CEX. Content-specific checklists were not able to differentiate between those groups for the more difficult stations. Inter-station reliability for the global ratings was sufficient for high-stakes exams. Students enjoyed the OSCE-setting simulating GPr consultation hours. They would prefer feedback from GPs after the OSCE and from simulated patients after each encounter.

Discussion and conclusion: Although the OSCE was short, results indicate advantages for using a global rating instead of checklists. Further research should include validating these results with a larger group of students and to find the threshold during the phases of education for switching from checklists to global ratings.     

Working in global health: A planning and implementation framework for international electives

Abstract

Purpose: Propose a framework for planning and undertaking an international elective.

Methods: On returning from conducting maternal health and well-being research in several remote communities in India, two undergraduate medical students have reflected on and documented their experiences with the view to assisting other students (and their supervisors) considering undertaking an international elective.

Results: A framework for undertaking clinical or research electives in remote or rural communities is presented. The framework comprises three distinct phases: Pre-departure planning and briefing, in-country experiences and returning from the elective and considers a range of factors to ensure that, as a minimum, visiting students “do no harm” and are themselves not harmed.

Conclusions: Students’ home institutions have a duty of care for preparing them for their international electives by providing pre-departure training, support during the elective and comprehensive de-briefing on their return. These electives should be evaluated (including by host communities) to ensure that exchanges are socially accountable, with no harm to the often-vulnerable communities in which students gain considerable experience. Also important is that future students build on the positive experiences of their predecessors to ensure sustainability of any interventions in host communities.     

An online app platform enhances collaborative medical student group learning and classroom management

Purpose: The authors presented their results in effectively using a free and widely-accessible online app platform to manage and teach a first-year pathology course at Mayo Medical School.

Methods used: The authors utilized the Google “Blogger”, “Forms”, “Flubaroo”, “Sheets”, “Docs”, and “Slides” apps to effectively build a collaborative classroom teaching and management system. Students were surveyed on the use of the app platform in the classroom, and 44 (94%) students responded.

Results: Thirty-two (73%) of the students reported that “Blogger” was an effective place for online discussion of pathology topics and questions. 43 (98%) of the students reported that the “Forms/Flubaroo” grade-reporting system was helpful. 40 (91%) of the students used the remote, collaborative features of “Slides” to create team-based learning presentations, and 39 (89%) of the students found those collaborative features helpful. “Docs” helped teaching assistants to collaboratively create study guides or grading rubrics. Overall, 41 (93%) of the students found that the app platform was helpful in establishing a collaborative, online classroom environment.

Conclusions: The online app platform allowed faculty to build an efficient and effective classroom teaching and management system. The ease of accessibility and opportunity for collaboration allowed for collaborative learning, grading, and teaching.     

Cartoon versus traditional self-study handouts for medical students: CARTOON randomized controlled trial

Objective: The objective of this study is to compare the effectiveness of a “cartoon-style” handout with a “traditional-style” handout in a self-study assignment for preclinical medical students.

Methods: Third-year medical students (n?=?93) at the Faculty of Medicine Ramathibodi Hospital, Mahidol University, took a pre-learning assessment of their knowledge of intercostal chest drainage. They were then randomly allocated to receive either a “cartoon-style” or a “traditional-style” handout on the same topic. After studying these over a 2-week period, students completed a post-learning assessment and estimated their levels of reading completion.

Results: Of the 79 participants completing the post-learning test, those in the cartoon-style group achieved a score 13.8% higher than the traditional-style group (p?=?0.018). A higher proportion of students in the cartoon-style group reported reading ≥75% of the handout content (70.7% versus 42.1%). In post-hoc analyses, students whose cumulative grade point averages (GPA) from previous academic assessments were in the middle and lower range achieved higher scores with the cartoon-style handout than with the traditional one. In the lower-GPA group, the use of a cartoon-style handout was independently associated with a higher score.

Conclusions: Students given a cartoon-style handout reported reading more of the material and achieved higher post-learning test scores than students given a traditional handout.     

Exploring the feasibility and acceptability of using tactical decision games to develop final year medical students’ non-technical skills

Introduction: Clinical decision-making, situation awareness, task management, and teamwork are key non-technical skills (NTS) required by junior doctors. Tactical decision games (TDGs) are low-fidelity classroom-based activities designed to develop proficiency in NTS. This study aimed to explore the feasibility and acceptability of using TDGs as a novel teaching method for final year medical students.

Methods: Final year medical students at the University of Edinburgh participated in a single TDG session. Focus groups were then used to explore students’ perceptions of participating in the TDG session and transcribed data from the focus groups was thematically analyzed.

Results: Six key themes emerged from the data: “the value of non-medical games”; “giving and receiving feedback”; “observing and reflecting”; “recognizing and understanding NTS”; “dealing with uncertainty and ambiguity”, and “introducing TDGs into the curriculum”.

Conclusions: TDGs are an easy-to-use, low-fidelity method of teaching medical students about the importance of NTS. Medical students view TDGs as a valuable learning activity that appears to increase awareness and understanding of the importance of NTS.     

Reforms in VUmc School of Medical Sciences Amsterdam: Student engagement,a Minor elective semester and stakeholder collaboration in improving the quality of assessments

Abstract

Background: At VUmc School of Medical Sciences, major curricular reforms occurred in 2005 and 2015, related to the introduction of a Bachelor-Master structure, a new legislation from the Ministry of Education, the changing societal context, and taking note of students’ and teachers’ needs.

Summary of work: Along with the introduction of the Bachelor-Master system, the period between 2005 and 2009 saw the movement from traditional lecture-based teaching to small group teaching in a competency-based curriculum, in which the students were responsible for their learning. Student engagement grew through students’ designing learning modules and conducting some of the teaching. In the Bachelor program, an elective “Minor”, was designed to broaden and deepen the knowledge of our students beyond the core learning outcomes, in a discipline of their choice. The examination board (EB), responsible for maintaining the quality of assessment, was split into the General EB, which handled overall strategy issues, and the Executive EB, which handled student requests and monitored the quality of assessments.

Lessons learned: Students develop a sense of what education is about if they are provided opportunities in designing teaching and conducting it. A Minor elective in the medical study can provide the students with an opportunity to learn outside the medical field. Collaborative working between different stakeholders in a medical school is crucial for safeguarding the quality of assessments. Curricular reforms need time to be accepted and integrated into the culture of the medical school. The educational vision needs to be refreshed regularly in alignment with the changing societal context.     

Development of a phenomenologically derived method to assess affective learning in student journals following impactive educational experiences

Background: Assessment of affective learning (AL) is difficult but important, particularly for health professional students, where it is intimately linked to the development of professional values. This study originally aimed to determine whether an emotionally impactive, extended, multimethod, interprofessional simulation experience enhanced the AL of senior medical students, compared to conventional seminars and workshops alone. This necessitated the development of a method to assess for the presence and quality of AL.

Methods: We developed a “double hermeneutic” method, derived from Smith’s Interpretative Phenomenological Analysis, to identify examples of AL, according to Krathwohl’s hierarchy (“receiving,” “responding,” “valuing,” “organization,” “characterization”), in the journals of students from each arm of a randomized educational trial. Three assessors rated the highest level of AL seen in each journal and then we compared ratings from the two study arms.

Results: A total of 135 journals were available for assessment (81 Intervention, 54 Control). The method proved to be effective in identifying and characterizing examples of uniprofessional and interprofessional AL. The median level identified in Intervention journals (“valuing”) was significantly higher than Control journals (“responding,” p?Conclusions: The method described provides a means to assess affective learning among health professional students. An extended, immersive simulation experience appears to enhance affective learning.     

Boosting clinical performance: The impact of enhanced final year placements

Background: This study follows on from a study that investigated how to develop effective final year medical student assistantship placements, using multidisciplinary clinical teams in planning and delivery.

Aims: This study assessed the effects on objective structured clinical examination (OSCE) performance of the in-course enhanced “super-assistantship” placement introduced to a randomly selected sample of 2013–14 final year medical students at Leeds medical school.

Methods: Quantitative data analysis was used to compare the global grades of OSCE stations between students who undertook this placement against those who did not.

Results: There was a small overall improvement in the “super-assistantship” student scores across the whole assessment (effect size?=?0.085). “Pre-op Capacity”, “Admissions Prescribing” and “Hip Pain” stations had small-medium effect sizes (0.226, 0.215, and 0.214) in favor of the intervention group. Other stations had small effect sizes (0.107–0.191), mostly in favor of the intervention group.

Conclusions: The “super-assistantship” experience characterized by increasing student responsibility on placement can help to improve competence and confidence in clinical decision-making “in a simulated environment”. The clinical environment and multidisciplinary team must be ready and supported to provide these opportunities effectively. Further in-course opportunities for increasing final year student responsibility should be developed.     

Defining curricular priorities for student-as-teacher programs: A National Delphi Study

Background: “Student-as-Teacher” (SaT) programs have been growing in number to prepare medical students for their teaching roles in residency and beyond, but it remains unknown what content areas should be covered in SaT curricula.

Aim: To determine five to ten “essential” content areas for inclusion in SaT curricula using expert opinion.

Methods: Using a three-round Delphi process, moderators iteratively surveyed a panel of 28 medical educators (25 academy directors and three individuals identified as having expertise in undergraduate medical education) representing 25 medical schools in the United States. This “SaT Delphi Working Group” was tasked with rating topics for inclusion in SaT curricula on a 3-point scale (i.e. 1. “essential,” 2. “important, but not essential” 3. “not important”). Topics achieving ≥70% consensus as “essential,” “important” or “not important” were accepted by the moderators and removed from subsequent rounds.

Results: Hundred per cent response rate (n?=?28) was achieved for all survey rounds. Five content areas reached consensus as “essential” for inclusion in a SaT curriculum: feedback, bedside teaching and clinical precepting, small-group teaching, case-based teaching and professionalism as a medical educator.

Conclusion: This consensus from a group of leaders in medical education is a first step toward the implementation of more developmentally-appropriate SaT competencies.     

COVID 19: Designing and conducting an online mini-multiple interview (MMI) in a dynamic landscape

Abstract

Introduction: The COVID-19 pandemic presented numerous, significant challenges for medical schools, including how to select the best candidates from a pool of applicants when social distancing and other measures prevented “business as usual” admissions processes. However, selection into medical school is the gateway to medicine in many countries, and it is critical to use processes which are evidence-based, valid and reliable even under challenging circumstances. Our challenge was to plan and conduct a multiple-mini interview (MMI) in a dynamic and stringent safe distancing context.

Methods: This paper reports a case study of how to plan, re-plan and conduct MMIs in an environment where substantially tighter safe distancing measures were introduced just before the MMI was due to be delivered.

Results: We report on how to design and implement a fully remote, online MMI which ensured the safety of candidates and assessors.

Discussion: We discuss the challenges of this approach and also reflect on broader issues associated with selection into medical school during a pandemic. The aim of the paper is to provide broadly generalizable guidance to other medical schools faced with the challenge of selecting future students under difficult conditions.     

Medical students and professionalism – Do the hidden curriculum and current role models fail our future doctors?

Purpose: Formal medical curricula aim to promote professionalism through learning from lectures, interactive tutorials and simulations. We report an exploratory voting exercise, conducted within a new integrated professional teaching module, examining the likely influence on students’ knowledge and perceptions of truth telling.

Methods: Responses were collected from cohorts of final year students over a six-year period. Students were asked to pick between two responses to a standardized clinical vignette, firstly the response that they personally thought was the more desirable action, and subsequently the response they believed would most likely result in the context of everyday real-life clinical practice.

Results: The difference (proportional change) in voting for “avoid full disclosure” from vote 1 (more desirable action) to vote 2 (likely real-life response) was 50% (95% CI: 36–64%, p?Conclusions: This finding highlights a substantial inconsistency between the knowledge taught by the formal curriculum, and the perception generated by the hidden curriculum. Medical Schools should develop strategies to manage the hidden curriculum, prepare clinical teachers to be good role models, and prepare students to be discerning about the hidden curriculum and when choosing role models.     

Small group activities within academic communities improve the connectedness of students and faculty

Background: The University of California, San Diego, School of Medicine implemented a curriculum change that included reduction of lectures, incorporation of problem-based learning and other small group activities. Six academic communities were introduced for teaching longitudinal curricular content and organizing extracurricular activities.

Methods: Surveys were collected from 904 first- and second-year medical students over 6 years. Student satisfaction data with their sense of connectedness and community support were collected before and after the implementation of the new curriculum. In a follow-up survey, medical students rated factors that contributed to their sense of connectedness with faculty and students (n?=?134).

Results: Students’ perception of connectedness to faculty significantly increased following implementation of a curriculum change that included academic communities. Students ranked small group clinical skills activities within academic communities significantly higher than other activities concerning their sense of connectedness with faculty. Students’ perception of connectedness among each other was high at baseline and did not significantly change. Small group activities scored higher than extracurricular activities regarding students’ connectedness among themselves.

Conclusions: The implementation of a new curriculum with more small group educational activities including academic communities enhanced connectedness between students and faculty and resulted in an increased sense of community.     

Medical students' perception of test anxiety triggered by different assessment modalities

Abstract

Objectives: Test anxiety is well known among medical students. However, little is known about test anxiety produced by different components of exam individually. This study aimed to stratify varying levels of test anxiety provoked by each exam modality and to explore the students perceptions about confounding factors.

Methods: A self-administered questionnaire was administered to medical students. The instrument contained four main themes; lifestyle, psychological and specific factors of information needs, learning styles, and perceived difficulty level of each assessment tool.

Results: A highest test anxiety score of 5 was ranked for “not scheduling available time” and “insufficient exercise” by 28.8 and 28.3% students, respectively. For “irrational thoughts about exam” and “fear to fail”, a highest test anxiety score of 5 was scored by 28.8 and 25.7% students, respectively. The highest total anxiety score of 1255 was recorded for long case exam, followed by 975 for examiner-based objective structured clinical examination. Excessive course load and course not well covered by faculty were thought to be the main confounding factors.

Conclusions: The examiner-based assessment modalities induced high test anxiety. Faculty is urged to cover core contents within stipulated time and to rigorously reform and update existing curricula to prepare relevant course material.     

“But Dr Google said…” – Training medical students how to communicate with E-patients

Abstract

Purpose: Patients who have access to information online may feel empowered and also confront their physicians with more detailed questions. Medical students are not well-prepared for dealing with so-called “e-patients.” We created a teaching module to deal with this, and evaluate its effectiveness.

Method: Senior medical students had to manage encounters with standardized patients (SPE) in a cross-over design. They received blended-learning teaching on e-patients and a control intervention according to their randomization group (EI/LI?=?early/late intervention). Each SPE was rated by two blinded video raters, the SP and the student.

Results: N?=?46 students could be included. After the intervention, each group (EI, LI) significantly improved their competency in dealing with e-patients as judged by expert video raters (EI: M_T0?=?9.75 (2.51) versus M_T1?=?16.60 (2.80); LI: M_T0?=?8.70 (2.14) versus M_T2?=?15.20 (2.84); both p < 0.001) and SP (EI: M_T0?=?24.13 (4.83) versus M_T1?=?26.52 (3.06); LI: M_T0?=?23.37 (3.10) versus M_T2?=?27.47 (4.38); both p < 0.001). Students’ rating showed a similar non-significant trend.

Conclusions: Students, SP and expert video raters determined that blended-learning teaching can improve students’ competencies when dealing with e-patients. Within the study period, this effect was lasting; however, further studies should look at long-term outcomes.