Usability evaluation of pharmacogenomics clinical decision support aids and clinical knowledge resources in a computerized provider order entry system: A mixed methods approach

BackgroundPharmacogenomics (PGx) is positioned to have a widespread impact on the practice of medicine, yet physician acceptance is low. The presentation of context-specific PGx information, in the form of clinical decision support (CDS) alerts embedded in a computerized provider order entry (CPOE) system, can aid uptake. Usability evaluations can inform optimal design, which, in turn, can spur adoption.ObjectivesThe study objectives were to: (1) evaluate an early prototype, commercial CPOE system with PGx-CDS alerts in a simulated environment, (2) identify potential improvements to the system user interface, and (3) understand the contexts under which PGx knowledge embedded in an electronic health record is useful to prescribers.MethodsUsing a mixed methods approach, we presented seven cardiologists and three oncologists with five hypothetical clinical case scenarios. Each scenario featured a drug for which a gene encoding drug metabolizing enzyme required consideration of dosage adjustment. We used Morae^® to capture comments and on-screen movements as participants prescribed each drug. In addition to PGx-CDS alerts, ‘Infobutton^®’ and ‘Evidence’ icons provided participants with clinical knowledge resources to aid decision-making.ResultsNine themes emerged. Five suggested minor improvements to the CPOE user interface; two suggested presenting PGx information through PGx-CDS alerts using an ‘Infobutton’ or ‘Evidence’ icon. The remaining themes were strong recommendations to provide succinct, relevant guidelines and dosing recommendations of phenotypic information from credible and trustworthy sources; any more information was overwhelming. Participants’ median rating of PGx-CDS system usability was 2 on a Likert scale ranging from 1 (strongly agree) to 7 (strongly disagree).ConclusionsUsability evaluation results suggest that participants considered PGx information important for improving prescribing decisions; and that they would incorporate PGx-CDS when information is presented in relevant and useful ways.     

Design and development of a mobile computer application to reengineer workflows in the hospital and the methodology to evaluate its effectiveness

This paper describes a new method of collecting additional data for the purpose of skin cancer research from the patients in the hospital using the system Mobile Computing in Medicine Graz (MoCoMed-Graz). This system departs from the traditional paper-based questionnaire data collection methods and implements a new composition of evaluation methods to demonstrate its effectiveness.The patients fill out a questionnaire on a Tablet-PC (or iPad Device) and the resulting medical data is integrated into the electronic patient record for display when the patient enters the doctor’s examination room. Since the data is now part of the electronic patient record, the doctor can discuss the data together with the patient making corrections or completions where necessary, thus enhancing data quality and patient empowerment. A further advantage is that all questionnaires are in the system at the end of the day - and manual entry is no longer necessary - consequently raising data completeness. The front end was developed using a User Centered Design Process for touch tablet computers and transfers the data in XML to the SAP based enterprise hospital information system. The system was evaluated at the Graz University Hospital - where about 30 outpatients consult the pigmented lesion clinic each day - following Bronfenbrenner’s three level perspective: The microlevel, the mesolevel and the macrolevel:

On the microlevel, the questions answered by 194 outpatients, evaluated with the System Usability Scale (SUS) resulted in a median of 97.5 (min: 50, max: 100) which showed that it is easy to use.

On the mesolevel, the time spent by medical doctors was measured before and after the implementation of the system; the medical task performance time of 20 doctors (age median 43 (min: 29; max: 50)) showed a reduction of 90%.

On the macrolevel, a cost model was developed to show how much money can be saved by the hospital management. This showed that, for an average of 30 patients per day, on a 250 day basis per year in this single clinic, the hospital management can save up to 40,000 EUR per annum, proving that mobile computers can successfully contribute to workflow optimization.

     

Clinical simulation: A method for development and evaluation of clinical information systems

Use of clinical simulation in the design and evaluation of eHealth systems and applications has increased during the last decade. This paper describes a methodological approach for using clinical simulations in the design and evaluation of clinical information systems. The method is based on experiences from more than 20 clinical simulation studies conducted at the ITX-lab in the Capital Region of Denmark during the last 5 years. A ten-step approach to conducting simulations is presented in this paper. To illustrate the approach, a clinical simulation study concerning implementation of Digital Clinical Practice Guidelines in a prototype planning and coordination module is presented. In the case study potential benefits were assessed in a full-scale simulation test including 18 health care professionals. The results showed that health care professionals can benefit from such a module. Unintended consequences concerning terminology and changes in the division of responsibility amongst healthcare professionals were also identified, and questions were raised concerning future workflow across sector borders. Furthermore unexpected new possible benefits concerning improved communication, content of information in discharge letters and quality management emerged during the testing. In addition new potential groups of users were identified. The case study is used to demonstrate the potential of using the clinical simulation approach described in the paper.     

An architecture for a continuous,user-driven,and data-driven application of clinical guidelines and its evaluation

ObjectivesDesign, implement, and evaluate a new architecture for realistic continuous guideline (GL)-based decision support, based on a series of requirements that we have identified, such as support for continuous care, for multiple task types, and for data-driven and user-driven modes.MethodsWe designed and implemented a new continuous GL-based support architecture, PICARD, which accesses a temporal reasoning engine, and provides several different types of application interfaces. We present the new architecture in detail in the current paper. To evaluate the architecture, we first performed a technical evaluation of the PICARD architecture, using 19 simulated scenarios in the preeclampsia/toxemia domain. We then performed a functional evaluation with the help of two domain experts, by generating patient records that simulate 60 decision points from six clinical guideline-based scenarios, lasting from two days to four weeks. Finally, 36 clinicians made manual decisions in half of the scenarios, and had access to the automated GL-based support in the other half. The measures used in all three experiments were correctness and completeness of the decisions relative to the GL.ResultsMean correctness and completeness in the technical evaluation were 1 ± 0.0 and 0.96 ± 0.03 respectively. The functional evaluation produced only several minor comments from the two experts, mostly regarding the output’s style; otherwise the system’s recommendations were validated. In the clinically oriented evaluation, the 36 clinicians applied manually approximately 41% of the GL’s recommended actions. Completeness increased to approximately 93% when using PICARD. Manual correctness was approximately 94.5%, and remained similar when using PICARD; but while 68% of the manual decisions included correct but redundant actions, only 3% of the actions included in decisions made when using PICARD were redundant.ConclusionsThe PICARD architecture is technically feasible and is functionally valid, and addresses the realistic continuous GL-based application requirements that we have defined; in particular, the requirement for care over significant time frames. The use of the PICARD architecture in the domain we examined resulted in enhanced completeness and in reduction of redundancies, and is potentially beneficial for general GL-based management of chronic patients.     

Strategies to facilitate shared decision-making about pediatric oncology clinical trial enrollment: A systematic review

Objective

We conducted a systematic review to identify the strategies that have been recommended in the literature to facilitate shared decision-making regarding enrolment in pediatric oncology clinical trials.

Curriculum content and evaluation of resident competency in clinical pathology (laboratory medicine): a proposal

Ten years have passed since the Graylyn Conference Report on Laboratory Medicine Clinical Pathology training was issued. Over that period, the Accreditation Council for Graduate Medical Education substantially revised the requirements for training programs; the American Board of Pathology amended both the requirements and the periods needed for certification; and the discipline itself, along with the broader discipline of pathology, evolved significantly. Recently, a curriculum proposal in anatomical pathology was published as a potential template to be used by training programs to help meet these new and evolving needs. Toward the same end, the Academy of Clinical Laboratory Physicians and Scientists has now developed a template for a curriculum in clinical pathology (laboratory medicine), taking into account newly designated and revised areas of residency core competency, the alterations in training requirements promulgated by the Accreditation Council for Graduate Medical Education and American Board of Pathology, and the rapidly developing nature of the discipline itself. The proposed clinical pathology curriculum defines goals and objectives for training, provides guidelines for instructional methods, and gives examples of how outcomes can be assessed. This curriculum is presented as a potentially helpful outline for use by pathology residency training programs.     

Training faculty to facilitate communication skills training: development and evaluation of a workshop

OBJECTIVE: To develop a workshop for training faculty to facilitate small group role play sessions for a communication skills training program and assess the impact of that workshop on the trainees' self-efficacy about facilitation skills. METHODS: A multi-specialty group of 33 attending physicians at a Comprehensive Cancer Center were trained in a Facilitating Communication Skills Training workshop in order to prepare them to facilitate small group role play with fellows and residents. The workshop curriculum was based on theory and literature on teaching communication skills. RESULTS: The workshop had a significant effect on participants' self-efficacy in facilitating communication skills training. At least 75% of participants reported feeling comfortable facilitating communication skills training small groups. CONCLUSION: This facilitation workshop was successful in providing participants with confidence to successfully facilitate small group role play sessions in communication skills training. PRACTICE IMPLICATIONS: In order to evaluate the effectiveness of communication skills training programs, it is important to have trained facilitators who adhere to a set of facilitation guidelines. Workshops on facilitation skills provide the background and practice time necessary as a first step in the training process.     

Barriers and facilitators to implementing shared decision-making in clinical practice: update of a systematic review of health professionals' perceptions

Objective

To update a systematic review on the barriers and facilitators to implementing shared decision-making in clinical practice as perceived by health professionals.

Methods

From March to December 2006, PubMed, Embase, CINHAL, PsycINFO, and Dissertation Abstracts were searched. Studies were included if they reported on health professionals’ perceived barriers and facilitators to implementing shared decision-making in practice. Quality of the included studies was assessed. Content analysis was performed with a pre-established taxonomy.

Results

Out of 1130 titles, 10 new eligible studies were identified for a total of 38 included studies compared to 28 in the previous version. The vast majority of participants (n = 3231) were physicians (89%). The three most often reported barriers were: time constraints (22/38) and lack of applicability due to patient characteristics (18/38) and the clinical situation (16/38). The three most often reported facilitators were: provider motivation (23/38) and positive impact on the clinical process (16/38) and patient outcomes (16/38).

Conclusion

This systematic review update confirms the results of the original review.

Practice implications

Interventions to foster implementation of shared decision-making in clinical practice will need to address a range of factors.     

Medical students learning the pelvic examination: comparison of outcome in terms of skills between a professional patient and a clinical patient model

OBJECTIVE: To compare two models of learning the pelvic examination (PE) for medical students, with professional patients (PP) or with clinical patients (CP), by measuring perceived distress and learning outcome in terms of skills. METHODS: Prospective longitudinal study. Assessments of self-perceived distress on four occasions at the prospect of performing a PE. Evaluation of the learning session (LS) and clinical clerkship concerning outcome of palpation skills. RESULTS: During the LS, students in the PP model (PP students) received enough guidance from their coaches, were certain they had palpated the uterus and at least one ovary, and were less distressed afterwards compared with students who were instructed using the CP model (CP students). During the clinical clerkship, the PP students performed twice as many PEs as CP students did and had more often confirmed palpating the uterus and an ovary. CONCLUSION: PP students were more skilful in palpating the uterus and ovaries and performed more PEs during the clinical clerkship than did CP students. PRACTICE IMPLICATIONS: Engaging healthy and voluntary women as PPs takes time and effort. It is, however, worthwhile as it increases the confidence of students who perform PEs, makes them more competent, and ultimately improves their skills in performing the examination during their clinical clerkship.     

Feasibility,acceptability, and effectiveness of a decision aid versus an informational website to promote clinical trial decision-making among cancer patients: A pilot randomized controlled trial

ObjectiveTo assess intervention feasibility and acceptability, and compare the effectiveness of the CHOICES Decision Aid (DA) versus the National Cancer Institute (NCI) Cancer Clinical Trials (CCT) website to improve knowledge about CCTs and preparedness to make an informed decision.MethodsOncology patients (n = 101) with a scheduled clinic visit were enrolled and randomized. Decision-making variables were collected at two timepoints. Post-intervention scores were examined via paired t-tests and multivariate regression analyses. Predictors of the magnitudes of the change in scores were examined in multivariable regression analyses.ResultsThe interventions were feasible to implement and acceptable to participants. Both interventions increased objective and subjective knowledge, improved clarity of opinions, and reduced decisional conflict (p-values < 0.01). Improvements in the belief that one could find out about CCTs were observed in the CHOICES DA arm (p < 0.001). Multivariable analyses controlling for educational attainment showed no significant differences in the magnitude of change in outcome variables between intervention arms, but did find that improvements in some variables in the NCI arm – but not CHOICES DA arm – were associated with previous educational attainment.ConclusionsInterventions were feasible to implement and acceptable. Improvements in knowledge and decision-making outcomes were observed in both arms, supporting the view that interventions to improve CCT decision making are effective and feasible. Our results suggest that the CHOICES DA may be more effective than an informational website in improving decision-making outcomes regardless of participants’ educational attainment.Practice implicationsCCT resources should support informed decision-making among all cancer survivors, regardless of educational attainment.     

The unintended contribution of clinical microbiology laboratories to climate change and mitigation strategies: a combination of descriptive study,short survey,literature review and opinion

ObjectiveClimate change poses a significant threat to humanity and human activity is largely responsible for it. Clinical microbiology laboratories have their unintended shares in carbon dioxide (CO₂) emissions. The aim of this study is to estimate CO₂ emission of a clinical microbiology laboratory and to propose initiatives to reduce the emissions.MethodsCO₂ emission of instruments was estimated based on their electricity consumption. CO₂ emitted in producing consumables was estimated by weighing the consumables needed to perform major tests in a large academic hospital. A systematic literature review was performed to identify studies on the impact of clinical microbiology laboratories on the environment. A short survey was sent to four major manufacturers of agar plates on initiatives to reduce the environmental impact of their products. Opinion was given on activities that can reduce CO₂ emission in laboratories.ResultsThe study shows that the largest amount of CO₂ emission in the microbiological laboratories comes from consumables and personnel commuting. For example, the production and transportation of agar plates needed to culture samples for a year in a hospital with 1320 beds result in 16 590 kg CO₂ is emitted. All survey participants mentioned that they were committed to reduce environmental impact of their products. The initiatives to reduce CO₂ emission can be performed at the laboratory and at policy level, such as reducing the number of tests to only the necessary amount to reduce consumables.DiscussionThe calculations contribute to map CO₂-related emissions in clinical microbiology laboratory activities, and the proposed initiatives to reduce the CO₂ may serve as starting point for further discussions.     

Clinical anatomy as the basis for clinical examination: development and evaluation of an Introduction to Clinical Examination in a problem-oriented medical curriculum

Clinical anatomy is usually defined as anatomy applied to patient care. The question is asked whether students of a new horizontally and vertically integrated medical curriculum recognize the subject as the basis for clinical examination. A clinical anatomy practicum was developed in the special activity, "Introduction to Clinical Medicine," held in the second year of the Pretoria medical curriculum. The practicum was conducted on a station basis to anatomically prepare the student for the inspection, palpation, percussion, and auscultation of the cardiovascular, respiratory, abdominal, and urogenital systems. A total of 23 stations consisting of eight cardiovascular, seven respiratory, and eight abdominal/urogenital stations were designed. Standardized patients, cadavers, skeletons, prosected specimens, x-rays, computed tomography (CT) scans, magnetic resonance imaging (MRI), multimedia programs, and clinical case studies were used as resources. A Likert-type questionnaire was used for student evaluation of the practicum. Most students realized the importance of surface anatomy for a family physician. More than two-thirds thought the practicum improved their understanding of the anatomical basis for clinical examination. The minority of students were stimulated to do further reading on clinical examination. The students' response to their ability to integrate the clinical examination with the radiological anatomy was average. Most students were continuously aware of the appropriateness of the practicum for their future career. We conclude that medical students recognize the importance of anatomy as the basis for clinical examination when exposed to an appropriate integrated presentation format.