The reliability and validity of the Chinese version of nurses’ self-concept questionnaire

cao x.y., Liu X.H., tian l. & guo y.q. (2013) Journal of Nursing Management  21 , 657–667 The reliability and validity of the Chinese version of nurses’ self-concept questionnaire Aim To examine the reliability and validity of the Chinese version of nurses’ self-concept questionnaire. Background Nurses’ self-concept is important to alleviate the current shortage of nurses. Nurses’ self-concept questionnaire is an effective instrument to measure nurses’ self-perception of professional competencies. However, the psychometric properties of the Chinese version have not been tested. Methods A two-stage research design was used in this study. At Stage 1347 registered nurses were recruited to establish the psychometric properties of the Chinese version. At Stage 2, a confirmatory factor analysis was used to examine the extracted factor structure from Stage 1 with 1017 respondents as a sample. Results The internal consistency of the Chinese version was 0.95 and the test–retest reliability was 0.83. The exploratory factor analysis extracted six dimensions. The findings at Stage 2 showed an acceptable model fit and discriminant validity. The Chinese version was a significant predictor of Maslach Burnout Inventory (β = −0.58; P = 0.00). Conclusions This study verified the psychometric properties of the Chinese version of nurses’ self-concept questionnaire. Implication for nursing management The Chinese version of nurses’ self-concept questionnaire will facilitate the evaluation of professional self-concept among nurses and help to develop the individualized self-concept strategies.     

Emotional care experienced by hospitalised patients: development and testing of a measurement instrument

Aims and objectives. This paper describes the development and preliminary psychometric testing of an instrument that evaluates the emotional care experienced by patients during hospitalisation. Background. Previous qualitative work using the Grounded Theory method identified the characteristics of interpersonal interactions that hospitalised patients perceived to be therapeutic. Three conditions were associated with the patient’s experience of emotional comfort: the patient’s perceived Level of Security, Level of Knowing and Level of Personal Value. Questions relating to each of these conditions were included in this new instrument. Design. Instrument development and psychometric testing. Method. Preliminary psychometric testing was carried out in four phases: construction of the instrument; assessment of face and content validity; testing for clarity and feasibility for use with hospitalised patients; assessment of reliability, construct validity of the tool and assessment of the internal structure. Conclusions. A hospital‐wide survey was carried out and the instrument was completed by a total sample of 132 patients. Two of the three sub‐scales achieved an internal consistency estimate of at least 0·70. The construct validity of the tool confirmed the previously identified characteristics of patients in need of additional emotional care. Exploratory factor analysis established two of the sub‐scales and identified a fourth sub‐scale which was named ‘Level of Connection’. Encouraging reliability and validity estimates were obtained and the instrument was improved. Further testing with larger samples is recommended. Relevance to clinical practice. This questionnaire, which is completed by hospitalised patients, differs from other instruments because it evaluates the interactions of all hospital staff rather than only nursing staff. This instrument can be used to identify patients who may be in need of additional emotional care and to evaluate the effectiveness of interventions directed at improving the emotional well‐being of patients.     

Perceived professional preparedness of senior nursing students' questionnaire: Development and psychometric evaluation

BackgroundNursing students' perceptions of their professional preparedness help them perform their independent nursing role with self-confidence.ObjectivesTo develop and psychometric testing of an instrument, the “Perceived Professional Preparedness of senior Nursing Students” questionnaire.DesignMixed-method exploratory study.MethodsWe conducted this study in two phases: (1) development of initial questionnaire through interview and literature review; (2) evaluation of psychometric properties of the instrument to introduce a reliable, valid tool.Settings and participantsWe assessed qualitative and quantitative face validity of initial questionnaire by administering it to 10 nursing students. Then, a panel of 10 nursing specialists determined the Content Validity Index. After modifying items, we assessed the construct validity of the 45-item questionnaire. A sample of 159 senior nursing students completed the questionnaire, and we conducted exploratory and confirmatory factor analysis using this data. To assess the test-retest reliability, 30 students completed the instrument twice with a two-week time interval.ResultsThe Content Validity Index with the modified Kappa coefficient was calculated as ≥0.72, which is considered satisfactory. In exploratory factor analysis using the maximum likelihood method and varimax rotation, we extracted 19 items in four factors. This structure included 61.91% of the total variance. The factors were clinical competency, evidence-based practice, framework-oriented performance, and patient-centered care. Cronbach's alpha coefficient and McDonald's omega values higher than 0.70 and inter-class correlation coefficient above 0.90 for all factors confirmed reliability. Confirmatory factor analysis indicated a suitable fitting of the final developed model.ConclusionThe developed questionnaire is a valid, reliable tool to assess the perceived preparedness of senior nursing students for transition to the clinical setting. Further psychometric testing for this questionnaire on larger populations and in different contexts is suggested.     

Development and testing of the parental coping strategy inventory (PCSI) with children with cancer in Taiwan

RATIONALE: This study describes the development and psychometric testing of the parental coping strategy inventory (PCSI). METHODS: The PCSI was developed on the basis of previous qualitative study on the Taiwanese parental adaptation process, when caring for children with cancer. In order to develop the measure of parental coping strategy inventory (PCSI), relevant parameters or items for the assessment subscales were then identified and tested in a three-stage process: item development, content validity testing and reliability testing. The PCSI consisted of 48 items in 12 scales after item selection, and the internal consistency of the scales were acceptable. In order to test the psychometric characteristics of the PCSI, data were collected from 183 mothers with children with cancer. RESULTS: Confirmatory factor analysis supported a good overall model fit of the construct validity of PCSI. In order to test the generalizability of the factor structure, mothers with children with epilepsy were used. The factorial validity of PCSI was supported from the population of those mothers with children with epilepsy. CONCLUSIONS: This version of the PCSI was developed with an explicit prior conceptual model based on grounded qualitative study findings. The PCSI is a specified coping behaviour measure with the conceptual framework that adaptation problems can be solved through specific coping strategies. It can be administered in 20 minutes and is the first documented measure of the adaptation process administered directly to Taiwanese parents. It demonstrates acceptable psychometric properties and could be used as a quick screening instrument in evaluating parental problems when caring for children with cancer as well as chronic illness (such as epilepsy, as tested). It could also be used as a predictor of parental adaptation outcome. This report presents preliminary data on the initial instrument development and psychometric properties of PCSI.     

Reliability and validity of the mammography screening beliefs questionnaire among Chinese American women

Cancer is the leading cause of death for Asian American women, and the breast is a primary site of cancer in Chinese women. Although a number of studies have used constructs from the Health Belief Model (HBM) to examine their relation to mammogram screening, the validity and reliability of the instruments on HBM constructs among Chinese women have not been consistently examined. The purpose of this study was to describe the psychometric properties of a culturally sensitive questionnaire for measuring Chinese women's beliefs (susceptibility, seriousness, benefits, and barriers) related to breast cancer and mammogram screening. The items developed for the questionnaire were drawn from a comprehensive literature review and focus groups. The instrument was translated using back translation technique and evaluated by a panel of professional experts and lay experts. A total of 220 Chinese American women ages 40 to 85 years residing in a suburban Midwestern community were included in the sample. Psychometric testing demonstrated satisfactory internal consistency and validity of the instrument for this group of women. The Cronbach alpha for the subscales ranged from.77 to.90. Construct validity was supported by exploring the factor structure of the instrument using confirmatory factor analysis and testing correlations with mammography compliance.     

Chinese Breast Cancer Screening Beliefs Questionnaire: development and psychometric testing with Chinese-Australian women

Title.  Chinese Breast Cancer Screening Beliefs Questionnaire: development andpsychometric testing with Chinese-Australian women.
Aim.  This paper is a report of the development and psychometric testing of the Chinese Breast Cancer Screening Beliefs Questionnaire, a culturally sensitive questionnaire for measuring Chinese-Australian women's beliefs, knowledge and attitudes towards breast cancer and breast screening practices.
Background.  Breast cancer is the leading cause of cancer morbidity among Chinese-Australian women. They are, however, 50% less likely to participate in all types of breast examination. A valid and reliable instrument to explore the breast cancer beliefs is essential for the development of interventions to promote breast cancer screening practices.
Method.  Items for the questionnaire were drawn from a literature review and in-depth interviews. A panel of professional experts and lay women evaluated face and content validity. The instrument was translated from English to Chinese using back-translation. In 2008, a total of 292 Chinese-Australian women aged 22–78 years who were resident of Australia were included in testing the instrument. Multi-trait analysis and Cronbach's alpha were used to assess internal consistency reliability and exploratory factor analysis assessed construct validity.
Results.  The final 13-item questionnaire had satisfactory validity and internal consistency. Cronbach's alpha for the total scale was 0·76, and for the three subscales ranged from 0·70 to 0·79. Exploratory factor analysis showed that the scale reduced to three factors.
Conclusion.  Preliminary data suggest that the Chinese Breast Cancer Screening Beliefs Questionnaire is a valid, reliable and culturally sensitive instrument for the measurement of Chinese-Australian women's beliefs, knowledge and attitudes about breast cancer and breast cancer screening.     

Development and psychometric testing of the Clinician Readiness for Measuring Outcomes Scale

Background If allied health professionals are to begin measuring outcomes routinely, a change in attitudes and behaviour is necessary. However, individuals need to be ready to change and often move through several stages before practice change is observed. Aim To develop and test the psychometric properties of a questionnaire that determines clinicians' readiness to measure outcomes. Methods A study of instrument development, validation and reliability. Ten expert allied health professionals were involved in content validity testing. A further 396 allied health professionals completed the questionnaire to establish content and construct validity, internal consistency and temporal reliability (or stability). Of these 396 allied health professionals, 70 participated in the temporal reliability assessment. Content validity was established using the Content Validity Index (CVI). Construct validity was determined using confirmatory factor analysis (CFA) and internal consistency was ascertained using Cronbach's alpha. Temporal reliability was confirmed using intraclass correlation coefficients (ICC 3,1). Results A 30‐item questionnaire was developed, reflecting the five stages of change from the Transtheoretical Model of Change, and commonly cited barriers to outcome measurement. Content validity was excellent (CVI = 0.96). Using CFA, a two‐factor model provided best fit. Based on CFA results, four items were dropped resulting in a 26‐item questionnaire (range 26–156). Internal consistency reliability was excellent (α = 0.94). Temporal (stability) reliability ICC (3,1) was very good (r = 0.86, P = 0.0001). Conclusions The final 26‐item questionnaire takes 10 minutes to complete and 5 minutes to score. The Clinician Readiness for Measuring Outcomes Scale provides educators with useful information about clinician readiness and helps identify strategies for affecting behaviour change.     

The Leuven questionnaire for Patient Self-care during Chemotherapy (L-PaSC): Instrument development and psychometric evaluation

PurposeSince chemotherapy has largely become an outpatient treatment, adequate self-management is of great importance. Available instruments focus exclusively on dealing with side effects. However, self-care during chemotherapy not only concerns symptom self-management. The aim of this study was to develop a valid instrument to assess patient self-care during chemotherapy.MethodFirst, we developed a topic list for our construct by performing a theory and literature review. Second, an expert panel of nine oncologists and oncology nurses evaluated content validity of the developing construct and its items using a triple Delphi procedure. A preliminary psychometric evaluation in 144 patients allowed identification and correction of items with poor psychometric properties. A convenience sample of 448 patients was used to evaluate item statistics (item difficulty), reliability (Cronbach alpha) and construct validity (exploratory factor analysis) of the final instrument.ResultsWe developed a 22-item instrument with 7 themes expressing the most relevant aspects of patient self-care during chemotherapy. Seven items cover symptom self-management, while 15 items reflect other aspects of self-care during chemotherapy. Content validity was excellent (CVI = 0.78–1.00). Item difficulty index of the questions ranged from 0.17 to 0.89. Internal consistency is acceptable (Cronbach alpha = 0.76). Exploratory factor analysis defines two underlying factors: adhering to treatment recommendations and managing treatment-related negative events on the one hand, and relieving symptoms on the other hand.ConclusionsThe L-PaSC demonstrated good content validity and psychometric properties. The L-PaSC can be applied in research and clinical practice for evaluating patient self-care during chemotherapy.     

The Leuven Questionnaire on Patient Knowledge of Chemotherapy (L-PaKC): Instrument development and psychometric evaluation

PurposeEvidence suggests that patients who gain knowledge perform better self-care, cope better and are more satisfied. Today, up-to-date and valid instruments for evaluating patient knowledge on chemotherapy are unavailable. Hence, our aim was to develop a valid instrument to assess patients' knowledge on chemotherapy.MethodWe performed a literature review to develop a topic list for the construct. Using a triple Delphi procedure, an expert panel of nine oncologists and oncology nurses evaluated the face and content validity of the topic list and the generated items. A preliminary psychometric evaluation of 144 patients allowed to identify and remediate items having limited applicability and item validity. A convenience sample of 440 patients was used to evaluate item statistics (item difficulty), reliability (Cronbach alpha) and construct validity (exploratory factor analysis) of the final instrument.ResultsWe developed a 20-item instrument reflecting 14 relevant themes of patient knowledge on chemotherapy in 13 questions. Twelve items cover general chemotherapy aspects, eight items cover treatment-specific knowledge. Three questions are facultative and address oral chemotherapy. Content validity was excellent (CVI = 0.78–1.00). Item difficulty ranged from 0.25 to 0.95. Internal consistency was acceptable (Cronbach's alpha = 0.67). Exploratory factor analysis defined four underlying factors: general aspects of chemotherapy treatment, negative treatment-related events, information resources and intake of oral chemotherapy.ConclusionsThe Leuven Questionnaire on Patient Knowledge of Chemotherapy (L-PaKC) demonstrated good content validity and psychometric properties, permitting application in both research and practice for evaluating patient knowledge on chemotherapy.     

Psychometric evaluation of Breast Health Behavior Questionnaire: Spanish version

The purpose of the study was to test the psychometric properties of a culturally sensitive and theory-based instrument: the Breast Health Behavior Questionnaire. This instrument was translated into Spanish and back-translated at a third- to fourth-grade reading level. The pilot group consisted of 70 Hispanic women who attended a class at a local church. Subsequent to pilot testing, another 40 Hispanic women who attended a class at the local health department comprised the study sample. The participants responded to the 15-item questionnaire, which is formatted as a Likert scale. Content validity of the Breast Health Behavior Questionnaire was determined by a panel of experts. A factor analysis of this instrument showed five separate dimensions accounting for 71.82% of the instrument's variance. The three major components of self-regulation theory (schema, coping, and appraisal criteria) were found clustered within the first three dimensions after three items were discarded. The Breast Health Behavior Questionnaire demonstrated an internal consistency reliability coefficient of .7172. The psychometric properties of the Spanish version of this questionnaire warrant further research. The instrument may support a better understanding of the Hispanic woman's practice of breast health behavior. Eventually, the Breast Health Behavior Questionnaire may assist nurses in the formulation of culturally grounded interventions.     

Development and validation of the Chinese version of the Diabetes Management Self-efficacy Scale

OBJECTIVE: The purpose of this study was to translate the Diabetes Management Self-Efficacy Scale (DMSES) into Chinese and test the validity and reliability of the instrument within a Taiwanese population. RESEARCH DESIGN AND METHODS: A two-stage design was used for this study. Stage I consisted of a multi-stepped process of forward and backward translation, using focus groups and consensus meetings to translate the 20-item Australia/English version DMSES to Chinese and test content validity. Stage II established the psychometric properties of the Chinese version DMSES (C-DMSES) by examining the criterion, convergent and construct validity, internal consistency and stability testing. The sample for Stage II comprised 230 patients with type 2 diabetes aged 30 years or more from a diabetes outpatient clinic in Taiwan. RESULTS: Three items were modified to better reflect Chinese practice. The C-DMSES obtained a total average CVI score of .86.The convergent validity of the C-DMSES correlated well with the validated measure of the General Self-Efficacy Scale in measuring self-efficacy (r=.55; p<.01). Criterion-related validity showed that the C-DMSES was a significant predictor of the Summary of Diabetes Self-Care Activities scores (Beta=.58; t=10.75, p<.01). Factor analysis supported the C-DMSES being composed of four subscales. Good internal consistency (Cronbach's alpha=.77 to .93) and test-retest reliability (Pearson correlation coefficient r=.86, p<.01) were found. CONCLUSIONS: The C-DMSES is a brief and psychometrically sound measure for evaluation of self-efficacy towards management of diabetes by persons with type 2 diabetes in Chinese populations.     

Development of an instrument to measure collaboration and satisfaction about care decisions

The psychometric assessment of a new instrument for measurement of the construct of nurse-physician collaboration in making specific patient care decisions, Collaboration and Satisfaction About Care Decisions (CSACD), is reported Content validity for the tool was supported by literature review, nurse and physician experts, and potential subjects In a pilot study 58 neonatal intensive care nurses'and resident physicians'responses showed variance, alpha reliability of the collaboration questions was 0 95 Construct validity of the collaboration questions was supported by finding expected correlational patterns and by factor analysis revealing a single factor that explained 75% of the variance in collaboration Further psychometric testing of the instrument is proposed, particularly in the context of substantive studies that would allow investigation of its association with patient outcomes     

Readiness to change for interprofessional collaboration in healthcare: Development and validation of a theory-based instrument

This paper presents a study that aimed to develop and validate a theory-based instrument for the assessment of readiness to change for interprofessional collaboration in healthcare (IPC-TTM). The instrument was developed in the Persian language and tested in the Iranian context. Healthcare professionals from medical and nursing professions participated in the assessment of validity and reliability of the instrument. We conducted this psychometric study in two phases: First, the questionnaire was developed based on the transtheoretical model (TTM) through literature review and expert panel. Then, in the validation phase, we held three modified Delphi rounds to assess the content and face validity of the questionnaire. We used confirmatory factor analysis (CFA) to evaluate the fit of the questionnaire as applied to modified TTM. Reliability of the final instrument was tested by assessing the test-retest reliability of instrument items with Kappa coefficient. We also calculated the intraclass correlation coefficient (ICC) and Cronbach’s alpha to assess the test-retest reliability and internal consistency of the instrument sub-scales. The initial item pool consisted of 30 items and three sub-scales (Attitude, Intention, and Action). The content validity of the questionnaire was confirmed with 17 items. Based on the CFA results two additional items were deleted to increase the fit of the model. The final instrument was confirmed with 15 items and three sub-scales. Reliability assessment on the 15-item instrument showed an acceptable test-retest reliability of the instrument items. ICC values for the Attitude, Intention, and Action sub-scales of the instrument were calculated as 0.82, 0.73, and 0.71, respectively. Moreover, Cronbach’s alpha for the Attitude, Intention, and Action sub-scales were 0.85, 0.73, and 0.77, respectively. This study offers a new theory-based instrument to measure readiness to change for interprofessional collaboration in healthcare in the Iranian context. The questionnaire can be used for ‘needs assessment’ in developing tailored educational interventions and self-assessments in interprofessional education studies.     

Construction and psychometric testing of the EMPATHIC questionnaire measuring parent satisfaction in the pediatric intensive care unit

Purpose

To construct and test the reliability and validity of the EMpowerment of PArents in THe Intensive Care (EMPATHIC) questionnaire measuring parent satisfaction in the pediatric intensive care unit (PICU).

Methods

Structured development and psychometric testing of a parent satisfaction-with-care instrument with the results of two cohorts of parents (n?=?2,046) from eight PICUs in the Netherlands.

Results

In the first cohort, 667/1,055 (63%) parents participated followed by 551/991 (56%) parents in the second cohort. The empirical structure of the instrument was established by confirmatory factor analysis with the first sample of parents confirming 65 statements within five theoretically conceptualized domains: information, care and cure, organization, parental participation, and professional attitude. The standardized factor loadings were greater than 0.40 in 63 statements. Cronbach??s ??, a measure of reliability, per domain ranged from 0.73 to 0.93 in both cohorts with no significant difference documenting the reliability over time. Beside rigorous content and face validity, the congruent validity of the instrument showed adequate correlation with four gold standard questions measuring overall satisfaction. The non-differential validity was confirmed with no significant differences between the population characteristics and the domains, except that parents with a child for a surgical admission were more satisfied on information issues.

Conclusions

The final EMPATHIC questionnaire incorporates 65 statements. The empirical structure of the satisfaction statements and domains was satisfactory. The reliability and validity proved to be adequate. The EMPATHIC questionnaire is a valid quality performance indicator to measure quality of care as perceived by parents.     

Psychometric evaluation of four HIV disease-specific quality-of-life instruments

OBJECTIVE: To provide a comparative evaluation of psychometric properties for three or more HIV disease-specific quality-of-life (QoL) instruments. METHODS: Four instruments were selected using the following criteria: multiple publiations of instrument, focus of instrument on QoL, psychometric validation publication or comparison with prevoiusly validated questionnaire, stages of HIV/AIDS used or evaluated in the study, and inclusion of sample items or the instrument in at least one publication. The four HIV-specific QoL instruments were: HIV/AIDS-Targeted Quality of Life Instrument, Medical Outcomes Study HIV questionnaire (MOS-HIV), Functional Assessment of Human Immunodeficiency Virus Infection, and HIV Overview of Problems -- Evaluation System. These instruments were evaluated using combined criteria derived from McHorney and Tarlov and Shumaker et al. The criteria include: administration, content, depth, reliability, validity, and responsiveness. A letter grade scale (A,B,C,D) was used in rating the criteria. RESULTS: No instrument demonstrated ideal psychometric properties. The MOS-HIV questionnaire was the only instrument that published results for seven of the eight categories. Therefore, a decision cannot be made about the best instrument to use for measuring QoL in an HIV-positive patient. CONCLUSIONS: Published data for these questionnaires had common limitations of sample size, study design, and population demograhpics, Hence, further testing of these questionnaires is recommended before use in any study to determine suitability, reliability and validity.     

Psychometric evaluation of undergraduate student nurses' learning perceived needs in disaster nursing: Two cross-sectional studies

BackgroundDisaster nursing education is a necessity for nurses and students to improve their disaster relief competencies. Determining undergraduate student nurses' learning perceived needs for disaster nursing can help improve curricula construction. In China there is currently no valid instrument available for the evaluation of influencing factors. A disaster nursing course content system was developed using the Delphi method in 2011. However, this system was unformed and lacked psychometric evaluation.ObjectivesTo adapt the disaster nursing course content system into an instrument, to evaluate its psychometric properties, and to investigate undergraduate student nurses' learning perceived needs for disaster nursing.Design, settings and participantsTwo cross-sectional studies were conducted in public higher education institutions in China. In the first study, a total of 1714 undergraduate student nurses were recruited in May to October 2016; in the second study, 68 were recruited in May 2019.MethodsThe instrument was adapted through literature review, face validity and pilot testing in preliminary studies. The construct validity and reliability of the instrument were tested using exploratory factor analysis, parallel analysis, confirmatory factor analysis, internal consistency reliability and test-retest reliability.ResultsThe exploratory factor analysis and parallel analysis extracted a three-factor solution comprising 19 items that accounted for 71.69% of the total variance, including discipline introduction, skills and knowledge in disaster relief, and disaster management. The fit indices indicated a good fit. The internal consistency and test-retest reliability was good, as indicated by a Cronbach's alpha of 0.89 and an intraclass correlation coefficient of 0.87.ConclusionThe Learning Needs for Disaster Nursing questionnaire exhibited good psychometric properties, thereby proving itself a valuable instrument for evaluating learning perceived needs in undergraduate student nurses.     

A measure of critical care nurses' post-code stress

AIM: The purpose of this research was to develop an instrument to measure critical care nurses' post-code stress and then to examine the psychometric properties. BACKGROUND: Critical care nurses experience stress from multiple sources. One source of stress may arise from participation in resuscitation attempts and this has been labelled post-code stress; however, no means exist for measuring this source of stress. DESIGN/METHOD: In phase 1, 47 items were developed and submitted to a panel of experts for content validity. Based on content experts' ratings, 20 items were retained for phase 2 instrument testing. To test the instrument, a convenience sample of critical care nurses was obtained from four institutions in north-eastern United States. Each nurse received the Post-Code Stress Scale and completed it anonymously. A subsample completed the Post-Code Stress Scale a second time to assess stability reliability. The Nursing Stress Scale was also administered to assess construct validity. RESULTS/FINDINGS: An exploratory principal components factor analysis with varimax rotation suggested five dimensions to post-code stress. These five dimensions accounted for 66% of the variance and indicated that stress arose from feeling discomposed, oppressed, uncertain, burdened and morally conflicted. The Pearson product moment correlation between the Post-Code Stress Scale and the Nursing Stress Scale was 0.46, providing preliminary evidence of construct validity. Internal consistency reliability estimates for the five-factor subscales ranged from 0.57 to 0.77 with only one factor being <0.70. The internal consistency reliability estimate for the final 14 items on the scale was 0.79. CONCLUSIONS: The instrument shows promise as a measure of post-code stress based on the evidence obtained in this study; however, further psychometric testing is warranted.     

Measuring assessors’ experiences of grading marginal student performances in clinical assessments – The assess-safe tool: Development and preliminary psychometric validation

Assessment of fitness for practice in the nursing student population is an essential yet challenging component of nursing education. The aim of this research was to describe the development and preliminary validation of the Assess-Safe instrument that explores assessors' experiences of grading nursing student performances in clinical courses when that performance is not a clear pass or fail. A 3 phase approach was used to develop and psychometrically test the instrument. Phase 1 involved the development of a pool of items following a literature review, coupled with findings from qualitative data. In phase 2, an expert panel rated the items for clarity and relevance, reducing the item pool. Assessors of Australian undergraduate nursing students from industry and academia were recruited for this study. A sample of 149 assessors across industry and academia completed the resultant survey to pilot test the instrument; constituting Phase 3. A high content validity index score of 0.95 was achieved through expert review. Construct validity using factor analysis revealed four factors including: assessor support; process support; assessor introspection; and student support. The Assess-Safe instrument achieved good internal reliability with an overall Cronbach's alpha coefficient of 0.77; and sub-scale scores ranging from 0.71 to 0.79. The Assess-Safe instrument demonstrated satisfactory psychometric properties and has utility for education programmes, research and policy development across a variety of practice based professions. Nonetheless, further psychometric validation is warranted.     

Evidence-based rating of upper-extremity motor function tests used for people following a stroke

INTRODUCTION: Tests of upper-extremity motor function used for people following a stroke have been described, but reliability and validity (psychometric properties) of measurements obtained with these tests have not been consistently established. This investigation was performed: (1) to review literature relative to upper-extremity motor function testing during rehabilitation following a stroke, (2) to develop selection criteria for identifying these tests in the literature, and (3) to rate the tests relative to their psychometric properties. METHOD: Literature searches were done using 2 databases. Reports of 4 psychometric properties were sought: interrater reliability, test-retest reliability, convergent validity or concurrent validity, and predictive validity. RESULTS: Nine tests met the inclusion criteria of having psychometric properties reported in the literature. No test had evidence for all 4 psychometric properties. Only the Nine-Hole Peg Test was supported by 3 out of 4 properties. Most tests had 2 properties supported. Concurrent validity or convergent validity was most frequently described; test-retest reliability was least frequently described. CONCLUSIONS: More complete psychometric support is needed for upper-extremity motor function tests applied following a stroke. The absence of psychometric support, however, does not mean that a test has no value. Clinicians are cautioned not to generalize psychometric evidence.