Adjustment scales for children and adolescents and Native American Indians: Factorial validity generalization for Ojibwe youths

Replication of the core syndrome factor structure of the Adjustment Scales for Children and Adolescents (ASCA; P.A. McDermott, N.C. Marston, & D.H. Stott, 1993) is reported for a sample of 183 Native American Indian (Ojibwe) children and adolescents from North Central Minnesota. The six ASCA core syndromes produced an identical two‐factor solution as the standardization data through principal axis analysis using multiple criteria for the number of factors to extract and retain. Varimax, direct oblimin, and promax rotations produced identical results and nearly identical factor‐structure coefficients. Coefficients of congruence resulted in an excellent match to the factorial results of the ASCA standardization sample and a large, independent sample. It was concluded that for these Ojibwe students, the ASCA measures two independent dimensions of psychopathology (i.e., Overactivity and Underactivity) that are similar to the conduct problems/externalizing and withdrawal/internalizing dimensions commonly found in the child psychopathology assessment literature. © 2006 Wiley Periodicals, Inc. Psychol Schs 43: 685–694, 2006.     

Replication of the Adjustment Scales for Children and Adolescents core syndrome factor structure

Independent examination and replication of the core syndrome factor structure of the Adjustment Scales for Children and Adolescents (ASCA; McDermott, Marston, & Stott, 1993) is reported. A sample of 1,020 children were randomly selected from their classroom and rated on the ASCA by their teacher. The six ASCA core syndromes produced a two‐factor solution through principle axis analysis using multiple criteria for the number of factors to extract and retain. Varimax, direct oblimin, and promax rotations produced identical results and nearly identical factor structure coefficients. It was concluded that the ASCA indeed measures two independent dimensions of psychopathology (Overactivity and Underactivity) that are similar to the conduct problems/externalizing and withdrawal/internalizing dimensions commonly found in the child psychopathology assessment literature (Cicchetti & Toth, 1991; Quay, 1986). © 2004 Wiley Periodicals, Inc. Psychol Schs 41: 191–199, 2004.     

Relationships Among Early Childhood Behavior Rating Scales: Convergent and Discriminant Construct Validity of the Preschool and Kindergarten Behavior Scales

Research Findings: Data that serve to establish the convergent and discriminant construct validity of a new behavior rating scale for use with the early childhood preschool population-the Preschool and Kindergarten Behavior Scales (PKBS)-are presented. The results of four different studies are presented wherein PKBS ratings of preschool or kindergarten age children were correlated with established comparison measures: the Social Skills Rating System, Mattson Evaluation of Social Skills with Youngsters, Conners Teacher Rating Scale, and School Social Behavior Scales. Correlations were in the desired directed for demonstrating convergent and discriminant construct validity of the PKBS. Practice Implications: The PKBS appears to adequately measure the constructs of social skills and both internalizing and externalizing problem behavior in early childhood. Although additional validation research for this instrument is needed, the PKBS appears to show promise as a research tool, screening device, and assessment instrument for assessing social-emotional behavior of children ages 3–6. Given the increasing importance of early detection of social-emotional problems as part of a comprehensive system of prevention and early intervention, future efforts at linking assessment tools to specific and effective intervention techniques appear to be a much needed and significant endeavor.     

Relationships Among Early Childhood Behavior Rating Scales: Convergent and Discriminant Construct Validity of the Preschool and Kindergarten Behavior Scales

Research Findings: Data that serve to establish the convergent and discriminant construct validity of a new behavior rating scale for use with the early childhood preschool population-the Preschool and Kindergarten Behavior Scales (PKBS)-are presented. The results of four different studies are presented wherein PKBS ratings of preschool or kindergarten age children were correlated with established comparison measures: the Social Skills Rating System, Mattson Evaluation of Social Skills with Youngsters, Conners Teacher Rating Scale, and School Social Behavior Scales. Correlations were in the desired directed for demonstrating convergent and discriminant construct validity of the PKBS. Practice Implications: The PKBS appears to adequately measure the constructs of social skills and both internalizing and externalizing problem behavior in early childhood. Although additional validation research for this instrument is needed, the PKBS appears to show promise as a research tool, screening device, and assessment instrument for assessing social-emotional behavior of children ages 3-6. Given the increasing importance of early detection of social-emotional problems as part of a comprehensive system of prevention and early intervention, future efforts at linking assessment tools to specific and effective intervention techniques appear to be a much needed and significant endeavor.     

Stability of the adjustment scales for children and adolescents

Investigation of the short‐term (90‐day) stability of the Adjustment Scales for Children and Adolescents is reported for 124 randomly selected children in grades ranging from kindergarten to grade 12. Significant test‐retest stability coefficients were obtained and mean differences across the retest interval did not exceed .8 raw score points. The Solitary Aggressive‐Impulsive, Diffident, and Lethargic/Hypoactive syndromes and the global Underactivity scale showed significant raw score and T score changes across the retest interval, but the effect strengths were small. Syndromic Profile Classifications and Discriminant Classifications were also significantly consistent across the retest interval. Results were similar to those obtained in other stability studies of teacher report behavior rating scales. © 2001 John Wiley & Sons, Inc.     

Interrater agreement for discriminant classifications for the adjustment scales for children and adolescents

Investigation of interrater agreement for the Adjustment Scales for Children and Adolescents (ASCA) discriminant classifications is reported. Two teaching professionals or paraprofessionals working in the same classroom for a minimum of 1 hour per day provided independent ratings of the same child using the ASCA. A total of 119 students ranging in age from 7 to 18 years were independently rated on the ASCA. Results indicated significant and moderate to substantial interrater agreement for the discriminant classifications. © 2002 Wiley Periodicals, Inc.     

ARE WE TALKING ABOUT THE SAME CHILD? PARENT–TEACHER RATINGS OF PRESCHOOLERS’ SOCIAL–EMOTIONAL BEHAVIORS

The parent‐teacher agreement has become an important issue of children's psychological assessment. However, the amount of research available for preschool children is small and mainly based on one index of agreement with samples of modest size/representativeness. This study examined parent‐teacher agreement (correlations) and discrepancies (t tests) on preschoolers' social skills and problem behaviors for the normative Portuguese sample (N = 1,000) of the Preschool and Kindergarten Behavior Scales – 2^nd Edition (PKBS‐2). Analyses were replicated according to the child's gender and mothers' educational level. Correlational analyses suggest weak to moderate informant agreement (mean correlation = .32). Parents' and teachers' ratings are significantly different for all PKBS‐2 scores, with parents assigning higher scores both on social skills and problem behaviors. Results highlight the importance of both parents' and teachers' perspectives to achieve a more comprehensive picture of preschoolers' social‐emotional behaviors, and reinforce the evidence of reliability of the PKBS‐2 Portuguese version.     

Reliability and comparability of a Spanish‐language form of the preschool and kindergarten behavior scales

Comparability of a Spanish language translation of the Preschool and Kindergarten Behavior Scales was examined in relation to the English language version. Children ages 3–6 enrolled in preschool, kindergarten, or Head Start programs were rated concurrently by respondents on English and Spanish versions of the PKBS. Results showed virtually identical internal consistency of scores on both forms on Social Skills (.93) and Problem Behavior (.96) Scales. Correlations between forms for Social Skills and Problem Behavior scores were .93 and .94, respectively. Implications of these findings, directions for future research and the importance of continued work toward development/translation of other Spanish language assessment instruments for the early childhood population are discussed. © 2002 Wiley Periodicals, Inc.     

Procrastination,conscientiousness, anxiety,and goals: Exploring the measurement and correlates of procrastination among school‐aged children

We explore the reliability and validity of a self‐report measure of procrastination and conscientiousness designed for use with third‐ to fifth‐grade students. The responses of 120 students are compared with teacher and parent ratings of the student. Confirmatory and exploratory factor analyses were also used to examine the structure of the scale. Procrastination and conscientiousness are highly correlated (inversely); evidence suggests that procrastination and conscientiousness are aspects of the same construct. Procrastination and conscientiousness are correlated with the Physiological Anxiety subscale of the Revised Children's Manifest Anxiety Scale, and with the Task (Mastery) and Avoidance (Task Aversiveness) subscales of Skaalvik's (1997) Goal Orientation Scales. Both theoretical implications and implications for interventions are discussed. © 2002 Wiley Periodicals, Inc.     

Validity of the home and community social behavior scales: Comparisons with five behavior‐rating scales

Three separate studies focusing on convergent and discriminant validity evidence for the Home and Community Social Behavior Scales are presented. The HCSBS is a 65‐item social behavior‐rating scale for use by parents and caretakers of children and youth ages 5–18. It is a parent‐rating version of the School Social Behavior Scales. Within these studies, relationships with five behavior‐rating scales were examined: the Social Skills Rating System, Conners Parent Rating Scale–Revised‐Short Form, Child Behavior Checklist, and the child and adolescent versions of the Behavior Assessment System for Children. HCSBS Scale A, Social Competence, evidenced strong positive correlations with measures of social skills and adaptability, strong negative correlations with measures of externalizing behavior problems, and modest negative correlations with measures of internalizing and atypical behavior problems. HCSBS Scale B, Antisocial Behavior, evidenced strong positive correlations with measures of externalizing behavior problems, modest positive correlations with measures of internalizing and atypical behavior problems, and strong negative correlations with measures of social skills and adaptability. These results support the HCSBS as a measure of social competence and antisocial behavior of children and youth. © 2001 John Wiley & Sons, Inc.     

Evaluating existing and new validity evidence for the Academic Motivation Scale

The current study evaluates existing and new validity evidence for the Academic Motivation Scale (AMS; Vallerand et al., 1992). We first provide a narrative review synthesizing past research, and then conduct a validity investigation of the scores from the measure. Data analysis using a sample of 1406 American college students provided construct validity evidence in the form of a well-fitting seven-factor model and adequate internal consistency of the item responses. Convergent and discriminant validity evidence provided insight into the distinctiveness of the seven subscales. However, support for the scale’s simplex structure, which would represent the self-determination theory continuum, was not fully substantiated. Implications for theory and the scale’s use in the current form are discussed.     

The relationship of teacher-rated social skills deficits and ADHD characteristics among kindergarten-age children

Research findings regarding the relationship of social skills deficits and behavioral characteristics associated with attention-deficit hyperactivity disorder (ADHD) among kindergarten-age children are presented. The Preschool and Kindergarten Behavior Scales (PKBS) were utilized to identify the social skills attributes of young children with significant ADHD characteristics. An ADHD target group (N = 95) was constructed by selecting participants from a large nationwide sample who were rated by their teachers as being in the highest 5% on the PKBS Attention Problems/Overactive subscale. A matched non-ADHD comparison group (by gender and age) of 95 children was developed through a randomized block procedure using the same nationwide sample. The ADHD group was rated as having significantly poorer social skills than the comparison group, and could be classified with a very high degree of accuracy based on discriminant function analysis of their social skills scores. Although exhibiting comparative deficits in all social skill areas, the ADHD participants were especially lacking in social cooperation skills: the ability to follow rules, structure, and important social expectations of both children and adults. Children who were rated high in ADHD characteristics were between five and six times more likely than the comparison children to be rated as having significant deficits in social skills. Implications of these findings for assessment and treatment of young children are discussed. © 1998 John Wiley & Sons, Inc.     

CONSTRUCT VALIDITY EVIDENCE FOR BRACKEN SCHOOL READINESS ASSESSMENT,THIRD EDITION,SPANISH FORM SCORES

Convergent and discriminant validity evidence was examined for scores on the Spanish Record Form of the Bracken School Readiness Assessment, Third Edition (BSRA‐3). Participants included a sample of 68 Hispanic, Spanish‐speaking children ages 4 to 5 years enrolled in preschool programs in Puerto Rico. Scores obtained from the BSRA‐3 Spanish Record Form were compared with scores from the Nonverbal Index of the Kaufman Assessment Battery for Children, Second Edition, and the Preschool and Kindergarten Behavior Scales, Second Edition. As expected, the correlation between school readiness scores and nonverbal intelligence was significant and moderate in the positive direction and the correlations between school readiness scores and behaviors were low. Discriminant validity evidence for BSRA‐3 scores was demonstrated using Steiger's Z test to compare correlations of similar and dissimilar constructs. As hypothesized, significant results emerged.     

Preschool teachers and classroom aides: Same context,similar perceptions of children's behaviors?

This study explored the correspondence and differences between school staff perceptions of preschool children's social skills and behavior problems. One hundred preschoolers were assessed by 14 pairs of teachers and classroom aides with the Preschool and Kindergarten Behavior Scales – 2^nd Edition (PKBS‐2 Portuguese version). Indexes of agreement and disagreement were calculated. Risk levels and item analyses of PKBS‐2 scores according to both informants' ratings were compared. A higher level of agreement was obtained for social skills scores than for behavior problems (mean correlation of .62). No statistically significant differences between informants were obtained for the risk levels, and item analyses revealed a similar pattern of behaviors that were most and least rated by both informants. Results indicate that the classroom aides' perspective on preschool assessment represents a reliable input, which justifies that they network with teachers in addressing preschoolers' social‐emotional and behavioral challenges.     

Convergent and discriminant construct validity of the internalizing symptoms scale for children with the BASC‐SRP‐C

This brief report details a study of the construct validity of the Internalizing Symptoms Scale for Children (ISSC) in comparison with the Child Self‐Report Form of the Behavioral Assessment System for Children (BASC). Using self‐reports of 121 students ages 8–12 from general education classes, who were administered both measures, correlational data were obtained between the scores of the two instruments. ISSC factor and total scores were found to have weak associations with the BASC School Adjustment Scales, and negatively associations with the BASC personal adjustment scales, providing discriminant evidence of the construct validity of the ISSC. Moderate to strong correlations were found between ISSC scores and the BASC Clinical Maladjustment, Other Problems, and Emotional Symptoms Index scores, evidencing convergent construct validity between the two measures. These results support the validity and clinical use of the ISSC as a measure of internalizing symptoms and emotional problems. © 2003 Wiley Periodicals, Inc. Psychol Schs 40: 139–144, 2003.     

Identifying at‐risk preschoolers: The discriminant validity of the differential ability scales

The discriminant validity of the Upper Preschool Level of the Differential Ability Scales (DAS) was studied using 32 at‐risk preschoolers (females = 14, males = 18) with a mean age of 57.28 months (SD = 4.43) and 30 normal preschoolers (females = 13, males = 17) with a mean age of 56.40 months (SD = 6.46). The results indicated that the DAS was an excellent measure to use when trying to differentiate between at‐risk and normal preschoolers. The DAS could reliably identify, better than chance, whether a child was at‐risk or normal. Specifically, the General Conceptual Ability score was found to be approximately 77% accurate in correctly classifying at‐risk from normal preschoolers. In addition, the use of the DAS in an abbreviated format by selecting specific core and/or diagnostic subtests during the preschool screening process was strongly supported. © 1999 John Wiley & Sons, Inc.     

A comparison of teachers' and school psychologists' perceptions of the importance of CHC abilities in the classroom

The broad cognitive abilities defined by the Cattell–Horn–Carroll (CHC) theory have been shown to predict school achievement. However, the ecological validity of these constructs has not been studied in classroom settings. This study compares ratings by a sample of teachers (n = 53) and school psychologists (n = 86) of the importance of the CHC cognitive abilities in the classroom. The scale demonstrated adequate reliability (total scale α = .93, median α = .74), although evidence of construct validity varied between teachers and school psychologists. Both teachers and school psychologists rated quantitative ability, crystallized knowledge, and fluid reasoning as most important to school success. However, school psychologists rated short‐term memory and quantitative ability as more important than did the teachers. Importance of these differences for consultation is discussed. © 2009 Wiley Periodicals, Inc.     

Adjustment scales for preschool intervention: Extending validity and relevance across multiple perspectives

A series of studies extended psychometric research on the Adjustment Scales for Preschool Intervention (ASPI). The ASPI is a multidimensional measure of preschool emotional and behavioral adjustment for use within formal early childhood educational programs. These studies used a multiple method, multisource approach to provide additional evidence for the reliability and validity of the ASPI. Findings documented inter‐rater reliability of the ASPI across key informants within early childhood educational programs—teachers and teacher assistants. Findings supported concurrent validity of the ASPI with direct observations of preschool classroom adjustment problems and the developmentally salient constructs of temperament and emotion regulation. Implications for policy, practice, and future research are discussed. © 2004 Wiley Periodicals, Inc. Psychol Schs 41: 725–736, 2004.     

CLASSROOM CONTEXTS AS THE FRAMEWORK FOR ASSESSING SOCIAL–EMOTIONAL ADJUSTMENT: A NATIONAL STUDY IN TRINIDAD AND TOBAGO

Contextually based assessments reveal the circumstances accompanying maladjustment (the when, where, and with whom) and supply clues to the motivations underpinning problem behaviors. The Adjustment Scales for Children and Adolescents (ASCA) is a teacher rating scale composed of indicators describing behavior in 24 classroom situational contexts. This study examines the Trinidad and Tobago national normative process for the ASCA contextual dimensions with a representative sample of elementary school children (N = 900). Exploratory and confirmatory factor analyses yielded the same three dimensions (peer context problems, teacher context problems, and learning context problems) observed in U.S. national samples. Dimensions were scaled using item response theory (IRT) and Bayesian scoring methods, with peer and learning context problems scores relating more strongly to clinical behavior disturbances and learning context problems showing stronger association with classroom learning styles. Implications for future research and practice are discussed.     

Joint confirmatory factor analysis of the differential ability scales and the Woodcock‐Johnson Tests of Cognitive Abilities–Third Edition

This study examined the underlying constructs measured by the Differential Ability Scales (DAS; C.D. Elliott, 1990a) as they relate to the Cattell‐Horn‐Carroll (CHC) Theory (K.S. McGrew, 1997) of cognitive abilities. The DAS and Woodcock‐Johnson Tests of Cognitive Abilities (WJ‐III COG; R.W. Woodcock, K.S. McGrew, & N. Mather, 2001) were administered to 131 children in grades 3 through 5 who took part in a concurrent validity study included in the Woodcock‐Johnson Tests of Cognitive Abilities, Third Edition, technical manual (K.S. McGrew & R.W. Woodcock, 2001). Confirmatory factor analyses using maximum likelihood estimation were conducted with the AMOS 5.0 (J.L. Arbuckle, 2001) statistical program to evaluate three models of increasing complexity, to compare how well each fit the data set, and to identify the one that best described the underlying constructs measured by the DAS. Results suggested that the synthesized Three‐Stratum CHC Model provided the most parsimonious representation among the three models tested. © 2007 Wiley Periodicals, Inc. Psychol Schs 44: 119–138, 2007.