Creating a Progress‐Monitoring System in Reading for Middle‐School Students: Tracking Progress Toward Meeting High‐Stakes Standards

In this study, we examined the reliability and validity of curriculum‐based measures (CBM) in reading for indexing the performance of secondary‐school students. Participants were 236 eighth‐grade students (134 females and 102 males) in the classrooms of 17 English teachers. Students completed 1‐, 2‐, and 3‐minute reading aloud and 2‐, 3‐, and 4‐minute maze selection tasks. The relation between performance on the CBMs and the state reading test were examined. Results revealed that both reading aloud and maze selection were reliable and valid predictors of performance on the state standards tests, with validity coefficients above .70. An exploratory follow‐up study was conducted in which the growth curves produced by the reading‐aloud and maze‐selection measures were compared for a subset of 31 students from the original study. For these 31 students, maze selection reflected change over time whereas reading aloud did not. This pattern of results was found for both lower‐ and higher‐performing students. Results suggest that it is important to consider both performance and progress when examining the technical adequacy of CBMs. Implications for the use of measures with secondary‐level students for progress monitoring are discussed.     

PASS cognitive processes,phonological processes,and basic reading performance for a sample of referred primary‐grade children

The purpose of this study was to explore the relationships among cognitive processing, phonological processing and basic reading skill performance. Cognitive theorists propose that Planning, Attention, Simultaneous and Successive (PASS) processes are related to various phonological skills. A sample of 62 Primary Grade children referred for reading problems were administered measures of cognitive processes (Cognitive Assessment System), phonological processes (Comprehensive Test of Phonological Processing) and basic reading achievement (Woodcock‐Johnson Tests of Academic Achievement‐III). Findings indicated that some cognitive processes were significantly related to phonological processes as well as basic reading skills. The strongest relationships were found between phonological memory and successive processes and between phonological awareness and basic reading performance.     

CBM maze-scores as indicators of reading level and growth for seventh-grade students

The technical adequacy of CBM maze-scores as indicators of reading level and growth for seventh-grade secondary-school students was examined. Participants were 452 Dutch students who completed weekly maze measures over a period of 23 weeks. Criterion measures were school level, dyslexia status, scores and growth on a standardized reading test. Results supported the technical adequacy of maze scores as indicators of reading level and growth. Alternate-form reliability coefficients were significant and intermediate to high. Mean maze scores showed significant increase over time, students’ growth trajectories differed, and students’ initial performance levels (intercepts) and growth rates (slopes) were not correlated. Maze reading level and growth were related to reading level and/or growth on criterion measures. A nonlinear model provided a better fit for the data than a linear model. Implications for use of CBM maze-scores for data-based decision-making are discussed.     

Is fluency‐based story retell a good indicator of reading comprehension?

This study examined the reliability and validity of scores on a fluency‐based measure of reading comprehension. The Dynamic Indicators of Basic Early Literacy Skills (DIBELS; 6th ed. revised) Retell Fluency (RTF), Oral Reading Fluency (DORF), and Woodcock Johnson III NU Tests of Achievement (WJ‐III NU ACH) Reading Comprehension measures were administered to fourth‐grade students. Results indicated a large difference between real time and recorded retell fluency scores for each passage. In addition, students' retell fluency scores had a low correlation with their reading comprehension scores. In light of these findings, practitioners may want to exercise caution in using fluency‐based story‐retell scores as a measure of reading comprehension. © 2011 Wiley Periodicals, Inc.     

Concurrent and predictive validity of the Phelps Kindergarten Readiness Scale‐II

The purpose of this research was to establish the concurrent and predictive validity of the Phelps Kindergarten Readiness Scale, Second Edition (PKRS‐II; L. Phelps, 2003). Seventy‐four kindergarten students of diverse ethnic backgrounds enrolled in a northeastern suburban school participated in the study. The concurrent administration of the PKRS‐II and the Woodcock‐Johnson III Brief Intellectual Ability Scale (R.W. Woodcock, K.S. McGrew, & N. Mather, 2001a) occurred in the fall of the kindergarten year. To assess predictive validity, the Woodcock Johnson III Tests of Achievement (R.W. Woodcock, K.S. McGrew, & N. Mather, 2001b) was administered in the spring of that year. All concurrent and predictive correlations were significant. Based on the results of this study, the PKRS‐II may be used with confidence to screen for children who may be at risk for academic difficulties. © 2005 Wiley Periodicals, Inc. Psychol Schs 42: 355–359, 2005.     

THE UTILITY OF MAZE ACCURATE RESPONSE RATE IN ASSESSING READING COMPREHENSION IN UPPER ELEMENTARY AND MIDDLE SCHOOL STUDENTS

This study examined the predictive utility of five formative reading measures: words correct per minute, number of comprehension questions correct, reading comprehension rate, number of maze correct responses, and maze accurate response rate (MARR). Broad Reading cluster scores obtained via the Woodcock–Johnson III (WJ III) Tests of Achievement served as the criterion variable. Examiners administered all reading measures to 98 students enrolled in upper elementary (UES) and middle school (MS) grades (grades 4 through 8). Results indicated significant intercorrelations within all predictor variables for the combined and UES samples; fewer intercorrelations existed at the MS level. MARR exhibited the highest correlation with WJ III Broad Reading across all correlational analyses. Additional regression analyses indicated that the MARR technique best predicted WJ III Broad Reading cluster scores across all groups analyzed. Limitations of the current study and suggestions for future research are discussed.     

Concurrent validity of the Slosson full‐range intelligence test: Comparison with the Wechsler intelligence scale for children–third edition and the Woodcock Johnson tests of achievement–revised

This study examined the concurrent validity of the Slosson Full‐Range Intelligence Test (S‐FRIT) by comparing S‐FRIT scores to the scores of the Wechsler Intelligence Scale for Children–Third Edition (WISC‐III) and the Woodcock‐Johnson Tests of Achievement–Revised (WJ‐R). Data from 123 elementary students' screening and psychological testing results were examined. Results revealed that the S‐FRIT scores were more related to overall intelligence, verbal, and math abilities than nonverbal intelligence, reading, or written language abilities. Further, it was found that 89% of the participants' S‐FRIT Full‐Range IQ scores fell within one standard deviation of their WISC‐III FSIQ scores, with an average discrepancy of 7.6 points. Discrepancies between S‐FRIT and WISC‐III scores were also examined by educational diagnostic categories and ability levels. Limitations and suggestions for future research are provided. © 2002 John Wiley & Sons, Inc.     

Prediction of reading by Ga and Gc specific cognitive abilities for low‐SES white and hispanic English‐speaking children

Based on previous findings (McGrew, Flanagan, Keith, & Vanderwood, 1997) that auditory processing (Ga) predicts reading decoding, and crystallized intelligence (Gc) predicts reading comprehension beyond the prediction of reading by g(broad general intelligence), this study examined the cross‐ethnic predictive validity of Ga and Gc for reading achievement among low‐SES English‐speaking White and Hispanic students. Subtests of the Woodcock‐Johnson Psycho‐Educational Battery‐Revised (WJ‐R) cognitive subtests were used to measure Ga and Gc, and the WJ‐R achievement subtests were used to measure basic reading skills and reading comprehension. Results indicated that there are no differences between ethnic groups in the prediction of reading ability, and that phonetic coding and crystallized intelligence together are strong predictors of reading achievement. © 2000 John Wiley & Sons, Inc.     

An examination of the CTONI utilizing Gc‐Gf theory: A comparison of the CTONI and WJ‐III

The present investigation examined the validity of the Comprehensive Test of Nonverbal Intelligence (CTONI) with the Woodcock‐Johnson III Tests of Cognitive Abilities (WJ‐III COG) by administering these instruments in counterbalanced order to 60 college students. Results indicated that the mean CTONI NIQ score was not significantly different from the mean WJ‐III COG General Intellectual Ability (GIA) score. However, mean score differences were found between the CTONI NIQ and the WJ‐III COG Verbal Ability, Thinking Ability, Comprehension‐Knowledge, and Fluid Reasoning cluster scores. Although the correlations between the CTONI and the WJ‐III COG cluster scores were generally of small magnitude, the CTONI Geometric Nonverbal IQ composite score demonstrated construct specificity, whereas the CTONI Pictorial Nonverbal IQ scale did not. The implications of the findings are discussed and practitioners are asked to use caution when using this instrument to assess the fluid reasoning abilities of college students. © 2007 Wiley Periodicals, Inc.     

An examination of the criterion validity and sensitivity to brief intervention of alternate curriculum‐based measures of writing skill

Curriculum‐based measures have been validated for use in evaluating reading, mathematics, and writing skills (Marston, 1989). Despite its common use by school psychologists (Wilson & Reschly, 1996), the relationship between the Woodcock Johnson‐Revised and curriculum‐based measures of writing has not been evaluated. This study investigated the relationship between the Woodcock Johnson‐Revised Writing Samples subtest and alternate curriculum‐based measures of written expression. In addition, the sensitivity of the measures to the effects of a short group writing intervention was assessed. Forty‐five third and fourth graders participated in an intervention that consisted of brainstorming ideas, presenting those ideas on a dry‐erase board, and writing a complete sentence on paper with writing quality feedback before completing a CBM (curriculum‐based measurement) writing passage. Numbers of words written as well as five alternate measures of writing samples were used to assess the effects of the intervention. The intervention had a positive effect on total words written. Total punctuation marks, simple sentences, and words in complete sentences emerged as the best predictors of the Woodcock Johnson‐Revised Writing Samples subtest scores in regression analyses. The implications of the analyses, limitations of the study, and directions for future research are discussed. © 2004 Wiley Periodicals, Inc. Psychol Schs 41: 291–300, 2004.     

A preliminary investigation of the concurrent validity of reading comprehension rate: A direct,dynamic measure of reading comprehension

Reading comprehension rate (RCR) is a direct measure of reading skills that may be useful in formatively evaluating students reading beyond the fourth‐grade level. To investigate the concurrent validity of RCR, we correlated RCR, reading comprehension level (RCL), and words correct per minute (WC/M) with the Broad Reading Cluster Scores of the Woodcock‐Johnson III Tests of Achievement (WJ‐III ACH) across 88 students in 4th, 5th, and 10th grades. Results showed that aloud‐RCR was significantly correlated with the WJ‐III ACH scores for 4th‐grade (r = .90; n = 22), 5th‐grade (r = .87; n = 29), and 10th‐grade (r = .65; n = 37) students. Regression analysis specified a one‐predictor model for 4th‐grade students (aloud‐RCR), a two‐predictor model for 5th‐grade students (WC/M and aloud‐RCR), and a one‐predictor model for 10th‐grade students (WC/M). Discussion focuses on directions for future research and applied issues related to RCR probe passage development. © 2007 Wiley Periodicals, Inc. Psychol Schs 44: 373–388, 2007.     

Joint confirmatory factor analysis of the differential ability scales and the Woodcock‐Johnson Tests of Cognitive Abilities–Third Edition

This study examined the underlying constructs measured by the Differential Ability Scales (DAS; C.D. Elliott, 1990a) as they relate to the Cattell‐Horn‐Carroll (CHC) Theory (K.S. McGrew, 1997) of cognitive abilities. The DAS and Woodcock‐Johnson Tests of Cognitive Abilities (WJ‐III COG; R.W. Woodcock, K.S. McGrew, & N. Mather, 2001) were administered to 131 children in grades 3 through 5 who took part in a concurrent validity study included in the Woodcock‐Johnson Tests of Cognitive Abilities, Third Edition, technical manual (K.S. McGrew & R.W. Woodcock, 2001). Confirmatory factor analyses using maximum likelihood estimation were conducted with the AMOS 5.0 (J.L. Arbuckle, 2001) statistical program to evaluate three models of increasing complexity, to compare how well each fit the data set, and to identify the one that best described the underlying constructs measured by the DAS. Results suggested that the synthesized Three‐Stratum CHC Model provided the most parsimonious representation among the three models tested. © 2007 Wiley Periodicals, Inc. Psychol Schs 44: 119–138, 2007.     

Examining the relationship between treatment outcomes for academic achievement and social skills in school‐age children with attention‐deficit hyperactivity disorder

The purpose of this study was to determine the relationship between treatment‐induced changes in academic achievement and social skills in elementary school‐age children with attention‐deficit hyperactivity disorder. A sample of 123 children in grades 1 through 4 with symptoms of inattention, impulsivity and/or hyperactivity, and significant achievement problems in math or reading were identified for participation. Participants were exposed to academic interventions mediated by their teachers, parents, peers, computers, or the student themselves. Data were collected on academic competence using the Woodcock‐Johnson III Test of Achievement and the Academic Competence Evaluation Scales; social skills were assessed using the Social Skills Rating System. Correlations between changes in academic competence and social skills from preintervention to approximately 10 months later were calculated. Results showed that as teacher ratings of reading improved, there were corresponding improvements in social skills. For students in peer‐mediated math interventions, increases in math fluency were correlated with improvements in self‐control. Results are discussed in the context of possible reasons for these findings and implications for practice and future research. © 2008 Wiley Periodicals, Inc.     

FORMATIVE,INFORMATIVE, AND SUMMATIVE ASSESSMENT: THE RELATIONSHIP AMONG CURRICULUM‐BASED MEASUREMENT OF READING,CLASSROOM ENGAGEMENT,AND READING PERFORMANCE

This study explored the relationships among formative curriculum‐based measures of reading (CBM‐R), student engagement as an extra‐academic indicator of student motivation, and summative performance on a high‐stakes reading assessment. A diverse sample of third‐, fourth‐, and fifth‐grade students and their teachers responded to questionnaires about student engagement in academic tasks. These questionnaires were collected about the same time as fall CBM‐R oral reading fluency and maze screening tasks. Results indicated that fall student and teacher reports of engagement and a composite score of reading competence derived from CBM‐R screening tests uniquely predicted student performance on year‐end standardized reading tests. Profile analyses indicated that student engagement was associated with better reading performance among students with low competence, suggesting that engagement may be particularly important for increasing student performance for struggling readers. Implications for interventions targeting both student motivation, as well as reading skill development, are discussed.     

Relations between measures of Cattell‐Horn‐Carroll (CHC) cognitive abilities and mathematics achievement across the school‐age years

Cognitive clusters from the Woodcock‐Johnson III (WJ III) Tests of Cognitive Abilities that measure select Cattell‐Horn‐Carroll broad and narrow cognitive abilities were shown to be significantly related to mathematics achievement in a large, nationally representative sample of children and adolescents. Multiple regression analyses were used to predict performance on the Math Calculation Skills and Math Reasoning clusters from the WJ III Tests of Achievement for 14 age groups ranging in age from 6 to 19 years. Comprehension‐Knowledge (Gc) demonstrated moderate relations with Math Calculation Skills after the early school‐age years and moderate to strong relations with Math Reasoning. Fluid Reasoning (Gf), Short‐term Memory (Gsm), and Working Memory generally demonstrated moderate relations with the mathematics clusters. Processing Speed (Gs) demonstrated moderate relations with Math Reasoning during the elementary school years and moderate to strong relations with Math Calculation Skills. During the earliest ages of the analysis, Long‐term Retrieval (Glr) demonstrated moderate relations with the mathematics clusters, and Auditory Processing (Ga) demonstrated moderate relations with Math Calculation Skills. Visual‐Spatial Thinking (Gv) generally demonstrated nonsignificant relations with the mathematics clusters. © 2003 Wiley Periodicals, Inc. Psychol Schs 40: 155–171, 2003.     

Assessing giftedness in children: Comparing the accuracy of three shortened measures of Intelligence to the Stanford–Binet Intelligence Scales,Fifth Edition

This study examined the accuracy of three shortened measures of intelligence: the Woodcock–Johnson Tests of Cognitive Ability, Third Edition Brief Intellectual Ability (WJ III COG BIA) score; the Stanford–Binet Intelligence Scale, Fifth Edition Abbreviated IQ (SB5 ABIQ); and the Kaufman Brief Intelligence Test IQ Composite (K‐BIT) in predicting giftedness as assessed by the SB5 Full Scale IQ score (SB5 FSIQ). Participants were 202 third grade students who were individually administered the SB5, WJ III, and K‐BIT. Four scores (SB5 ABIQ, K‐BIT, WJ III COG BIA, and SB5 FSIQ) were extracted. Correlational analyses revealed positive, significant relationships among the four scores. Discriminant function analyses, conducted to examine the accuracy of the three shortened measures of intelligence in predicting giftedness, revealed that overall, the WJ III score was the most accurate, and the K‐BIT score was the least accurate in identifying giftedness. © 2008 Wiley Periodicals, Inc.     

Measuring college students' reading comprehension ability using cloze tests

Recent investigations challenge the construct validity of sustained silent reading tests. Performance of two groups of post‐secondary students (e.g. struggling and non‐struggling) on a sustained silent reading test and two types of cloze test (i.e. maze and open‐ended) was compared in order to identify the test format that contributes greater variance in reading comprehension. One hundred participants were recruited from students enrolled in a preparatory course for a high‐stakes statewide reading examination. Our results suggest that all three measures have good concurrent validity. There was no evidence that open‐ended cloze performance was more related to verbal ability than any other reading measure. Maze performance did the best job at discriminating between our struggling and non‐struggling readers. Implications for reading comprehension assessment in post secondary‐aged adults are discussed.     

A Comparison of Lower‐ and Higher‐Resourced Tier 2 Reading Interventions for High School Sophomores

The purpose of this study was to compare the effects of peer‐mediated versus teacher‐directed reading intervention on the reading performance of high school sophomores. Participants (n = 57) from the lowest 25th percentile of their sophomore class in reading were assigned randomly to peer‐mediated or teacher‐directed intervention. Fifteen to sixteen 25‐minute intervention sessions over 12 weeks included listening passage preview, retelling, and main idea questioning. Linear regression revealed statistically significant main effects of intervention on maze selection, with both treatment groups outperforming a nonequivalent control group (ES = .69–1.00). There were no statistically significant differences on oral reading fluency or maze selection between the peer‐mediated and teacher‐directed groups. Participating in peer‐mediated intervention and receiving more minutes of instruction were significantly associated with higher performance on the district reading assessment. Implications for allocating resources to tiered intervention in secondary schools are discussed.     

Relations Among the Home Language and Literacy Environment and Children’s Language Abilities: A Study of Head Start Dual Language Learners and Their Mothers

Research Findings: This study explored the relations between Spanish–English dual language learner (DLL) children’s home language and literacy experiences and their expressive vocabulary and oral comprehension abilities in Spanish and in English. Data from Spanish–English mothers of 93 preschool-age Head Start children who resided in central Pennsylvania were analyzed. Children completed the Picture Vocabulary and Oral Comprehension subtests of the Batería III Woodcock–Muñoz and the Woodcock–Johnson III Tests of Achievement. Results revealed that the language spoken by mothers and children and the frequency of mother–child reading at home influenced children’s Spanish language abilities. In addition, the frequency with which children told a story was positively related to children’s performance on English oral language measures. Practice or Policy: The findings suggest that language and literacy experiences at home have a differential impact on DLLs’ language abilities in their 2 languages. Specific components of the home environment that benefit and support DLL children’s language abilities are discussed.     

ENGLISH LANGUAGE PROFICIENCY AND TEST PERFORMANCE: AN EVALUATION OF BILINGUAL STUDENTS WITH THE WOODCOCK‐JOHNSON III TESTS OF COGNITIVE ABILITIES

In this article, we report the findings of an exploratory empirical study that investigated the relationship between English Language Proficiency (ELP) on performance on the Woodcock‐Johnson Tests of Cognitive Abilities‐Third Edition (WJ III) when administered in English to bilingual students of varying levels of ELP. Sixty‐one second‐grade students, identified as Limited English Proficient, were recruited from a suburban public school district and were given the WJ III in addition to their annual state standardized assessment of ELP. The findings of this study provide evidence to support a linear, inverse relationship between ELP and performance on tests that require higher levels of English language development and mainstream cultural knowledge. The implications of the findings of the present study suggest that practitioners must consider an examinee's level of developmental language proficiency and cultural knowledge acquisition as continuous variables when determining the impact of such factors on test performance and evaluation regarding whether scores obtained from tests administered in English are indeed valid for interpretation.