The Effect of High School Socioeconomic Status on the Predictive Validity of SAT Scores and High School Grade‐Point Average

Research has often found that, when high school grades and SAT scores are used to predict first‐year college grade‐point average (FGPA) via regression analysis, African‐American and Latino students, are, on average, predicted to earn higher FGPAs than they actually do. Under various plausible models, this phenomenon can be explained in terms of the unreliability of predictor variables. Attributing overprediction to measurement error, however, is not fully satisfactory: Might the measurement errors in the predictor variables be systematic in part, and could they be reduced? The research hypothesis in the current study was that the overprediction of Latino and African‐American performance occurs, at least in part, because these students are more likely than White students to attend high schools with fewer resources. The study provided some support for this hypothesis and showed that the prediction of college grades can be improved using information about high school socioeconomic status. An interesting peripheral finding was that grades provided by students’ high schools were stronger predictors of FGPA than were students’ self‐reported high school grades. Correlations between the two types of high school grades (computed for each of 18 colleges) ranged from .59 to .85.     

Within‐High‐School Versus Across‐High‐School Scaling of Admissions Assessments: Implications for Validity and Diversity Effects

Previous research has established that SAT scores and high school grade point average (HSGPA) differ in their predictive power and in the size of mean differences across racial/ethnic groups. However, the SAT is scaled nationally across all test takers while HSGPA is scaled locally within a school. In this study, the researchers propose that this difference in how SAT scores and HSGPA are scaled partially explains differences in validity and subgroup differences. Using a large data set consisting of 170,390 students each of whom matriculated at one of 114 separate colleges, the researchers find that awarding SAT scores by ranking SAT within a high school generally results in substantial reduction in the size of subgroup mean differences for this predictor. However, validity for predicting first‐year GPA is also reduced by a small amount. Conversely, placing HSGPA onto a nationally normed metric through the use of multiple regression procedures results in a moderate increase in the size of subgroup mean differences, while also producing a small increase in validity. Taken together, these findings suggest that differences in predictor scaling can partially explain differences in the size of subgroup mean differences between HSGPA and SAT scores and have implications for predictive power.     

The influence of test‐based accountability policies on early elementary teachers: School climate,environmental stress,and teacher stress

This study examined the potential influence of test‐based accountability policies on school environment and teacher stress among early elementary teachers. Structural equation modeling of data from 541 kindergarten through second grade teachers across three states found that use of student performance on high‐stakes tests to evaluate teachers indirectly was related to teachers’ professional investment via test stress in the environment. Although students in kindergarten through second grade do not take high‐stakes assessments, early elementary teachers reported high levels of stress associated with test‐based accountability policies. This study provides data across multiple states that test‐based accountability policies may have negative influences on school environment and teacher stress among early elementary teachers. Implications for practice and research are discussed.     

Inclusive Achievement Testing for Linguistically and Culturally Diverse Test Takers: Essential Considerations for Test Developers and Decision Makers

Substantial growth in the numbers of English language learners (ELLs) in the United States and Canada in recent years has significantly affected the educational systems of both countries. This article focuses on critical issues and concerns related to the assessment of ELLs in U.S. and Canadian schools and emphasizes assessment approaches for test developers and decision makers that will facilitate increased equity, meaningfulness, and accuracy in assessment and accountability efforts. It begins by examining the crucial issue of defining ELLs as a group. Next, it examines the impact of testing originating from the No Child Left Behind Act of 2001 (NCLB) in the U.S. and government‐mandated standards‐driven testing in Canada by briefly describing each country's respective legislated testing requirements and outlining their consequences at several levels. Finally, the authors identify key points that test developers and decision makers in both contexts should consider in testing this ever‐increasing group of students.     

Predicting College Performance of American Indians: A Large‐Sample Examination of the SAT

Extensive research has examined the validity and fairness of standardized tests in academic admissions. However, due to their underrepresentation in higher education, American Indians have gained much less attention in this research. In the present study, we examined for American Indian students (1) group differences on SAT scores, (2) the predictive and incremental validity of SAT over high school grades, (3) the effect of socioeconomic status on SAT validity, (4) differential prediction in the use of SAT scores, and (5) potential omitted variables that could explain differential prediction for American Indian students. Results provided evidence of predictive and incremental validity of SAT scores, and the validity of SAT scores was largely independent of socioeconomic status. Overprediction was found when using SAT scores to predict college performance and it was reduced when including high school grades as an additional predictor. This study provides substantial evidence of the validity and fairness of SAT scores for American Indians.     

Gender‐Based Differential Prediction by Curriculum Samples for College Admissions

A longstanding concern about admissions to higher education is the underprediction of female academic performance by admission test scores. One explanation for these findings is selection system bias, that is, not all relevant KSAOs that are related to academic performance and gender are included in the prediction model. One solution to this problem is to include these omitted KSAOs in the prediction model, many of these KSAOs are 'noncognitive' and “hard‐to‐measure” skills in a high‐stakes context. An alternative approach to capture relevant KSAOs is using representative performance samples. We examined differential prediction of first year‐ and third year academic performance by gender based on a curriculum‐sampling test that was designed as a small‐scale simulation of later college performance. In addition, we examined differential prediction using both frequentist and Bayesian analyses. Our results showed no differential prediction or small female underprediction when using the curriculum‐sampling tests to predict first year GPA, and no differential prediction for predicting third year GPA. In addition, our results suggest that more comprehensive curriculum samples may show less differential prediction. We conclude that curriculum sampling may offer a practically feasible method that yields minimal differential prediction by gender in high‐stakes operational selection settings.     

The Role of Socioeconomic Status in SAT–Freshman Grade Relationships Across Gender and Racial Subgroups

Recent research has shown that admissions tests retain the vast majority of their predictive power after controlling for socioeconomic status (SES), and that SES provides only a slight increment over SAT and high school grades (high school grade point average [HSGPA]) in predicting academic performance. To address the possibility that these overall analyses obscure differences by race/ethnicity or gender, we examine the role of SES in the test‒grade relationship for men and women as well as for various racial/ethnic subgroups within the United States. For each subgroup, the test‒grade relationship is only slightly diminished when controlling for SES. Further, SES is a substantially less powerful predictor of academic performance than both SAT and HSGPA. Among the indicators of SES (i.e., father's education, mother's education, and parental income), father's education appears to be strongest predictor of freshman grades across subgroups, with the exception of the Asian subgroup. In general, SES appears to behave similarly across subgroups in the prediction of freshman grades with SAT scores and HSGPA.     

Counter engagement: parents refusing high stakes testing and questioning policy in the era of the common core

This study is a critical discourse analysis of the New Jersey Opt-Out Movement. In 2015, and in response to the increasing standardization of US public school instruction, and over-use of high-stakes testing, NJ parents began to refuse to allow their children to take a key end-of-the year exam, the PARCC. We employ the concepts of master and counter narratives to exam the qualitative data that was collected in an online-questionnaire, a focus group, and refusal letters. We argue that these parents have refused this exam for their children based on differing reasons, that parents effectively changed the master narrative of the PARCC to grow their movement, and their refusal letters were key in promoting a new counter narrative.     

试述利用高中和标准化考试成绩确定大学申请学生的合格性──美国加州大学的经验与启示

本文以美国加州大学的招生实践为基础,分析高中成绩和标准化入学考试分数对大学一年级成绩的预测效度,以及它们在评定大学申请学生合格性中的作用,同时也阐述了加州大学利用这两种成绩确定申请学生合格性方法的问题与面临的挑战。研究表明,高中成绩对大学一年级成绩的预测效度高于标准化考试(SATI)。但高中成绩主要反映了学生掌握高中知识的程度,而标准化考试成绩则侧重于体现学生的认知能力。合理结合、使用这两种成绩对学生的知识和能力进行评价,将会使大学招生更为科学公允。     

Trick or treat: new ecology of education accountability system in the USA

This study tracks American states’ policy choices under the No Child Left Behind Act and explores their consequences for student achievement. Using the path analysis of relationships among state‐level policy input, context, and outcome variables, the study portrays a Halloween‐like ‘trick‐or‐treating’ game between the federal and state governments in the new ecology of the test‐driven education accountability system. States that chose the ‘trick’ path with a calculative policy negotiation and manipulation strategy made significant gains on their own state assessments but not on the national assessment. In contrast, states that followed the ‘treat’ path with a faithful policy implementation for funding strategy have not yet brought about significant gains on either the national or state assessments. The first‐generation accountability states with a prior history of high‐stakes testing tended to employ both strategies at the same time. However, neither effective illusion nor ineffective implementation serves the goal of long‐term, sustainable academic improvement. Implications for research and policy are discussed.     

The Relationship Between Interparental Conflict and Self‐Reported Grade Point Average Among College Students

Interparental conflict has been shown to have a negative effect on the academic success of children and adolescents. This study examined the relationship between college students' (N = 143) perceived levels of interparental conflict, their living arrangement, and their current self‐reported grade point average. Participants who experienced more interparental conflict, specifically female students and those living away from home, reported a lower grade point average. Implications for college counselors are discussed.     

The Gap Between Influence and Efficacy: College Readiness Training,Urban School Counselors,and the Promotion of Equity

This phenomenological study presents 11 urban school counselors’ perceptions of their graduate education in school counseling in relation to their engagement in college readiness counseling with low‐income, 1st‐generation college‐bound students. Findings from 2 rounds of interviews suggest that intentional strategies to integrate postsecondary readiness and planning into counselor education curricula is necessary to efficiently prepare school counselors to promote college access and success for at‐risk youth, thereby reducing the inequities that currently exist in postsecondary degree attainment.     

现行断裂韧度测试标准的差异及对实际测量的影响

针对现行断裂韧度测试标准的不同,分析了钝化线和上界限线的规定形式对实际测量结果的影响,探讨了各标准的侧重点,并对标准的发展提出几点建议。     

Establishing an Early Warning System: Predicting Low Grades in College Students from Survey of Academic Orientations Scores

Counselors, faculty, and student personnel specialists are often unaware that college students are experiencing serious academic or adjustment difficulties until it is too late to rectify the problem. Most universities would benefit from an early warning system that detects at-risk students before performance or social problems jeopardize their college careers. This investigation demonstrated that scores from the Survey of Academic Orientations (SAO) were predictive of first-semester freshmen grades. Subsequent analysis showed that the SAO significantly improved the prediction of grade point averages, after taking the effects of Scholastic Assessment Test scores and high school percentage rank into consideration. The SAO gives educators a new early warning device, a way to identify those undergraduates most at risk of receiving poor grades. The next steps in the research process are to: (1) assess the relationship of SAO scores to other important academic indexes, such as retention and student stress, and (2) determine if furnishing counselors and other college personnel with SAO scores is of therapeutic value.     

Bunny Hill or Black Diamond: Differences in Advanced Course‐Taking in College as a Function of Cognitive Ability and High School GPA

College students commonly have considerable course choice, and they can differ substantially in the proportion of their coursework taken at an advanced level. While advanced coursework is generally viewed as a desirable component of a student's education, research has rarely explored differences in student course‐taking patterns as a measure of academic success in college. We examined the relationship between the SAT, high school grade point average (HSGPA), and the amount of advanced coursework taken in a sample of 62 colleges and 188,985 students. We found that both the SAT and HSGPA predict enrollment in advanced courses, even after controlling for advanced placement (AP) credits and demographic variables. The SAT subtests of Critical Reading, Writing, and Math displayed differential relationships with advanced course‐taking dependent on student major. Gender and race/ethnicity were also related to advanced course‐taking, with women taking more advanced courses in all major categories except for science, technology, engineering, and mathematics (STEM) where they took fewer, even after controlling for other variables. Socioeconomic status had a negligible relationship with advanced course‐taking. This research broadens our understanding of academic achievement in college and the goals of admissions in higher education.     

普通高中实施课程标准后生物学科高考设计研究

2007年高考的课标卷是普通高中实施课程标准后的第一份试卷,其对今后课程标准的实施和高考命题有重要的价值,因此开展高考课标卷的设计研究就成为高考命题的首要任务。2007年高考生物课标卷的设计在内容抽样和目标确定方面,做到了总体保持稳定、适当体现新课程的理念;在试卷结构方面,理综卷生物学科增加了所占的分数比例,试卷难度控制在0.5—0.6之间;选做题尽量做到了形式的等值。同时考前进行调研性试测是新、老高考实现平稳过渡的重要措施。     

The Consortium and the Commissioner: A Grass Roots Tale of Fighting High Stakes Graduation Testing in New York

The following paper provides a case study of the resistance of the New York Performance Standards Consortium to the state’s unitary high stakes testing policy from 1998 to 2006. After detailing the history of the grass roots actions undertaken by the group of alternative high schools called ‘The Consortium’, the analysis seeks to apply sociological and philosophical theory of, among others, John Rawls and Charles Willie to explain: (1) the success of the subdominant people of power in fighting the implementation of the battery of high stakes graduation tests; and (2) the failures of the dominant state authority to uniformly enforce its policy, with particular regard to the decisions of New York’s Commissioner of Education. Implications of the case are then discussed to place this little known educational struggle in a broader social, political and historical context.

超越文理分科:美国高中课程和大学招生的专业分化

美国高中课程设置和大学招生要求,既不是文理不分、也不是文理分科,而是通过学生选修选考,进行更为深入的、专业导向的分化。在该制度下,共同基础课程的修读学分要求和考核要求较低,专业导向课程的内容难度、考核难度较高。相比较而言,选择性高校更加重视考生在专业导向课程上的学业成绩。