Evidence-Based Policy: 2002 No Child Left Behind Act
April 17, 2017
President Trump’s Secretary of Education, Betsy DeVos, continues the neoliberal ideology in education policy into the 115th Congress, arguing for more school choice, voucher programs, and government deregulation. This moment is therefore a critical and opportune one for us to reexamine the effectiveness of the NCLB Act, not in terms of ideological arguments and rhetoric, but based on research data and analyses. Based on numerous studies by education policy researchers, it is clear that the NCLB Act, through the use of standardized tests, incentives and sanctions, improved education outcomes for students across the nation. Crucially, this played a significant role in tackling the “rising tide of mediocrity” in the American education system.
Passed with bipartisan support in 2011, the NCLB Act was based on the premise that higher standards, stronger accountability, and greater school choice would improve education outcomes. Specifically, it introduced the following initiatives. First, states must administer standardized reading, math and science examinations at various grade levels, and schools must report the aggregate results for both the student population and specific disadvantaged groups. Second, schools must achieve “adequate yearly progress” (AYP) as defined by the states or face sanctions of increasing severity. Sanctions faced by these schools include being mandated to offer students the option to transfer into a higher-performing school, being required to implement supplemental education services, and even being forced to shut down, among many others. Third, teachers must be “highly qualified”, which largely refers to a bachelor’s degree in their teaching subject and state certification.
America’s Mediocre Education System
Compared to international standards, America’s education system lags behind. In the 2015 PISA assessment, the United States ranked 19th in science, 20th in reading and 31st in mathematics out of 35 OECD countries, decisively lower than average, in spite of having a higher income per capita and spending almost twice the average amount on education per pupil than other nations . In fact, according to a McKinsey study, this persistent gap in academic achievement between children in the United States and their international counterparts deprived the economy of as much as $2.3 trillion in economic output in 2008 .
Fortunately, academic achievement in the United States has been steadily improving, in part due to the efforts of education policymakers and legislators, such as the NCLB Act. The standard measure of the achievement levels is the National Assessment of Educational Progress (NAEP). In math, the average fourth-grade scores improved from 235 (out of 500 points) in 2003 to 240 in 2009 and the average eighth-grade scores improved from 278 in 2003 to 283 in 2009 . In reading, the average fourth-grade scores improved from 218 in 2003 to 221 in 2009 and the average eighth-grade scores improved marginally from 263 in 2003 to 264 in 2009 .
Nonetheless, these test scores do not reflect the full picture, and the debate for and against the NCLB Act remains as contentious as ever.
Debate over No Child Left Behind
Proponents of the NCLB Act argue that standardized testing holds both teachers and schools accountable, allowing students and parents to compare the performance of these teachers and schools with others. This underscores the Schumpeterian concept of creative destruction, in which organizations with operational slack either have to improve or be replaced by more competent and innovative ones. For example, in 2003, about 30 percent of all public schools did not meet AYP for at least one year, with nearly seven percent not meeting AYP for two or more years . Corresponding sanctions, such as being mandated to offer students the option to transfer into a higher performing school, were imposed on these schools. As a result, almost 70,000 students exercised the transfer option in that year, resulting in not only a better education for these students, but also an increased pressure on these schools to improve . Finally, apart from raising accountability, the NCLB Act also improves teaching standards through standardized testing, which provides teachers the guidance to determine what and when to teach students. This was in stark contrast to the past in which schools determined their own curriculum, irrespective of the latest developments in pedagogy, international education benchmarks, and industry requirements.
On the other hand, detractors of the NCLB Act contend that standardized testing causes teachers to “teach to the test”, stifling their teaching abilities and creativity. Moreover, skills and values, such as creativity, empathy, and resilience, that are not covered in the tests may be neglected. This focus on rote learning and repetitive test taking harms the social and emotional well-being of students. Furthermore, these high-stakes tests are not reflective of solving real-world issues, and some students do not cope well with such rigid forms of assessments. In particular, the excessive use of multiple choice questions in standardized tests hinders an accurate assessment of a student’s understanding the topic at hand. Special education and Limited English Proficient students also take the same standardized exams as the general student population, thereby neglecting their unique learning difficulties. Additionally, in pursuit of achieving AYP goals, states have progressively lowered their assessment standards, resulting in worse education outcomes . Lastly, critics of the NCLB Act argue that since the sanctions are determined based on improvements in the percentage of students who achieve proficiency standards, this has resulted in an “education triage”, in which the lowest and highest performing students are neglected because they do not contribute to the school’s ability to meet AYP. Schools reportedly only focus on “bubble students”, who refer to students below but near the proficiency standards.
The vast majority of education policy researchers believe that the effectiveness of the NCLB Act in increasing academic achievement is more nuanced that traditional politicians and activists portray. On balance, the NCLB Act resulted in moderate improvements in academic achievement when compared to what schools would have achieved without such accountability systems in place.
First and foremost, one of the most important findings by policy researchers is that standardized tests are both valid and reliable, accurately predicting numerous life outcomes such as wages, body mass index, number of arrests and life satisfaction . Furthermore, given that these examinations incentivize the learning of essential employment skills in mathematics, science and reading literacy, standardized tests can play an important role in raising workforce productivity. In fact, Hanushek and Woessmann conclude decisively in their study the extremely robust and consistent positive relationship between test scores and growth rates. From 1971 to 2003, using data from 12 OECD countries, the test-score trend of individual countries accounted for 64 percent of the variation in their growth trends . Indeed, skills will play an increasingly important role in the American economy. According to a study by Rothwell from the Brookings Institute, only a third of adults possess a bachelor’s degree or more, despite the fact that almost half of all newly available jobs requires one . In the light of an increasingly knowledge-based economy, coupled with the proliferation of robots, automation and artificial intelligence, the lackluster performance by the United States in raising its numeracy and literacy levels will be increasingly detrimental to its economy, workforce and wages.
Against this backdrop, it is unsurprising that education policymakers have turned to better standardized tests, stronger incentives and harsher penalties to spur state schools to improve. For example, Dee and Jacob found that stricter accountability systems imposed by the NCLB Act improved the math performance of fourth-grade students by almost two-third of a year’s worth of growth, after controlling for external factors like socioeconomic status (2009) . Among these students, the effect was the largest among the bottom percentile and among disadvantaged subgroups like African Americans, Hispanics and low-income families. However, the study showed a statistically insignificant improvement in the math performance of eighth-grade students and no evidence that the NCLB improved fourth-grade reading performance. Separately, Hanushek and Raymond (2005) , Springer (2008) , Wong, Cook, and Steiner (2009) , and Neal and Schanzenbach (2010)  corroborate the general findings that the NCLB Act improved academic achievement among students, although to varying degrees. Overall, this seems to suggest that the NCLB Act was most effective at raising basic skills easily tested by standardized exams, such as a fourth-grade math exam, and in particular among the most disadvantaged subgroups.
Despite these positive effects, academic policy researchers generally conclude that “triage” effects do exist as a result of the AYP system. For example, Neal and Schanzenbach showed that the variation in proficiency standards for different grades between the Chicago Public School accountability system and that of the NCLB Act resulted in no change in academic performance for students who did not have a realistic chance of becoming proficient in the near term and improvements in students near the proficiency standard (2010) . These results are corroborated by Ladd and Lauen (2010)  and Krieg (2008) .
Moreover, there is a general consensus among researchers that the AYP standards incentivized states to lower their proficiency standards, leading to counterproductive results. For instance, Cronin et. al. present evidence that seven out of 12 states lowered their proficiency standards between 2003 and 2006, with the declines being the largest in states with the highest initial proficiency standards (2005) . Indeed, by 2011, Usher showed that nearly half of all schools in the country were considered failing (2015) .
On the other hand, researchers, whilst finding some evidence of “teaching to the test”, generally argue for improvements to standardized tests, rather than abandoning these tests altogether. This is particularly important to academics because standardized testing produces high-quality quantitative results that empower the analysis of education policies. For example, comparing results in 1994 and 1998, Klein et al presented evidence that in math, the improvements among fourth-grade students in the high-stakes Texas Assessment of Academic Skills (TAAS) were greater than that in the lower-stakes NAEP test (2000) . Furthermore, according to the TAAS, the difference between the scores of whites and students of color is small and decreasing greatly, whereas according to the NAEP, it was large and increasing slightly. This hints at some evidence of students being coached to the unique styles of these tests, the worsening of skills outside of what is taught in narrower standardized curriculum and the presence of racial biases in some standardized tests. Despite these criticisms, Klein et al. emphasize that they nonetheless believe that a large-scale assessment is essential to monitoring student progress. This is reiterated by Bambrick-Santoyo’s Driven by Data (2010), along with many other researchers .
Finally, the NCLB Act has proven to be relatively cost-effective at improving students’ academic achievement levels. For example, by 2008, the policy increased annual spending per pupil by a significant $600 in states that did not have school accountability programs prior to the NCLB Act . This increased expenditure was directed to student instruction and educational support services and represented a reasonable return on investment in terms of its corresponding test score increases. Furthermore, at the federal level, total federal education funding increased by about 30 percent, from $42 billion in 2001 to $56 billion in 2004, thereby providing state schools with significant federal support . With education spending representing one of the most cost-effective means to raise social mobility and economic productivity, the shift in federal funding towards education signifies tremendous progress towards investing in the future of our country.
America’s education system has fallen behind. While the NCLB Act has indeed helped improve education outcomes moderately in a cost-efficient manner, it has also led to notable drawbacks: “triage” effects, artificially low proficiency standards and poorly designed standardized tests. Nonetheless, progress has been made. Through the passage of the Every Student Succeeds Act in 2015, the federal government remedied much of the major weaknesses of the NCLB Act, whilst demonstrating its continual commitment to standardized testing and state accountability systems. As schools across the United States enter into a new era of increased accountability, competition and school choice under the new Trump administration, it will be more important than ever to rely on objective analyses and research to strengthen our education system, our workforce and our country.
 http://hanushek.stanford.edu/sites/default/files/publications/Hanushek+Woessmann 2012 JEconGrowth 17(4).pdf
 http://hanushek.stanford.edu/sites/default/files/publications/hanushek+raymond.2005 jpam 24-2.pdf
Additional Blog Posts
Student Blog Disclaimer
The views expressed on the Student Blog are the author’s opinions and don’t necessarily represent the Penn Wharton Public Policy Initiative’s strategies, recommendations, or opinions.