New York’s English and math scores are scheduled to be released this week — at long last. Compared to prior years, the state has delayed their release by a month.
But when the scores arrive, they will come with a big asterisk.
This year, as in the past, the numbers will not be directly comparable to the previous year because of changes to the test itself. Under pressure from teachers, students, and parents who argued that classrooms are too focused on preparing for the exams, the state shortened the tests from three days to two — which means this year’s scores will not allow for an apples-to-apples comparison, state officials said.
By contrast, last year was one of the rare instances in the last decade when the tests did not change, allowing observers to identify trends. New York City posted small gains in reading and math, narrowing the gap with the rest of the state. But with a new test, determining if this pattern has continued will be hard to judge. Here are some questions we’ll be asking as this year’s scores come out.
If the tests aren’t comparable, can they tell us whether students or schools are improving?
The short answer, according to Teachers College professor Aaron Pallas, is not really.
State officials will continue to report the share of students who are considered proficient in reading and math, as in previous years. But because the way the exam is scored must change to account for shorter tests, it will be difficult to know whether the tests reflect real changes in student learning.
If scores improve, “Does that mean they did better, or is that an artifact of the changes in testing?” Pallas said. “The state is probably not going to be able to answer that this week.”
That means it will be difficult to use the scores as an overall barometer of the health of the city’s school system and to see what impact some Mayor Bill de Blasio’s biggest education initiatives are having (or not). This lack of clarity will be especially evident, for example, when trying to gauge improvements among schools in the city’s $750 million Renewal turnaround initiative. The city is making final decisions about the 50 schools that remain in the program this school year.
Still, it’s possible city officials will seize on the results if they show gains. When scores rocketed up 8 points in English and one point in math in 2016, de Blasio said the improvements were “pure hard evidence” that his policies were paying off — even as state officials said the scores, when judged against the previous year, were also not an “apples-to-apples” comparison.
How strong is the opt-out movement?
In recent years, roughly one in five students have opted out of the state tests in protest. But in New York City, that percentage has historically been much smaller: just 4 percent of students sat out at least one exam last year, a slight increase from the year before.
Still, the opt-out rate serves as something of a bellwether of attitudes toward state education policy. The movement grew in response to a series of reform initiatives, including a law that became controversial because one of its provisions tied state test scores to teacher evaluations, an element that is currently on hold, and in reaction to the adoption of the Common Core learning standards. After the state rolled out new tests aligned with the standards, scores plummeted.
This year, partly in response to parent opposition to testing, state officials have taken steps to lessen its role (and the time testing takes) in schools. Under the federal Every Student Succeeds Act, which gives states more leeway than they enjoyed under No Child Left Behind, New York policymakers have shifted some of the focus from standardized exams to other metrics such as chronic absenteeism and have introduced interventions, generally seen as less harsh, at the lowest-performing schools.
Will these changes temper some of the fury that prompted the opt-out movement in the first place? So far it’s unclear. But officials said the opt-out numbers will be released alongside the annual test scores.
What about test-score gaps among different groups of students?
Richard Carranza has repeatedly talked about some of the structural and historical disadvantages found in the nation’s largest school system since taking its helm, and if history is any guide, this year’s test scores will continue to demonstrate these inequities.
Black and Hispanic students have historically performed far below their white peers, a divide that did not narrow significantly last year. We’ll also be on the lookout for trends among English learners and students with disabilities.
But once again, because of changes to the test, how these disparities are narrowing (or widening) over time may not be clear. Nor will there be a full sense of whether the scores reflect the city’s “Equity and Excellence” agenda, which is largely designed to give schools extra resources, but has drawn criticism for not tackling systemic disparities.
State officials said that the tests should now remain the same for the next two years, meaning this year could serve as a baseline to measure Carranza’s new approach— including his promise to address school segregation — even if the verdict this year remains murky.