awaiting clarity

Expecting big changes to state testing this year? Don’t hold your breath

Sheridan School District sixth grader Monica Dinh takes part in a practice session last year (Photo By Craig F. Walker / The Denver Post)

Some Colorado districts and lawmakers have long been itching to throw off the straitjacket of state standardized tests so they could experiment with alternative ways of gauging student learning.

A new federal law offers hope for such flexibility, but it appears unlikely Colorado legislators will take any major action on the issue this year.

“There’s not going to be significant legislation,” said Lakewood Democratic Rep. Brittany Pettersen, chair of the House Education Committee.

The only proposal she foresees is the possibility lawmakers could direct the Colorado Department of Education study the issue.

Why? Lawmakers want to wait until the U.S. Department of Education fleshes out the details of the new law with regulations.

The Every Student Succeeds Act, passed by Congress late last year, leaves the familiar annual testing calendar in place. But the bill also offers grants that states can use to try to improve their testing systems. That could open the door for a states, for example, to use of multiple tests. The law also creates a pilot program under which up to seven states can develop new tests.

What that will mean in practice remains to be seen. Experts who are creating new rules for the federal department that will accompany the law are just starting their work.

Asked whether ESSA allows multiple state tests, Assistant Commissioner Gretchen Morgan of CDE told the House Education Committee at a recent hearing that there is still much to learn about the new law.

“ESSA does still speak to a single state assessment. … We don’t know yet what to expect,” she said. “It’s going to be a while.”

The committee backed a bill to study options for future state test changes but defeated a bill aimed at making Colorado attractive for an upcoming federal testing pilot program.

The committee passed House Bill 16-1234, which would require the state education department to study possible alternative tests in language arts, math, science social studies and report back to the legislature.

“This is a study bill. It’s a do-nothing bill this year” but could lay some groundwork for the future, said sponsor Rep. Gordon Klingenschmitt, R-Colorado Springs. As one of the chamber’s most conservative Republicans, Klingenschmitt has little clout in the Democratic-controlled House. If his bill doesn’t survive, Pettersen indicated the idea might be resurrected in another measure.

The other bill, House Bill 16-1131, called for the state education department to recommend local testing options to the State Board of Education and would have allowed the department to reduce testing under certain circumstances if Colorado participates in the ESSA pilot.

Sponsor Rep. Terri Carver, R-Colorado Springs, said the bill was intended to ensure a testing pilot program included in last year’s state testing reform law would be tailored to make it more attractive to districts.

Pettersen said she didn’t think the state needed a bill to do those things.

“I believe that’s correct,” Morgan replied.

The bill was killed on a 7-4 vote, with one Republican joining Democrats in opposition

Testing alternatives might come into play in another bill. Rep. Jim Wilson, R-Salida, is working on a yet-to-be-introduced measure intended to give school districts some relief from state mandates, including how frequently some districts have to file improvement plans.

Wilson agreed his bill also could provide a vehicle for discussion of testing alternatives. But he doesn’t think that will happen this year. “I think that may wait for flexibility 2.0 legislation next year.”

Last year’s testing reform law included a provision creating a complicated, multi-year pilot program under which districts could experiment with different tests, but no district has taken up the offer.

“We haven’t received any notifications from districts or charter schools that they’re interested in doing that,” Morgan told the committee.

A group of 10 rural districts is working on what’s called the Student-Centered Accountability Project, hoping to design an alternative to the current state system for rating districts and schools. The group currently is seeking bids for management of the project and trying to determine costs.

Only two states, Arizona and Florida, are actively pursuing alternative tests, according to a recent Education Week article. A bill that would allow districts to choose from a menu of tests is headed to the governor’s desk in Arizona.

Surprising report

EXCLUSIVE: Did online snafus skew Tennessee test scores? Analysts say not much

PHOTO: TN.gov
Education Commissioner Candice McQueen will release the results of Tennessee's 2017-18 standardized test this week, but the reliability of those TNReady scores has been in question since this spring's problem-plagued administration of the online exam.

An independent analysis of technical problems that disrupted Tennessee’s online testing program this spring is challenging popular opinion that student scores were significantly tainted as a result.

Education Commissioner Candice McQueen said Wednesday that the disruptions to computerized testing had “small to no impact” on scores, based on a monthlong analysis by the Human Resources Research Organization, or HumRRO. The Virginia-based technical group has expertise in psychometrics, the science behind educational assessments.

“We do believe these are valid, reliable scores,” McQueen told Chalkbeat on the eve of releasing state- and district-level scores for TNReady, the state’s standardized test in its third year.


Here are five things to know as Tennessee prepares to release TNReady scores


The state hired the research group to scrutinize several issues, including whether frequent online testing snafus made this year’s results unreliable. For instance, during at least seven days out of the three-week testing window, students statewide reported problems logging in, staying online, and submitting their tests — issues that eventually prompted the Legislature to roll back the importance of scores in students’ final grades, teacher evaluations, and school accountability systems.

But the analysis did not reveal a dramatic impact.

“For students who experienced the disruption, the analysis did not find any systematic effect on test scores that resulted from lapses in time between signing in and submitting their tests,” McQueen told Chalkbeat.

There was, however, a “small but consistent effect” if a student had to log on multiple times in order to complete the test, she said.

“When I say small, we’re talking about an impact that would be a handful of scale score points out of, say, a possible 200 or 250 points,” McQueen said.

Analysts found some differences in test score averages between 2017 and 2018 but concluded they were not due to the technical disruptions.

“Plausible explanations could be the students just didn’t know the (academic) standards as well and just didn’t do as well on the test,” McQueen said. “Or perhaps they were less motivated after learning that their scores would not count in their final grades after the legislation passed. … The motivation of our students is an unknown we just can’t quantify. We can’t get in their minds on motivation.”

About half of the 600,000 students who took TNReady this year tested with computers, and the other half used paper materials in the state’s transition to online exams. Those testing online included all high school students.

Out of about 502,000 end-of-course tests administered to high schoolers, educators filed about 7,600 irregularity reports – about 1.4 percent – related to problems with test administration, which automatically invalidated those results.

The state asked the analysts specifically to look at the irregularity reports for patterns that could be cause for concern, such as demographic shifts or excessive use of invalidations. They found none.

TNReady headaches started on April 16 – the first day of testing – when students struggled to log on. More problems emerged during the weeks that followed until technicians finally traced the issues to a combination of “bugs in the software” and the slowness of a computerized tool that helps students in need of audible instructions. At one point, officials with testing company Questar blamed a possible cyberattack for shutting down its online platform, but state investigators later dismissed that theory.

While this year’s scores officially are mostly inconsequential, McQueen emphasized Wednesday that the results are still valuable for understanding student performance and growth and analyzing the effectiveness of classroom instruction across Tennessee.

“TNReady scores should be looked at just like any data point in the scheme of multiple data points,” she said. “That’s how we talk about this every year. But it’s an important data point.”

choosing leaders

Meet one possible successor to departing Denver superintendent Tom Boasberg

PHOTO: Melanie Asmar
Denver Public Schools Deputy Superintendent Susana Cordova addresses teachers at an early literacy training session.

As Denver officials wrestle with how to pick a replacement for longtime superintendent Tom Boasberg, one insider stands out as a likely candidate.

Susana Cordova, the district’s deputy superintendent, already held her boss’s job once before, when Boasberg took an extended leave in 2016. She has a long history with the district, including as a student, graduating from Abraham Lincoln High School, and as a bilingual teacher starting her career more than 20 years ago.

When she was selected to sit in for Boasberg for six months, board members at the time cited her hard work and the many good relationships they saw she had with people. This time around, several community members are saying they want a leader who will listen to teachers and the community.

Cordova, 52, told Chalkbeat she’s waiting to see what the board decides about the selection process, but said she wants to be ready, when they are, to talk about her interest in the position.

“DPS has played an incredibly important role in every aspect of my life. I’m very committed to making sure that we continue to make progress as an organization,” Cordova said. “I believe I have both the passion and the track record to help move us forward.”

During her career, she has held positions as a teacher, principal, and first became an administrator, starting in 2002, as the district’s literacy director.

Just before taking on the role of acting superintendent in 2016, Cordova talked to Chalkbeat about how her education, at a time of desegregation, shaped her experience and about her long path to connecting with her culture.

“I didn’t grow up bilingual. I learned Spanish after I graduated from college,” Cordova, said at the time. “I grew up at a point in time where I found it more difficult to embrace my Latino culture, academically. There were, I would say, probably some negative messages around what it meant to be Latino at that point of time.”

She said she went through introspection during her senior year of college and realized that many students in her neighborhood bought into the negative messages and had not been successful.

“I didn’t want our schools to be places like that,” she said.

In her time as acting superintendent, she oversaw teacher contract negotiations and preparations for asking voters for a bond that they ultimately approved that fall. Cordova’s deputy superintendent position was created for her after Boasberg returned.

But it’s much of Cordova’s work with students of color that has earned her national recognition.

In December, Education Week, an education publication, named her a “Leader to Learn From,” pointing to her role in the district’s work on equity, specifically with English language learners, and in her advocacy to protect students under the Deferred Action for Childhood Arrivals program, or DACA.

Cordova was also named a Latino Educator Champion of Change by President Barack Obama in 2014. Locally, in 2016, the University of Denver’s Latino Leadership Institute inducted Cordova into its hall of fame.

The Denver school board met Tuesday morning, and again on Wednesday to discuss the superintendent position.

Take a look back at a Q & A Chalkbeat did with Cordova in 2016, and one in 2014.