Are Children Learning

Here’s why a test loved by teachers isn’t likely to replace Indiana’s ISTEP

PHOTO: Alan Petersime

As Indiana attempts to overhaul its student testing program in hopes of replacing the unpopular ISTEP test, teachers around the state have been pushing for an exam they’re already using in their classrooms: The MAP test.

The MAP — Measure of Academic Progress — is a favorite of teachers who appreciate the real-time data it provides about how well students have mastered specific skills, such as decimals or fractions in elementary school math.

The test, created by the Northwest Evaluation Association, can be administered two to four times per year in English and Math. It takes far less time than typical state exams — about an hour per subject per session — and teachers can see the results immediately, enabling them to tailor their lessons to areas where kids are showing deficits.

“(With ISTEP) I might be able to see if they can answer eighth and ninth grade level math questions” said Reuben Benzel, a math teacher at Herron High School. “But (with MAP) I can see whether they are able to do something like answer a proof even before I teach it. I can see immediately how much my students grew.”

But teachers pulling for the MAP to become Indiana’s new ISTEP are likely out of luck.

Even though rules are relaxing around what kinds of tests students in Indiana and other states need to take, exams like MAP that show how students improve over the course of a year do not yet meet federal or state testing requirements for use in state accountability.

Federal law requires states to measure student performance at a single point in time — whether through one end-of-year exam or multiple exams given throughout the year that are combined to form one score. State Superintendent Glenda Ritz has raised the possibility that the state could adapt a test like MAP by figuring out a way to combine multiple test scores, but there are few existing models for how to do that so it meets federal guidelines.

Indiana law also discourages the use of tests like MAP — so-called “formative” or “interim” assessments — as an annual state exam because the state’s A-F grading system is based on the percentage of students who pass or fail the test. MAP isn’t designed to determine which students have passed or failed according to state expectations for what kids should know at each grade level like ISTEP is — students can theoretically score anywhere on the MAP scale in any grade.

Someday, it might be possible to make MAP more adaptable so that it could be used in states like Indiana that need a pass/fail result, said Jason Mendenhall, NWEA’s senior vice president of strategic solutions.

“Measuring student growth independent of grade level … that is a different purpose then measuring student performance against grade level,” Mendenhall said. “If we provide a measure of academic performance, we’d design the structure and content of that assessment differently.”

But for now, it seems the test is best used as a teaching tool.

Cynthia Roach, testing director for the Indiana State Board of Education, said she’d be open to exploring ways to use something like the MAP in the state’s assessment program but notes that Indiana is limited by federal law requiring states to annually test kids in grades 3-8 to determine how many are performing at grade level.

“(Federal law) requires we have a grade level test on grade level standards,” Roach said. “While we do generally like (MAP), and it’s very useful to us, I think…that would need to be studied in-depth.”

These also are not the kinds of changes that can be done quickly. The state’s current accountability system took years to design and implement, and ideally tests should take anywhere from two to five years to create, experts say.

Some educators and test experts are concerned that using a test like MAP that is given multiple times during the year could force teachers to teach the same things at the same time to stay on schedule. Others worry that multiple tests throughout the year would increase the amount of time kids spend testing. If MAP suddenly gets stakes attached to it, will more tests pop up to prepare for it?

At that point, the state might just be replacing one longer exam with multiple shorter ones.

But it’s hard to ignore that teachers say they appreciate the more specific feedback from MAP over any kind of results they get from ISTEP or A-F grades.

Before Benzel came to Herron, he taught at Emmerich Manual High School, where he learned how to adapt his teaching to different groups of students based on their MAP scores. Students on the lower end of the scale might need more of the basics, like how to think conceptually about numbers and arithmetic. But higher-achieving students might be able to handle more on their own. Benzel said he might encourage those kids to use geometry to prove the pythagorean theorem, rather than just teaching them about the theorem.

“We have to meet students where they’re at,” Benzel said. “Standardizing their education system … may show policymakers what we’re producing, but a lot of kids are being lost.”

ethnic studies

50 years in, why the fight for Mexican-American studies in schools is still in its early stages

PHOTO: Annie Wells/Los Angeles Times via Getty Images
Sonia Salazar, a college student, joins over 1,000 people to commemorate the historic East LA student walkouts of 1968 earlier this year. Mexican-American Studies courses are gaining traction now in K-12 schools after years of growth in higher education, a panel concluded during a recent civil rights conference in San Antonio.

Thirteen-year-old Alejandra Del Bosque knows not everyone gets to take a class like hers.

In it, she’s learned about Mexican-American students who staged walkouts in the late 1960s and early 1970s to protest the lack of resources available to their schools. She’s also learned how her state’s school funding system has still been deemed inadequate in recent court rulings.

“There was so much to learn about my heritage that I didn’t know,” Del Bosque said. “But from what I understand, it’s a unique class that’s not everywhere. For me, as a Mexican-American, it’s exciting.”

Her experience remains relatively rare. Fifty years after televised civil rights hearings galvanized the Chicano movement, academics and activists agree that the push for Mexican-American studies still lacks basic resources. And though interest is increasing, in part thanks to President Trump, growth has been slow — especially in K-12 schools, since college-level programs have traditionally gotten more attention.

“That was a big mistake we made,” Juan Tejeda, a professor at Palo Alto College, said last week. “There should have always been a focus on developing culturally relevant curriculum from pre-K through 12.”

He spoke at an event commemorating the 1968 U.S. Commission on Civil Rights Hearings on Mexican-Americans in the Southwest, where he and others took stock of the movement that emerged in the decades since to better engage Latino students. (Of the 58 million Latinos in the U.S., nearly two-thirds are of Mexican descent, and most were born in the U.S.)

That’s long been a challenge for schools, especially as most educators are white. Some research has suggested that when students see themselves reflected in their curriculum, test scores and graduation rates rise. Another study found that taking an ethnic studies course helped reduce dropout rates.

Not many students have access to those courses, though. There’s no solid national data on how many school districts have some form of Mexican-American studies in their schools. California is understood to have taken the lead, while Tejeda estimated that only about 38 of more than 1,000 Texas districts have started a program.

That’s partly due to ongoing political opposition.

Arizona’s ban on teaching Mexican-American studies back in 2010 was a wake-up call for the movement, Tejeda said. (Last year, a federal court ruled that the state’s move was “racist and unconstitutional,” but Tucson hasn’t reinstated its program yet.)

Over the last decade, Mexican-American professors built a network that evolved into a group called Somos MAS. The group began a push for a standard high school elective course in Texas.

After four years of lobbying, the Texas board of education approved the course last year. Battles have also turned toward materials: When the book to be used in schools for Mexican-American studies was released in 2016, it was described by many Chicano scholars as racist for its portrayal of Mexican-Americans as lazy and un-American. That book was later thrown out, as was another the board didn’t like in 2017. Then came a debate over the course’s name, which just ended in September.

Those fights were about more than details – they were about granting the topic legitimacy, and about making it easy for teachers to introduce the material, said Lilliana Patricia Saldaña, a professor at the University of Texas at San Antonio.

“There were already some teachers here or there taking upon themselves to incorporate the studies into the schools, but it was sporadic, and accurate materials weren’t always easy to find,” Saldaña said. “Approving a course that can be aligned with state standards is ideal and would allow for the programs to be more streamlined.”

Another key challenge: in many cases, limited student interest. At the college level, Our Lady of The Lake University — the host of the hearings in 1968 and the conference last week — considered nixing its Mexican-American studies program in 2012 because of the small number of participating students. It was later saved.

“That also reminded us that if we don’t fight to keep these programs, they will be lost,” Tejeda said. “But what we needed to do was focus on getting students interested while they are younger.”

Saldaña says student interest has grown more recently thanks to political rhetoric around immigration, specifically from President Donald Trump. Trump has disparaged Mexican immigrants, questioned the impartiality of a Mexican-American judge, and made wanting to build a wall on the U.S.-Mexico border the center of many political speeches.

“Between what we are seeing with the current administration in office, and the battle here on the ground over the course we have been fighting for, students are getting a real-time lesson,” Saldaña said.

Somos MAS now hosts an annual summit for K-12 educators to come learn about Mexican-American Studies and how to integrate lessons into their classrooms. The University of Texas at San Antonio also offers a summer training institute that has drawn nearly 100 teachers at its most recent gathering.

It’s not nearly enough, the panelists said. “What needs to happen next is a focus on building infrastructure: such as more teacher training opportunities on how to incorporate MAS in their classrooms; a teacher certificate in Mexican-American Studies, and more advanced degrees in ethnic studies so students see a future in this field of work,” Saldaña said.

Students from KIPP Camino Academy. (Photo by Francisco Vara-Orta)

One school that has moved ahead with Mexican-American studies course is KIPP Camino Academy in San Antonio. After a pilot program two years ago, the class is now an elective for seventh- and eighth-graders.

On Friday, 20 of the KIPP students watched the discussion on the 50-year fight to get Mexican-American studies in their schools with their instructor, JoAnn Trujillo.

“Some of these kids have driven by the university here and never have gotten to step foot on its grounds,” Trujillo said. “So us being here — in part because of the program, and seeing how Mexican-American studies is something special that had to be fought for many years — will plant seeds about going to college and feeling more self-worth.”

Data dive

Hardly any kids passed ISTEP at one of Indiana’s largest schools. Here’s why it’s not getting an F

Indiana Virtual Pathways Academy is one of the state’s largest and fastest-growing schools. But because too few of its students took the state exams — and those who did weren’t enrolled long enough — there is no clear picture of how well the school is educating them.

The virtual charter school, which opened in 2017, more than doubled in size to 6,232 students since last fall, in part because state data shows more than 1,700 students transferred from its troubled sister school, Indiana Virtual School.

But despite Indiana Virtual Pathways Academy’s rapid growth, the school is bypassing a key accountability measure that Indiana thinks is important for transparency: A-F grades, which were approved by the Indiana State Board of Education on Wednesday.

Read: As students signed up, online school hired barely any teachers — but founder’s company charged it millions

Education department officials said the school did not get a grade, despite its high enrollment last year, because it did not test enough students who had been enrolled long enough to have one calculated. State grades are based primarily on student test scores, and virtual schools are known to struggle to get their remote students to sit for exams.

State test participation rate data shows IVPA tested about 19 percent of its 346 10th-graders in 2018 — about 65 students. To use test scores to calculate a school grade, the state requires that at least 40 test-takers must have attended the school for at least 162 days, a majority of the school year. But state officials said that while the school enrolled 48 10th-graders who met the attendance threshold during the testing period, only three of those students took the exams.

Federal requirements say schools must test at least 95 percent of students, and school grades can be affected if a school falls below that percentage. But there is currently no consequence for a school that doesn’t test enough students to get a letter grade.

The students who were tested at IVPA posted poor results: 5.7 percent passed both state English and math exams.

Leaders from Indiana Virtual School and IVPA did not respond to requests for comment on A-F grades or testing participation, but the schools’ superintendent Percy Clark said in an emailed statement that students from varying education backgrounds select IVPA, and that the school was designed to serve students who are far behind their peers academically.

“Our students CHOOSE to come to Indiana Virtual Pathways Academy from many different backgrounds, and we accept everyone regardless of where they are on their academic journey,” Clark said.

Virtual charter school critics say IVPA’s lack of a letter grade is an example of how the schools are able to avoid scrutiny.

“It’s absolutely indefensible,” said Brandon Brown, CEO of The Mind Trust, an organization that advocates for charter schools but has been a vocal critic of virtual charter schools. “When it comes to charter schools, the grand bargain is that the charter school gets increased autonomy, and in exchange, there is greater accountability. It’s hard to see where the accountability is for virtual schools right now.”

In contrast to IVPA, other large virtual schools in the state tested at least 90 percent of their students, and nearly every traditional school in Indiana met the federal threshold for testing students.

Indiana Virtual School, the subject of a Chalkbeat investigation that revealed questionable educational and spending practices, tested about two-thirds of its students in 2018. Students at the school, which received its third F grade from the state this week, did marginally better than at IVPA, but performed far below state averages: 18.6 percent of elementary and middle school students passed both tests, and 4.4 percent of high-schoolers did. State law says schools are up for state board of education intervention when they reach four consecutive F grades.

Brown, who used to work in the Indianapolis mayor’s office overseeing charter schools, said this is where charter school authorizers — the entities charged with monitoring the schools’ operations, finances, and academics — need to be involved. Daleville Public Schools, a small rural district near Muncie, oversees IVS and IVPA. State education leaders have previously questioned whether school districts have the capacity and expertise to oversee statewide charter schools. District leaders did not immediately respond to requests for comment.

“If I was still an authorizer and one of our schools had less than a 20 percent rate of their students taking the ISTEP, we would be mortified, and we would be holding that school accountable with very clear measures,” Brown said. “In light of the tens of millions of dollars used to fund this school, there has to be at least a basic level of accountability, and right now, it’s hard to account for how that money is being spent because we just don’t know.”

With such high enrollment numbers, Indiana Virtual School and Indiana Virtual Pathways Academy could together bring in upward of $35 million from the state for this school year, according to funding estimates from the Legislative Services Agency.

At the state’s other full-time virtual charter schools — including those billed as alternative schools like IVPA — state grades are rising as enrollment grows. Indiana Connections Academy is up to a D this year from an F, and Insight School of Indiana is up to a C from an F. For grades under Indiana’s federal plan, the schools received an F and D, respectively.

Indiana Connections Career Academy enrolled about 70 students last year and received no grade, but education department officials say that is because it had too few students to calculate one, despite testing more than 95 percent of them. It’s not uncommon for small schools — especially high schools that have just one tested grade — to not get a grade. This year, the school’s enrollment is up to about 300 students.

Virtual charter school accountability has become a hot issue in Indiana. Earlier this year, the state board of education convened a committee to study virtual charter schools, which have grown rapidly here in recent years. And last month, the committee released a series of recommendations, including slowing growth of new virtual charter schools to 15 percent per year — after a school hits 250 students — for their first four years.

Getting students who are located remotely to sit for state exams is a challenge for virtual schools. Melissa Brown, head of Indiana Connections Academy, said dogged work contacting and keeping up with students has made some of the difference for her school, both in students taking tests and improving on them.

“Our teachers are relentless in trying to engage with kids,” she said. “We are by no means where we want to be. We still have a lot of work to do. But 8-point growth is something that we’re celebrating today.”

Melissa Brown said the school is also offering students who come in behind grade level more ways to make up their classes and incentives for them to stay at the school. For example, she said the school has a lot of over-age eighth-graders who should be in high school. Instead of just drilling their eighth-grade classes, they also have a chance to try out high school-level work — a taste of what’s to come, Brown said. So far, it’s working.

“We’re just trying to be really creative about helping kids progress,” she said.

At Insight, school director Elizabeth Lamey said she’s excited by how the high school has been able to help students show more growth on state tests. Currently, the school, which opened in 2016, is getting grades calculated only on how much students improve on state tests from one year to the next, not their proficiency or other measures such as graduation rate.

Lamey said improving the school’s curriculum and focusing on remediation and teacher training contributed to their progress and sets them up to continue that work.

“We hope to see even more growth this year,” Lamey said. “We know that it’s a rougher road, the older students get, to remediate. It takes more time, and we are slow and steady — we keep moving forward.”

Accountability issues will continue to be important for virtual charter schools as their enrollments grow.

Indiana’s five full-time virtual charter schools enroll about 13,000 students. Although it appears that total virtual charter school enrollment in Indiana has declined since 2017-18, those figures include the closing of low-performing Hoosier Virtual Academy. The school enrolled 1,170 students when it closed in June, which was far lower than the 3,342 it was recorded as having at the beginning of that school year.

Comparing enrollment totals between fall of 2017 and fall of 2018, every virtual charter school currently open in the state saw enrollment rise, with the exception of Indiana Virtual School. Indiana Connections Academy and its sister school, Indiana Connections Career Academy, gained nearly 400 students between them. Insight is also up 45 students.

Virtual charter schools tend to have volatile enrollment patterns in part because of how easily students can enroll and withdraw — their families don’t have to move, and they can live anywhere in the state. Students moving between schools is not unique to virtual schools, but those schools do tend to see higher instances of mobility than traditional schools.

That means it can be hard to determine just how much virtual school enrollment has changed from one year to the next — enrollment numbers reported in the fall might fluctuate wildly through the rest of year.