a test of happiness

When teachers are better at raising test scores, their students are less happy, study finds

PHOTO: Denver Post file
Students practice for a standardized test.

Is a good teacher one who makes students enjoy class the most or one who is strict and has high standards? And are those two types even at odds?

new study that tries to quantify this phenomenon finds that on average, teachers who are good at raising test scores are worse at making kids happy in class.

“Teachers who are skilled at improving students’ math achievement may do so in ways that make students less happy or less engaged in class,” writes University of Maryland’s David Blazar in the study, published in the peer-reviewed journal Education Finance and Policy.

The analysis doesn’t suggest that test scores are a poor measure of teacher quality, but does highlight the different ways teachers may be effective.

The research uses data from four school districts across three states between 2010 and 2013; in one year, students were randomly assigned to fourth- and fifth-grade teachers, allowing researchers to study what effect different teachers had on students. Those students were also surveyed about their behavior, self-efficacy, and happiness in class.

A large body of past research has found that teachers have a meaningful impact on student test scores, and a number of more recent studies have found that teachers also impact other measures — sometimes called non-cognitive outcomes — such as behavior and attendance. 

The latest study asks a few big questions.

First: Do teachers have an impact on students’ attitudes and behavior, as measured by student surveys? Here, the answer is convincingly yes, consistent with the emerging research.

Second: Are the statistical estimates — often called value-added  measures — of teacher impacts on test scores and non-cognitive skills accurate? The study examined this by comparing the statistical estimates to the results from from random assignment, and it found that the answer varies. Value-added measures are quite accurate for predicting test scores — an important finding in light of the charged debate on whether to judge teachers by these metrics. But it concludes that the statistical models are often biased for measuring  impact on student attitudes, suggesting that attempting to evaluate teachers in this regard may be misguided.

Finally: Is a teacher’s performance, measured by test scores, similar to performance according to other measures? This question is especially important because it’s key for understanding how to think about teacher quality and how to evaluate it.

The study concludes there was only a weak relationship between test score performance and student behavior and feeling of efficacy in math. But when it came to student happiness, there was a moderate negative association — on average, greater test score gains meant less happy students.

What explains this potentially surprising inverse relationship?

It could be that teachers who were less demanding were more popular because their instruction was less likely to promote learning — but more enjoyable for students. Maybe those teachers just popped in a video on many days; perhaps they never gave homework.

Blazar, for his part, is skeptical of this theory.

“I’m not sure that’s a likely explanation in large part because teachers’ emotional support for students … seems to be really predictive of how happy students are in class,” he said. “Building an emotionally supportive classroom environment is something that educators and researchers have cared about for a long time.”

Another interpretation, then, is that measures of teacher effectiveness based on test scores leave out important dimensions of what makes a good teacher — such as caring for students, something that might show up in happiness surveys.

Blazar emphasizes that while the correlation was negative and statistically significant it was not strong in size, meaning that there were certainly teachers who succeeded in improving both test scores and happiness.

Past research has generally shown that test-based measures capture some, but not all, of the components of effective teaching. Test score results tend to be only modestly related to other measures of performance, like classroom observations or effects on student attendance.

On the other hand, teachers’ impacts on tests have rarely been negatively related to other measures. In fact, there is usually a small positive association, including with regards to student surveys. Moreover, a number of studies have linked teachers’ and schools’ test score impacts to longer-term results, including adult income and college success.

“[Test score value-added] clearly can’t be all about things we don’t care about, such as test prep, if it translates into longer-run outcomes,” Blazar said.

“I think that both are likely important,” he said, referring to test scores and students’ engagement and happiness in class.

“Hopefully we can get to a place where teachers are good at multiple skills,” Blazar said. “Rather than just documenting this pattern, I would want to use this information to say, if you’re good at raising test scores but not as good at engaging students, how can we get you to a place where you can do both at the same time?”

Want more Chalkbeat? Sign up for our new weekly national newsletter here.

Future of Teaching

Tentative contract includes big raises for IPS teachers

PHOTO: Dylan Peers McCoy
Teachers would receive significant raises under a tentative new contract with IPS.

A month after voters approved a vast funding increase for Indianapolis Public Schools, Superintendent Lewis Ferebee’s administration and the district teachers union have reached a tentative deal for a new contract that would boost teacher pay by an average of 6.3 percent.

The agreement was ratified by union members Wednesday, according to a statement from teachers union president Ronald Swann. It must be approved by the Indianapolis Public Schools board, which is likely to consider the contract next week, before it is final.

Swann did not provide details of the agreement, but it was outlined in union presentations to teachers on Wednesday ahead of the ratification vote. The deal would cover the 2018-19 school year, and teachers would receive retroactive pay back to July 2018. The prior contract ended in June.

Raising teacher pay was a key part of the sales pitch district leaders used to win support for a referendum to raise $220 million over eight years from taxpayers for operating expenses. The referendum passed with wide support from voters last month, and although the district will not get that money until next year, the administration can now bank on an influx of cash in June 2019. Teachers could receive another raise next year, once the money from the referendum begins flowing.

The proposed deal would bring pay raises for new and experienced teachers. First year teachers in the district would see their salaries jump to $42,587, about $2,600 above the current base salary, according to the presentation to teachers. Returning teachers would move up the pay scale, with most receiving raises of about $2,600.

The deal also brings a reward for teachers who are at the top of the current scale. The top of the scale would rise to $74,920 by adding several stops above the current maximum of $59,400. That means teachers who are currently at the top of the scale would be able to move up and continue getting raises.

Many longtime teachers in the district also earn additional pay for advanced education, but teachers who joined the district more recently are not eligible for that extra money.

Teachers who received evaluations of ineffective or needs improvement in 2017-18 are not eligible for raises.

The new contract is the second time in recent years that teachers have won substantial raises in Indianapolis Public Schools. After four years of painful pay freezes, Ferebee negotiated a contract in 2015 that included a large pay increase. Teacher pay is especially important for the district because it is competing with several surrounding communities to staff schools.

Health care costs would go up this year, a policy shift that was advocated by the Indy Chamber, which urged the district to reduce health insurance spending as part of a plan to shift more money to teacher salaries.

The contract includes a provision that was piloted last year allowing the district to place newly hired teachers at anywhere on the salary schedule. It’s designed to allow the district to pay more for especially hard-to-fill positions.

Teachers at some troubled schools, known as the transformation zone, would also be eligible for extra pay on top of their regular salaries at the discretion of the administration. That money would come from state grants specifically targeted at transformation zone schools.

The idea of allowing superintendents to pay some teachers in their districts more than others is controversial.

Teacher Pay

‘Our teachers have waited long enough’: Educators say Indiana needs to act now on teacher pay

PHOTO: Shaina Cavazos
Students in Decatur Township work on physics problems with their teacher.

Educators and advocates are pushing state leaders to take action this year to raise teacher compensation — not to wait for additional research, as Gov. Eric Holcomb proposed last week.

“Our teachers have waited long enough,” said Teresa Meredith, president of the Indiana State Teachers Association, the state’s largest teachers union. “It doesn’t take a two-year study to discover what we already know: teachers need to be valued, respected, and paid as professionals.”

Holcomb’s proposal last week to study raises in the upcoming budget-writing session and make bigger steps in 2021 didn’t sit well with some, since lawmakers and advocates spent the fall talking up the need to make teacher salaries competitive with other states. But given the state’s tight budget situation, Holcomb suggested studying the impact of raises for at least a year, as well as looking at how much money would be needed and how districts would be expected to get the money to teachers.

Read: Raising teacher pay likely to be at the forefront for Indiana lawmakers and advocates in 2019

The proposal drew quick criticism. Education leaders and advocacy groups took to Twitter to express their hopes that Holcomb and lawmakers would find ways to address teacher salaries this year as well as into the future.

“IN must respond now,” State Superintendent Jennifer McCormick tweeted Friday morning, remarking that too many teachers across the state are leaving the profession because pay is too low. “Kids deserve & depend upon excellent teachers.”

“We can’t wait to act because Hoosier children are counting on all us to come together to ensure our schools can attract and retain the best teachers,” Justin Ohlemiller, executive director of Stand for Children Indiana, said in a blog post titled “The time to act on teacher pay is now.

ISTA’s 2019 legislative agenda, released Monday, will continue pushing for lawmakers and state leaders to find creative solutions to raise teacher pay and make Indiana competitive with other states.

And ISTA says they might have voters on their side. A recent ISTA poll of more than 600 Hoosiers, conducted by Emma White Research, shows that funding for education is a priority across the state, with more than 86 percent of those sampled supporting sending more money to public schools. About 72 percent of people polled believe educators are underpaid.

But it’s unclear if there would be enough money in the budget to spend on across-the-board raises after other funding obligations are met, such as funding needed by the Department of Child Services to deal with effects of the state’s opioid crisis. Senate Democrats have called for $81 million a year to ensure 5 percent raises for teachers and counselors over the next two years. Republicans have strong majorities in both chambers.

Neither ISTA, lawmakers, Holcomb nor other education groups have released specific plans for either how much they’d like to see set aside for teachers or strategies for how a pay increase could feasibly be carried out. However, the effort has brought together some unlikely allies — the union, a vocal advocate for traditional public schools, rarely aligns its education policy with groups like Stand and Teach Plus Indiana that have favored increased school-choice options, such as charter schools.

With limited dollars to go around, the focus will have to also be on how to make existing education dollars go farther, Meredith said. She, along with Republican House Speaker Brian Bosma last month, pointed to the need to curtail spending on administration, which, they argue, could free up money for other expenses such as teacher compensation.

Some have also pointed to the state’s recent budget surplus and reserves as evidence that Indiana could spend more on education if there was political will to do so.

“The surplus has come on the backs of educators and their students,” Meredith said. “Elected leaders must do more. They must do more to declare teacher pay a priority in this session, and they must take action.”

ISTA is also hoping lawmakers will act to:

  • Restore collective bargaining rights so educators can negotiate work hours and class size, as well as salaries and benefits.
  • Remove teacher evaluation results from decisions about salary until the state’s new ILEARN test has been in place for a few years.
  • Invest in school counselors, psychologists, and social workers
  • Strengthen regulations for charter and virtual charter schools, including putting a moratorium on new virtual schools until those safeguards can be enacted.
  • Study districts that have focused on how to best teach students who have experienced trauma.

Indiana’s next legislative session begins in January.

Correction: Dec. 11, 2018: This story has been updated to reflect that Stand for Children Indiana doesn’t take a position in regards to private school vouchers.