Tying Teacher Evaluation to Student Test Scores: The Ongoing Debate

Interestingly, fewer states are including student test scores in their teacher evaluation calculations. As of October 2019, 34 states will use student test scores while calculating teacher effectiveness, compared to 43 states in 2015 (read more here).

In addition to reading the aforementioned article, I recently engaged in a conversation with an advocate of using student test scores to calculate teacher effectiveness. I’m always amused when people say that educators need to be held accountable in similar ways to other professions (ie. The business world). These advocates want some means of measuring teacher effectiveness (as do we all), and equate students to “products” that are churned out at the end of the year. Obviously, we know that human beings are not “products” churned out on a factory belt. But, I’m always perplexed by these proponents. What I find most perplexing is that, the grand majority of the time, people touting/proposing/enacting these kinds of proposals:

    Are not teachers
    Have never been teachers
    Have no experience in PUBLIC education
    Have NO certification in education
    Run some kind of educational “philanthropy”
    See improving education as their “crusade”

I’m no statistician, but neither are many advocates for these types of reforms. I don’t understand how any teacher evaluation system could accurately account for all the variables that vastly impact student achievement (over which educators have MINIMAL TO ZERO control), including but not limited to (just to name a few of the big ones):

  • Poverty
  • Hunger
  • Homelessness
  • Family Mobility
  • Single-Parent Households
  • Parents’ Academic History/Ability
  • Diet
  • Physical Activity/Physical Health
  • Mental Health

I’ve heard that professors at prestigious universities have been trying to quantify and control for these almost uncontrollable variables since the release of “A Nation At Risk” in 1983 (with minimal to no success). I’ve read about researchers developing ridiculous formulas to try and control for outside-of-school factors and then incorporating these formulas into teacher evaluation along with student performance. In terms of actually improving student achievement by tying student achievement to teacher evaluation, the data are inconclusive. Of course, I contend that the reason for this is that these types of evaluation systems do nothing to address the underlying symptoms of student academic performance, or lack there of. “Efforts to improve educational outcomes in schools, attempting to drive change through test-based accountability, are unlikely to succeed unless accompanied by policies to address the out-of-school factors that negatively affect large numbers of our nations’ students” (Berliner, 2015).

Don’t misunderstand me….

• Students should ALWAYS be showing growth

• Teacher evaluation should encompass some type of measurable/quantified measure

I’m NOT saying that because of the issues mentioned above, we should not hold educators accountable. I’m NOT saying that we as educators can’t do things in order to ameliorate some of these underlying issues. THAT’S NOT WHAT I’M SAYING AT ALL. In fact, much research exists that posits, yes, these out-of-school factors exist, but here are things we can do in our classrooms to help. I am saying that teacher evaluation systems that include student performance as a measure of teacher effectiveness will always be seriously flawed.

I’m interested to see how this trend continues. Clearly, the government plays a major role in these types of educational reform initiatives. Thus, I would say that, unfortunately, future evaluation changes will be the result of a continuously changing and volatile political climate.

Like/comment/share!

Illinois Getting Rid of PARCC Tests… Can We Broaden the Curriculum and Focus on Performance-Based Assessments Now?

Illinois may be getting rid of PARCC (other states already have). For some, this is no surprise. Secondary educators lambasted PARCC testing and the tests were eventually removed from the high school setting. Others saw PARCC as another cyclical education reform that just so happened to bring about new types of assessments (“computer-based,” oh my!). PARCC replaced state-standardized tests like ISAT, which replaced IGAP and on down the road since the doom and gloom proclamations in 1983’s A Nation at Risk.

Obviously, in our test-based accountability system, PARCC will be replaced with something else. We’ve heard that the new tests may be shorter, allowing for teachers/administrators/districts to receive the results in an expeditious manner. What is more, it’s possible that the new tests will be adaptive in that test will adjust the difficulty of the questions based on student responses (similar to NWEA’s MAP assessments).

However, it’s my view that these changes aren’t enough. Sure, shorter tests will be good for teachers and students. Teachers and parents have decried that students are over assessed for years. Sure, more expeditious feedback is good. That’s always been one of the major drawbacks of these state-standardized tests. Sure, adaptive tests that adjust according to student responses could be a good thing, if this helps us better identify student deficiencies.

Yet, I’m not sure any of these adjustments will address a pressing issue facing all schools, but especially schools serving disadvantaged communities: narrowing of the curriculum. If these tests are tied to any federal funding (like what happened with Obama’s Race to the Top initiative), there will continue to be narrowing of the curriculum. If these test are used to evaluate, rate, and/or compare schools and districts, there will continue to be narrowing of the curriculum. If districts prioritize these tests and the data generated by them, there will continue to be narrowing of the curriculum. Point being, it’s a different means to the same end. We may have new tests on the horizon. But, the accountability movement/reform in education is still alive and well. When state-standardized test scores are used to evaluate schools/districts/teachers, narrowing of the curriculum will continue to occur.

What is more, as past research has shown, these state-standardized tests only assess low-level thinking skills, numb teacher and student creativity, and prepare students to take tests rather than to think critically and solve real-world problems. With more standardized tests, even though they’ve been shortened and allow teachers to receive feedback in a timely manner, I’m guessing we’ll still have tests that assess low-level thinking skills, decrease creativity, and don’t accurately show all that a student really knows.

I’ve always been an advocate of performance-based assessments, which challenge students to use higher-order thinking in order to create a product or complete a process. The essential components of performance-based assessments help to ensure complexity and higher-order thinking: relevant, real-world oriented, open-ended, time-bound, products presented to an authentic audience, embedded formative assessment and feedback.

Performance-based assessments are not new. In fact, they’ve been around in some form or another since the days of John Dewey. However, when accountability reforms increased the pressure facing today’s schools, we moved away from performance-based measures of learning to standardized measures. This pressure also forced the narrowing of the curriculum. Thus, I (and many others) appeal to our legislators and education policy makers to truly consider what’s best for our students, for our teachers, and for our schools. When moving forward with new state-standardized testing, we must consider all that we’ve learned from the pressures associated with these tests.

Like/Comment/Share! Help raise awareness about this issue!

Dear Representative Jeanne Ives: We Need to Talk

I apologize for the delay in blog posts. It’s been a while since I’ve written. I’ve been busy this summer! However, I could not ignore an opportunity to write a post focused on Jeanne Ives and her deleterious comments regarding teachers, unions, and the teacher pension system in Illinois.

Her comments have circulated social media for few weeks now (Facebook Link; Youtube Link). I find the following quote most troubling: “I’ll get out my checkbook and I’ll send a property tax bill to my county to pay for bloated administrative salaries in public schools… in public schools where on average, in the state of Illinois, less than half of the students are ready for college… Just over 1/3 are even reading or doing math at grade level… Maybe I should send them more money…”

Undoubtedly, she’s passionate. You can hear it in her voice. I appreciate that. Yet, imagine if she were more passionate about clarity. Before I begin to poke holes in the validity of her claim, I’ll first share the following troubling statistic/fact (allowing me to situate my response): Schools with less than 10% of students from low socioeconomic status backgrounds score as well as or better than the highest achieving nations (Finland, Shanghai, etc.) in the world. In fact, if one were to analyze a data set showing level of achievement and percentage of students from low socioeconomic status backgrounds, one would see an inverse correlation between the two. Therefore, as the percentage of students from low socioeconomic status backgrounds increases, the level of achievement decreases. In no way am I saying that poor students cannot achieve. Quite the opposite, in fact, considering I dedicate my life to showing that they can. I’m simply sharing this information to highlight the importance of not conflating separate issues in education. Are there overpaid administrators in education? Possibly. Yet, it’s important to understand that one issue does not exist as a result of the other. Put plainly, student academic underachievement is not a result of (possible) bloated administrative salaries. When considering student academic achievement (or lack thereof), there are far too many concurrent variables at play (poverty, student/family mobility, etc.) to make a claim that one of those variables is significantly more profound than all the others. One may see her conflation (as I do) as a complete misinterpretation of issues facing educators today. Thus, it would behoove her (and the many politicians like her) to leave education to those who have the knowledge and ability to bring about the necessary changes.

Recently, Jeanne also blasted a teacher on twitter, claiming that “support of unions = chaos in schools.” As you can see in the picture accompanying this post, I responded with a comment to get her thinking and to encourage her to explain to me how unions contribute to chaos in schools, considering that chaos is prevalent in a considerable amount of non-unionized, failing charter schools (I’m still waiting for her to get back to me…). In addition, I always think it’s wise to consider how successful districts or world nations deal with prevalent education issues. For example, Finland works closely with its teacher union in order to best serve its students. Granted, as an administrator, I’ve had many difficult conversations with teachers’ unions and union representatives. However, like Finland, I believe that in order to raise achievement for all students, it’s considerably more propitious to work with unions as opposed to lumping them all together into one picture/broad stroke and developing evil machinations to bring about union demise. Jeanne’s comments really brought me back. Teacher/union blasting was so 2014. I think Diane Ravtich should send her signed copies of her most recent work.

She also made comments about the “state’s pension problem.” This will be short and sweet. If I’m not mistaken, politicians have voted to borrow against teacher pensions for decades. These politicians have never paid back the loan. I’m no financial expert. However, it’s rare in life to get a loan and never have to pay it back (sarcasm). The pension system was never designed to serve as an interest free loan for politicians to use as they see fit.

Of course, it’s truly unfortunate when people who have widespread access to such a large array of people don’t think before they spread misinformation. At the same time, her comments truly demonstrate her lack of understanding. Not that politicians need to be experts in all fields. However, a working knowledge regarding some of the basics would certainly help.

Like/Comment/Share!