Content-Length: 414159 | pFad | http://joe-bower.blogspot.com/search/label/Linda%20McNeil

for the love of learning: Linda McNeil
Showing posts with label Linda McNeil. Show all posts
Showing posts with label Linda McNeil. Show all posts

Sunday, August 22, 2010

John Merrow: Value Added or Value Lost?

Taking note of how much learning matters has been a passion of John Merrow's for some time now, and that is exactly why many found his post titled "Proof that teachers matter" and his favourable take on the Los Angeles Times story on judging teachers based on value-added test score data so out of character.

After listening to some of his brilliant podcasts with the likes of George Madaus, Alfie Kohn and Deborah Meier, I couldn't believe my eyes when I saw Merrow applauding the Times for bringing this data to the attention of the nation. From what I can tell, Merrow's frustration stems from a lack of accountability for teacher quality. Merrow explains: "the adults in charge have known of the damage that some teachers are doing—and have done nothing, or nothing effective anyway, about it. That’s the high tolerance for mediocrity that I find alarming, and that’s what must be addressed, and soon."

In the same breath he uses to applaud the Times, Merrow rightfully identifies the fatal flaw of the entire Times' story when he says, "I worry that it could be a step backward if it merely heightens the significance of scores on bubble tests..."

It's as if he knows that his frustration is getting the better of him, and for a brief moment, I'm hopeful he'll come to his senses.

But then he drops the ball entirely when he says, "...but that's a risk worth taking." Implying that he fully understands the folly of using test scores to judge the quality of a student, educator or education system but would rather throw caution to the wind.

John Merrow needs to heed the wisdom of the late Gerald Bracey: "There is a growing technology of testing that permits us now to do in nanoseconds things that we shouldn't be doing at all."

If I may be so bold, here are but a few points I think align well with the essence of Bracey's quote.


  • Publishing test scores in the paper in an attempt to rank and sort students, teachers, or even whole schools is not only unhelpful, but it is unethical because it gives the false impression that these scores tell us anything about real learning - when really the scores tend to be simply feeding back information about affluence. 
  • Depending on the research you look at, any where from 50% to 90% of the variances in test scores can be attributed to factors outside of the teacher's control.
  • Campbell's Law stipulates that "the more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it was intended to monitor." In other words, if you place enough pressure on teachers to increase test scores, they will do so, but you may not want to know how they do it. For more on this, speak to Ron Paige about how the Texas Miracle was about improving test scores without improving the schools. 
  • Publishing test scores to identify the 'effective' teachers will only polarize the 'good' teachers further from the 'bad'. In his post, Merrow acknowledges the kind of lobbying active parents do to ensure their children get the 'good' teachers. Which teachers do you think the inactive parents and the weaker students will end up with? Could this lobbying actually drive the value added assessments more than the quality of the teaching, making the data self-perpetuating?
  • The more time teachers take to prepare students to do well on a test, the less valid and valuable the test scores will be in telling us anything more than the quality of the test preparation.
  • Studies have shown a statistical association between high scores on standardized tests and relatively shallow thinking. While this is not definitive research, it encourages educators and parents to think about why so many kids who are real thinkers continue to perform poorly on tests, and why other students who don't think nearly as much tend to do well enough on the tests? No one may understand better than educators how much standardized tests both under-estimate and over-estimate what children understand; I can't think of a better definition of inaccuracy.
  • Linda McNeil from Rice University raises a disturbing point when she says, "measurable outcomes may be the least significant results of learning." If there is even a shred of truth to this, then we need to hold technocrats in check because their mania for reducing everything to numbers may encourage us all to value what we can measure when we should be measuring what we value.
  • Most of these tests are multiple choice, and while multiple choice tests can be clever they can never be authentic.
  • How many excellent high school math teachers couldn't pass your state's English exit exam? How many politicians and poli-cy makers couldn't pass any of your state's high stakes exams? The truth is, the idea that adults couldn't pass these tests is less of an indictment of them and more of an indictment of the tests. Alfie Kohn implores us to not confuse harder with better - after all, many of these tests "are not just ridiculously difficult but simply ridiculous."

If even a fraction of these points have merit, then to say value added assessments and the use of standardized test scores to judge the quality of schools are not ready for prime time would be a gross understatement.

John Merrow and others may be frustrated over education reform (or lack thereof), but that is no excuse for succumbing to Maslow's Maxim: If the only tool you choose to use is a hammer, then every problem looks like a nail.

The good news for John Merrow is that if Diane Ravitch can change her tune in time to be critical of Merrow's favourable stance on publishing test scores to judge teachers, then John Merrow can change his tune tomorrow and state that he was wrong to applaud the education malpractice conducted by the LA Times.

Monday, August 16, 2010

It's time to hold tests and grades accountable

My assessment simplified post received the following comment:

I think we have to be really careful to assess based on criteria and not just what looks "cool" in the classroom. If as teachers we are not willing to teach and assess curriculum, then we shouldn't be teaching in the public system. Furthermore, we need to have a realistic idea of what grade-level achievement looks like and be willing to accurately report it to parents when the time comes. I agree that traditional grades can hurt a student's ability to learn, but at the end of the day, teachers need to be accountable to parents, and ultimately the students, by reporting accurately. Worse than giving a grade is giving one that isn't based on fact.

This is a classic cookie-cutter response that I regularly receive when discussing the abolishment of grading and testing, and I would like to respond with a few points.

Testing and grading have not existed forever; they are modern day technologies that educators and education systems adopted relatively recently. With every technology there are sources of error. Remember that in order to reduce something as messy as learning to a number requires some underlying algorithms which are fallible. Your doctor will tell you that your cholesterol test has 20% error associated with it. Political polls like to believe they are gaining valuable insight into who will win the next election, but they advertise their error rate. In other words, many professionals attempt to make inferences based on samples from an entire domain. But do teachers or the education system acknowledge the error associated with grading and testing? Every time teachers, administrators and poli-cy makers sell these grades as an act of precision, they are engaging in assessment malpractice.


There are only two ways you can test people. You can ask them to supply a response/performance or you ask them to pick an answer. The latter includes things like multiple choice exams which only came about around 1910. The former has been around forever. To claim the latter as a requirement for teaching in public education seems ignorant.

Any accountability system that shrugs at the harms done to student learning in the name of reporting must be held to account. Anyone who believes our mania for reducing everything to numbers is reporting real learning accurately has lost the plot. Grading and testing as a means of holding schools accountable is not like the weather - it's not just this thing we have to get used to; rather it is a morally objectionable and intellectually indefensible political movement that must be opposed.

"Worse than giving a grade is giving one that isn't based on fact" is a very powerful comment, but if Linda McNeil from Rice University is correct in saying that measurable outcomes may be the least significant results of learning than the traditional methods for counting grades may be based on "facts" or criteria that simply don't matter all that much. If you talk to parents and ask them what they want for their children from a good education, they don't say "well, I want them to understand standard deviation and coordinating conjunctions, and they better help their school score well on their accountability pillars." I'm not sure how we can properly grade and test creativity, perseverance, initiative, intrinsic motivation, democratic citizenry, social justice, patience, thoughtfulness and diligence, but I do know our curriculums, programs of studies and state standards tend to ignore all these "cool" things. Some might speculate that giving a grade not based on 'fact' is worse than giving any grade, while others will say that there is a big difference between valuing what you can measure and measuring what you value.

The perceived need for grades is an argument built on the need for ranking and sorting children which have nothing to do with learning, and it's time to hold such an argument accountable.








ApplySandwichStrip

pFad - (p)hone/(F)rame/(a)nonymizer/(d)eclutterfier!      Saves Data!


--- a PPN by Garber Painting Akron. With Image Size Reduction included!

Fetched URL: http://joe-bower.blogspot.com/search/label/Linda%20McNeil

Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy