Category Archives: Testing

Chris Christie and the Common Core Two Step

Governor Chris Christie of New Jersey is a Tough Guy.  The New Jersey Republican revels in his reputation as a politician who says what he thinks without apology and who is willing to get into dust ups with constituents who challenge him in public.  There have been moments in his tenure in Trenton when this has had a certain bipartisan charm, such as when, with Superstorm Sandy bearing down on the Garden State, the governor told people to “get the hell off the beach.”  Unfortunately, many more examples of Christie being “authentic” are unnecessary and embarrassing examples of temper — such as the time Governor Christie, when faced with former Navy SEAL and current Rutgers Law School student William Brown in a town hall meeting ended up calling the veteran an “idiot” and had him escorted out.

Here is Governor Christie also in 2012, expressing his anger at a passerby who made negative remarks about his education policies:

https://www.youtube.com/watch?v=zkzzHjq6wJI

Then there was the time that Governor Christie was in the Jersey Shore community of Belmar to talk on the second anniversary of Sandy and tout his record on the recovery, but when he was confronted by a former Asbury Park city council member Jim Keady over how 80% of recovery money was not yet dispersed, Mr. Keady was treated to full Chris Christie:

Mr. Keady explains himself nicely here:

Governor Christie has saved some his most “authentic” moments for New Jersey’s public school teachers and their union.  Early in his first term, he accused the union of using students as “drug mules” because of a civics lesson in Monroe Township on the eve of statewide school budget votes – after he had already proposed deep cuts to state aid.  The governor accused the NJEA of placing ads that accused him of “hating kids” and of openly praying for his death.  New Jersey teacher and blogger Jersey Jazzman makes clear just how big a pile of hooey those accusations are.  The “prayer” was little more than a joke in questionable taste, and this was the billboard in question:

NJEA billboard 2011

The Governor has also made his hostility clear in direct confrontations with New Jersey teachers.  Marie Corfield, an art teacher in the Flemington-Raritan Regional School District, went to a Christie Town Hall in 2010 to challenge his education policies and rhetoric.  Mr. Christie, not appreciating what he deemed a disrespectful look on Ms. Corfield’s face, launched into a monologue that suited him so well, it went up on his Youtube channel to help cement his Tough Guy reputation. It also inspired Marie Corfield to run for Assembly:

And there was the time, days before his reelection, that Governor Christie met elementary teacher Melissa Tomlinson at a campaign rally where she asked why he was constantly calling New Jersey public schools “failure factories“.  The result was predictable:

Christie Yells Again

Governor Christie has been on board with education reform from the beginning of his term, applying for Race to the Top funding, adopting the Common Core State Standards, joining the PARCC consortium as a governing state, crafting new teacher evaluations using student test scores, and working to expand charter schools in the state.  Nobody can likely recall any doubt about any of these initiatives from anyone within the governor’s inner circle and certainly not from Governor Christie himself.  In fact, in August 2013, Governor Christie appeared at the KIPP Schools Summit in Las Vegas and spoke positively about the Common Core initiative and the Obama Administration:

“We are doing Common Core in New Jersey and we’re going to continue. And, this is one of those areas where I have agreed more with the President than not. And with Secretary Duncan. They haven’t been perfect on this, but they’ve been better than a lot of folks have been in terms of the reform movement.”

Given Governor Christie’s reputation for being a genuine Tough Guy who sticks to his guns even if it is not popular, it was odd to find that he apparently would like what was said in Vegas to stay in Vegas and is now walking back that support for Republican audiences in Iowa:

“I’ve said this before.  I have grave concerns about the way this has been done and especially the way the Obama administration has tried to implement it through tying federal funding to these things.  And that changes the entire nature of it from what was initially supposed to be a voluntary system that states could decide on their own.”

Lyndsey Layton in the Washington Post reported that Governor Christie went on in those remarks to say:

“So we’re in the midst of a re-examination of it in New Jersey. I appointed a commission a few months ago to look at it in light of these new developments from the Obama administration and they’re going to come back to me with a report in the next I think six or eight weeks, then we’re going to take some action. It is something I’ve been very concerned about, because in the end education needs to be a local issue.”

What could possibly be going on that would give the famously self confident and unapologetically “authentic” “Tough Guy” governor to start walking back from reforms he has been pursuing since 2010 with barely pausing to breath?  What could plant any seed of doubt in his generally doubt free mind?

Oh, right.

Chris Christie is running for the Republican nomination for President.  One of his main rivals will be former Florida Governor Jeb Bush who is trying to stick with his support of Common Core while not naming it too often.  Governor Christie must be mindful that Republican support for Common Core has fallen in the past year with 58% of Republican parents opposing the standards and only 19% viewing them favorably.  While most of those opponents likely object to the standards on substantive grounds, Mr. Christie must also be mindful that conservative opposition to the standards also include no small number of these people:

https://twitter.com/dimebag5150/status/566021629298606083

https://twitter.com/HellOfAPrez/status/550098761398366209

https://twitter.com/jonithoreau/status/539600974072250368

…who also, according to popular theory, wield outsized influence in primaries.

Will trying to two step his support for education reform to the right of Jeb Bush work for Governor Christie?  I have no idea.  Recent polling suggests that Common Core may not be so toxic in all early voting states, and primary voters may not be as extreme and polarized as commonly thought.  So Governor Christie is trying to distinguish himself from Governor Bush, but to what effect is up in the air.

What is not up in the air is what this “rethinking” means for New Jersey: Bupkas.

The New Jersey Department of Education website still contains links to the Common Core State Standards in the English Language Arts and Mathematics and links to college and career readiness and to New Jersey’s resource page for teaching Common Core.  The AchieveNJ section of the DOE site is still up, complete with links to Student Growth Percentiles for teachers in tested subjects and Student Growth Objectives for teachers in all subjects.  PARCC assessments are still being fully implemented this spring as scheduled, and the Commissioner sent “guidance” to districts that strongly suggested that districts could face consequences if too many parents opted their children out of the assessments and that there was no requirement for schools to provide those students with alternative settings. Trenton-appointed Newark Superintendent Cami Anderson is still in place and still thundering ahead with the One Newark plan to turn the district into the “charter school capital” of the nation.

There is no sign that any of that is being reconsidered in Trenton.  Governor Christie may move one foot away from his education record while in Iowa or New Hampshire, but residents of the Garden State should expect the “Tough Guy’s” other foot to stomp down with emphasis right where it already is.

3 Comments

Filed under Cami Anderson, charter schools, Chris Christie, Common Core, Newark, One Newark, PARCC, Testing

Saving Mr. Data

I am beginning to think that enthusiasts of standardized testing and data in education accountability are feeling nervous these days.  Senator Lamar Alexander of Tennessee is the new chair of the Senate committee on Health, Education, Labor, and Pensions, and he has set about the long overdue process of renewing and/or revising the No Child Left Behind Act which required annual testing of all students in every state.  The outcome of that process and of the House’s parallel bill which left committee already and which failed to adopt a Democratic sponsored amendment to require states to adopt “college and career ready standards” and to use standardized test results in accountability systems, will play a significant role in the current policy environment that is best summarized as “test and punish”.

However, it is not just a Republican controlled Congress that is threatening federal mandates for universal and annual standardized testing.  An unusual coalition of small government conservatives and anti-testing progressives have joined with growing numbers of parents concerned with how test based accountability is consuming their children’s education.  The once unthinkable is now being thought out loud and in the open — Congress could reauthorize the Elementary and Secondary Education Act without provisions requiring that all states test all students in all grades.

This would, obviously, be a blow to a cornerstone provision of NCLB that once enjoyed bipartisan support as a necessary measure to ensure that states did not try to duck being accountable for all students.  It would also throw a huge monkey-wrench into favored policies of the Obama administration promoted by Secretary of Education Arne Duncan. While the Common Core State Standards might survive in some form without annual standardized testing, the testing consortia, Partnership for Assessment of Readiness for College and Careers (PARCC) and Smarter Balance Assessment Consortium (SBAC), began their work with the support of federal grants almost as soon as the standards were being adopted thanks to financial support from the Bill and Melinda Gates Foundation and federal incentives from the Race to the Top grant program.  If annual testing requirements were scrapped by Congress, it is an open question how many states would keep Common Core and stay with the testing programs created for it.  Another policy threatened by removing annual testing requirements is the assessment of teachers by the test scores of their students.  Despite wide criticism from the research community, Secretary Duncan remains firmly committed to tying teacher evaluations to students’ annual progress on standardized examinations, and without annual examinations of all students, you cannot run their results through discredited and unstable statistical models to determine if teachers deserve their jobs.

So defenders of annual testing have work to do in public if they are going to save their baby,

One such recent effort appeared in the New York Times on February 6th. Penned by Chad Aldeman, a partner at Bellwether Education and former adviser to Secretary Duncan’s Department of Education, it is simply titled “In Defense of Annual Testing”, and it lays out what are becoming familiar efforts to shore up presumably left leaning support for keeping NCLB’s annual testing requirements.  These are not arguments that should be casually dismissed, and they have the moral authority of some of the nation’s most distinguished civil rights organizations that originally signed on for the accountability measures in NCLB when it passed and who have reiterated their support.

They are, however, arguments that don’t stand up to serious scrutiny.

Aldeman opens with a brief assertion of a now familiar claim:

But annual testing has tremendous value. It lets schools follow students’ progress closely, and it allows for measurement of how much students learn and grow over time, not just where they are in a single moment.

This claim suggests that without ANNUAL standardized testing of ALL students then we will not know how INDIVIDUAL students are progressing through school.  It has echoes in Secretary Duncan’s anecdote of how he tutored a great kid in his youth who had been tricked into thinking he was progressing towards college but who was barely reading at a third grade level.  According to Secretary Duncan’s telling, this young man was the proverbial “child left behind” for whose education nobody had ever taken any real responsibility.  Annual testing was the only effective means to catch how he was being poorly served and demand that someone do something about it, and Secretary Duncan even presented annual testing of all students as a parental tool: “Will we work together to ensure every parent’s right to know every year how much progress her child is making in school? Or is that optional?”

The problem is that this line of thinking shows a staggering lack of imagination.

As an argument, it fails to acknowledge that there are many other, and far more interesting, points of data that can be used by teachers, parents, and schools to keep far more compelling tabs on student progress throughout the year.  Locally designed and implemented ongoing assessments such as portfolios and project based learning can provide teachers with ongoing and meaningful insights into how children are learning, and report cards can be reformed to provide parents and guardians with far more nuanced information.

It is even possible to use externally designed assessments in more interesting ways that help inform teachers, students, and parents in real time.  Bruce Baker of Rutgers University notes that computer-based “adaptive assessments” given individually and with no stakes attached can be the basis of a system of formative assessment that gives immediate feedback to teachers about student progress that can be used to craft individual learning plans for those who struggle.  In coordination with portfolios and project based learning (and with full disclosure of how they use data and substantial privacy safeguards), computer based assessments could become a valuable tool based on data.  Dr. Baker further notes such data-driven and formative assessments would be vastly more useful than mass administered tests whose results are distributed months after the fact when students have already moved on to their next grade levels.

Aldeman dedicates most of his Times piece, however, on the belief that NOT testing every child in every year will allow states and localities to wiggle out from being accountable to all students all the time:

The grade-span approach would eviscerate the ability to look at particular groups of students within schools. Instead of having multiple grades over which schools could compile results, each school would be held responsible only for the performance of students in a single grade. Not only would this lower the quality of the data, but it would also raise the stakes of the tests: If you think the stakes are too high now, imagine being a fifth grader in a school where your score determines the results of the entire school.

Worst of all, under this approach, far fewer schools would be on the hook for paying attention to historically disadvantaged groups of students. A school with 10 Hispanic students in each grade would no longer be held accountable for whether those students were making sufficient progress, because the 10 fifth graders wouldn’t be enough to count as a meaningful population size.

Let me state that as a liberal with an eye for history, this argument is certainly intriguing.  We are a nation that only 12 years before my birth required the National Guard to let nine African American students attend a high school ordered to desegregate.  In 1969, the year I was born, the Supreme Court issued a ruling calling for Southern states to cease delays in desegregating their schools — a full 15 years after Brown v. Board found such arrangements unconstitutional.  Federal legislation and federal court cases were also instrumental in holding states and municipalities responsible for ending gender discrimination, for providing students with disabilities access to an education, and for providing support for students learning English.  It is no doubt this record of positive intervention at the federal level and of state delays in implementing equality of opportunity that motivated civil rights groups to endorse annual testing in NCLB and to stand with it today.

That does not change that such testing is unnecessary, is unacceptably disruptive to learning, and is narrowing curricula nationwide.

Mr. Aldeman is suggesting that eliminating annual testing will mean huge swaths of children will be hidden from the test and that the test stakes will be raised enormously with only exam being used.  The stakes argument hinges on a mistaken impression of what the exams say and what should be done with the data they produce.  For the stakes on gradespan testing to be even higher than they are today, one has to assume that such testing is used not only to monitor the education system but also to actively punish schools with low test results.  While few would argue that schools with poor results should be permitted to languish, the kinds of punitive measures embodied in NCLB are not a necessary result of monitoring student test scores.  Under the leadership of Superintendent Tony Alvarado, New York City’s Community District 2 implemented a complex and interconnect culture of reform that included standards and assessments.  However, data from the assessments were used to monitor how schools in the district were doing and to allocate resources for improvement and innovation where they were most needed and with the constant goal of instructional improvement.  Again, Dr. Baker of Rutgers makes a salient observation:

Here’s the really important part, which also relates to my thermometer example above. The testing measures themselves ARE NOT THE ACTIONABLE INFORMATION. Testing provides information on symptoms, not causes or underlying processes. It is pure folly to look at low test scores for a given institution, and follow up with an action plan to “improve test scores,” or close the school if/when test scores don’t improve, without ever taking stock of the potential causes behind the low test scores. TEST SCORES ARE SYMPTOMS, NOT CAUSES, NOT ACTIONABLE IN AND OF THEMSELVES.

Recognition of that fact and crafting policy responses to low test scores with that in mind would necessarily lower the stakes on the tests themselves.

Further, while there might be some argument for an annual test that could contribute to closer monitoring of those symptoms, there is no argument that convincingly says that such tests must be given to every student in every grade in order to get a good picture of how schools and school systems serve historically disadvantaged children.  First, a low stakes system of formative assessments, both qualitative and quantitative, could apply to all children and would conform to accommodations for children with special needs.  So there can readily be ways for teachers, schools, and parents to know how ALL students are doing during the course of the year.

Once we’ve set aside the issue of having a meaningful, formative assessment system for all students that can actually assist teachers, there’s no truly compelling argument against properly devised sampling of students for standardized testing.  Implemented correctly, sampling would not leave substantial numbers of children invisible as Mr. Aldeman fears, and we would stop spending inordinate time trying to ferret out distinctions in performance within schools when, as Dr. Baker once again notes, the greatest and most consequential differences in test measured achievement exist between schools and districts, not within them.  Insisting upon keeping annual testing of every student in every grade keeps an unnecessarily disruptive system in place as part of an accountability system that, in fifteen years, has not yielded sufficient results to justify the sacrifices in teacher autonomy over instruction and the sacrifices in non-tested subjects being shunted aside in favor of test preparation.  In fact, the only people to “benefit” from this system are private test designers like Pearson, who are being handed not just lucrative contracts but also terabytes of data to mine for new products, and advocates of firing as many teachers as possible based upon student test scores.

This is especially frustrating to me because data, when used with a clear understanding of what it can and what it cannot do, is a tool, an important tool at that.  It can help us develop broad pictures of what is happening in schools, and it can direct our attention to places that require more careful and nuanced study.  The persistent overreach and abuse of its capabilities is building a backlash that makes it much harder to successfully advocate for more judicious and appropriate use of what can be learned.  If we wish to SAVE data and its uses in school, it would be best to set aside NCLB and begin again sensibly.

I believe I see the problem, Captain.  My head's been severed.

I believe I see the problem, Captain. My head’s been severed.

12 Comments

Filed under Data, NCLB, politics, teaching, Testing, VAMs

Paving The Road to Hell — And Other Gates Foundation Initiatives

Towards the end of last year, the Seattle Times provided coverage of the Gates Foundation’s report on the tenth anniversary of its global health initiative. After a decade of effort and a billion dollars invested, Bill Gates admitted that despite the investment he had been “pretty naive” about how long it would take to significantly improve public health outcomes in the developing world. Most notable was Gates’ admission that the problems in his approach were not merely ones about overcoming scientific hurdles, but rather they seriously underestimated the challenges of implementing highly technological “solutions” in countries where the majority of the population lack secure access to routine infrastructure which, in the words of Dr. David McCoy of Queen Mary University in London, are “the barriers to existing solutions.”

Both Peter Greene of the Curmudgucation blog and Anthony Cody of Living in Dialogue have written excellent pieces on this somewhat quiet but very important admission by Bill Gates.  Greene astutely notes that Gates’ realization of his limitations does not actually lead him to understand why his approach is flawed:

Gates wants to use systems to change society, but his understanding of how humans and culture and society and communities change is faulty. It’s not surprising that Gates is naive– it’s surprising that he is always naive in the same way. It always boils down to “I really thought people would behave differently.” And although I’ve rarely seen him acknowledge it print, it also boils down to, “There were plenty of people who could have told me better, but I didn’t listen to them.”

The non-success of Grand Challenges is just like the failure of the Gates Common Core initiative. Gates did not take the time to do his homework about the pre-existing structures and systems. He did not value the expertise of people already working in the field, and so he did not consult it or listen to it. He put an unwarranted faith in his created systems, and imagined that they would prevail because everyone on the ground would be easily assimilated into the new imposed-from-outside system. He became frustrated by peoples’ insistence on seeing things through their own point-of-view rather than his. And he spent a huge amount of money attempting to impose his vision on everybody else.

This is an important observation because it shows that there is a flawed perspective rooted at the heart of the Gates Foundation, and while the man and the institution may be able to recognize failures, they are not inclined to understand why they have failed.  Anthony Cody also recognizes this observation as he lines up quotes from the central figures at the Gates Foundation that demonstrate little regard for the knowledge about teaching held by teachers and wonders if the “humility” earned in Grand Challenges project will translate to humility about the foundation’s approach to education reform.  I believe that Greene and Cody are completely on point and insightful in their observations and questions on these points, and it is important for people outside the Gates Foundation to constantly remind it that education is a complex and interconnected set of systems with knowledgeable and invested stakeholders that cannot simply be plowed over and disregarded without consequences.

A specific quote from Melinda Gates cited by Mr. Cody struck me in particular, and I believe it highlights some of the difficulties we face in enticing the Gates’ and their namesake foundation to listen.  Cody quotes Mrs. Gates from 2011:

It may surprise you–it was certainly surprising to us–but the field of education doesn’t know very much at all about effective teaching. We have all known terrific teachers. You watch them at work for 10 minutes and you can tell how thoroughly they’ve mastered the craft. But nobody has been able to identify what, precisely, makes them so outstanding.

This ignorance has serious ramifications. We can’t give teachers the right kind of support because there’s no way to distinguish the right kind from the wrong kind. We can’t evaluate teaching because we are not consistent in what we’re looking for. We can’t spread best practices because we can’t capture them in the first place.

Asserting that “the field of education doesn’t know very much at all about effective teaching” is one of those statements most frequently made by people who do not want to have to bother with how much information there is that refutes the statement.  However, if Mrs. Gates wants to fill herself in on what the “field of education” knows about effective teaching, she could begin with the 4th edition of The Handbook of Research on Teaching.  It might even be worth her while to read the third edition, see if a full version of the second edition is available, and then finish up with the original publication from 1963.  A fifth edition was supposed to published in 2014, but it seems that the editors are taking some extra time to be careful with it.

Then, for kicks, she might want to talk to some of America’s working teachers and see if they know anything as well.

Of course, knowing this field as I do, I suspect that someone who has been working in the technocratic solutions domain for this many years will still object that the multiple 1000s of pages of research on teaching to which I have referred still won’t tell us what “effective teaching” is.  Researching education is, by necessity, working with a “soft field” where you are unlikely to find absolute answers to your questions.  What we know changes as related fields like psychology build their knowledge base, and ideas can circulate in and out of favor as what schools are expected to do evolves with societal priorities.  Most importantly, research on teaching has to consider how variable the 100,000 schools and millions of classrooms across the country are and how that variability influences the teaching that is both possible and that is needed.  We are not engineering within the parameters of Newtonian physics, and that is appropriate.

Mrs. Gates’ other assertion that “you watch them (great teachers) at work for 10 minutes and you can tell how thoroughly they’ve mastered the craft” (but, gosh darn it, we just don’t know why they are so great!) is the kind of statement made by people who really don’t understand teaching.  Of course, there are great teachers, and, of course, you can be impressed by them fairly quickly, but to say that you KNOW someone has thoroughly “mastered the craft” in ten minutes is romantic in the style of teachers whose lives have been edited by Hollywood.  What does Mrs. Gates risk missing in her ten minute assessment?

  • The lesson that worked very well in the first period but worked far less well in the third period.
  • The day when the lesson plan was simply off base.
  • The work that teacher did outside of the classroom determining what students knew, selecting teaching and learning strategies that would help them build upon that, figuring out what would help the teacher know the students had learned.
  • ANY of the uncertainty in the previously described process and the necessity to pivot if that uncertainty disrupts the plan.
  • How the teacher self assesses and with what information.
  • The week when that teacher has sick children at home, cannot get enough sleep, and has little time to plan.
  • The week disrupted by excessive standardized testing or mandatory field tests of examinations.
  • ANYTHING, really, beyond being impressed by Razzle Dazzle without thinking about substance.

Mrs. Gates’ comment makes the most sense to me if she is unaware of the level of work that goes into lending that impressive ten minutes substance, and if she is not especially discerning about whether or not the substance exists.  In fact, in ten minutes, it is sadly easy to be taken in by weak teaching that is buoyed by personality.  I witnessed this early in my teacher education career when I supervised a student teacher who I eventually had to counsel out of the profession.  She was an intelligent young woman, but she was not up to the task of leading a classroom even on her best day and simply could not gain student attention.  What was interesting, however, was how her struggles demonstrated the weaknesses of her cooperating teacher, a 20 year veteran who, with only ten minutes to watch her, would have impressed an outside observer.  She was a dynamic personality who kept the energy level of her class high, but when her student teacher took over the lesson plans, the thinness of the teaching was painfully obvious over time.  Visit after visit, I witnessed the same teaching approach of presentation and then practice via seat work, and it was clear that the only reason the teaching I first saw SEEMED skilled was the personal energy of the cooperating teacher.  The situation became awkward as my shy and hesitant student teacher made obvious the thin planning that went into the classroom.

Mrs Gates’ ten minute observation would have, most likely, been taken in by the Razzle Dazzle:

…and missed whether or not there was substance.  For that matter, Mrs. Gates’ ten minutes would miss a lot of genuinely great teachers simply having an inevitable bad day.

The problem here is complicated and frustrating.  Melinda Gates’ comment demonstrates first, that the Gates Foundation does not really understand (or is dismissive of) the real complexities and uncertainties involved in being a “great teacher,” and second, that the foundation thinks it can ultimately identify precisely WHAT makes their teaching “great” and distribute that throughout the teaching corps.  Instead of appreciating that research on teaching is various because teaching itself is various, the foundation’s leadership seems wedded to an idea that we need singular answers scaled throughout the entire system.

It reminds me of some of the mixed-bag innovations from the Progressive era which, contrary to popular imagination, was not all trust busting, union victories, and establishment of national parks.  Consider “scientific management” that arose from the work of Frederick Taylor and which greatly influenced how factory work was conceived.  Taylor studied work flow to determine the “best” ways for laborers to perform their tasks, and much of what he determined was useful for productivity and workers themselves.  For example, he concluded that workers needed rest periods which was not an accepted practice at the time.  However, faith in “Taylorism” rapidly overstated its ability to scale up the “best” way to do certain tasks, leading to conflicts with workers themselves, such as the famous incident at the Watertown Arsenal when one molder sparked a mass walk out in response to being timed by a stop watch.  While scientific management survives in different incarnations today, Taylorism itself was more geared towards the automation of tasks since workers were not allowed to vary how they did their work once “innovations” were put into place.

I’ve come to think that the Gates Foundation suffers from a similar problem: armed with an interesting and worthwhile question – “How can we identify and support great teaching?” – they have approached it as a technocratic matter instead of as a sociological one.  In doing so, they have vastly overestimated the strength of their tools and vastly underestimated the knowledge and the agency of what they hoped to reform.  The result is rapidly devolving into a discordant mess of overlapping perverse incentives that mistake common standards with a platform for effective teaching, treat standardized test scores as strongly indicative of teacher impact, and encourage teaching narrowly to the tested curriculum. Teachers and parents are increasingly reacting much the same way that the early 20th century workers did when told their ideas mattered less than a supervisor with a stop watch.

We’ve paved roads like this before, and the destinations were not exactly what was hoped for.

3 Comments

Filed under Common Core, Gates Foundation, Stories, Testing

Andrew Cuomo to New York State: Your Teachers Stink. I Will Fire Them. I will Break Their Union.

The gauntlet that New York Governor Andrew Cuomo and New York Regents Chancellor Merryl Tisch picked up with their public correspondence in December has been thrown down.  The Governor announced his plans to revamp and revise education in New York with his State of the State address on January 21st, and it was accompanied by a book detailing his policy proposals.  On teacher evaluation, Governor Cuomo is delivering a massive change — and a direct challenge to community control of their teacher workforce.  If the governor gets his way, 50% of teachers’ evaluations will be controlled by students’ annual progress on standardized tests, and no teacher rated “ineffective” in either half of the evaluation will be scored higher than “developing.”   The other 50% of annual evaluations will be comprised of two observations, one by a school administrator and another by an “independent observer” in the form of an administrator from another district or a state approved outside agency.  The so-called “independent observer” observation will count for 35% of the evaluation.  Local administrators are to be restricted to 15%.

New York State principals?  Andrew Cuomo says you cannot do your jobs.  New York State communities?  Nobody in your town is qualified to evaluate your children’s teachers.  Andrew Cuomo wants to take that away for Albany.

Governor Cuomo insists that these draconian measures are necessary because only a third of New York students scored as proficient or highly proficient on the new Common Core aligned standardized examinations, and by his logic that means the teacher evaluation system, which currently weights the results of those exams for 20%, is “baloney” because only 1% of teachers were found ineffective.  However, tying a criticism of the teacher ineffectiveness to the CCSS aligned exams is flagrantly mendacious because “proficient” was never tied to “grade level” or “passing”;  it was tied to SAT scores loosely predictive of college success.

Governor Cuomo’s teacher evaluation plan is set to punish teachers for not graduating vastly more students ready to succeed in college, as measured by one test score, than currently attend college.

What can reasonably be predicted as an outcome of this?  Plenty.  And none of it will be pretty.

First, this policy will fall heavily upon districts with high levels of poverty which are tightly concentrated because of New York’s appallingly high Residential Income Segregation Index.  We know from disaggregated PISA data that schools with high levels of poverty struggle in standardized test achievement compared to schools in affluent communities. Following Governor Cuomo’s logic it is not that these schools and their teachers struggle with the long established deprivations of poverty upon their student population and would benefit from aggressive plans of economic renewal and integration; it is that their teachers are ineffective and need to be fired.

Second, no teacher in New York will be actually safe no matter how good they are or how talented their students.  The value-added models (VAMs) of teacher performance based on standardized tests are by now subject to so much research demonstrating their unreliability that using them at all is indefensible.  The American Statistical Association (ASA) warned last year that teacher input can only account for 1-14% of student variability on standardized tests, and VAM generated rankings of teachers are not stable, meaning a teacher can be in the top 20% in one year and slide below the median in a subsequent year.  If you think that your child attending a selective public school with a math teacher whose students all pass a challenging algebra examination will have that teacher spared via VAMs — think again.  Teachers who are excellent by every other conceivable model of assessment can be rated as the “worst” grade level teacher in New York City via value-added modeling.

And Governor Cuomo wants that to be 50% of teacher evaluations.

The predictable outcome of this will be an objectively worse education for nearly every student in the state.  Consequences from the No Child Left Behind law’s focus on test-based accountability include a steady narrowing of school curricula to subjects that are tested, leaving science, the social studies, the arts, and health as dwindling portions of public eduction.  Teaching to the test as is common practice in “no excuses” charter schools will become a prominent methodology in historically struggling schools, and it will grow in currently successful schools as well.  Teachers and administrators will have little choice — with so much riding on VAMs that unstable and able to find teachers of advanced students in the bottom 10% of teachers, test preparation as curriculum will spread.  Further, as experienced teachers are pushed out, the teacher workforce will become younger, assuming that New York State schools can possibly entice new teachers to start a career under these conditions.  These will be novices whose classroom skills will be on a steep learning curve for their early years, and many of them will be forced out by VAMs before reaching the point where their skills start to level off.

A less experienced teacher workforce teaching more and more to the test — THAT is the likely outcome of Governor Cuomo’s evaluation proposals.  There will also be no local measure that can preserve a teacher in his or her job because the only local component of the evaluation system – local administrator observations – will be restricted to 15%.  Are you a principal whose teachers work in underfunded facilities with students who live in poverty?  Tough.  Are you a parent whose child’s teacher works with gifted students in a curriculum accelerated 2-3 years beyond the test?  Tough.  Are you a school board member who wants to preserve the social studies, sciences, art, music, and health?  Tough.  85% of your teachers’ evaluations are outside the input of any local stakeholders; Albany will be in control.  And Governor Cuomo will hold nearly three quarters of a potential increase in aid for schools hostage unless he gets his way.

It is impossible to not connect the dots here.  Among Governor Cuomo’s most reliable donors are Wall Street supporters of charter school expansion who can turn such schools into revenue streams for private corporations using public money.  Charter schools, among whose strongest supporters at the Thomas B. Fordham Institute recently admitted are in the business of pushing out harder to educate children, have been turned into a way to monetize our public education budgets.  Governor Cuomo, who raised half of his $40 million election war chest from just 341 donors, owes that sector.

The only entity with enough members and resources to resist that is the NYSUT.

Most of Governor Cuomo’s teacher evaluation plans (and his other education proposals) will make our schools objectively worse places to learn with many fewer experienced teachers and a diminishing curriculum.  However, they will make the teachers’ union much weaker with an unstable and uncertain cadre of members who have less experience and no practical job security — and who will not be able to effectively resist more and more of our public schools turned over to private interests.

Everything about this is wrong.

74 Comments

Filed under Corruption, New York Board of Regents, politics, schools, Testing, Unions

Arne Duncan’s Great Kid Story Problem

In his speech laying out administration priorities for the renewal or rewrite of No Child Left Behind, Secretary of Education Arne Duncan turned to a personal anecdote to explain the imperative of accountability based reform:

In between my junior and senior year at college, I took a year off to help in my mother’s after-school tutoring program on the South Side of Chicago and figure out if I really wanted to devote my life to this fight for educational opportunity.

One of the students I tutored was a basketball player at the local high school, who was studying to take his ACT.

He was a great kid who had done all the right things. In a very violent neighborhood, he had stayed away from the gangs. He didn’t drink, he didn’t use drugs. He was actually an honor roll student with a “B” average, and on track to graduate. I initially thought this was absolutely a young man who could beat the odds and defy the negative stereotypes of young black men.

But as we started to work together, I was heartbroken to quickly realize that he was basically functionally illiterate.

He was reading at maybe a 2nd or 3rd grade level, and was unable to put together a written paragraph. Tragically, he had played by all the rules, but had no idea how far behind he was. Throughout his life, he had been led to believe that he was on-track for college success.

And he was nowhere close.

The educational system had failed him, and the buck stopped nowhere.

This is the kind of personal story that makes great fodder for satirical pieces in The Onion, but I will grant Secretary Duncan a point: there are children in the system who are passed along from grade to grade without learning enough to be successful in more complex subjects later on.  And the Secretary has a point that in too many cases like these few people are willing to take responsibility.  When I talk to my education students about this, I frame this as a cycle of blame passing:  The ninth grade teacher has a student who cannot write well and blames the junior high teachers for what they didn’t teach.  The junior high teachers blame the middle school teachers, and the middle school teachers blame the elementary school teachers.  Eventually, the child is in utero and nobody has taken proper responsibility for teaching the child as he has arrived in the classroom that year.  Given that higher education institutions report that about 20% of first year students need to take at least one remedial class when they arrive (and even 12.8% of entering students at very selective 4 year schools), it is reasonable to ask if our elementary and secondary education systems can do a better job preparing more students for further schooling.

Of course, answering such questions are complex.  Critics and reformers often point to the number of college students in need of some remediation and state those students are “not ready” for college.  That’s far too broad a brush.  For starters, the numbers are variable by the type of institution reporting, by race and ethnicity, by gender, by age of student, by dependency status, and by the educational obtainment of the parents of the student receiving remediation.   Additionally, students can receive a wide variety of remediation in college from a single studies skills course to an entire plate of courses meant to “plug holes” from elementary and secondary education.  A student who dropped out of high school, got a GED at 25, and enrolled in Community College who needs math instruction to progress in a STEM program is far less worrisome than the young man in Secretary Duncan’s anecdote who is reported as laboring under the impression that his reading level being at The Magic Treehouse series is going to get him into college.

There’s just a problem.  Secretary Duncan’s priorities for the NCLB revision won’t help him either.

It isn’t that someone shouldn’t have taken responsibility for the young man’s learning (although how Secretary Duncan, at the callow age of 20 or 21 could actually tell that nobody had done so is left unexplained); it’s that forcing that responsibility by holding his teachers accountable to his standardized test scores each and every year, as favored by the Obama administration, is one of the worst paths to take to help him.

“Testing” is not a dirty word.  As part of a multiple assessment system to help teachers, students, and parents know where students stand and in what areas students need help.  Formative assessments, however they are developed and administered, are meant to provide the kind of feedback that can personalize instruction and help teachers as they create a rich and complete curriculum.  Dr. Bruce Baker of Rutgers University notes for what such assessments cannot be used:

This information should NOT be used for “accountability” purposes. It should NOT be mined/aggregated/modeled to determine at high level whether institutions or individuals are “doing their jobs,” or for closing schools and firing teachers. That’s not to say, however, that there might not be some use for institutions (schools districts) mining these data to determine how student progress is being made on certain concepts/skills across schools, in order to identify, strengths and weaknesses. In other words, for thoughtful data informed management. Current annual assessments aren’t particularly useful for “data informed” leadership either. But this stuff could be, given the right modeling tools.

This is the approach we use to ensure that no child is left behind. By the time annual, uniform, standardized assessment data are returned in relatively meaningless aggregate scores to the front office 6 months down the road, those kids have already been left behind, and the information provided isn’t even sufficiently fine grained as to be helpful in helping them to catch up.

Dr. Baker differentiates testing used for individual diagnostic purposes and testing used for accountability/system monitoring purposes:

When it comes to testing for system monitoring, where we are looking at institutions and systems, rather than individuals, immediate feedback is less important. Time intervals can be longer, because institutional change occurs over the long haul, not from just this year, to next. Further, we want our sampling – our measurements – to be as minimally intrusive as possible – both in terms of the number of times we take those measurements, and in terms of the number of measurements we take at any one time. In part, we want measurement for accountability purposes to be non-intrusive so that teachers and local administrators, and the kids especially, can get on with their day – with their learning – development of knowledge and skills.

So, when it comes to “System Monitoring” the most appropriate approach is to use a sampling scheme that is minimally sufficient to capture, at point in time, achievement levels of kids in any given school or district (Institution). You don’t have to test every kid in a school to know how kids in that school are doing. You don’t have to have any one kid take an entire test, if you creatively distribute relevant test items across appropriately sampled kids. Using sampling methods like those used in the National Assessment of Educational Progress can go a long way toward reducing the intrusiveness of testing while providing potentially more valid estimates of institutional performance (how well schools and districts are doing).

The distinctions here should be obvious, and they are crucial:  accountability relies upon system wide data that is best captured via sampling, and monitoring system wide trends via data does not require that every child be tested in the same standardized test every single year.  As Dr. Baker has shown previously, trying to take this data and use it for accountability of individual teachers based upon value-added modeling does not produce results that are stable and are therefore pretty useless.

Wouldn’t you know that Secretary Duncan has it exactly backwards?

By insisting that large standardized measures be given to every child every year AND endorsing using those data for individual teacher accountability, the Secretary is calling for maintaining a standardized testing regime that is needlessly intrusive and for applying the data from those tests for the wrong purposes.  Worse, it is incentivizing the worst kind of teaching, practices to which Secretary Duncan gave a passing acknowledgement as destructive but which his insistence upon placing the highest stakes on an intrusive testing schedule will entrench into classrooms.  We’ve seen this in the years since NCLB with narrowing curricula and more focus on tested subjects that upon a full, rich curriculum.

One other rationale is possible by insisting upon annual, large scale examinations for every child, but it is one that betrays a lack of imagination.  Secretary Duncan said that:

I believe parents, and teachers, and students have both the right and the absolute need to know how much progress all students are making each year towards college- and career-readiness. The reality of unexpected, crushing disappointments, about the actual lack of college preparedness cannot continue to happen to hard working 16- and 17-year olds – it is not fair to them, and it is simply too late. Those days must be over.

That means that all students need to take annual, statewide assessments that are aligned to their teacher’s classroom instruction in reading and math in grades 3 through 8, and once in high school.

Secretary Duncan is suggesting that mass standardized tests given annually are the tools needed by parents to monitor their children’s progress.  I suppose there may be families out there who are itching for that packet from the state DOE that comes weeks or months after the standardized exam, but I think it is far more likely that parents would like to know that teachers have access and utilize a steady stream of tools to assist their students and to communicate with families.  As it stands, Secretary Duncan insists on giving those parents a single test result that can suggest something is going on but which cannot say a blessed thing about why it is going on.

Arne Duncan is worried about that great kid he met three decades ago.  Sadly, he doesn’t have a clue about what would have helped that child not get lost in the system.

3 Comments

Filed under Common Core, Data, NCLB, teaching, Testing

New York’s Public Schools Need Some Friends in Albany

This is the text of a detailed letter I am sending to my representatives and other leaders in Albany.  I invite anyone to use any portion of it and the resources in the notes to write your own.  However, the New York State Allies for Public Education has a convenient web form that will generate a letter to your representatives as well.  It can be found here.  The agenda has been set by Governor Cuomo and Chancellor Tisch — it will make our schools objectively worse in every way and it will sweep up all teachers regardless of their capabilities.  We need parents, community members, and teachers to band together to say that this must be stopped.  Let’s dare our representatives in Albany to become friends of public education.

The Honorable Linda Rosenthal
LOB 741
Albany, NY 12248

Senator Jose Serrano
181 State Street Room 406
Legislative Office Building
Albany, NY 12247

Dear Assemblywoman Rosenthal and Senator Serrano:

The public schools of New York need some friends in Albany.

I wish I could say that the parents, children, and teachers of this state could count upon friendship in the Governor’s office or at the Regents Chancellor’s office, but both Governor Cuomo and Chancellor Tisch have made it very clear that they intend great harm to our public education system.  They have powerful backers among Wall Street and private foundations, and they have the encouragement of the United States Department of Education, but regardless, what they say they intend to do will not only harm the 600,000 public school teachers of New York, but also it will degrade the quality of education enjoyed by millions of school aged children and counted upon by their parents and communities.

Governor Cuomo vetoed a bill on December 29th that his own office drafted (1) and which would have given teachers and principals a two year grace period from suffering professional consequences due to the results of the new Common Core aligned state examinations.  The Governor justifies this by claiming that the current teacher evaluation system finds too few teachers incompetent and that student scores of the new exams demonstrates that this is untrue.  Chancellor Tisch has joined the Governor in calling for far more rigid teacher evaluations, responding to a December letter from the State Director of Operations with her own priorities. (2) Chancellor Tisch backs changing teacher evaluations so that the 20% currently set aside for local measures of teacher performance be eliminated and that the portion assigned to student growth in standardized tests be raised to 40% overall.  In addition, Chancellor Tisch proposes that a teacher found “ineffective” by the standardized tests be determined to be ineffective overall, and she believes that two such evaluations should lead to a teacher’s removal.

There are few proposals that could be so immediately harmful to students regardless of Governor Cuomo’s declaration that he is looking out for them and that the NYSUT only wants to protect bad teachers.  This change to teacher evaluation rests upon a flawed premise about student achievement in New York, will subject teachers to an evaluation system with no basis in research, and will dramatically harm the quality of curriculum and instruction across the state in both affluent and impoverished districts.

Governor Cuomo and Chancellor Tisch apparently believe that because the student proficiency levels on the new Common Core aligned examinations are in the 30-35% range then it is “obvious” that many more New York teachers must be incompetent and deserve to be removed from the classroom.  This is a flawed premise and deliberately misleading. Both the Governor and Chancellor know full well that the cut scores for proficiency were set deliberately to match SAT scores (3) linked to specific grades in first year college courses.  The percentage of New Yorkers over 25 with a bachelor’s degree is 32.8 (4),so the argument that THESE proficiency levels on THESE exams mean that many New York teachers are incompetent only works if you assume that there is a demand for college educated workers not being met currently.  The economic evidence for that assumption is weak, however, because while a college wage premium exists, its growth has shrunk dramatically in recent decades (5) and much of that small growth is coming from falling wages for non-college graduates.  It would be worthwhile to question the uneven distribution of college opportunity among racial, ethnic, and economic lines, but it would also be worthwhile to discuss the loss of opportunities for families to move from poverty to the lower middle class (6), losses that keep many more families in poverty than can be lifted by more college degrees.

From that flawed premise, Governor Cuomo and Chancellor Tisch assume that teachers can be accurately measured as ineffective based upon standardized test scores.  Nothing could be further from the truth.  Value Added Models (VAMs) are not widely accepted as valid for teacher evaluation, and the evidence against using them that way led the American Statistical Association to issue a statement warning about the limitations of VAMs (7).  Teacher ratings using VAMs can be highly unstable.  Dr. Bruce Baker of Rutgers notes that teachers who ranked in the top 20% of teachers using value added modeling were likely to shift in subsequent years (8), some even to the lowest quintile and then back to the top, demonstrating how unreliable these methods are.  VAMs take their toll on excellent teachers in excellent schools as well, as demonstrated by the case of the “worst 8th grade math teacher in New York City” in 2012 (9).  This teacher taught at a citywide gifted and talented school, and all of her students passed the challenging Regents algebra exam, but her VAM, based upon an exam testing material her students had learned several years earlier, placed her at the absolute bottom of all 8th grade math teachers.  Hers is not an isolated case, and if Governor Cuomo and Chancellor Tisch have their way, there will be no locally derived measure sufficient to have saved her job.

The tragic impact this will have upon classrooms everywhere should be obvious.  With such dire consequences tied to a single set of standardized examinations and with no other measure mattering, teachers, even in successful schools, will have to teach to the test.  Narrow and relentless test preparation can increase student scores, but it comes at the expense of creativity and subjects not tested.  Research since the passage of No Child Left Behind demonstrates that subjects such as science, social studies, art, music, and physical education have all been reduced because of the consequences attached to low test scores (10).  The Cuomo/Tisch proposals for teacher evaluation will inevitably accelerate this, leading to less time spent in a well rounded curriculum and more time in didactic instruction and seat work.

Meanwhile, the New York Times recognized this week that fiscal inequity is “the central crisis” in New York’s schools, and that Albany is over $5.6 billion dollars short annually of commitments made in 2007 (11).  The New York State School Boards Association estimates that the average district in New York has lost $3.1 million a year in state aid due to the continued use of the gap elimination adjustment (12), and Dr. Baker of Rutgers calculated that New York City alone has lost between $3-4000 per pupil per year through Albany’s refusal to fully fund its own aid formula (13).

In a time when teachers are being told to do far more with their students, Governor Cuomo has consistently starved local districts of funds, and now he and Chancellor Tisch demand that these same teachers produce test results or be fired using statistical models with no foundation in research.

Enough is enough.  The New York State Allies for Public Education has responded to Governor Cuomo and Chancellor Tisch (14), and I implore you to join them in opposing this damaging agenda. It has no basis in fact, it will severely harm all of our schools in every community, and it fully ignores the ongoing failure of Albany to equitably fund our state’s schools.

Our public schools need friends in Albany.  I hope that you will be among them.

Sincerely,

Daniel S. Katz, Ph.D.
Director of Secondary Education and Secondary/Special Education, Seton Hall University
Father of Two New York Public School Students

Notes:

1. Taylor, K. (2014, December 29). Cuomo Vetoes Bill That Would Protect Teachers From Low Ratings. The New York Times. Retrieved January 6, 2015, from http://www.nytimes.com/2014/12/30/nyregion/cuomo-in-reversal-vetoes-bill-that-would-have-protected-teachers-from-low-ratings.html

2. Burris, C. (2015, January 1). Teacher Evaluation: Going from Bad to Worse? The Washington Post. Retrieved January 6, 2015, from http://www.washingtonpost.com/blogs/answer-sheet/wp/2015/01/01/teacher-evaluation-going-from-bad-to-worse/

3. Burris, C. (2014, April 29). The Scary Way Common Core Test “Cut Scores” Are Selected. The Washington Post. Retrieved January 5, 2015, from http://www.washingtonpost.com/blogs/answer-sheet/wp/2014/04/29/the-scary-way-common-core-test-cut-scores-are-selected/

4. United States Census Bureau. (n.d.). Retrieved January 7, 2015, from http://quickfacts.census.gov/qfd/states/36000.html

5. Shierholz, H., & Mishel, L. (2013, August 21). A Decade of Flat Wages: The Key Barrier to Shared Prosperity and a Rising Middle Class. Retrieved January 7, 2015, from http://www.epi.org/publication/a-decade-of-flat-wages-the-key-barrier-to-shared-prosperity-and-a-rising-middle-class/

6. Harris, B., & Kearney, M. (2013, December 4). A Dozen Facts about America’s Struggling Lower-Middle-Class. Retrieved January 7, 2015, from http://www.brookings.edu/research/reports/2013/12/12-facts-lower-middle-class

7. ASA Statement on Using Value-Added Models for Educational Assessment. (2014, April 8). Retrieved January 7, 2015, from https://www.amstat.org/policy/pdfs/ASA_VAM_Statement.pdf

8. Baker, B. (2012, November 17). On the Stability (or not) of Being Irreplaceable. Retrieved January 7, 2015, from http://schoolfinance101.wordpress.com/2012/11/17/on-the-stability-or-not-of-being-irreplaceable/

9. Pallas, A. (2012, May 16). Meet the “Worst” 8th Grade Math Teacher in New York City. The Washington Post. Retrieved January 6, 2015, from http://www.washingtonpost.com/blogs/answer-sheet/post/meet-the-worst-8th-grade-math-teacher-in-nyc/2012/05/15/gIQArmlbSU_blog.html

10. David, J. (2011). High Stakes Testing Narrows the Curriculum. Educational Leadersip, 68(6), 78-80. Retrieved January 6, 2015, from http://www.ascd.org/publications/educational_leadership/mar11/vol68/num06/High-Stakes_Testing_Narrows_the_Curriculum.aspx

11. The Central Crisis in New York Education. (2015, January 4). The New York Times. Retrieved January 6, 2015, from http://www.nytimes.com/2015/01/05/opinion/the-central-crisis-in-new-york-education.html?_r=1

12. Q&A: New York State’s Gap Elimination Adjustment. (n.d.). Retrieved January 7, 2015, from http://www.nyssba.org/clientuploads/nyssba_pdf/Q&A/Q&A-Gap-Elimination.pdf

13. Baker, B. (2012, December 7). Forget the $300m Deal! Let’s talk $3.4 billion (or more)! Retrieved January 7, 2015, from http://schoolfinance101.wordpress.com/2012/12/07/forget-the-300m-deal-lets-talk-3-4-billion-or-more/

14. NYSAPE Response Letter to Governor on Public Education. (2015, January 5). Retrieved January 7, 2015, from http://www.nysape.org/nysape-response-letter-to-governor-on-public-education.html

3 Comments

Filed under Activism, New York Board of Regents, politics, schools, Social Justice, teaching, Testing

A New Year’s Resolution for Ed “Reformers” — Remember Our Future Teachers Are In The Schools You Are “Reforming”

About five years back, I got my first impression that our older child might potentially decide to become a teacher.  It was during what I thought was going to be a game of “Hungry Hungry Hippos” which took quite an unexpected turn when our child took all of the marbles, placed them neatly in the center of the game, and told the hippos that they all had to “wait for snack time.”  Over time and with more time in school, other hints have cropped up such as an almost immediate affinity for any teacher at the head of the classroom, a willingness to respect norms of classroom behavior, an almost obsessive love of certain stories and storytelling, a fascination with explaining acquired knowledge to others, giddy excitement at the opportunity to do a presentation for students in a lower grade, and a certain flair for the theatrical.  While this same child is also a bit of a homework resister and not a fan of rote tasks, I can see aspects of a “born teacher” growing up (even though these same traits could apply to other fields).

This lines up well with what we know about how individual students make the decision to become teachers.  It is not a process that begins simply with a sudden decision to teach.  Rather, it unfolds over time during the some 13,000 hours that students spend in contact with classroom teachers from Kindergarten to 12th grade, a period that Dan Lortie called the “apprenticeship of observation” in his 1975 work, Schoolteacher: A Sociological Study.  Those who decide to teach have prolonged and substantial experiences with people practicing their chosen profession over the course of 13 years, and many potential teachers wish to teach because they, themselves, enjoyed being taught.  They found the study of subjects and school itself to be enjoyable.  While many of the ideas about what teaching actually is that are formed during this observational period are simplistic and need to be challenged both in teacher preparation and throughout the career, it remains true that school is the most active recruiter of future teachers.  If my older child does decide to become a teacher, like most others who choose the field, it will be out of a desire to share with future generations of students a love of learning and to make their school experiences enjoyable, joyous, and inspirational as well.

That is, if Governor Andrew Cuomo and Board of Regents Chancellor Dr. Merryl Tisch manage to not ruin New York’s schools first.

That statement is not made even a little bit tongue in cheek because both Governor Cuomo and Dr. Tisch have made it abundantly clear in the past month that their dissatisfaction with New York teacher evaluations will not go unanswered and their likely “solution” will unleash a torrent of perverse incentives upon our schools.  Andrew Cuomo signaled his intentions to make teacher evaluations more “rigorous” just before the election with newspaper interviews and public statements.  The process was set in motion last month with a letter from Jim Malatras, director of state operations, to Dr. Tisch and outgoing New York State Education Department Commissioner Dr. John King.  The letter opens with the now familiar refrain that the new Common Core aligned state examinations are showing far too few of graduating seniors being “college ready” (even though the proficiency levels, which were set with cut scores pinned to the SAT scores of successful college freshmen, slightly exceed the percentage of New Yorkers over 25 with a bachelor’s degree), and then laments about the unacceptability of the situation.  Teacher and blogger Peter Greene nearly dissects the letter in this post, and among its many facets is a clear desire to make it far easier to get rid of teachers and to increase the number of teachers found ineffective and thus able to be removed from the classroom.

On December 29th, Governor Cuomo vetoed a bill his office had originally drafted that would have given teachers a two year grace period from the new exams being used to remove them from the classroom, a move that starkly reversed his pre-election promises to give the new systems more time to be understood.  Questioned on his change of course, the governor raised the irrelevant specter of child abusers remaining in the classroom, “I understand the union’s issue; they don’t want anyone fired,” Cuomo said. “But we have teachers that have been found guilty of sexually abusing students who we can’t get out of the classroom.”  He did not explain himself with any specific cases of teachers actually found guilty of sexual abuse still teaching, nor did he explain how tying more of teachers’ evaluations to student test scores will get abusers out of schools faster, but he did join both Michelle Rhee and Campbell Brown in trying to scare people into endorsing radical changes to teachers’ workplace protections.

Dr. Tisch responded to Mr. Malatras’ letter with her own set of priorities to tie far more of teachers’ evaluations directly to student progress in the state examinations and possibly eliminating local measures of teacher effectiveness altogether.  2013 New York Principal of the Year Carol Burris explains in this article what Dr. Tisch and Governor Cuomo appear to be proposing:

The system she wants to change is one that she created several years ago with former education commissioner John King, which was put into law by the New York Legislature and that was rushed into place by Gov. Andrew Cuomo who denied districts state aid if they did not adopt it. It became mandatory for teachers and principals to be evaluated in part by student standardized test scores.

The short version of what she wants to do now is this—double down on test scores and strip away the power of local school boards to negotiate the majority of the evaluation plan. Tisch would get rid of the locally selected measures of achievement, which now comprise 20 percent of the evaluation, and double the state test score portion, to 40 percent. She also recommends that the score ranges for the observation process be taken out of the hands of local districts, and be determined by Albany instead.

Principal Burris further notes that Dr. Tisch appears intent on ensuring that the predicted growth of students on standardized tests be the supreme measure of teacher effectiveness, suggesting that teachers found ineffective by those measures be found ineffective overall and removed from the classroom after two such ratings.  Such a system would provide no room for a principal to protect a teacher known locally as both effective and valued by the community, as Principal Burris relates in the story of a teacher from Great Neck who would fall victim to Dr. Tisch and Governor Cuomo.  Given the growing understanding that value added measures (VAMs) of teacher effectiveness rely upon tests not designed to detect teacher input, are highly unstable, and cannot account for teacher impact on variability among student scores, it is quite apt that Dr. Audrey Amrein-Beardsley of Arizona State University and a leading researcher on value-added measures, described the proposal as going from “bad to idiotic.”

This aggressive move to double the value added portion of teacher evaluations and to override local measures in favor of standardized tests is bad for teachers, and it is potentially even worse for students.  By doubling the state examination’s role, eliminating locally chosen measures, and potentially overriding any consideration other than the state examination, Dr. Tisch and Governor Cuomo are proposing a system where teachers would face strong incentives to push test preparation into a central role in the curriculum.  Michelle Rhee’s tenure as Chancellor Schools in Washington, D.C. demonstrated the not excusable but entirely predictable results of tying people’s job security to capriciously unstable measures of their effectiveness.  Less drastic, but potentially more widely damaging for more students, is the evidence that raising the stakes on standardized tests to these extremes will result in an even narrower curriculum than under the original No Child Left Behind provisions which have already reduced time spent on non-tested content and increased teacher centered instruction.  In New York State this will be compounded by the constant gaming of state aid from the Cuomo administration that has coincided with increased demands on districts, especially struggling districts, to perform at higher levels.

It takes no powers of prognostication to see where New York schools are headed if the Governor and Chancellor get their way.

John I. Goodlad, a giant in education research in the second half of the 20th century, passed away at the age of 94 on November 29th of last year.  In his 1984 book, A Place Called School, he asked, “Boredom is a disease of epidemic proportions. … Why are our schools not places of joy?”  The Cuomo/Tisch goals for teacher evaluation are almost guaranteed to drive a huge amount of joy right out of our schools alongside art, music, civics, and health.  Teachers and students will have less room to explore, make mistakes, learn from those mistakes, and shared purposes for education outside of test performance will be even further diminished.

And this is where education “reformers” need to think especially carefully because it is not just the schools of today that they are impacting.  Children in Kindergarten today were born in 2009.  Several 100 thousand of them will likely be first year teachers by the year 2031-2032, and the kinds of teachers they will become will be greatly influenced by what school is like for them between now and their graduation from high school as the class of 2027.  Will their schools be places of extreme test preparation, didactic instruction, and a curriculum that is narrowed by the parameters of tests?  Will these future teachers learn that school is supposed to be emulate even a fraction of the stress and narrowness of the Chinese cram school portrayed in this recent New York Times Magazine? Will there be joy?  And if not, what kinds of future teachers will emerge from those schools to teach the generations behind them?

So, education “reformers” — a New Year’s Resolution for you just as America’s teachers are returning for the second half of the year: The next generation of teachers are currently in the schools that you are reforming. Resolve not to wipe out the joy.

2 Comments

Filed under schools, Stories, teacher learning, teaching, Testing

Exit The King….An Opportunity for Union Leadership?

Dr. John B. King Jr., the Commissioner of Education and President of the University of the State of New York, is stepping down from that position and will become a senior adviser to United States Secretary of Education, Arne Duncan.  While the announcement drew praise from the usual suspects who support Dr. King’s agenda of charter schools, Common Core State Standards, high stakes testing, and teacher evaluations based on test scores, supporters of traditional, fully public, schools had harsh criticisms for the outgoing Commissioner. Education activist and director of Class Size Matters, Leonie Haimson stated:

John King was the most unpopular commissioner in the history of NY State.  He showed no respect for parents, teachers or student privacy.  Ironically, he was intent on protecting his own privacy, and routinely withheld public documents; our Freedom of Information request of his communications with inBloom and the Gates foundation is more than 1 ½ years overdue.  His resignation is good news for New York state; hopefully he will be unable to do as much damage at the US Department of Education.

Dr. King’s problematic tenure began in May, 2011, and he swiftly moved to push through the implementation of the Common Core State Standards and accompanying testing systems that his predecessor Commissioner David Steiner had committed to when Dr. King served as his Deputy Commissioner.  This editorial, appearing in the Hudson Valley paper The Journal News, summarizes Dr. King’s time as Commissioner as “tone-deaf” and characterized by his inability to listen to criticism:

Many parents and educators in this region have offered reasonable, passionate and often convincing arguments against the growing state focus on testing, data-crunching, and evaluating teachers with a formula that is easily picked apart. But King has not been willing to engage his critics. This position has enraged many and created a bizarre stare-down between the state Education Department and many school districts that are supposed to be part of the same team.

The problems with Dr. King’s governance of NYSED are multifaceted.  The EngageNY website, set up by the State Education Department as a clearinghouse of information on the Common Core State Standards and materials designed for leaders and teachers, was quickly called out for hurried and poorly designed “resources” placed on the site when it debuted.  New York Principal Carol Burris documents in this article parents who found links to inappropriate materials under “make test prep fun”, and materials posted for modules on 8th grade algebra which included links to topics that are taught in calculus.  As with many things associated with the Common Core, the rush to both develop and implement the standards has led to a “get the product out and clean it up later” mentality that is emblematic of Dr. King’s leadership and many other reformers.

Questionable materials from EngageNY might have been overlooked by many in the public, but the CCSS are tied to high stakes testing on student proficiency in the standards — and Dr. King has been moving New York at a rapid clip in that direction as well.  Predictably, those who have had close contact with the exams have noted, within the allowed parameters of a nondisclosure agreement with testing giant Pearson, how the exams are confusing and inappropriate for the age of students who have to take them, another likely effect of their being rushed to meet Dr. King’s implementation schedule.  Principal Elizabeth Philips of PS 321 in Park Slope noted earlier this year in the New York Times:

In general terms, the tests were confusing, developmentally inappropriate and not well aligned with the Common Core standards. The questions were focused on small details in the passages, rather than on overall comprehension, and many were ambiguous. Children as young as 8 were asked several questions that required rereading four different paragraphs and then deciding which one of those paragraphs best connected to a fifth paragraph. There was a strong emphasis on questions addressing the structure rather than the meaning of the texts. There was also a striking lack of passages with an urban setting. And the tests were too long; none of us can figure out why we need to test for three days to determine how well a child reads and writes….

…At Public School 321, we entered this year’s testing period doing everything that we were supposed to do as a school. We limited test prep and kept the focus on great instruction. We reassured families that we would avoid stressing out their children, and we did. But we believed that New York State and Pearson would have listened to the extensive feedback they received last year and revised the tests accordingly. We were not naïve enough to think that the tests would be transformed, but we counted on their being slightly improved. It truly was shocking to look at the exams in third, fourth and fifth grade and to see that they were worse than ever. We felt as if we’d been had.

As troubling as the quality of the exams used to assess students’ “College and Career Readiness” AND their teachers’ effectiveness is, the way that the scores were deliberately (and opaquely) engineered to rate only 30% of students as proficient and highly proficient is worse.  State officials, including Dr. King, warned that the scores from the first round of CCSS aligned testing would produce dramatically lower results, but those warnings were predicated on schools not having sufficiently aligned curriculum materials yet.  However, Principal Burris provided an in-depth analysis of how the cut scores for each level of achievement were determined, and her conclusion is troubling:  Dr. King asked for a specific analysis from the College Board on SAT scores that predict “success” in first year courses at 4 year colleges and universities, and the result of that analysis was used to determine what scores on the CCSS aligned tests would be labeled as “proficient” and “highly proficient” as the committee worked through the materials with representatives from the State Education Department.  The result was that 31% of students taking the tests scored as proficient and highly proficient — and the evidence points to the conclusion that Dr. King and the SED wanted that result.

By the way — the percentage of New York residents over 25 with a BA?  32.8%Far from finding a vast educational wasteland where only a third of students succeed, the tests found the percentage of students likely to pursue higher education.

Not that Dr. King, the Regents, or anyone from the Cuomo administration was eager to explain it that way and justifying it as a good assessment system for the entire student population.  This became painfully clear when Dr. King attempted a publicity tour of town hall meetings that erupted disastrously in Poughkeepsie  in Fall of last year.  While keeping his usual calm and soft-spoken demeanor in face of extensive and heated criticism, Dr. King also remained entirely impervious to the concerns of the gathered parents and other community stakeholders.  After the Poughkeepsie forum, he also changed the schedule, canceling meetings, and switched formats so he appeared with a number of other state officials — and despite claiming the goal was to listen to concerns, nothing has dissuaded Dr. King from barreling on at full speed.  In early April of this year, he told an audience at New York University that New York was on the right path and “We’re not retreating” from the combined reforms ushered in during his tenure. In the same talk, he essentially dismissed parents who were opting their children out of the testing by saying “they are now denying themselves and their teachers the opportunity to know how their children are performing against a common benchmark used throughout the state.”  While Dr. King’s steadfastness earned him high praise from allies like Regents Chancellor Merryl Tisch and reform organizations, some lawmakers in Albany noted his poor representation of his ideas and his unwillingness to listen to others’ ideas, leading to bipartisan calls for his improvement or resignation last year.  Assemblyman Thomas Abinanti (D. Westchester) noted:

“For quite some time, Education Commissioner John King has closed off all meaningful conversation with parents, educators, administrators, and elected officials who have highlighted serious deficiencies in State Education Department policies,” Abinanti said. “He has exhibited a conscious disregard for their concerns.

“He should be listening, educating where criticisms are unfounded, and adopting changes where criticisms are valid,” the lawmaker continued. “His rigidity makes him unsuited for the position of Education Commissioner. Commissioner King should resign immediately.”

Assemblyman Abinanti was joined in this criticism by Republican Senator Jack Collins and New York State Allies for Public Education, and they were joined in April of this year by the New York State United Teachers’ Delegate Assembly who withdrew support for New York state’s Common Core implementation, supported parents who opt their children out of state examinations, and called for Dr. King’s removal as Commissioner.

But being a failed education reform leader is a lot like being a failed hedge fund manager — others have to live with the consequences of your actions while you get a quiet send off to another lucrative position, so Dr. King is off the join Secretary Duncan in Washington, D.C.

Dr. King is obviously a greatly intelligent man.  His academic accomplishments, which include a B.A. from Harvard University, a J.D. from Yale Law School, and both an M.A. and Ed.D. from Teachers College at Columbia University, are appropriately described as impressive as hell.  He was born in 1975 which means that he was 22 in 1997.  According to his biography, he taught for 3 years, and joined the founding leadership team for Roxbury Prep charter school, and from there moved to become Managing Director of the Uncommon School charter network, a chain on “no excuses” and extremely high attrition charter schools in various urban communities.  Dr. King was 34 years old when he was tapped to become Deputy Commissioner of NYSED, and he was 36 years old when he succeeded David Steiner as Commissioner and became the daily leader for the 7000 public and private schools, the 270 private and public colleges and universities, the 7000 public libraries, the 900 museums, the 25 public broadcasting services, and all of the different licensed professions that comprise the University of the State of New York.  He had never led a fully public school as principal, and he had never been in the leadership of a public school district.

Dr. King is an excellent example of how experience and specialized knowledge matter.  He is an impressively intelligent man who clearly impressed some very important people with his intelligence and commitment to a set of ideas for education reform.  However, understanding the complexities of public education requires both special knowledge and experience.  Public school governance is a peculiar case study where a structure that looks like a typical hierarchical bureaucracy is subjected to multiple levels of democratic control and where various stakeholders have overlapping sets of both complimentary and competing interests.  These same stakeholders are not limited in their access to the organization by the rules of top down corporate management either, and they can access the different layers of authority and practice without having to go through official channels.  Governing such a structure, as any principal or superintendent knows, takes more than intelligence and knowledge; it takes leadership, political acumen, negotiating skills, and flexibility in the face of emergent needs and complications.  While these skills may be innate, all of them are honed by experience.

If Dr. King had been a superintendent of a complex school system for ten years when he was tapped to become Deputy Commissioner, his intelligence and knowledge may have been tempered by a proper understanding of the complexities of public education and the skills needed to leverage the various stakeholders.  Instead, he clearly had no idea how to work with those constituencies and frequently favored opacity and rigidity when implementing major changes to something both parents and teachers take incredibly personally.

With Dr. King on the way out, there is an opportunity for New York and national union leadership to leverage a difference.  The next Commissioner will be appointed by the Regents, so the next Commissioner will still be committed to CCSS, high stakes testing, VAM based teacher evaluation, and charter schools.  However, there is no need for the next Commissioner to be closed off to all stakeholders outside of the NYSED, and there is every possibility that a Commissioner with genuine school and district leadership experience will understand how to negotiate and how to adapt to changing circumstances.  A Commissioner who has led a complex school district will be more likely to understand that leveraging complex changes requires time, resources, development, and a constant process of revising plans to respond to emergent needs that are inherently unpredictable.

I have no doubt in my mind that such a leader is exactly the kind of person that Regents Chancellor Dr. Merryl Tisch has no interest in appointing. But a public campaign to explain the need to the state could pressure her to seek an appointee interested in her reform agenda but with the skills that would blunt it. That is far from perfect, but the current leadership in Albany precludes the perfect.

Last month, I wrote an open letter to AFT President Randi Weingarten, and to my surprise, she contacted me directly and responded on my blog.  She responded to my concerns that union leadership was so concerned with maintaining a “seat at the table” with policy makers that the union was failing to vigorously oppose and denounce damaging policies that were coming from politicians from the union’s traditional political allies:

To advance this mission—which is the soul of the union—we have to use every single tactic and strategy available. That means at the ballot box, the bargaining table, the town square and the picket line, and it also entails the building of community and school partnerships, devising solutions and taking the risk to try things–provided they are good for kids and fair to educators. We must always work as a democratic institution that builds the trust, the agency and the activism of our members. That’s what we mean when we say solution driven, member mobilized and community engaged.

When we have the responsibility of being the bargaining agent, we can’t walk away from the table. It is at the table where we have a legal voice—a voice that many governors, like Gov. Scott Walker in Wisconsin or soon-to-be former Gov. Tom Corbett in Pennsylvania, have rushed to obliterate.

More important, if we want to make a difference in the lives of our students, our communities and the wonderful people we represent, we need to be able to both fight back and find common ground. It can’t be either/or. We can’t take only one of these approaches. Which approach depends upon what will best serve our students, our schools, our profession and our communities. And while those decisions on which tools to employ and which strategies to adopt will vary under the circumstances, our values must always be firmly held. It is about keeping “our eyes on the prize.”

I won’t say that President Weingarten and I are seeing exactly eye to eye here, but perhaps we are on the same step ladder.  And while the union has been more clear of late in challenging the anti-public school rhetoric coming from Albany, the compromise of continuing to engage with the policy makers, of staying at the table, is a compromise that should give the NYSUT and its parent AFT some chips to cash in.  I hope that in the coming weeks, the Regents will hear clearly, forcefully, and PUBLICLY from the teachers’ strongest representatives that our state needs a Commissioner who understands public education, knows the perspectives of the communities, parents, students, and professionals who make up public schools, and is willing to make education reform an iterative process instead of a set of rigid commandments.

New York State’s 600,000 professional teachers and million of public school students deserve a Commissioner with these experiences and skills.  And we need the most powerful voices in the state to call for that in public.

1 Comment

Filed under Common Core, New York Board of Regents, schools, Testing, Unions

Bride of VAMenstein: No Bad Idea Gets Left Behind

When I was much younger, my grandfather, a carpenter and engineer, had an expression he was fond of saying whenever we drove through a particularly poorly designed intersection or highway interchange.  He’d grunt in disgust and comment, “Whoever built this should do the world a favor.  Design ONE more and then drop dead.”

There are times when I’d like the economists who keep insisting they can design value added models of teacher effectiveness to consider following the same advice.

On November 25th, the U.S. Department of Education released newly proposed regulations for teacher preparation in the over 1200 programs that exist across the country.  The press release stated:

“It has long been clear that as a nation, we could do a far better job of preparing teachers for the classroom. It’s not just something that studies show – I hear it in my conversations with teachers, principals and parents,” U.S. Education Secretary Arne Duncan said. “New teachers want to do a great job for their kids, but often, they struggle at the beginning of their careers and have to figure out too much for themselves. Teachers deserve better, and our students do too. This proposal, along with our other key initiatives in supporting flexibility, equity and leadership, will help get us closer to President Obama’s goal of putting a great teacher in every classroom, and especially in our high-need schools.”

This is not a new subject for research and policy speculation.  In 1984, Judith Lanier of Michigan State University contributed a comprehensive chapter on teacher education for the 3rd Handbook of Research on Teaching.  Dr. Lanier concluded that while many spoke of the importance of teacher preparation, there were no entities willing to take robust authority for making sure its many parts worked, and that its quality remained highly spotty and often quite poor.  Since then, there have been numerous proposals to change and improve teacher preparation from the Holmes Group Reports, to the Carnegie report on teacher preparation, to John Goodlad’s proposals for preparing teachers, to the original report of the National Commission on Teaching and America’s Future.  In the 30 years since Dr. Lanier wrote her chapter, there have been numerous proposals, programs, and practices that have worked upon teacher preparation in the United States.

Now it is the turn of the Data Junkies.

The DOE announcement says states will be required to report on the performance of teacher preparation programs based upon the following:

  • Employment outcomes: New teacher placement and three-year retention rates in high-need schools and in all schools.
  • New teacher and employer feedback: Surveys on the effectiveness of preparation.
  • Student learning outcomes: Impact of new teachers as measured by student growth, teacher evaluation, or both.
  • Assurance of specialized accreditation or evidence that a program produces high-quality candidates.

Some of this is benign, some of it is deceptive, and some of it is rank foolishness.  The fact that Secretary Duncan’s statement specifically cited Relay “Graduate School of Education” as an example of an innovation in teacher preparation to be held up does not lead me to a great deal of confidence.  Relay, for those who do not know, is a teacher training “graduate school” that has no actual professors of education and is not attached to an institution of higher learning.  Rather, it is an alternative program housed in North Star Academy Charter School in Newark, NJ using its own teachers to train new hires in the methods of teaching used in North Star and allowing them both to be credentialed and to “earn” graduate degrees.  Relay and its supporters defend this because the charter school has externally impressive scores on standardized tests, but those scores come, as Dr. Bruce Baker of Rutgers University demonstrates, at the expense of more than half of the students who enroll at North Star – because they never make it to graduation.  North Star enrolls over 14% fewer students on free lunch than Newark Public Schools in general, less than half as many students with disabilities, and the students with disabilities at North Star are vastly more likely to be mild or low cost to the school, including no students with autism, no emotionally disturbed students, no intellectually disabled students, and no students with multiple disabilities.  Between 5th grade and 12th grade, half of students attending North Star leave the school, and 60% of African American boys leave.

Just to be clear: The Secretary of Education for the United States of America announced new teacher preparation regulations by praising the “innovation” of a “Graduate School of Education” that does no serious graduate study, has no qualified educational researchers, and that prepares its graduates to teach the methods espoused by a charter school where an African American male student only has a 40% chance of reaching his senior year of high school.

Components of these regulations are puzzling.  The DOE wants states to keep track of teacher retention rates, presumably because of the long known problem of early career teachers leaving both assignments or the profession in high numbers.  Such a requirement raises staggering logistical challenges, as states do not readily have ways to track the careers of teachers certified in their states who teach in other states, teachers who switch teaching in a public school for a position in a private or parochial school, and teachers who take up full time graduate studies — all of which are very different than leaving because of feeling overwhelmed and under-prepared.

More troubling, such data would be largely indicative of the professional cultures and environments of the schools in which teacher preparation graduates teach.  While teacher education has worked in the past three decades to provide prospective teachers with quality experiences to reduce the long recognized “reality shock” experienced by novice teachers, such work is frequently difficult, time and resource intensive, and requires significant rethinking of the relationship between universities and schools where prospective teachers are prepared.  However, significant research also exists that demonstrates that teacher turnover is deeply tied to school factors in initial job placements that are entirely outside university control.  In no place in these regulations on preparing teachers do I see anything related to how states and communities support the local schools to promote collaborative environments that support early career educators. What I do see is a potentially perverse incentive for teacher preparation programs to steer their graduates as far away from struggling schools as possible.

Worse than this provision by far, however, is the proposal to take the already invalid concept of Value Added Measures (VAM) of teacher performance and to use the VAMs of teachers to evaluate their teacher preparation programs.  A VAM is a statistical model based on student standardized test performance that takes a student’s previous year’s test scores, claims to predict how that student will perform given a year of effective teaching, and then generates the teacher’s “value added” based on how well students do based on those predictions.  The American Statistical Association issued a clearly worded statement this year detailing the problems with VAMs, citing both the lack of tests that are valid for the purpose and the very limited impact that teachers have on student variability on standardized test performance.  Research generally agrees that teachers are a very important if not the most important in school factor for students, but research also agrees whatever teachers’ impact is, standardized tests are an exceedingly poor measure of it, accounting for only 1-14% of student variability on the tests.

Despite these inherent flaws, VAMs remain highly popular with the federal DOE which has been influenced by the Gates Foundation funded “Measures of Effective Teaching” study which claims that VAMs can be used as a component of teacher evaluation.  Jesse Rothstein of University of California at Berkeley, however, notes that the data used to justify that claim is strikingly weak, and that teachers who are effective by some measures show up as ineffective by others and vice versa.  Dr. Baker of Rutgers illustrates here that teachers whose students score high in one year (called “Irreplaceables” by Michelle Rhee’s New Teacher Project “thought leaders”) are not all “irreplaceable” in subsequent years (and in fact most drift all over the map), making it absolutely necessary to consider that factors outside of the classroom play significant roles in student test performance. VAMs also potentially damage teachers whose students, far from being low performers, work at an accelerated curriculum that is several years past the material directly tested on the exams used to generate VAMs.  The New York Times reported in 2011 of the tribulations of Ms. Stacy Isaacson, who was universally regarded as an outstanding mathematics teacher whose students got excellent scores on state examinations and over two dozen of whom went on to New York City’s highly selective high schools, got ranked in the 7th percentile of teachers in the city by the VAM formula used that year:

NYC VAM

Ms. Isaacson’s low percentile could not be explained to her by anyone in her administration, and the fault lay at the opaque statistical formula used to rank her based on students’ tests.  Given the inherent flaws with VAMs, my explanation is as follows.  In the New York City Value Added Model, what is circled in this picture is a real number:

NYC VAMreal

Everything circled here is the result of misapplying statistical tools used to model entire national economies to a single teacher’s classrooms:

NYC VAMfake

Anyone who knows children and their development should be troubled by VAMs because in order to believe that they work with such small samples as a single teacher’s classroom, we have to believe that the VAM can adequately account for every factor outside of a teacher’s instruction that can impact how students do on a test.  Did Johnny get an Individualized Education Plan this year that finally provides support for his dyslexia?  Are Johnny’s parents reconciling after a period of separation and his home life is stabilizing?  Has Johnny’s cognitive development reached a point where he is ready for more complex learning and will outpace previous years of instruction because children do not actually develop in straight lines?  All of these are factors that can boost a teacher’s value added score without the teacher actually having done anything especially different for Johnny.  There are as many factors not directly related to a single teacher that can negatively impact a value added score.

So let’s review: Research supporting VAMs ignores its own contradictory research.  No current standardized test is sufficiently well designed for the purpose of generating VAMs. VAMs measure teacher input on student variability in standardized test scores which is as low as 1% and only as high as 14%.  Teachers whose students score in very high percentiles in one year can have students who score far differently in subsequent years. Teachers who are effective by every other measure possible can be placed in the very bottom tier of teachers using VAMs.  This is not the kind of stuff that inspires much confidence, but the federal DOE is going to push ahead anyway.

Have really terrible measures of teacher effectiveness on your hands?  Never mind!  If you are Secretary Duncan, you have Bill Gates backed research and advocacy, and seriously flawed “research” from Michelle Rhee’s pet group to tell you otherwise.  Full speed ahead.

Of course, if you are going to blatantly ignore what a growing body of genuine research tells you about your favored reforms, it stands to reason that you will double down on them and try to push them even further into the system by measuring teacher preparation programs by the VAMs their graduates generate.  There is a lesson here that Secretary Duncan, Bill Gates, Michelle Rhee, and an entire platoon of corporate reformers seem incapable of learning, and it has to do with learning humility when beloved projects turn out to be far more complicated and fraught with failure than anticipated.

In the 1935 sequel “Bride of Frankenstein,” the badly wounded but recovering Henry Frankenstein initially renounces his creation but is forced by his former mentor, Dr. Septimus Pretorius, to assist a project creating a “bride” for the monster.  The monster is excited by the chance to have a companion like himself, but is quickly devastated by her immediate, terrified, rejection of him and destroys himself, Henry’s laboratory, Dr. Pretorius, and the bride, proving again that the power of life and death is not a toy to be trifled with.

I could save Secretary Duncan quite a lot of trouble if he’d just ask.

Well, that didn't go as planned, did it?

Well, that didn’t go as planned, did it?

6 Comments

Filed under Gates Foundation, schools, teacher learning, Testing, VAMs

Andrew Cuomo Makes it Official: He’s at War With Teachers

New York Governor Andrew Cuomo recently sent some mixed signals on his education platform.  In late September, he declared that the teacher evaluation system in the Empire State needs “refinement” because even using standardized test scores to create value-added measures, too many teachers are found to be effective or highly effective. This month, however, the Cuomo campaign, perhaps responding to criticisms of his embrace of the Common Core State Standards, issued an ad that suggested a softer approach to education.  Featuring Governor Cuomo in a white sweater helping his similarly attired daughter with her homework at a table decorated with white pumpkins and a glass bowl of smooth pebbles, the ad promised “real teacher evaluations” and not using Common Core test scores for “five years.”  That promise, however, simply reflects an existing item in the state budget that delays including test scores in graduating students’ transcripts; it does not promise to not use the test scores to evaluate teachers in any way.  The governor’s softer, rather beige, image is an illusion.

There was no illusion this week, however.

Speaking with the New York Daily News editorial board, Mr. Cuomo emphasized his priorities on education for a second term in Albany:

“I believe these kinds of changes are probably the single best thing that I can do as governor that’s going to matter long-term,” he said, “to break what is in essence one of the only remaining public monopolies — and that’s what this is, it’s a public monopoly.”

He said the key is to put “real performance measures with some competition, which is why I like charter schools.”

Cuomo said he will push a plan that includes more incentives — and sanctions — that “make it a more rigorous evaluation system.”

The governor took a direct, insulting, swipe at the 600,000 members of the NYSUT, by saying, “The teachers don’t want to do the evaluations and they don’t want to do rigorous evaluations — I get it.  I feel exactly opposite.”

It is rare to have one person summarize, so succinctly, nearly everything that is wrong with the current education reform environment.  “Break…a public monopoly…competition, which I why I like charter schools…the teachers don’t want to do the evaluations.”  In those short turns of phrase, Andrew Cuomo demonstrates how he utterly fails to understand teachers, the corrupted “competition” environment he promotes, and the entire purpose of having a compulsory, common school system.  I personally cannot think of any statements he could have made that disqualify him more from having any power over how we educate our young people.

The governor, who expects to win Tuesday’s election by a wide margin, faced immediately backlash over his comments, but he has opted to double down and repeat the rhetoric of calling our state’s public schools a monopoly.  He has even gotten harsh criticism from the Working Families Party, whose endorsement he wrestled for this summer when the progressive party looked to ready to endorse Fordham Law School Professor Zephyr Teachout. W.F.P.’s state director, Bill Lipton commented:

“His proposed policies on public education will weaken, not strengthen our public education system, and they would represent a step away from the principle of high quality public education for all students. High stakes testing and competition are not the answer. Investment in the future is the answer, and that means progressive taxation and adequate resources for our schools.”

In return, Governor Cuomo’s campaign spokesman, Peter Kauffmann said, “This is all political blather.”  If anyone in the leadership of W.F.P. still has faith in Mr. Cuomo’s promises to them, I will be astonished.

I am going to address Mr. Cuomo’s statements in reverse order:

1) “The teachers don’t want to do the evaluations and they don’t want to do rigorous evaluations”

Mr. Cuomo bases this upon teacher opposition to the “rigorous” evaluations that include the use of students’ standardized test scores to determine if teachers are highly effective, effective, or not effective.  Not meeting the “effective” range on the evaluations can cost teachers tenure or it can initiate efforts to remove them from the classroom if they already have tenure.  Governor Cuomo is on record as believing that the current system is too lenient on teachers because under the new Common Core aligned examinations, student proficiency in the state has dropped dramatically while, in his view, too many teachers remain rated as effective and highly effective.  Presumably, the Governor wants to change the evaluation system so that administrator input is less important and so that the “rigorous” method of rating teachers by students’ test scores has more of an impact on their effectiveness ratings.  This is a fatally flawed approach, and it is fated to unleash appalling results for several important reasons.

First, as I have written previously, he has egregiously, and probably deliberately, misrepresented what the student proficiency ratings from the Common Core exams mean.  While students reaching proficient and highly proficient on the exams only reached 36% of test takers last year, the cut scores were deliberately set to reflect the percentage of students in the state whose combined SAT scores reflect reasonable first year college performance.  Unsurprisingly, the numbers of students who scored at proficient and above almost exactly mirrored the percentage of students with those SAT scores.  This cannot be construed as students and their teachers under-performing expectations, and, not for nothing, the percentage of New Yorkers over the age of 25 with a bachelor’s degree is 32.8%.

So let’s be perfectly clear: the Governor is saying that teachers in communities where large percentages of students do not attend college are automatically “not effective” teachers.

Second, the entire CONCEPT of tying teacher performance to standardized test scores rests on controversial premises and is not widely accepted by the research community.  The American Statistical Association warns that teacher input can only account for between 1-14% of student variability on standardized test performance, and they also do not believe that any current examination is able to effectively evaluate teacher input on student learning.  Further, advocates of value added models tend to make “heroic assumptions” in order to claim causation in their models, and they tend to ignore the complications for their models that arise when you recognize that students in schools are not assigned to teachers randomly.

I know many teachers who wish to improve their teaching and who would welcome a process that gives them good data on how to go about doing that.  I know no teachers who want to be subjected to evaluations that rely on flawed assumptions of what can be learned via standardized exams.

Finally, value added models tend to be incredibly opaque to the people who are evaluated by them.  For example, this is the Value Added Model that New York City used in the 2010-2011 school year:

NYC VAM

This is also the VAM that found teacher Stacey Issacson to be only in the SEVENTH percentile of teachers despite the fact that in her first year of teaching 65 of 66 students in her class scored “proficient” or above on the state examinations, and more than two dozen of her students in her first years of teaching went on to attend New York City’s selective high schools.  Perhaps worse than having a formula spit back such a negative rating was the inability of anyone to actually explain to her what landed her in such a position, and Ms. Issacson, with two Ivy League degrees to her name and the unconditional praise of her principal, could not understand how the model found her so deficient either.  Perhaps I can help.  In this image I have circled the real number that actually exists prior to value added modeling:

NYC VAMreal

And in this image, I circle everything else:

NYC VAMfake

Consider everything that might impact a student’s test performance that has nothing to do with the teacher.  Perhaps he finally got an IEP and is receiving paraprofessional support that improves his scores.  Perhaps there is a family situation that distracts him from school work for a period of time during the year.  Perhaps he is simply having a burst of cognitive growth because children do not grow in straight lines and is ready for this material at this time, or, subsequently, perhaps he had a developmental burst two years ago and is experiencing a perfectly normal regression to the norm.  Value added model advocates pretend that they can account for all of that statistical noise in single student for a single school year, and then they want to fire teachers on those assumptions.  This is what happens when macroeconomists get bored and try to use their methods on individual students’ test scores.

Governor Cuomo assumes that because teachers do not want to be subjected to statistically invalid, career ending, evaluations that they do not want to be evaluated.

2) “competition, which I why I like charter schools”

Charter schools were never supposed to be “competition” for the public school system.  As originally conceived, they would be schools given temporary charters and be relieved of certain regulations so that they could experiment with ways to teach populations of students who were historically difficult to teach in more traditionally organized schools.  In this vision, originally advocated by AFT President  Albert Shanker, charter schools would feed the lessons they learned back to the traditional school system in a mutually beneficial way.  Governor Cuomo’s idea is as far from that vision as it is possible to be and still be using the same language.

The Governor apparently thinks that charter schools are there to put pressure on fully public schools, and that the “competition” for students will act like a free marketplace to force improvement on the system.  This is a gospel that has deep roots, going as far back as Milton Friedman in 1955, and gaining intellectual heft for the voucher movement in the 1990s with Chubb and Moe’s 1990 volume, “Politics, Markets and America’s Schools.”  While vouchers have rarely been a popular idea, advocates for competition in public education have transformed charter schools into a parallel system that competes with fully public schools.  This has flaws on several levels.  First, it is an odd kind of marketplace when one provider is relieved of labor rules and various state and federal education regulations and the other is still held fully accountable for them.  Charter schools’ freedom from regulations was meant to allow for innovations that would help traditional schools learn, but instead it has become a “competition” where one competitor is participating in a sack race and the other in a 100 yard dash.  A sack race, by the way, is an entirely fine thing to participate in, but no race is legitimate when everyone isn’t required to follow the same rules.

Second, the presence of the charter sector as currently operated and regulated actively makes district schools worse off.  As Dr. Baker of Rutgers demonstrates, charter schools generally compete for demographic advantages over fully public schools.  They draw from a pool of applicants who are both attuned to the process and willing and/or able to participate in it.  Once students are admitted, many prominent charters, especially ones that get high praise from Governor Cuomo, engage in “substantial cream skimming” that results in their student populations being less poor, having fewer students on IEPs, and needing less instruction in English as a Second Language.  While charter operators deny engaging in these practices, well documented cases are available in the media.  Dr. Baker’s research confirms that when charter schools are able to do this, the district schools in the same community are left with student populations that more heavily concentrate the very populations of children that the charter schools are unwilling to accommodate.  Charter advocates then claim that they are getting “better” results with the “same” kids and protest loudly that they deserve a greater share of the finite resources available for schools, even when the costs of their transportation and building expenses are paid by the districts.

This isn’t just a sack racer versus a sprinter, then — the sprinter has slipped a couple of cinder blocks into his opponents’ sacks.  Teachers don’t mind that other schools may do things differently than they do in their own schools; they mind very much being berated for the results of system-wide neglect of their community schools, and they mind being negatively compared to schools that make their own rules and refuse to serve all children.

3) “Break…a public monopoly”

That we are poised to have a two term governor who describes New York’s public education system as “monopoly” is such a breath taking circumstance, that I am saddened beyond belief.  The common schools movement in this country was conceived of as an exercise in promoting the public good not merely in advancing individuals.  We wanted universal, compulsory, free education to serve the individual by promoting academic and economic merit as well by promoting the habits of mind and character that enrich a person’s experience in life.  We also wanted schools to promote the good of society by preparing individuals for the world of work beyond school and by preparing individuals to be thoughtful participants in our democracy who value civic virtues in addition to their own good.  For nearly two centuries, Americans have thought of public schools as the center of community civic life, something to be valued because it provides bedrock principles of democratic equality, and as our concept of democratic participation has expanded, so has our concept of plurality in schools.  From literacy for former slaves to women’s suffrage to incorporation of immigrants to tearing down White Supremacism and promoting civil rights, to inclusion of those with disabilities, to gender equality, to equal protection for LGBT citizens — our schools have helped us to reconceive our ideas of pluralism in every decade.

Schools have also stood as important symbols of our commitment to common aspects of our society that all have access to regardless of race, gender, or economic advantage.  There was a time in our nation’s history when we were dedicated not merely to building economic infrastructure, but also to building community, cultural, and natural infrastructure.  There are libraries, parks, museums, and publicly supported arts across our country that are testament to the belief that the world of knowledge, natural beauty, and the arts cannot be the sole province of the wealthy.  Public schools are part of that commitment, but to call them a “monopoly” reveals a mindset disregarding that heritage and which rejects it as a commitment to the future.  Does Governor Cuomo drive the New York Throughway and see a “public monopoly”?  Does he enter the Metropolitan Museum of Art in New York City whose entry fee is a suggested donation and see a “public monopoly”?  Does he want to “break up” the Franklin D. Roosevelt  and Watkins Glen State Parks?

What Governor Cuomo appears to believe is that education exists solely for the social mobility of individuals with no regard for the public purposes of education.  David Labaree of Stanford University posited in this 1997 essay, that the historic balance of purposes in education was already out of balance with current trends favoring education for individual social mobility far outweighing the public purposes of social efficiency and democratic equality.  Labaree was rightly concerned that if people only see education as the accumulation of credentials that can be turned in for economic advantage then not only will the civic purposes of education be swept aside, but also that the effort to accumulate the most valuable credentials for the least effort will diminish actual learning.  Governor Cuomo’s depiction of schools as a “public monopoly” only makes sense if he is mostly concerned with how education “consumers” accumulate valued goods from school, but discounts the essential services schools provide to our democracy.  It is an impoverished view that relegates school to just another mechanism to sort people in and out of economic advantage.

Governor Andrew Cuomo may not only be at war with teachers.  He may be at war with the very concept of public education.  If he does indeed win a second term on Tuesday, he must be opposed at every step of his distorted and dangerous ideas about our public schools.

11 Comments

Filed under charter schools, politics, schools, Social Justice, teaching, Testing, Unions, VAMs