Tag Archives: testing

Eva Moskowitz’s “Success”

The founding class of Eva Moskowitz’s Success Academy chain of “no excuses” charter schools graduated from eighth grade last week.  Of the original class of 73 students who enrolled in 2006, 32 made it to last week, and, according to Juan Gonzalez of the New York Daily News, despite 27 of those students sitting for the entrance exams to New York City’s highly selective public high schools, no Success Academy graduate qualified for admission.  Moskowitz has widely touted her schools’ closing of the achievement gap between racial demographics on state issued standardized tests, and while the city’s elite high schools are rightly criticized for their low enrollment of black and Latino children, Gonzalez notes that the overall 12% acceptance rate for black and Latino students taking the test should have given as many as 3 acceptances from Moskowitz’s school.

This is not news that should produce any satisfaction even among Ms. Moskowitz’s most fierce critics, nor should any criticism be aimed at the young children involved.  Despite my serious reservations about the atmosphere and techniques employed by Ms. Moskowitz’s charter chain, I have no doubt that the young people who have been at Success Academy 1 since 2006 are admirable and hard working young people, and it is my sincerest hope that they have bright futures ahead of them.  Nor do I want my criticism of Moskowitz’s methods and self promotion to second guess the parents who have sought out and appreciated her schools’ focus on discipline and raising test scores.  However, Ms. Moskowitz has applied to the state for another 14 Success Academies and under the current state budget deal approved in Albany, New York City will have no say in granting these charters and will have to provide space for the schools or pay Moskowitz’s rent in another facility.  The sharp decline in the enrollment of her first graduating class and her curriculum’s inability to place graduates in the city’s most selective high schools (despite her claims of closing the achievement gap) requires the asking of some sharp questions.

And it is well beyond time that Ms. Moskowitz answer questions of the public that is required by law to pay for her schools.

Ms. Moskowitz is not controversial merely for her confrontational manner nor for her refusal to let the state examine how her chain uses the substantial sums it gets from taxpayers.  Success Academy is part of the “no excuses” camp of education reform that insists if you fire the right teachers, insist upon extreme personal rigor and focus upon the “basics” that you can close the historic achievement gap between white and Asian students and their black and Latino peers. The school of thought has powerful advocates among the likes of Michelle Rhee and Joel Klein and demonstrably has the ear of Secretary of Education Arne Duncan and the rest of the Obama administration.  It has a certain appeal if you do not think about it too hard.  These critics decry those who focus on anti-poverty and anti-racism efforts as “excusing” bad teaching and claim that if people just work hard enough, historic gaps in academic progress, and presumably economic progress, would close.  In doing so, however, they take up two exceptionally pernicious implied arguments.  The first is that the well-demonstrated deprivations of poverty do not matter so long as the school demands enough out of its students.  The second is that the existence of children who demonstrate the desired perseverance proves that others are just slacking and could overcome if only they just worked hard enough.  Both of these beliefs diminish genuinely complex issues to slogans and side step societal responsibility to address poverty.

Moskowitz’s schools take this to extremes.  The New York Times reported in 2011, when the Success chain had only 7 schools, how children who do not fit into its very narrow mode find themselves subjected to excessive punishments and ongoing suggestions that they should leave.  In less than a month of Kindergarten at Success Academy 3, Matthew Sprowal was subjected to so much pressure and punishment (he has ADD) that he was throwing up most mornings, and his mother received direct communication from Moskowitz herself strongly implying her son should be at another school.  This is not an isolated case.  In 2010-2011, Success 1 suspended a fifth of its students at least once.  Public schools in the same neighborhood suspend 3% of students in a typical year.  Further, evidence exists that the schools place special pressures on the parents of disabled students to seek different schools.  A parent at Upper West Success taped school officials saying they could not properly accommodate her Kindergarten student’s IEP and offering to find him a public school placement.

Charter schools like Success Academy take students from a lottery, and in theory, that lottery ensures that they are not selective like exclusive private schools, but practices like those reported by former Success Academy families demonstrate that the schools do not abide by a spirit of inclusiveness (and may actually violate state and federal law).  Moskowitz repeatedly tells the media that she is succeeding with the city’s neediest children, but her schools clearly enroll far fewer children on free and reduced lunch, fewer children with disabilities and fewer children who are second language learners than her neighboring district schools, and the pattern of those students who leave the schools in the early grades is not random.

It is true that Success Academy students get higher than average scores on state tests, but this is coming from a population of students who have already had those most likely to struggle on the tests weeded out — and it comes with the cost of extreme test preparation rolled in the curriculum.  A Success Academy teacher, writing on terms of anonymity, gave the following account to NYU’s Dr. Diane Ravitch:

“Custom Test Prep Materials: I think many schools use practice workbooks from publishers like Kaplan, etc. We have people whose job it is to put together custom test prep packets based on state guidance. Much more aligned to common core and closer to the test than the published books I’ve seen. Also, teachers are putting together additional worksheets and practice based on what we see in the classroom. Huge volume of practice materials for every possible need (and we use it all, too). Also many practice tests and quizzes that copy format of the test.

“Intensive organization-wide focus on test prep: For the last months and weeks before the test, everyone from Eva on down is completely focused on test prep. Just a few examples….

“We have to give kids 1/2/3/4 scores daily. Kids are broken up into small groups based on the data and get differentiated instruction. If they get a 1, they stay back from recess or after school for extra practice.

“Thousands of dollars spent on prizes to incentivize the kids to work hard. Some teachers have expressed concern about bribing them with basketballs and other toys instead of learning for the sake of learning. The response is “prizes aren’t optional.”

“We get daily inspirational emails from principals with a countdown, anecdotes about the importance of state tests, and ever-multiplying plans for “getting kids over the finish line” (these get old fast).

Excessive test preparation is a concern for all New York City schools, and the teacher evaluation incentives implemented as part of Race to the Top have not helped.  The New York legislature passed a law this Spring mandating that test preparation can take up no more than 2% of instructional time in public schools.  Charter schools were exempt, which is a relief for Ms. Moskowitz’s schools who would apparently lose months of their planned curricula.

In a follow up message, the same teacher forwarded a message to Success Academy teachers from a senior administrator giving his ideas on why they have been “attacked” in the media.  The message contrasts their work to the work of “failure factories”, claims to have found the “solution” to urban education, claims that people are jealous of their schools and frames Success Academy, which can raise over 7 million dollars in a one night fundraiser, as victims of teacher unions.

Missing in the self congratulatory rhetoric and the extreme test preparation?  The children pressured and forced out of the network’s schools for reasons no public school could ever employ.  There is no “solution” for urban education that involves losing over half a graduating class of students between first grade and eighth.  There is no “solution” for the challenges of educating students with learning disabilities, behavioral disabilities or who are learning English that includes pushing them off on to other schools.

Which brings me back to the first graduating class of eighth graders at Success Academy 1.  I genuinely wish them well, and I certainly admire the qualities they must possess to thrive in an environment like the one described above.  But the children Ms. Moskowitz failed to mention in her address to her first class of “scholars” are the ones she failed to get to that day.  Those are the children she refused to accommodate and whose education she washed her hands of.

And she should be made to account for every single one of them before New York grants her a single new classroom.

Leave a comment

Filed under charter schools, politics, Social Justice, teaching

Welcoming a New Cohort of Future Teachers

Yesterday, my program got an early chance to meet members of our incoming Class of 2018.  I had a series of hand outs with critical planning information for their next four years, but more important than reading to them action items that they can read for themselves, I and my colleagues wanted them to get to know each other and begin to see each other as people who can be relied upon.  This is not only good for them as they enter a four year program together, but also it is good for their future practice in schools.  Teachers who collaborate and seek out ideas from a variety of trusted people are more able to seek solutions to questions about teaching than teachers who close the door of their classrooms and try to not be seen.  It also helps our incoming students start to see how people with different backgrounds and reasons for being in a school can quickly come together to collaborate and learn about each other.

These new future teachers are entering their university preparation for teaching at a difficult time.  The Common Core State Standards movement was sweeping along as fait accompli until questions about its quality, purposes and the speed of implementation have hit mainstream.  New mass high stakes testing is still scheduled to roll out over the next few school years, but it is meeting with increasing teacher and parental resistance.  Communities across the country will soon see their students, teachers and school assessed by those exams, and teachers will face potential career consequences based on value added modeling of their teaching using test data.  These policies are not being tested carefully in small settings; they are being rolled out simultaneously in classrooms affecting 10s of millions of students.  Mass disruption is the order of the day.

Teaching as a profession is under higher scrutiny.  “Reformers” such as Michelle Rhee have advocated for years that the solution to nearly every problem facing education is to fire “ineffective” teachers and to use test scores to determine teacher effectiveness.  To accomplish this, they not only needed mass testing, they also needed to diminish teachers’ workplace protections and that has meant stripping away traditional union rights.  Court cases like the recently (and controversially) decided Vergara case are likely to increase in number. At the same time, traditional teacher education is coming under attack via the partisan think tank National Council of Teacher Quality (NCTQ) which has taken it upon itself to “rank” all teacher preparation programs in the country.

The contradictions of the self-styled education reformers are evident and troubling.  They have pushed for complicated standards and testing regimens at a time when states and school districts around the country are cutting budgets and personnel.  They have demanded that teachers be held to higher standards of performance using measures of their performance that experts in statistics say are poorly designed for that purpose.  They have demanded that teachers work with fewer protections for their employment while dramatically raising their stakes of their work.  The same “reformers” who bemoan the quality of university based teacher education are enthusiastic backers of Teach for America’s five week training model and of charter schools which are contemplating setting up their own teacher training “graduate schools” that resemble computer delivered workplace training rather than a serious professional education.

And yet, we still are able to welcome a group of young people enthusiastic about becoming teachers and eager to take up the challenges of learning to teach.

Young people have historically been attracted to teaching as a profession for various reasons.  In the early decades of the Common School movement, teaching was seen as an appropriate occupation for young, educated women until they found husbands and had children of their own.  For some portions of the teacher population, teaching was a way for a first college educated generation to take a place in a middle class profession with a reasonable salary and benefits.  As more white, middle and upper middle class women have sought careers in previously restricted fields like law and medicine, more minorities have taken up teaching (although proportions still lag behind the percentage of students who are minorities).

There are, however, reasons that teachers teach which go well beyond labor economics.  Decade after decade, talented young people seek out careers as teachers for reasons that are best labeled as affective, meaning they speak not to rational calculations of risk and reward, but that they speak to rewards that defy measurement.  Since 1975, researchers have repeated affirmed Dan Lortie’s observation that teachers rely upon “psychic rewards” rather than extrinsic compensation for affirmation of their purposes in school.   Ask a teacher about the greatest satisfactions of teaching, and you will almost certainly hear about how making a difference in child’s life matters or a specific instance of reaching a particular student with a lesson that made difficult content interesting and exciting.  Teachers consistently report that they revel in the ability to connect with students academically and personally and that a “good class” provides personal and professional satisfaction (just as a “bad class” provides personal and professional angst).  There is no external measurement of this, but it is a major part of the difference between a teacher who is happy on the job and one who is not.

Similarly, teachers tend to be people who found at least some enjoyment from school and wish to impart some of that experience to their own students.  Lortie referred to this characteristic as “continuity” meaning that teachers generally wish to continue experiencing that which was pleasant in their own education.  This can take many forms, and it should not be construed to mean that all teachers wish to be uncritical of schools and schooling.  In my years as a teacher educator, every student I have taught can point to an example of someone that he or she does NOT want to be, but the powerful visions of teaching come from those teachers they wish to emulate.  It takes time to dig down into what it actually was that made those great teachers exceptional (most of my students rely initially upon affect), but once understood, that former teacher is an even more powerful role model.

The reality is that the new class of future teachers I greeted yesterday began their teacher education many years ago when the narrative of their own education began.  That narrative is wrapped up in a 15,000 hours of time spent in classrooms from Kindergarten to 12th grade and involves all of the work done as students and impressions of work done by teachers.  Much of what they learn from this “apprenticeship of observation” is facile, and it takes a lot of hard work being introduced to the teacher’s side of the desk to understand what it means to academically and socially manage the workings of a classroom.  However, this narrative is still very precious because it contains the initial commitment a future teacher makes to her or his future students.  Without that narrative, they would not want to teach in the first place.  It is here that words like “vocation” become equally if not more important than words like “profession” when discussing how teachers learn to teach.

It is, therefore, vitally important that we keep our eyes not merely on what schools and classrooms achieve on standardized tests, but also we keep our eyes focused squarely on what kinds of places schools and classrooms are and what kinds of experiences teachers can craft for the children entrusted to them.  I know of no truly dedicated teacher who is afraid of using some data as a tool to both analyze and communicate about her or his work.  But I know many people who are rightly concerned that we have spent far too much time in the past ten year using data from high stakes standardized tests in ways that reach far beyond their utility.  I know people who are concerned that we have incentivized administrators and teachers to value test performance over genuine learning.  I know people who are concerned that the risk taking and uncertainty that accompanies real teaching is becoming too risky for teachers who are evaluated as if they are producing manufactured goods tested within tight tolerances.  I share those concerns.

We do not need to simply demand more of our teachers; we need to demand more of ourselves and of our vision for a public education.  Schools need to be places where uncertainty, risk taking and messing around with ideas is both encouraged and instructive.  Teachers need to be able to inspire their students to create meaning rather than merely fill in bubble sheets because the narrative of schooling and learning that we create for those students today does not just impact how they learn, it impacts how those among them who wish to teach will envision the role of a teacher.  How many powerful examples of passionate commitment to students, content and learning will those students encounter and incorporate into their constructs of the work and craft of teaching?  How many of them will see intangible rewards for teaching that offset the difficulty of the job and inspire them to share their love of learning with the generations that follow them?

The next generation of teachers is in our public schools right now.  We owe it to them and to the 100s of millions of students they will teach to envision schools as places of joy and passion.

1 Comment

Filed under politics, schools, Stories, teacher learning, teaching

What Really Worries Me About the Vergara Decision

On June 10th, California Judge Rolf M. Treu declared that teacher tenure laws in California deprive students of their right to an education and declared them unconstitutional.  The provisions that were specifically targeted were the time frame for awarding tenure to California teachers, seniority rules on firing of teachers colloquially known as “last in, first out” and rules for due process before removing a teacher after the initial probationary period.  Judge Treu grandly compared his decision to Brown v. Board of Education and sent shock waves through the mainstream teacher community.

I do not think the ruling is likely to survive a challenge.

First, the evidence that Judge Treu said “shocks the conscience” and was presented by the plaintiffs is not precisely rock solid.  Relying heavily upon the work of Professor Raj Chetty of Harvard University, the plaintiffs claimed that even one “grossly ineffective” teacher had long term lasting harm on student’s achievement and future economic success, and they claimed California’s tenure laws subjected students to such “grossly ineffective” teachers.  The problem here is not that there are not a discernible portion of teachers who ought to be removed, but that the Chetty research, indeed most of the research used by the plaintiffs is, to put it mildly, disputed.

Dr. Audrey Amrein-Beardsley of Arizona State University writes the blog Vamboozled to discuss research and policy around the use of value added measures of teacher performance (VAMs), and she has taken on the flaws of Dr, Chetty’s work on numerous occasions, notably here and here. Dr. Amrein-Beardsley links to critiques from other scholars as well, and the obvious message that Judge Treu missed is that this scholarship “shocks the conscience” most powerfully when one thoroughly ignores that does not represent a professional consensus among education researchers.  Indeed, it is easy to portray the handful of researchers who insist that single teacher impacts can be measured this way as outliers.  So with appeals in the works, it is hard to believe that Judge Treu’s wholesale ignoring of contrary evidence will be replicated by every judge who reviews the evidence.

Second, as Dr. Diane Ravitch of New York University explains here, the plaintiffs in the Vergara case are of questionable standing.  If the argument is that “grossly ineffective” teachers have damaging lifelong impacts on students, it would stand to reason that the plaintiffs could clearly demonstrate that they had been subjected to such teachers.  Not so much.  In fact, some of them apparently claimed that a given teacher was bad at teaching when those same teachers were widely recognized as excellent:

One of the plaintiffs (Monterroza) said that her teacher, Christine McLaughlin was a very bad teacher, but McLaughlin was Pasadena teacher of the year and has received many awards for excellent teaching (google her).

Dr. Ravitch refers to briefs by the defense that go on to note how none of the plaintiffs could tie any of the supposedly poor teachers to the specific statutes that were challenged in the lawsuit.  Appeals attorneys were certainly make use of this, and given judges more inclined to consider all the evidence, they may have successes.

I am, therefore, tentatively hopeful that this case will die or be substantively altered on appeal.  But I am still worried, and the reason is that the case provides a much desired legal win for a coordinated set of interests that have teacher unions firmly in their sights.  The plaintiffs were sponsored by the group “Students Matter” which is funded by Silicon Valley technology entrepreneur David Welch and is financially allied with charter school funders and Michelle Rhee’s “Students First” organization that similarly attacks teachers’ union protections.  Given the partisan position of the lawsuit’s backers, it was extremely troubling, if not surprising, to see Secretary of Education Arne Duncan welcome a decision that greatly undermines teachers’ workplace protections:

With strong financial backers like Welch, Rhee and organizations like the Walton Family Foundation and tacit approval from the administration, we can expect similar lawsuits in pretty much every state over the next few years.  It fits one of the favorite narratives of the education “reform” camp:  that everything hinges on teachers and if we only fire the right teachers, schools, everywhere, will improve dramatically

brace yourself

This is pernicious for a number of reasons.  First, it relies of the very shaky and often laughable claim that all it takes to close the achievement gap is enough “great teachers” in a row.  Michelle Rhee loves to repeat this claim, but the claim does not stand up to very strong scrutiny, most notably that the research basis for the claim merely extrapolated from one year gains in classrooms with an identified effective teacher instead of studying students over time.

Further, we should question the value of the metrics used to rate teacher effectiveness in the first place.  As I have written previously, the American Statistical Association’s statement on the use of VAMs warns that only 1% to 14% of student variation on test scores can be attributed to variation in teacher quality. The does not mean, by the way, that teachers have no effect, but that statistically tying the achievement gap among students as measured by standardized testing to variability in teacher quality is looking at a very narrow slice of that gap’s origins.  What else can account for persistent gaps in student test scores?  Los Angles has a Residential Income Segregation Index of 51. 54% of children in the central city live in povertyThe impacts of poverty on children are by now well documented and cannot be excluded when considering school performance. Classrooms in Los Angeles are overcrowded, sometimes to a shocking extreme. California’s woeful education expenditures place it in the company of Arkansas and below West Virginia.  But according to the proponents of the Vergara case, the only thing that matters is teacher effectiveness as rated by the test score gains made by their students, regardless of all of the other factors that may effect those scores.

And this is painful ground for teacher and student advocates.  It sounds like I am saying that teachers have little impact, but what I mean to say is that teachers matter, but not in ways that are effectively measured by the value added models based on standardized testing.  Professor Jesse Rothstein’s review of the Measures of Effective Teaching study funded by the Gates Foundation demonstrated that teachers who did very well in their value added measures did far less well in measures of students gaining higher order thinking skills, so it is highly possible that the measures favored by Vergara’s so-called expert witnesses improperly favor the wrong teachers.  Anecdotally, such measures of effectiveness miss the realities of how teachers work with students.  The worst teacher of my entire life was my seventh grade mathematics teacher who was a bully and the most demotivating individual I have ever known in my life.  However, in a community where 95% of high school graduates went on to four year colleges and universities, the depths of his ineffectiveness would have been masked by the external advantages of his students.  Influence and impact upon students can frequently be hard to see in any numbers, but they are real regardless.  I have had former students contact me via social media to express appreciation for the role I played in their development towards adulthood, and not all of those students were long term academic successes (they are, however, remarkable people…testing misses that).

That is because an effective teacher is not merely a person who extracts a pre-determined gain in a standardized test over the course of one year.  Effective teachers inspire students to take risks that may result in messy but instructive failures.  Effective teachers help student manage social and emotional challenges to become more skilled at collaboration and leadership.  Effective teachers challenge students to, as Maxine Greene phrased it, “stir” themselves and see the world in different and transformative ways.  Effective teachers may simply convince a struggling student to stay in school for the stability it provides in his or her life.

As we prepare to challenge the Vergara decision and to brace ourselves for the flood of similar suits that the likes of Michelle Rhee are undoubtedly planning, it is vital that we not only confront the highly flawed assumptions of test based teacher competence, but also that we uplift a better vision of the importance of skilled and experienced teachers.

4 Comments

Filed under Media, politics, schools, Social Justice, Testing, VAMs

Gates’ Money and Privacy Activism — Opposition to Ed. Reform Hits the Mainstream

A few stories caught a lot of eyes over the weekend.  None of that is good news for education reformers who have banked on stealth and little reporting.

The first is a major article and interview regarding the role Bill Gates’ money has played in the development of, promotion of and adoption of the Common Core State Standards in the Washington Post.  The story is not entirely complete.  For starters, it fails to disclose that David Coleman already had funding from the Gates Foundation for his Student Achievement Partners, so a meeting with Gates in 2008 is not their first intersection.  Also, it does not explore the heavy hand that Gates has also had in the push for more high stakes testing to evaluate teachers via his funding of the highly flawed Measures of Effective Teaching study, nor does it examine the role that Gates has played in enabling technology entrepreneurs to mine the data generated from those tests without parental consent.

Regardless, the article is both informative and important for several reasons.  First, it is one of the first times anyone in a major news outlet has provided a portrait of the diverse opposition to current reform efforts in education that doesn’t make it sound like mostly the work of Alex Jones style cranks.  The article even quotes academics who question whether the standards are based on sound research on how children learn or even if there is a connection between quality standards and learning.  Second, this is an article in a major outlet that does not equivocate in the slightest about how much influence one very rich man has had in trying to control the entire course of American public education.  While it does not editorialize on the question, it is hard to read how many federal, state, nonprofit, academic and corporate entities were lobbied by, influenced by or funded by Gates and not wonder what role democracy has anymore when it comes to our public schools.

Finally, Gates himself comes across as defensive and dismissive:

Gates is disdainful of the rhetoric from opponents. He sees himself as a technocrat trying to foster solutions to a profound social problem — gaping inequalities in U.S. public education — by investing in promising new ideas.

This would be more convincing if Gates displayed the slightest interest in testing new ideas before unveiling them in 45 states at once before parents and teachers have a chance to understand them, indeed, before anyone has a chance to understand if they are a net positive or not.  From Gates’ point of view and experience, this must make sense.  He has compared common standards to standardized electrical outlets and computer code as a means of allowing innovation, and certainly getting DOS on most desktop computers in the world led to a lot of software developers having a common platform.  But education is not consumer electronics, and bypassing the entirety of stakeholders who value public education for a variety of reasons was going to lead to push back, and even today, Bill Gates does not demonstrate awareness of that.

The second article appeared in Politico and was dedicated to parent activists working to protect their children from data mining operations tied to public education.  This represents another public airing of activities whose proponents would prefer to avoid being seen in the open.  The report quotes New York’s Leonie Haimson of Class Size Matters about how parents have reacted when informed about the plans of technology firms to use pretty much every bit of data they can get their hands on, and it quotes worried data entrepreneurs coming to grips with parental opposition:

Many said they had always assumed parents would support their vision: to mine vast quantities of data for insights into what’s working, and what’s not, for individual students and for the education system as a whole.

“People took for granted that parents would understand [the benefits], that it was self-evident,” said Michael Horn, a co-founder of the Clayton Christensen Institute, an education think tank.

Instead, legitimate questions about data security have mixed with alarmist rhetoric in a combustible brew that’s “spreading like wildfire” on social media, said Aimee Rogstad Guidera, executive director of the Data Quality Campaign, a nonprofit advocacy group for data-driven education.

That fear, Guidera said, “leads to people saying, ‘Shut it down. No more.’”

Guidera hopes to counter the protests by circulating videos and graphics emphasizing the value of data. But she acknowledges the outrage will be hard to rein in.

Could the parent lobby scuttle a data revolution that’s been championed by the White House, pushed by billionaire philanthropists and embraced by reformers of both parties as the best hope to improve public education? “I do have that concern,” Guidera said. “Absolutely.”

The article doesn’t go into detail about just how much money is thought to be at stake and takes the data mining firms at their word that they only want to help, but I came away from reading it with one resounding message: this damage is entirely self inflicted, but the data miners see the parent activists as the problem.  They did not want to do the hard marketing work of convincing people that they were doing something valuable, and they did not anticipate that parents might see the data generated by their children’s public educations as something they’d want to protect rather than just shovel over for free.  It is hard to sympathize here, especially when they have avoided openness from the beginning.

Which leads to the third article from today: a call from the Gates Foundation for a two year “moratorium” on high stakes decisions based upon Common Core aligned testing.  This is the first official wavering from the Gates camp since the standards and testing drive began in earnest, and it is highly significant as an indication of concern that the whole enterprise is in trouble.  It may also be a miscalculation — yes, teacher opposition to using value added measures of their effectiveness based on standardized tests is strong, and yes, teachers have barely had time to adjust to the new standards.  But two years will not fix the flaws in VAMs, and it will not assuage parental concerns about the role of testing and data mining.  It will potentially take a chunk out of testing companies and data mining companies who were making business plans based upon all Common Core states embarking on wide scale testing next year, and I find it interesting that the Gates Foundation is willing to have them cool their heels while the standards’ supporters try to do something they have avoided all along: talk in public.

Leave a comment

Filed under Activism, Common Core, Funding, Gates Foundation, Media, Privacy, Testing, VAMs

Who is more important? Pearson? Or our children?

Some background:

My wife and I have two children who are public school students in New York City.  We, as many other parents do, had our eldest tested for admission to the city’s gifted and talented program.  I’ll be honest – this child is exceptionally bright, but creative use of verbal language, imagination, story telling (our eldest’s strengths), are not really part of the tests used to qualify.  Regardless, the score was high enough to qualify for a seat which was assigned by lottery.

Our youngest sat for this year’s examinations in January. Sibling preference in admission at the G&T programs meant that if that score had qualified as well both our children would be in the same school next year.

Our youngest missed by the smallest margin.

Now I must be clear about this.  Our family does not deserve anyone’s sympathy.  It was by sheer luck of a random drawing among the many children who qualified that got our eldest a seat.  Our youngest was not owed a seat, and our zoned school is another one of the highest regarded schools in the city and is very close to the other school.  We know families who schlep across town to three different schools in pursuit of the cherry that the NYC Department of Education has placed on top the public school system.  Then there are the families whose kids qualify but for whom there are no seats because they’ve greatly overpromised what they can deliver.  Then there is the entire issue of how so many of the qualifying students are concentrated in affluent districts in the city.

So we will be fine, but since we would prefer our family’s attention to concentrate on one school for as long as possible, we took the opportunity to make an appointment with the DOE to review our youngest’s test.  That appointment was today, and we were given twenty minutes to sit with the exam and the answer key under the supervision of a DOE employee.  It was actually a more helpful experience than I anticipated, and our DOE representative was really quite delightful and very skilled at explaining the tests and how they were administered.  I can tell you the following:  We found that our child was prone to picking distractors, especially as each section of the exam progressed. We found one indisputably incorrectly scored item which means the exam is flagged for an immediate rescore.  We also found a handful of items that I strongly suspect would make my friends in measurement and quantitative methods cringe.

And that’s all that I can tell you.

You see, our child was assessed using the Otis-Lennon School Ability Test (OLSAT) and the Naglieri Nonverbal Ability Test (NNAT-2), both of which are products of Pearson, and in order to get a look at the examinations, I had to sign a non-disclosure form.  Chew on that for a minute.  An official of the New York Department of Education had me and my wife sign a form promising that we would not specifically or generally disclose the contents of an examination that was administered to our child for the purpose of selecting a public school.  The contents of that examination, several of which arguably violate principles of good test design for young children, must be kept secret even though, of course, it will be redesigned for the next year’s exams and even though I can purchase any number of OLSAT related materials directly from Pearson.

I cannot even really blame Pearson here.  They have developed the examination, and there is significant money at stake for them in a) keeping too much of their material from being seen by competitors and 2) making certain that people have to purchase exam related materials from them.

On the other hand, I have no trouble blaming craven politicians and bureaucrats who contracted Pearson and agreed to terms like this which are good for business, but bad for public discussion of education policy.  What we did today allows my family to pursue our interests as a household, but it disallows any informed discussion with the broader community about the nature of measurements that determine substantial educational opportunities.  And there are real discussions that ought to be had.  This year, three times as many children qualified for seats in the coveted citywide G&T programs as there were seats available, but these qualified children are not randomly distributed across the city.  Districts 2 and 3 in Manhattan combined for 623 of those Kindergarten aged children qualified for entry to citywide programs while districts 7,8, 9, 12 (The Bronx), 16, 23, 32 (Brooklyn), and 29 (Queens) had none.  With an income segregation index of 57 in New York City, there is an important discussion to be had about the nature of these tests and whether they identify gifted or privileged children.  But Pearson’s intellectual property is more important than that discussion.

NYRISI

Which is ironic given how eager New York was to join with InBloom, the data storage cloud service that was going to provide storage for student records and allow technology and publishing companies to mine that data to create products for sale.  It was only the vigorous activism by advocates like Leonie Haimson on Class Size Matters that put enough pressure on Albany to halt the project, but it is by no means the only one that sees student data as a commodity.

What does it say that your child’s school records are able to be used without your consent for private purposes but that private materials with profound impact upon public school children and their opportunity must be protected?

1 Comment

Filed under Pearson, Privacy, Stories, Testing

Open Letter to President Obama — You Are Listening to the Wrong People

Dear Mr. President:

I am writing to you with three different roles.  First, I am the director of secondary education and secondary/special education teacher preparation at Seton Hall University where I have been on the faculty since 2002.  Second, I am a lifelong educator whose teaching experience at levels from seventh grade to graduate school courses stretches back to 1993. Finally and most importantly, sir, I am the father of two school aged children enrolled in the public schools of New York City.  All three of those roles in life have prompted me to write to you, and it is my hope that you will seriously consider what I have to say, for it is based upon my devotion to my children, my experience as a teacher and upon the data that is readily available about what is being done to schools during your administration.

With respect, Mr. President, you are listening to all the wrong people about our nation’s schools.

When you were inaugurated, many of us in education had hoped that your administration would urge Congress to roll back the detrimental aspects of the No Child Left Behind act, which had taken the previous two decades of educational failure rhetoric and placed a punishing regimen of unreasonable expectations, high stakes testing and punishment into effect that left schools and schools systems under threat of a “failure” label if they did not achieve near miraculous score gains in standardized examinations.  Instead, we got the Race to the Top program which has taken the worst elements of NCLB and made them even worse.  Your signature education initiative incentivized participating states to enroll in rushed and unproven common standards, increases the amount of high stakes testing at all levels of public education, subjects teachers to invalid measures of job performance and creates preferential treatment for charter schools that cynically manipulate data on their enrollment and achievements, sue to prevent public oversight of the public moneys they receive and whose expansion provides new investment vehicles for the very wealthy.  All of these results have rich and powerful advocates, and all of them are damaging to our nation’s public schools.

The Common Core State Standards have been described as a state led effort because of the role of the National Governors Association in their creation, but the work of a very few people is far more directly responsible for them.  David Coleman, now President of the College Board, Jason Zimba and Susan Pimentel of Student Achievement Incorporated worked with a small group of core writers that were largely representative of the testing and publishing industries to produce K-12 standards in English Language Arts and Mathematics in less than two years.  This is a staggering pace for such a complex project, and it was conducted in clear violation of highly regarded and accepted processes for the creation of standards.  Dr. Sandra Stotsky of the University of Arkansas was a member of the validation committee that was convened, in theory, to validate the quality of the standards, but she refused to signed off on them when, by her own account, repeated efforts to have the research basis for the standards produced by the writing committees went unanswered.  Once written, the standards were rapidly adopted by states due to the incentives of Race to the Top and aggressive spending of the Bill and Melinda Gates Foundation.  Diane Ravitch of New York University has repeatedly pointed out that this process was staggeringly flawed, and even more flawed than the opaque writing and promotion efforts has been the race to roll out the standards in nearly all states simultaneously with no small scale field testing and no known way for data from the implementation to be fed back to any body that is tasked with revising the standards based on such data.

Mr. Bill Gates seems enormously confident, absent any defensible evidence, that this is the correct path.  He provided funding to Student Achievement Incorporated and the National Governors Association, and has been spending lavishly since 2010 to make certain all forms of organizations continue to boost the standards.  Mr. Gates spoke this year at the Teaching and Learning Conference hosted by the National Board for Professional Teaching Standards (an organization he has given grants to recently), and his defense of national standards was telling.  According to the Washington Post:

Standardization is especially important to allow for innovation in the classroom, said Gates, who used an analogy of electrical outlets.

“If you have 50 different plug types, appliances wouldn’t be available and would be very expensive,” he said. But once an electric outlet becomes standardized, many companies can design appliances and competition ensues, creating variety and better prices for consumers, he said.

The version posted to the Gates Foundation website offers a more explanatory framing of the metaphor, but Mr. President, I hope the flaw in his thinking is evident.  Multi-state standards are not, inherently, a bad thing, primarily if used like the National Assessment of Educational Progress as a NO STAKES diagnostic tool, and Mr. Gates is correct that a variety of INDUSTRY standards have led to consumer innovations.  However, even after we accept a standard for early literacy acquisition to be age appropriate and based on research into how children learn to read, the process by which any given child meets that standard is vastly more complex than the process of attaching an electric motor to a hand blender; worse, it does not demonstrate an understanding that children develop at very varied rates, and that an age appropriate target for one child may be entirely inappropriate for a peer in the same classroom.

Even assuming that Mr. Gates is correct and that CCSS would allow teachers to innovate, Race to the Top and Mr. Gates’ own advocacy have worked to tie the CCSS to a regimen of high stakes testing the likes of which we have never seen and which are already incentivizing teachers and school districts to vastly narrow their teaching in response.  Mr. President, policy analysts refer to perverse incentives as those elements of policy that incentivize behavior in such a way that people can obtain the incentive while engaging in practices that are damaging or undesirable.  In this case, Race to the Top is the Mother of All Perverse Incentives.  Your administration required states to adopt test-based evaluation of teachers in addition to adoption of common standards.  This has resulted in states both enrolling in the CCSS testing consortia, and adopting Value Added Models (VAM) of teacher effectiveness as part of teacher assessment and retention.  Mr. President, you recently remarked that schools should not be teaching to the test even while your administration was stripping Washington State of its NCLB waiver over its desire to not use high stakes testing to evaluate teachers, but you could do little that incentivizes teaching to the test more than this.  Michelle Rhee’s tenure as D.C. Schools Chancellor provides an instructive anecdote.  Despite her denials and cursory investigation, it is very clear that her “raise test scores or be fired” approach spawned widespread cheating. That behavior is not excusable, but it is evidence of how far some people placed in extraordinarily difficult circumstances will go when subject to such incentives, and it is simply inevitable that short of cheating, the use of VAMs in teacher evaluation will result in more teaching to the test.

And VAMs themselves are invalid, Mr. President.  The American Statistical Association is quite clear on this in its recent statement on the use of VAMs for teacher evaluation.

The measure of student achievement is typically a score on a standardized test, and VAMs are only as good as the data fed into them. Ideally, tests should fully measure student achievement with respect to the curriculum objectives and content standards adopted by the state, in both breadth and depth. In practice, no test meets this stringent standard, and it needs to be recognized that, at best, most VAMs predict only performance on the test and not necessarily long-range learning outcomes. Other student outcomes are predicted only to the extent that they are correlated with test scores. A teacher’s efforts to encourage students’ creativity or help colleagues improve their instruction, for example, are not explicitly recognized in VAMs…

It is unknown how full implementation of an accountability system incorporating test-based indicators, such as those derived from VAMs, will affect the actions and dispositions of teachers, principals and other educators. Perceptions of transparency, fairness and credibility will be crucial in determining the degree of success of the system as a whole in achieving its goals of improving the quality of teaching. Given the unpredictability of such complex interacting forces, it is difficult to anticipate how the education system as a whole will be affected and how the educator labor market will respond.

This is clear-cut, sir.  There are no current high stakes tests that meet the requirements of a well developed VAM, and there is no evidence about how VAMs will influence the schools in which they are deployed, but your signature education program is incentivizing them anyway.

To date, no study reliably shows that current VAMs can be used the way they are going to be used over the next few years, but that has not stopped the Gates Foundation from being front and center in this issue as well.  The Gates commissioned “Measures of Effective Teaching” study concluded that VAMs can be effectively used to evaluate teachers, but Jesse Rothstein of the University of California at Berkeley demonstrated clearly how flawed the study was, especially how it drew conclusions only weakly supported by its own data:

The results presented in the report do not support the conclusions drawn from them. This is especially troubling because the Gates Foundation has widely circulated a stand-alone policy brief (with the same title as the research report) that omits the full analysis, so even careful readers will be unaware of the weak evidentiary basis for its conclusions…

Hence, while the report’s conclusion that teachers who perform well on one measure “tend to” do well on the other is technically correct, the tendency is shockingly weak.  As discussed below (and in contrast to many media summaries of the MET study), this important result casts substantial doubt on the utility of student test score gains as a measure of teacher effectiveness.  Moreover, the focus on the stable components – which cannot be observed directly but whose properties are inferred by researchers based on comparisons between classes taught be the same teacher – inflates the correlations among measures.  Around 45% of teacher who appear based on the actually-observed scores to be at the 80th percentile on one measure are in fact below average on the other. Although this problem would decrease if information from multiple years (or multiple courses in the same year) were averaged, in realistic settings misclassification rates would remain much higher than the already high rates inferred for the stable components.

It is almost inconceivable how it is that our nation is rushing forward with a package of reforms that are being implemented at breakneck speed with such damaging potential and with so little evidence to suggest that they will do anyone any good, and with mounting evidence that they are objectively harmful.  But one thing is actually very certain: these “reforms” and their attendant policies are making some people a substantial profit.

Three years ago, education writer and consultant and former National Board Certified Teacher Nancy Flanagan noted that the rush for CCSS implementation meant that a publishing bonanza was on the horizon.   Certainly, their implementation with the coming testing requirements has been a bonanza for Pearson who landed the contract to write and implement the Partnership for Assessment of Readiness for College and Careers (PARCC)  testing consortium.  At a predicted cost of 24 dollars for a set of tests as the math and ELA testing comes on line, Pearson is guaranteed a huge new income stream from the more than 10 million students currently in PARCC states.  But Pearson is only the most public face of making money off of the reforms put in place by your administration.  Common standards and mass testing generate vast amount of data, and technology companies are starting up all intending to mine that data for profit.  This is ground that has been ploughed by Rupert Murdoch who, when he began acquiring education technology firms, identified a “500 billion dollar sector” waiting for “big breakthroughs”.  Bill Gates has also been involved in this sector, setting up the data cloud storage firm InBloom for 100 million dollars, and watching it close when parental concerns over data security and the plan to allow vendors to access the data could not be overcome.  But other firms such as Knewton intend to continue data mining and creating products based upon that analysis, and none of them, regardless of how intriguing their products might be, demonstrate sufficient care about the need to explain their services to parents, the need to allow parents and guardians to opt their children out of the data pool or the need to build real support among the people whose children are being transformed into revenue.

I am asking you as a father, sir: would this be acceptable to you?  I regret to inform you, Mr. President, that your own administration has abetted this by changing the regulations that implement the Federal Education Rights and Privacy Act.

Publishers, testing companies and technology firms are not the only ones who are reaping new windfalls from your education policies, Mr. President.  It turns out that Wall Street investors are eager to see another aspect of Race to the Top, charter school expansion, continue as rapidly as everything else, and while many of them proclaim to be fans of the charter schools’ alleged “successes” it is also clear that many of them have also figured out how to make guaranteed money from supporting charter schools.  Hedge fund billionaires can use a combination of federal tax credits to make investing in charter school construction a vehicle that can guarantee a doubled return within 7 years.  This is entirely unlike traditional school construction funding via bond issues because such bond issues are done in the open and for a public with a vote for or against the responsible school boards.  This is done entirely in private and with no oversight and precious little public knowledge.  It is little wonder then that Wall Street interests are not only investing in charter school construction, they are also organizing PACs such as Democrats for Education Reform specifically to keep state governments granting more and more charters, something else that you enabled with the provisions of Race to the Top.

You might be able to justify this, Mr. President if you could claim that charter schools are actually the solution to American education, but to make that claim you would have to ignore evidence.  Many charters are excellent schools.  Many are terrible.  But there is no evidence that the charter school segment is consistently outperforming fully public schools.  There is, however, evidence that charter schools do not educate children with disabilities at comparable levels as fully public schools.  There is evidence that charter schools do not serve students who are English Language Learners like their fully public peer schools do.  There is evidence that one of the most prominent charter operators in New York City, Eva Moskowitz of Success Academy, is not telling the truth about the number of children in poverty that she serves, the real achievements of her schools test scores, or the rate of attrition for students with disabilities and language learning issues.

These schools are not miracle factories, Mr. President, but supporting their expansion is making people money.  Your Secretary of Education, Arne Duncan, once opined that Hurricane Katrina was the “best thing” ever for New Orleans Schools because it shook up the status quo and got people “serious” about reform.  That “reform” has meant that this week, the last public school in New Orleans has closed for good, and the city school system in entirely comprised of charter schools.  Amidst growing evidence that many prominent charter operators are not equally educating students and amidst disturbing studies about rising segregation in the charter sector, I cannot help but wonder how Secretary Duncan justifies his statement today.

No wonder teacher morale is at an all time low.

Your public voice in these issues has been a disaster for you, Mr. President.  Secretary Duncan may be the most controversial person to hold that office since its creation, and he has repeatedly demonstrated that he is both insensitive to teacher and parental concerns and fully vested in a false narrative about American education.  Mr. Duncan has frequently repeated to charges from corporate reformers and privatizers that American education is stagnant and that we can infer a need for their favored reforms from international testing data.  This is part of a narrative of deepening failure which thoroughly ignores how American students have never fared well on such measures and how these scores and our economic health have little connection.  Mr. Duncan has observed that he believes our teachers are not educated enough and we should be more like South Korea, despite the fact that South Korea’s educational “success” comes with high costs:  20% of family income on average spent on private “cram” classes, focus on drill and rote learning that leads to high test scores, and wide recognition that South Korean children face too much pressure, leading to an alarming youth suicide rate.  This is hardly praise worthy, sir.

Secretary Duncan’s misunderstanding extends to why people are criticizing the CCSS and other Race to the Top reforms.  I am sure that you know how he said that Common Core opponents are often “white suburban moms” who are upset to find out their children are not “as brilliant as they thought they were”.  Mr. Duncan apologized for the remark, but his insinuation that any opposition to CCSS is unreasonable betrays that he really does not understand the issue.  Mr. President, American parents, by wide margins, believe that the schools their children attend are doing very good work, and despite three decades of an unrelenting failure narrative, that percentage, over 70%, has remained stable.  What parents are saying is that Common Core, evaluating teachers by tests and the increase in high stakes testing and heavy pressure on schools to raise test scores at all costs have come too rapidly, with too little transparency, and with extreme negatives vis-a-vis how children experience school.  Mr. Duncan does not understand that as evidenced by his remarks in April with NY Commissioner John King where he called parental protests “drama and noise.”  Mr. Duncan may call the 10s of 1000s of families who have opted out of Pearson’s testing and the list of districts refusing to field test the exams “drama and noise”.  Many, myself included, call it a movement that is ignored and dismissed at peril.  I do not know if your Secretary of Education has told you that most opposition to reform comes from Glenn Beck styled cranks and spoiled suburbanites, but if he has, you have been sorely misinformed.

Mr. President, in 1999 Congress passed the Gramm-Leach-Bliley Act, also known as the Financial Services Modernization Act, and President Clinton signed it into law.  Although the trends in mortgage lending and investment products that led to the financial crisis had begun long before 1999, the removal of regulations that prevented commercial and investment banks and insurance firms from blending their businesses greatly accelerated the damage being done to our financial industry.

Mr. President, I am afraid that history will look upon Race to the Top as your Financial Services Modernization Act, a tool crafted to be cynically misappropriated by interests with no concern for the public good.

And what is so frustrating, Mr. President, is how entirely unnecessary this judgment of history will be.  Our schools need help, sir, but it is not help that will be found by racing to implement new standards, layering on more high stakes tests, threatening teachers’ livelihoods with invalid statistical models or by turning more and more of our urban school districts over to for profit charter school corporations.  Our schools are afflicted by the same thing that afflicts our society: rising poverty and constant cuts to assistance for the poor.  16 million children in the United States live in poverty; that is 22% of all children, 38.2% of all African American children and 35% of Hispanic children.  Our schools serve communities, and our segregation by income has increased over the past 30 years, meaning that both rich and poor increasingly live in communities with people mostly of their own income level.  The Residential Income Segregation Index (RISI) scores for Houston, Dallas, New York, Los Angeles and Philadelphia are all above 50, and the RISI has gone up in every region of the country since 1980.  Nationally, it is 46, an increase of 39% since 1980.

We see this when we look at our PISA scores broken down by the income characteristics of communities.  According to USC Professor Emeritus Stephen Krashen, the portrait of America’s schools look very different when poverty characteristics are considered.  In schools where less than 10% of the students qualify for free and reduced lunch, our PISA scores are higher than the average for any OECD nation, but where 75% or more of students are in poverty, the PISA scores are second to last.  Given that our communities are increasingly segregated by income, Mr. President, it is inevitable that test score data compared nation to nation will be misleading.

It is at this point that Arne Duncan, Michelle Rhee, Joel Klein, Eva Moskowitz, Andrew Cuomo, Bill Gates, Whitney Tilson, and a host of other corporate “reformers” will line up to accuse me of making “excuses” for “bad schools”.  They will insist, absent any evidence, that “great teachers” can close the achievement gap even if we completely fail to address poverty in our communities.  But it is not “making excuses” to insist that if we want a child living in poverty to succeed in school that we cannot ignore whether or not she knows if she is going to eat tonight, or if she will have a place to sleep, or if her parents will continue to work or any of the host of other matters that afflict children in poverty in ways that negatively impact their formal education.  Mr. President, we have known the long term impacts of poverty on children for some time now just as we have known that it has been growing and deepening, and we spend far less than our peer nations on helping to alleviate the detrimental impacts of poverty.  Nothing in education policy in the past three decades has done anything to address that.

That is not “excuse making,” Mr. President, that is aiming the analysis at the actual problem, whether or not addressing the problem will make anyone a profit.

You have an advantage that few of your predecessors had, Mr. President, and it is your demonstrated interest in and ability to genuinely listen to others.  Joshua Dubois wrote about your meetings with the families at Sandy Hook Elementary School, and how for hours, you sat, embraced, asked questions and listened to them. What strikes me, sir, is how, despite an election year warming up, you never once mentioned this to the press and never once used this remarkable testament to your character for political gain.  I urge you, Mr. President, to visit teachers, parents and children in the same manner, without cameras or vetting, and just ask them what they want our schools to be.  You will not find their answers easily mapped onto your education policies.

It is not too late for you to have a transformational impact on America’s schools, Mr. President, but it will take a number of immediate actions to have a chance.  I ask you to consider the following, badly needed, steps:

  1. Scrap Race to the Top: Your signature education policy is detrimental to children, teachers, schools and communities.  Ending it will not do away with the Common Core State Standards, testing or charter schools, but it will free states and districts to look truly reflectively at these initiatives and to voluntarily engage in as little or as much of them as they deem necessary and beneficial.  It will require proponents of these policies to make their cases in full view of the public in all 50 states instead of hiding behind coercive requirements for federal funding.
  2. Restore Federal Privacy Protections: Technology entrepreneurs may have truly powerful learning tools in development, but to make them work, they need student records deemed private under federal law.  Instead of engaging teachers and parents about these tools, they got your administration to revise regulations and are now mining those records without any meaningful consent.  This is unacceptable, and it must stop.  Our children are not sent to public school to be monetized without our consent.  Parents will listen to open and honest efforts to describe how these tools can benefit their children, but they will oppose efforts to bypass them.
  3. Be Serious About Holding Charter Schools Accountable to Civil Rights Legislation: Your administration recently expressed interest in making certain that charter schools meet federal civil rights requirements.  This is a good first step.  It must be applied vigorously, especially given how poorly many high profile charter operators do in serving students with disabilities, educating English Language Learners and retaining students of color after admission.  Your administration has granted enormous favoritism to charter schools, and they must be made fully accountable.
  4. Demand a Marshall Plan for School Aid and Construction:  Nearly all states are spending less money per pupil today than in 2008. In New York State, the average school district still receives $3.1 million less in state aid than they would have without budgetary tricks like the Gap Elimination Adjustment.  All across the country, our public schools are being told to implement a complex new curriculum, meet unrealistic testing requirements and to do so while having their budgets cut to the bone.  Further, in 2008, the AFT commissioned a study that estimated a need for over $250 billion in school infrastructure spending nationwide, a need that remains unmet.  It adds insult to injury that students come from homes that suffer from the deprivations of poverty and arrive in schools that are cold in the winter, hot in the summer and wet when it rains.  Our nation must do something about this.  At the same time, you must highlight schools where children in poverty thrive, not merely where they get good test scores.
  5. Replace Secretary Duncan: Mr. Duncan is entwined so deeply in the Race to the Top approach to reform that he is incapable of moving away from it.  Your Secretary of Education demonstrates no understanding of why people oppose current reforms, little willingness to see his mistakes as more than verbal slip ups, and he consistently misuses international test data to denigrate the quality of our schools and teachers.  If you want to protect our schools from the forces of corporate reform, Secretary Duncan cannot lead.

You have an opportunity, Mr. President, to retask the federal Department of Education with protecting our national Commons, our history of 200 years of seeing public education as a public good for communities and a private good for individuals.  Your administration has abetted the use of our public schools by private and corporate interests in ways that are actually detrimental to education.  If you wish that to not be your legacy, you must act now.

Sincerely,

Daniel S. Katz, Ph.D.

Director, Secondary and Secondary/Special Education Teacher Preparation, Seton Hall University

Career Educator

Father of Two Public School Children

 

 

Leave a comment

Filed under Activism, charter schools, Common Core, DFER, Gates Foundation, politics, Privacy, schools, Social Justice, Stories, teaching, Testing, VAMs

Can We Talk About Poverty And Violence NOW?

I became aware of this via a graduate school colleague.  Research from the CDC and Harvard University identifies that as much as 30% of young people in our urban areas suffer from Post Traumatic Stress Disorder as the result of living in communities afflicted by violence, a rate higher than soldiers returning from Iraq and Afghanistan.  This citation recently went viral because of report on a San Francisco CBS affiliate that mentioned the research — while deciding to coin the phrase “hood disease” to describe the phenomenon.  Response to that polarizing and sensationalist turn of phrase was swift, and it was well earned.  Hopefully, it will not obscure a chance to focus on a conversation that is desperately missing from today’s education conversation — the impact of poverty and violence on children and what it means to provide meaningful education for those children.

I am not optimistic, unfortunately.  Discussing the impacts of poverty and community violence on children would mean taking a good hard look at American society as a whole, how segregated we remain as a society (and how it is getting worse since 1980), how poorly we do as a country at helping families in poverty and how we largely ignore problems that are clustered in communities that are predominantly of color. I find it hard to believe that we are ready for a conversation today.  It would require more willingness for painful introspection and confrontation of racism that many prefer to believe does not exist.

Optimism is further undercut by the fact that the impacts of poverty on all sorts of outcomes for young people is not precisely news, although the PTSD estimates for community violence should cause more people to take notice.  “Effects of Poverty on Children” was published in 1997 and found vast differences in physical, cognitive, school achievement, and emotional and behavioral outcomes for children living in poverty, and it described the ways in which poverty influences these outcomes.  They recommended community health, parental education, in home interventions, and renewed efforts to eliminate deep, sustained poverty.  Not one of these recommendations found their way into the Bush era No Child Left Behind education reform bill nor into its Obama administration successor, Race to the Top.  Arizona State University Regents’ Professor Emeritus David Berliner delivered the Presidential Invited Speech at the 2005 meeting of the American Educational Research Association, and he titled in “Our Impoverished View of Education Reform.”  Among his conclusions:

All I am saying in this essay is that I am tired of acting like the schools, all alone, can do what is needed to help more people achieve higher levels of academic performance in our society. As Jean Anyon (1997, p. 168) put it “Attempting to fix inner city schools without fixing the city in which they are embedded is like trying to clean the air on one side of a screen door.”

To clean the air on both sides of the screen door we need to begin thinking about building a two-way system of accountability for contemporary America. The obligation that we educators have accepted to be accountable to our communities must become reciprocal. Our communities must also be accountable to those of us who work in the schools, and they can do this by creating social conditions for our nation that allow us to do our jobs well. Accountability is a two way process, it requires a principal and an agent. For too long schools have thought of themselves only as agents who must meet the demands of the principal, often the local community, state, or federal government. It is time for principals (and other school leaders) to become principals. That is, school people need to see communities as agents as well as principals and hold communities to standards that insure all our children are accorded the opportunities necessary for growing well.

It does take a whole village to raise a child, and we actually know a little bit about how to do that. What we seem not to know how to do in modern America is to raise the village, to promote communal values that insure that all our children will prosper. We need to face the fact that our whole society needs to be held as accountable for providing healthy children ready to learn, as our schools are for delivering quality instruction. One-way accountability, where we are always blaming the schools for the faults that we find, is neither just, nor likely to solve the problems we want to address.

But since that address in 2005, “one-way accountability” has not only dominated policy, it has actually spawned an entire industrial scaled investment in testing and data, entrenching it even deeper.  Even though it has very little to do with the issues that plague impoverished communities in our country and the schools that try to serve them.

Most of what you’ve read about our “failing” national schools is based on flawed data.  Even using the preferred tool of accountability advocates, standardized tests, the crisis in our public schools is one of community poverty.  This graphic comes courtesy of Christine McCarthy, a New York City public school teacher and recipient of a Distinguished Fullbright Award in Teaching:

Image

Stephen Krashen, professor emeritus at USC provides the data for this chart which should make it crystal clear that the constant doubling down on standards and testing will have no serious impact on the international testing gaps that produce such gnashing on the teeth in the media and in Washington.  A test does not alleviate the well documented impacts of poverty.  Firing a teacher whose students are performing poorly on a test does not alleviate the well documented impacts of poverty.

It is at this junction, that a Michelle Rhee or Joel Klein comes along, sometimes on a talk show, to say that there should be “no excuses” for even a school with a 75% or higher poverty rate.  Their preferred “no excuses” methods involve firing as many people as they can, closing down schools and turning more and more children over to charter school operators.  Certainly, many of those operators like to claim that they’ve found the “secret sauce” to educating within communities afflicted by high rates of poverty.  Eva Moskowitz’s “Success Academy” empire claims that it is educating the exact same students as the neighborhood schools in Harlem, but that claim is simply false, and a parent at Upper West Side Success documented on tape how administrators have tried to counsel out her son who has an IEP, something no neighborhood school could do.  Northstar Academy in Newark loves to claim at 100% graduation rate for seniors, but it fails to report its 50% attrition rate prior to senior year.

The lesson here is that there is no “special sauce” and “Superman” is a comic book hero.  We, as a society, have never figured out a way to provide large scale, genuine, educational opportunity to children growing up in communities with deep and persistent poverty.  We, as a society, are woefully uncommitted to alleviating poverty and have even come to accept the terrifying 20% rate of childhood poverty as normal and perhaps inevitable.  But absent those two commitments, no amount of firing teachers or testing students until they cry is going to “fix” American education.

And this is where I worry for the future again:  I think it is very likely that a combination of suburban parental outrage and teacher activism is going to push back hard on current reforms.  If Common Core survives, it will be substantially modified with fewer tests and less emphasis on value added models of teacher evaluation.  The fact is that pushing the punishment narrative that has been the burden of urban schools for so long to communities that generally like their schools is going to create a backlash.  But once those parents have pushed back and changed these systems, we will still be left with communities rife with damaging poverty and violence, and we will most likely go back to ignoring those facts.

And the next cycle of “reform” will ignore it too.

Leave a comment

Filed under charter schools, politics, schools, Social Justice, teaching, Testing, VAMs

Randi Weingarten Admits the Common Core is in Trouble

President of the American Federation of Teachers, Randi Weingarten, has taken some criticism for her support of the Common Core State Standards.  She still believes that they have potential to be beneficial, but in an interview with Salon.com yesterday, she also admitted that they might fail.  Weingarten leveled a substantial amount of her criticism at the testing and evaluation policies that have come coupled to the CCSS, especially the secrecy that testing giant Pearson has tied to its contracts for CCSS tests.  Five of the union president’s points:

These standards were done by the states — the governors and the state chiefs — in a very rapid fashion, and there was not enough conversation and discussion about what they were, and how they would be implemented. Number 1.

 

Number 2, as a result, there are problems in the standards, particularly as applied to [grades] K through 2 … They seem to be developmentally inappropriate for the earliest of kids …

 

Number 3: … The state tried to copyright the standards. [There’s] one thing about education that’s absolutely imperative, which is that you try things, and you adjust, and you have a continuous learning process. The copyright suggests they’re fixed in slate, and that’s just wrong …

 

Number 4: There was more work that was done about testing of the standards and the assessment process, than actually the implementation. And that’s why many people believe that this is about a testing process, not about a learning process.

 

And so — Number 5 — you get to what happened in New York and other places, where all of the sudden, the state commissioner last year said the scores will go down 30 points – and then magically the scores went down 30 points. So most people then distrusted what was going on here. Was this about actually helping kids get higher standards? Or was this about trying to create a sense of failure in the public system?

If, as Weingarten states several time, implementation of standards is “90-95%” of what matters, then these criticisms are welcome but also overdue.  All five of those concerns have been evident for some time as the Obama administration and CCSS boosters outside of government have been rushing this implementation and rushing the linkage to high stakes testing for teacher evaluation ahead at a truly breakneck pace.  Weingarten is absolutely correct when she asserts:

I think the teachers, the parents … have become so frustrated with standardization, and with top-down accountability and being told what to do without being given the resources to do it, and having testing before teaching, that they’ve gotten so frustrated that they just don’t trust the transition to standards anymore.

But the thing is that anyone with an understanding of American education, as she has, should have seen that frustration coming years away.  That frustration was built into the Race to the Top grants which pressured states to adopt valued added models of teacher evaluation using common assessments.  Since then, almost all work around Common Core has been to essentially monetize it either via testing, curriculum or technology materials while teachers and students across the country struggle with staff cut backs and delayed school improvement budgets.  Parents and guardians, who by wide margins approve of and appreciate what their children’s teachers do, were bound to notice.

Regardless, I do welcome Randi Weingarten sounding this alarm.  That she believes the standards have potential to do good is not an opinion she is alone in having, but what really stands out is that she is the first high level supporter of the CCSS who is publically willing to admit that they are in trouble and that they are in trouble because the implementation is running roughshod over teachers and students.  Who else is willing to admit to this?  Certainly not Arne Duncan.  Absolutely not John King.  Not Bill Gates.

But they should.

 

Leave a comment

Filed under Common Core, Gates Foundation, Media, politics, Testing

How Andrew Cuomo Has Lost My Vote

Andrew Cuomo has lost my vote — and if you are a teacher, a parent of a public school child or a citizen who sees schools as a vital component of our civil society, he should lose your vote too.  He has been as abusive towards our public schools and the people who work in them as have Republican governors such as Scott Walker and Chris Christie, only without the national spotlight aimed at his policies.  My conservative friends will probably suggest this has to do with media bias, and I won’t deny some possibility of that.  However, a simpler explanation is that Governor Cuomo, unlike Governors Walker and Christie, has done little to highlight his conflicts with unionized teachers — it would do him little good with his core constituencies at home or nationally to do so.

Regardless, he has been a net negative for schools and teachers although you would not have guessed it reading his inaugural address in 2011.  That speech had no mention of education or teachers and the only mention of school was a personal anecdote.  The same speech mentioned taxes or taxpayers seven times, budget three times and the deficit eight times in one short paragraph, claiming there was a deficit of trust and competence as well as a budgetary one.

It has become clear since then that even if he did not mention education in his address, he had education in his sights and it wasn’t to make sure school districts had the funds they need to guarantee educational opportunity for all.  One of the governor’s early achievements was a cap on property taxes   that may have helped many home owners but has also left many school districts scrambling for funds.  At the same time, Albany continued the “gap elimination adjustment” which became permanent in the 2011-2012 budget year.  In the GEA, Albany allocates school aid and then uses a formula to take it away…or even increases the amount of money removed from school aid if the state projects a shortfall in revenue.  Essentially, this is a formula that allows the legislature and the governor to announce a school aid budget and then to trim it when nobody is looking.  According to the New York State School Boards association, the GEA has cost New York districts an average of $3.1 million dollars per year each year since 2010.  64% of districts have cut personnel, 53% have increased class sizes and 36% have reduced or eliminated extracurricular activities.

None of this is good for the children of New York, but it certainly helps Governor Cuomo keep from ever considering higher taxes.  By the way, when you search the New York Times for “gap elimination adjustment” this is what comes up.  Too obscure for even the Times’ New York reporting, you have to go to local and regional papers to find comprehensive coverage.

While finding ways to trim the money available locally and at the state level, the Governor has also aggressively pursued state pension reform.  This is hardly unique to New York, but the demands to reform how career teachers retire comes at a time when teachers are being asked to do more than ever before…with less in the present and promises of less in the future.  Governor Cuomo is solidly behind the current reform environment which means the state is not only implementing the Common Core State Standards, but also the state is implementing test score driven evaluation of teachers.  While recent statements from the governor indicate a willingness to delay or reweight the degree to which student test scores will impact both student promotion and teacher evaluation, Commissioner John King was unambiguous that Albany believes it is on the right path for schools and will plow ahead.  Plowing ahead means teachers with larger class sizes and fewer support personnel having to quickly implement a new and complicated set of curriculum standards in all grades simultaneously and simultaneously having to face their retention and tenure decisions being based upon the result of tests that have resulted in dramatic declines across the board.

All of this in a budget environment where NYC parents are being asked to fund raise so schools can hire elementary reading specialists.  Schools lucky enough to have parents who are wealthy and connected maintain essential services.  Other schools?  Well, at least Andrew Cuomo doesn’t have to raise anyone’s taxes.

Balancing the budget on the backs of school children and public employees is unpleasant enough on its own, but Governor Cuomo’s behavior during the recent public battle between charter school magnate Eva Moskowitz and New York Mayor Bill de Blasio was beyond the pale.  The narrative should be familiar to New York residents.  In the waning days of his administration, Mayor Michael Bloomberg hastily granted a number of new colocations for charter schools in the city, including either new or newly expanded sites for Moskowitz’s Success Academy chain.  Mayor de Blasio granted most of these colocations, where a charter operator is allowed to take over space in an existing public school building without paying rent to the city.  Charter school advocates claim that paying for their space would put charters at a disadvantage compared to existing public schools, which they claim to be. But  Moskowitz herself sued the state of New York to prevent the Comptroller from auditing and succeeded in having a law struck down that granted the Comptroller that authority.  Her argument?  Her schools are not a “unit of the state”. Ponder that: her schools accept public funds and demand space in public school buildings without rent, but the state’s top financial officer has no authority to examine her books.  And she sued to make it that way.

Moskowitz stormed to Albany with her students claiming that the new mayor has declared war on her, but many of her claims fail to stand up to the slightest scrutiny.  Among the most damning highlights is that by halting one of the colocations, Mayor de Blasio was trying to prevent one third of the severely disabled students in one building from being displaced and sent all over the city.  Moskowitz likes to make lofty claims for her schools’ accomplishments drawing from a population that she alleges is among the city’s neediest.  Sadly, these claims are heavily embellished as well.  While Success Academy test scores are indeed high, there is no metric that makes Success Academy 4 the “highest performing school in the state,” and even though admission to charter schools is by lottery, remaining there is not guaranteed — and Moskowitz’s schools have exceptionally high attrition rates, especially among students who do not test well.  Diane Ravitch of NYU and Avi Blaustein note:

In just four years Harlem Success Academy 4 has lost over 21 percent of its students. The pattern of students leaving is not random. Students with low test scores, English Language Learners, and special education students are most likely to disappear from the school’s roster. Large numbers of students disappear beginning in 3rd grade, but not in the earlier grades. No natural pattern of student mobility can explain the sudden disappearance of students at the grade when state testing just happens to begin.

Given these issues, it was disturbing enough to watch Governor Cuomo rush to Moskowitz’s side during her “Save Eva” rally in Albany on the same day that Mayor de Blasio was rallying for support of a universal prekindergarten proposal for New York City.  But what has come out since then is simply inexcusable.  Not only did Cuomo show up to stand by Moskowitz, he actively participated in making the rally happen, and the result of that public pressure and multimillion dollar ad blitz got us a New York state budget that expressly forbids charging charter school rent in public schools and forces the city to pay charter schools’ rents if they cannot colocate.

The fact is that Eva Mokowitz has very wealthy friends.  The NY Times article makes clear that Governor Cuomo relies on campaign donations from Wall Street patrons of charter schools who helped fund the advertising backlash against Mayor de Blasio:

A lot was riding on the debate for Mr. Cuomo. A number of his largest financial backers, some of the biggest names on Wall Street, also happened to be staunch supporters of charter schools. According to campaign finance records, Mr. Cuomo’s re-election campaign has received hundreds of thousands of dollars from charter school supporters, including William A. Ackman, Carl C. Icahn, Bruce Kovner and Daniel Nir.

Kenneth G. Langone, a founder of Home Depot who sits on a prominent charter school board, gave $50,000 to Mr. Cuomo’s campaign last year. He said that when the governor asked him to lead a group of Republicans supporting his re-election, he agreed because of Mr. Cuomo’s support for charter schools.

Campaign filings show that the governor’s re-election campaign has collected over $400,000 in donations from wealthy donors who are also supporters of the Success Academy chain, including $65,000 directly from Moskowitz’s own political action committee. Mercedes Schneider, a Louisiana teacher, Ph.D. in statistics and education blogger, has extensively examined Success Academy tax documents with illuminating results, including that the IRS contact reported for Harlem Success Academy is Luxor Capital Group.

I don’t pretend to know why Wall Street big money is so invested in charter schools.  Perhaps they sincerely believe that competition from privately run charter schools that their own children will never attend is a “secret sauce” to improving universal education in this country.  Maybe they see charters as an effective tool against one of the last largely unionized work forces in America.  Perhaps expanding charters is seen as a key factor in setting up education as a massive data collection enterprise where entrepreneurs can turn data into profitable technology products.  It could be any number of factors, but one thing is certain: those factors are not being debated in public as part of the exercise of democratic control of public education.  It is almost entirely privately debated for private purposes.

And that is why Andrew Cuomo cannot have my vote.  He has made it very clear that he is not for public schools, public school teachers or public school students.  Those people have been continuously squeezed by local revenue roadblocks and state revenue take backs at a time when they have had to do more and more for higher and higher stakes.

He is, however, very much for what hedge fund campaign donors are for.  Those people have not been asked for a cent more in taxes and have their pet projects enshrined in the state budget.

If you are a student in New York, a parent of a student in New York, or a teacher in New York, Andrew Cuomo is not your governor, and he does not deserve your vote.

ADDENDUM:  There are reasons why hedge funds promote charter schools.  They are, surprise, linked to profit.

 

1 Comment

Filed under politics, schools, Testing

Vamboozled on the ASA Statement on Value Added Models

Audrey Amrein-Beardsley of Vamboozled just added the official statement from the American Statistical Association to her list of top articles on Value Added Models (VAMs) for education assessment.  The full statement can be found here, and it is a doozy.  Well, I say “doozy” because I know quite a few people who specialize in quantitative analysis and quotes like this count as pretty harsh condemnation:

VAMs are generally based on standardized test scores, and do not directly measure potential teacher contributions toward other student outcomes.

That means VAMs are limited.

VAMs typically measure correlation, not causation: Effects – positive or negative – attributed to a teacher may actually be caused by other factors that are not captured inthe model.

That means that VAMs used as the main means of teacher assessment are missing things…potentially very important things.

Under some conditions, VAM scores and rankings can change substantially when a different model or test is used, and a thorough analysis should be undertaken to evaluate the sensitivity of estimates to different models.

That means some VAMs are not exactly reliable. Page four lays it out in pretty clear language to me:

The measure of student achievement is typically a score on a standardized test, and VAMs are only as good as the data fed into them. Ideally, tests should fully measure student achievement with respect to the curriculum objectives and content standards adopted by the state, in both breadth and depth. In practice, no test meets this stringent standard, and it needs to be recognized that, at best, most VAMs predict only performance on the test and not necessarily long-range learning outcomes. Other student outcomes are predicted only to the extent that they are correlated with test scores. A teacher’s efforts to encourage students’ creativity or help colleagues improve their instruction, for example, are not explicitly recognized in VAMs.

VAM scores are calculated from classroom-level heterogeneity that is not explained by the background variables in the regression model. Those classroom-level differences may be due in part to other factors that are not included in the model (for example, class size, teaching “high-need” students, or having students who receive extracurricular tutoring). The validity of the VAM scores as a measure of teacher contributions depends on how well the particular regression model adopted adjusts for other factors that might systematically affect, or bias, a teacher’s VAM score.

“In practice, no test meets this stringent standard.”  Keep in mind, EVERY state that accepted “Race to the Top” grants HAD to agree to use these tests to evaluate teachers. And from page five:

When used appropriately, VAMs may provide quantitative information that is relevant for improving education processes. For example, the models can provide information on important sources of variability, and they can allow teachers and schools to see how their students have performed on the assessment instruments relative to students with similar prior test scores.

Teachers and schools can then explore targeted new teaching techniques or professional development activities, while building on their strengths.

There is a key difference between this observation from the ASA and what is happening in schools:  VAMs are NOT being used to provide data “relevant for improving education processes.”  They are being used to label teachers as effective or not effective.  They are being used to label schools failures or successes.  So when the ASA says on page seven:

Statistical science has an important role to play in raising the quality of education, through developing and refining statistical models for use in education, providing guidance on designing experiments and interpreting statistical results, and applying quality and process improvement expertise to help guide judgments in the presence of uncertainty. The ASA promotes sound use of statistical methodology for improving education.

You know that they think this is NOT what is happening.

And just remember: if you live in a “Race to the Top” state, this is happening to your children’s teachers.

Leave a comment

Filed under Testing, VAMs