Category Archives: Testing

Can We Talk About Poverty And Violence NOW?

I became aware of this via a graduate school colleague.  Research from the CDC and Harvard University identifies that as much as 30% of young people in our urban areas suffer from Post Traumatic Stress Disorder as the result of living in communities afflicted by violence, a rate higher than soldiers returning from Iraq and Afghanistan.  This citation recently went viral because of report on a San Francisco CBS affiliate that mentioned the research — while deciding to coin the phrase “hood disease” to describe the phenomenon.  Response to that polarizing and sensationalist turn of phrase was swift, and it was well earned.  Hopefully, it will not obscure a chance to focus on a conversation that is desperately missing from today’s education conversation — the impact of poverty and violence on children and what it means to provide meaningful education for those children.

I am not optimistic, unfortunately.  Discussing the impacts of poverty and community violence on children would mean taking a good hard look at American society as a whole, how segregated we remain as a society (and how it is getting worse since 1980), how poorly we do as a country at helping families in poverty and how we largely ignore problems that are clustered in communities that are predominantly of color. I find it hard to believe that we are ready for a conversation today.  It would require more willingness for painful introspection and confrontation of racism that many prefer to believe does not exist.

Optimism is further undercut by the fact that the impacts of poverty on all sorts of outcomes for young people is not precisely news, although the PTSD estimates for community violence should cause more people to take notice.  “Effects of Poverty on Children” was published in 1997 and found vast differences in physical, cognitive, school achievement, and emotional and behavioral outcomes for children living in poverty, and it described the ways in which poverty influences these outcomes.  They recommended community health, parental education, in home interventions, and renewed efforts to eliminate deep, sustained poverty.  Not one of these recommendations found their way into the Bush era No Child Left Behind education reform bill nor into its Obama administration successor, Race to the Top.  Arizona State University Regents’ Professor Emeritus David Berliner delivered the Presidential Invited Speech at the 2005 meeting of the American Educational Research Association, and he titled in “Our Impoverished View of Education Reform.”  Among his conclusions:

All I am saying in this essay is that I am tired of acting like the schools, all alone, can do what is needed to help more people achieve higher levels of academic performance in our society. As Jean Anyon (1997, p. 168) put it “Attempting to fix inner city schools without fixing the city in which they are embedded is like trying to clean the air on one side of a screen door.”

To clean the air on both sides of the screen door we need to begin thinking about building a two-way system of accountability for contemporary America. The obligation that we educators have accepted to be accountable to our communities must become reciprocal. Our communities must also be accountable to those of us who work in the schools, and they can do this by creating social conditions for our nation that allow us to do our jobs well. Accountability is a two way process, it requires a principal and an agent. For too long schools have thought of themselves only as agents who must meet the demands of the principal, often the local community, state, or federal government. It is time for principals (and other school leaders) to become principals. That is, school people need to see communities as agents as well as principals and hold communities to standards that insure all our children are accorded the opportunities necessary for growing well.

It does take a whole village to raise a child, and we actually know a little bit about how to do that. What we seem not to know how to do in modern America is to raise the village, to promote communal values that insure that all our children will prosper. We need to face the fact that our whole society needs to be held as accountable for providing healthy children ready to learn, as our schools are for delivering quality instruction. One-way accountability, where we are always blaming the schools for the faults that we find, is neither just, nor likely to solve the problems we want to address.

But since that address in 2005, “one-way accountability” has not only dominated policy, it has actually spawned an entire industrial scaled investment in testing and data, entrenching it even deeper.  Even though it has very little to do with the issues that plague impoverished communities in our country and the schools that try to serve them.

Most of what you’ve read about our “failing” national schools is based on flawed data.  Even using the preferred tool of accountability advocates, standardized tests, the crisis in our public schools is one of community poverty.  This graphic comes courtesy of Christine McCarthy, a New York City public school teacher and recipient of a Distinguished Fullbright Award in Teaching:

Image

Stephen Krashen, professor emeritus at USC provides the data for this chart which should make it crystal clear that the constant doubling down on standards and testing will have no serious impact on the international testing gaps that produce such gnashing on the teeth in the media and in Washington.  A test does not alleviate the well documented impacts of poverty.  Firing a teacher whose students are performing poorly on a test does not alleviate the well documented impacts of poverty.

It is at this junction, that a Michelle Rhee or Joel Klein comes along, sometimes on a talk show, to say that there should be “no excuses” for even a school with a 75% or higher poverty rate.  Their preferred “no excuses” methods involve firing as many people as they can, closing down schools and turning more and more children over to charter school operators.  Certainly, many of those operators like to claim that they’ve found the “secret sauce” to educating within communities afflicted by high rates of poverty.  Eva Moskowitz’s “Success Academy” empire claims that it is educating the exact same students as the neighborhood schools in Harlem, but that claim is simply false, and a parent at Upper West Side Success documented on tape how administrators have tried to counsel out her son who has an IEP, something no neighborhood school could do.  Northstar Academy in Newark loves to claim at 100% graduation rate for seniors, but it fails to report its 50% attrition rate prior to senior year.

The lesson here is that there is no “special sauce” and “Superman” is a comic book hero.  We, as a society, have never figured out a way to provide large scale, genuine, educational opportunity to children growing up in communities with deep and persistent poverty.  We, as a society, are woefully uncommitted to alleviating poverty and have even come to accept the terrifying 20% rate of childhood poverty as normal and perhaps inevitable.  But absent those two commitments, no amount of firing teachers or testing students until they cry is going to “fix” American education.

And this is where I worry for the future again:  I think it is very likely that a combination of suburban parental outrage and teacher activism is going to push back hard on current reforms.  If Common Core survives, it will be substantially modified with fewer tests and less emphasis on value added models of teacher evaluation.  The fact is that pushing the punishment narrative that has been the burden of urban schools for so long to communities that generally like their schools is going to create a backlash.  But once those parents have pushed back and changed these systems, we will still be left with communities rife with damaging poverty and violence, and we will most likely go back to ignoring those facts.

And the next cycle of “reform” will ignore it too.

Leave a comment

Filed under charter schools, politics, schools, Social Justice, teaching, Testing, VAMs

Randi Weingarten Admits the Common Core is in Trouble

President of the American Federation of Teachers, Randi Weingarten, has taken some criticism for her support of the Common Core State Standards.  She still believes that they have potential to be beneficial, but in an interview with Salon.com yesterday, she also admitted that they might fail.  Weingarten leveled a substantial amount of her criticism at the testing and evaluation policies that have come coupled to the CCSS, especially the secrecy that testing giant Pearson has tied to its contracts for CCSS tests.  Five of the union president’s points:

These standards were done by the states — the governors and the state chiefs — in a very rapid fashion, and there was not enough conversation and discussion about what they were, and how they would be implemented. Number 1.

 

Number 2, as a result, there are problems in the standards, particularly as applied to [grades] K through 2 … They seem to be developmentally inappropriate for the earliest of kids …

 

Number 3: … The state tried to copyright the standards. [There’s] one thing about education that’s absolutely imperative, which is that you try things, and you adjust, and you have a continuous learning process. The copyright suggests they’re fixed in slate, and that’s just wrong …

 

Number 4: There was more work that was done about testing of the standards and the assessment process, than actually the implementation. And that’s why many people believe that this is about a testing process, not about a learning process.

 

And so — Number 5 — you get to what happened in New York and other places, where all of the sudden, the state commissioner last year said the scores will go down 30 points – and then magically the scores went down 30 points. So most people then distrusted what was going on here. Was this about actually helping kids get higher standards? Or was this about trying to create a sense of failure in the public system?

If, as Weingarten states several time, implementation of standards is “90-95%” of what matters, then these criticisms are welcome but also overdue.  All five of those concerns have been evident for some time as the Obama administration and CCSS boosters outside of government have been rushing this implementation and rushing the linkage to high stakes testing for teacher evaluation ahead at a truly breakneck pace.  Weingarten is absolutely correct when she asserts:

I think the teachers, the parents … have become so frustrated with standardization, and with top-down accountability and being told what to do without being given the resources to do it, and having testing before teaching, that they’ve gotten so frustrated that they just don’t trust the transition to standards anymore.

But the thing is that anyone with an understanding of American education, as she has, should have seen that frustration coming years away.  That frustration was built into the Race to the Top grants which pressured states to adopt valued added models of teacher evaluation using common assessments.  Since then, almost all work around Common Core has been to essentially monetize it either via testing, curriculum or technology materials while teachers and students across the country struggle with staff cut backs and delayed school improvement budgets.  Parents and guardians, who by wide margins approve of and appreciate what their children’s teachers do, were bound to notice.

Regardless, I do welcome Randi Weingarten sounding this alarm.  That she believes the standards have potential to do good is not an opinion she is alone in having, but what really stands out is that she is the first high level supporter of the CCSS who is publically willing to admit that they are in trouble and that they are in trouble because the implementation is running roughshod over teachers and students.  Who else is willing to admit to this?  Certainly not Arne Duncan.  Absolutely not John King.  Not Bill Gates.

But they should.

 

Leave a comment

Filed under Common Core, Gates Foundation, Media, politics, Testing

Taking Back OUR Schools NYC Metro March & Rally

This will be VERY important for the future of NYC public education!

morecaucusnyc's avatarMovement of Rank and File Educators

30+ organizations representing parents, teachers, students and community members taking to the streets in defense of public education
Get more information,
then RSVP

"Taking Back OUR Schools NYC MetroMarch and Rally" http://tiny.cc/NYCmarch

View original post

Leave a comment

Filed under Activism, politics, Shared Posts, Testing

How Andrew Cuomo Has Lost My Vote

Andrew Cuomo has lost my vote — and if you are a teacher, a parent of a public school child or a citizen who sees schools as a vital component of our civil society, he should lose your vote too.  He has been as abusive towards our public schools and the people who work in them as have Republican governors such as Scott Walker and Chris Christie, only without the national spotlight aimed at his policies.  My conservative friends will probably suggest this has to do with media bias, and I won’t deny some possibility of that.  However, a simpler explanation is that Governor Cuomo, unlike Governors Walker and Christie, has done little to highlight his conflicts with unionized teachers — it would do him little good with his core constituencies at home or nationally to do so.

Regardless, he has been a net negative for schools and teachers although you would not have guessed it reading his inaugural address in 2011.  That speech had no mention of education or teachers and the only mention of school was a personal anecdote.  The same speech mentioned taxes or taxpayers seven times, budget three times and the deficit eight times in one short paragraph, claiming there was a deficit of trust and competence as well as a budgetary one.

It has become clear since then that even if he did not mention education in his address, he had education in his sights and it wasn’t to make sure school districts had the funds they need to guarantee educational opportunity for all.  One of the governor’s early achievements was a cap on property taxes   that may have helped many home owners but has also left many school districts scrambling for funds.  At the same time, Albany continued the “gap elimination adjustment” which became permanent in the 2011-2012 budget year.  In the GEA, Albany allocates school aid and then uses a formula to take it away…or even increases the amount of money removed from school aid if the state projects a shortfall in revenue.  Essentially, this is a formula that allows the legislature and the governor to announce a school aid budget and then to trim it when nobody is looking.  According to the New York State School Boards association, the GEA has cost New York districts an average of $3.1 million dollars per year each year since 2010.  64% of districts have cut personnel, 53% have increased class sizes and 36% have reduced or eliminated extracurricular activities.

None of this is good for the children of New York, but it certainly helps Governor Cuomo keep from ever considering higher taxes.  By the way, when you search the New York Times for “gap elimination adjustment” this is what comes up.  Too obscure for even the Times’ New York reporting, you have to go to local and regional papers to find comprehensive coverage.

While finding ways to trim the money available locally and at the state level, the Governor has also aggressively pursued state pension reform.  This is hardly unique to New York, but the demands to reform how career teachers retire comes at a time when teachers are being asked to do more than ever before…with less in the present and promises of less in the future.  Governor Cuomo is solidly behind the current reform environment which means the state is not only implementing the Common Core State Standards, but also the state is implementing test score driven evaluation of teachers.  While recent statements from the governor indicate a willingness to delay or reweight the degree to which student test scores will impact both student promotion and teacher evaluation, Commissioner John King was unambiguous that Albany believes it is on the right path for schools and will plow ahead.  Plowing ahead means teachers with larger class sizes and fewer support personnel having to quickly implement a new and complicated set of curriculum standards in all grades simultaneously and simultaneously having to face their retention and tenure decisions being based upon the result of tests that have resulted in dramatic declines across the board.

All of this in a budget environment where NYC parents are being asked to fund raise so schools can hire elementary reading specialists.  Schools lucky enough to have parents who are wealthy and connected maintain essential services.  Other schools?  Well, at least Andrew Cuomo doesn’t have to raise anyone’s taxes.

Balancing the budget on the backs of school children and public employees is unpleasant enough on its own, but Governor Cuomo’s behavior during the recent public battle between charter school magnate Eva Moskowitz and New York Mayor Bill de Blasio was beyond the pale.  The narrative should be familiar to New York residents.  In the waning days of his administration, Mayor Michael Bloomberg hastily granted a number of new colocations for charter schools in the city, including either new or newly expanded sites for Moskowitz’s Success Academy chain.  Mayor de Blasio granted most of these colocations, where a charter operator is allowed to take over space in an existing public school building without paying rent to the city.  Charter school advocates claim that paying for their space would put charters at a disadvantage compared to existing public schools, which they claim to be. But  Moskowitz herself sued the state of New York to prevent the Comptroller from auditing and succeeded in having a law struck down that granted the Comptroller that authority.  Her argument?  Her schools are not a “unit of the state”. Ponder that: her schools accept public funds and demand space in public school buildings without rent, but the state’s top financial officer has no authority to examine her books.  And she sued to make it that way.

Moskowitz stormed to Albany with her students claiming that the new mayor has declared war on her, but many of her claims fail to stand up to the slightest scrutiny.  Among the most damning highlights is that by halting one of the colocations, Mayor de Blasio was trying to prevent one third of the severely disabled students in one building from being displaced and sent all over the city.  Moskowitz likes to make lofty claims for her schools’ accomplishments drawing from a population that she alleges is among the city’s neediest.  Sadly, these claims are heavily embellished as well.  While Success Academy test scores are indeed high, there is no metric that makes Success Academy 4 the “highest performing school in the state,” and even though admission to charter schools is by lottery, remaining there is not guaranteed — and Moskowitz’s schools have exceptionally high attrition rates, especially among students who do not test well.  Diane Ravitch of NYU and Avi Blaustein note:

In just four years Harlem Success Academy 4 has lost over 21 percent of its students. The pattern of students leaving is not random. Students with low test scores, English Language Learners, and special education students are most likely to disappear from the school’s roster. Large numbers of students disappear beginning in 3rd grade, but not in the earlier grades. No natural pattern of student mobility can explain the sudden disappearance of students at the grade when state testing just happens to begin.

Given these issues, it was disturbing enough to watch Governor Cuomo rush to Moskowitz’s side during her “Save Eva” rally in Albany on the same day that Mayor de Blasio was rallying for support of a universal prekindergarten proposal for New York City.  But what has come out since then is simply inexcusable.  Not only did Cuomo show up to stand by Moskowitz, he actively participated in making the rally happen, and the result of that public pressure and multimillion dollar ad blitz got us a New York state budget that expressly forbids charging charter school rent in public schools and forces the city to pay charter schools’ rents if they cannot colocate.

The fact is that Eva Mokowitz has very wealthy friends.  The NY Times article makes clear that Governor Cuomo relies on campaign donations from Wall Street patrons of charter schools who helped fund the advertising backlash against Mayor de Blasio:

A lot was riding on the debate for Mr. Cuomo. A number of his largest financial backers, some of the biggest names on Wall Street, also happened to be staunch supporters of charter schools. According to campaign finance records, Mr. Cuomo’s re-election campaign has received hundreds of thousands of dollars from charter school supporters, including William A. Ackman, Carl C. Icahn, Bruce Kovner and Daniel Nir.

Kenneth G. Langone, a founder of Home Depot who sits on a prominent charter school board, gave $50,000 to Mr. Cuomo’s campaign last year. He said that when the governor asked him to lead a group of Republicans supporting his re-election, he agreed because of Mr. Cuomo’s support for charter schools.

Campaign filings show that the governor’s re-election campaign has collected over $400,000 in donations from wealthy donors who are also supporters of the Success Academy chain, including $65,000 directly from Moskowitz’s own political action committee. Mercedes Schneider, a Louisiana teacher, Ph.D. in statistics and education blogger, has extensively examined Success Academy tax documents with illuminating results, including that the IRS contact reported for Harlem Success Academy is Luxor Capital Group.

I don’t pretend to know why Wall Street big money is so invested in charter schools.  Perhaps they sincerely believe that competition from privately run charter schools that their own children will never attend is a “secret sauce” to improving universal education in this country.  Maybe they see charters as an effective tool against one of the last largely unionized work forces in America.  Perhaps expanding charters is seen as a key factor in setting up education as a massive data collection enterprise where entrepreneurs can turn data into profitable technology products.  It could be any number of factors, but one thing is certain: those factors are not being debated in public as part of the exercise of democratic control of public education.  It is almost entirely privately debated for private purposes.

And that is why Andrew Cuomo cannot have my vote.  He has made it very clear that he is not for public schools, public school teachers or public school students.  Those people have been continuously squeezed by local revenue roadblocks and state revenue take backs at a time when they have had to do more and more for higher and higher stakes.

He is, however, very much for what hedge fund campaign donors are for.  Those people have not been asked for a cent more in taxes and have their pet projects enshrined in the state budget.

If you are a student in New York, a parent of a student in New York, or a teacher in New York, Andrew Cuomo is not your governor, and he does not deserve your vote.

ADDENDUM:  There are reasons why hedge funds promote charter schools.  They are, surprise, linked to profit.

 

1 Comment

Filed under politics, schools, Testing

Vamboozled on the ASA Statement on Value Added Models

Audrey Amrein-Beardsley of Vamboozled just added the official statement from the American Statistical Association to her list of top articles on Value Added Models (VAMs) for education assessment.  The full statement can be found here, and it is a doozy.  Well, I say “doozy” because I know quite a few people who specialize in quantitative analysis and quotes like this count as pretty harsh condemnation:

VAMs are generally based on standardized test scores, and do not directly measure potential teacher contributions toward other student outcomes.

That means VAMs are limited.

VAMs typically measure correlation, not causation: Effects – positive or negative – attributed to a teacher may actually be caused by other factors that are not captured inthe model.

That means that VAMs used as the main means of teacher assessment are missing things…potentially very important things.

Under some conditions, VAM scores and rankings can change substantially when a different model or test is used, and a thorough analysis should be undertaken to evaluate the sensitivity of estimates to different models.

That means some VAMs are not exactly reliable. Page four lays it out in pretty clear language to me:

The measure of student achievement is typically a score on a standardized test, and VAMs are only as good as the data fed into them. Ideally, tests should fully measure student achievement with respect to the curriculum objectives and content standards adopted by the state, in both breadth and depth. In practice, no test meets this stringent standard, and it needs to be recognized that, at best, most VAMs predict only performance on the test and not necessarily long-range learning outcomes. Other student outcomes are predicted only to the extent that they are correlated with test scores. A teacher’s efforts to encourage students’ creativity or help colleagues improve their instruction, for example, are not explicitly recognized in VAMs.

VAM scores are calculated from classroom-level heterogeneity that is not explained by the background variables in the regression model. Those classroom-level differences may be due in part to other factors that are not included in the model (for example, class size, teaching “high-need” students, or having students who receive extracurricular tutoring). The validity of the VAM scores as a measure of teacher contributions depends on how well the particular regression model adopted adjusts for other factors that might systematically affect, or bias, a teacher’s VAM score.

“In practice, no test meets this stringent standard.”  Keep in mind, EVERY state that accepted “Race to the Top” grants HAD to agree to use these tests to evaluate teachers. And from page five:

When used appropriately, VAMs may provide quantitative information that is relevant for improving education processes. For example, the models can provide information on important sources of variability, and they can allow teachers and schools to see how their students have performed on the assessment instruments relative to students with similar prior test scores.

Teachers and schools can then explore targeted new teaching techniques or professional development activities, while building on their strengths.

There is a key difference between this observation from the ASA and what is happening in schools:  VAMs are NOT being used to provide data “relevant for improving education processes.”  They are being used to label teachers as effective or not effective.  They are being used to label schools failures or successes.  So when the ASA says on page seven:

Statistical science has an important role to play in raising the quality of education, through developing and refining statistical models for use in education, providing guidance on designing experiments and interpreting statistical results, and applying quality and process improvement expertise to help guide judgments in the presence of uncertainty. The ASA promotes sound use of statistical methodology for improving education.

You know that they think this is NOT what is happening.

And just remember: if you live in a “Race to the Top” state, this is happening to your children’s teachers.

Leave a comment

Filed under Testing, VAMs