Monthly Archives: May 2016

The Truthiness of Campbell Brown

Former news anchor turned education reform advocate Campbell Brown has established herself as one of the more aggressive public personalities arguing against teacher unions and in favor of school privatization.  After leaving CNN in 2010, Ms. Brown reemerged as an antagonist of teacher unions, taking to the pages of The Wall Street Journal to accuse New York City’s United Federation of Teachers of protecting teachers accused of sexual misconduct.  It was a devastating line of attack against a favorite target of would be education reformers – a well-funded and politically connected labor union favoring its membership over ethics.

Of course, it wasn’t really true.  Curiously, Ms. Brown seemed entirely unaware of the actual requirements in the UFT contact in effect at the time of her accusations.  This information was made crystal clear when Ms. Brown tried to publicly back UFT President Michael Mulgrew into a corner on the issue – and got seriously dressed down for her misrepresentation of the union’s position and actions:

Mr. Mulgrew: “We have made sure that on an allegation, a single allegation, a teacher must be removed.  If the principal wants the teacher removed, or the administrator, they must be removed from any contact with children. They then have a 30 day investigation period. If they are found guilty of any sort of sexual impropriety, any sexual impropriety, the administrating officer has no choice but to fire him. And those are the things that we put into our contract – that they must be fired if they are found guilty of any sexual impropriety. So I know you like to say things in certain ways, but I have found many of your allegations to be misleading.  So I am very proud of the fact that we take very seriously that on a single allegation – a child can say it in a flippant moment — that that teacher will be removed from any contact with a student, and if they are found guilty of any sort of sexual impropriety – any – there is no discretion: they must be fired.  And that is my answer to you.”

Ms. Brown: “So to clarify…”

Mr. Mulgrew: “That is my answer to you.”

Ms. Brown also came under fire for failing to disclose, as is typical in ethical journalism, her family connections to education reform and, specifically, anti-union education reform.  Her husband is Dan Senor, who was a figure in the Bush administration serving as the spokesman for the Coalition Provisional Authority in Iraq, and at the time of Ms. Brown’s relaunching of herself as an education advocate, he was an adviser to the Mitt Romney campaign and a board member of Students First, New York – the Empire State branch of Michelle Rhee’s anti-union organization.  Ms. Brown decided her best reply was to be snarky about the entire question of ethical journalism.

Ms. Brown returned to bring Vergara vs. The State of California style lawsuits against teacher tenure in New York and other locales, funneling dark money donations into her new organization “Partners for Educational Justice”.  The new campaign came with a fresh round of publicity and interviews where she tried to make her case to the public.  These were, charitably, as fact challenged as her previous efforts to paint the UFT as an organization dedicated to protecting sexual predators.  According the Michigan State University education professor Alyssa Hadley Dunn, Ms. Brown was wrong on almost every relevant point of fact, misrepresenting the staffing challenges faced by urban school districts (they have trouble retaining experienced teachers rather than being plagued by incompetent ones with tenure), arguing that teachers must be bad in urban districts because standardized test scores are low (in reality, teachers are important but no research solidly ties quality of teaching to standardized test results), and citing wildly out of date information on how long it takes to remove a tenured teacher from the classroom (177 days is not 830 days no matter how often that talking point is repeated).

Shortly after launching her lawsuit, Ms. Brown also started her education “news” website called the “The74,” which oddly sounds like a nightclub but is supposed to “represent” the roughly 74 million Americans under the age of 18 in the country.  The website is expected to operate on a budget of $4 million annually, and is funded by donors such as  Bloomberg Philanthropies, the Walton Family Foundation, and Jonathan Sackler who serves on the board of the New Schools Venture Fund — all reliable sources of charter school support.  From that platform, she has been billing herself as a viable host for education issues in the current election cycle, hosting a Republican candidate discussion in August last year – and blaming the national teacher unions for the fact that no Democratic candidates agreed to appear at a similar forum later in the Fall.  Jersey Jazzman demonstrated the long list of entirely viable reasons why Democrats might not want to participate in what would obviously have been an anti-union, pro-privatization event hosted by a media figure whose relationship with facts has been sketchy.  But blaming unions is sort of a reflex for Ms. Brown by now.

Most recently, Ms. Brown took to  Slate with a video giving “advice” for the next President of the United States.  In it, she said that two thirds of American eighth graders “cannot read or do math at grade level.”  In response, Tom Loveless, an expert on student achievement and senior fellow at The Brookings Institution, demonstrated that her facts were inaccurate in an exchange on Twitter:

Former Principal and current head of the Network for Public Education, Carol Burris, explained the depth of Ms. Brown’s error in The Washington Post.  During the exchange on Twitter, Ms. Brown admitted that her “source” for the claim about American students’ grade level skills came from the National Assessment of Educational Progress (NAEP) where, yes, roughly one third of American 8th graders meet the cut scores for “proficient” and “advanced” with two thirds at “basic” or  below.  As Burris notes, NAEP does not consider “proficient” to be synonymous with “grade level” skills and expectations.  In fact, if you read the description of “basic” performance in the 8th grade reading NAEP, you will see a description of competent if not outstanding reading ability:

Eighth-grade students performing at the Basic level should be able to locate information; identify statements of main idea, theme, or author’s purpose; and make simple inferences from texts. They should be able to interpret the meaning of a word as it is used in the text. Students performing at this level should also be able to state judgments and give some support about content and presentation of content.

To set up the NAEP proficiency as an appropriate grade level benchmark as Ms. Brown does is to entirely muddy the discussion and debate about how our schools are doing.  Such sleight of hand techniques seem deliberate and designed to paint a misleading portrait of our schools for reasons that have little to do with improving them for most children.  Regardless of motives, one thing is completely clear: anyone trying to portray NAEP results – or PARCC and SBAC results for that matter – as an established proxy for what grade level expectations should be in our schools is either seriously misinformed or a liar.

Carol Burris spoke very cogently about why this matters beyond the question of truthfulness as well:

If you set an unreasonable cut score on state tests and pressure teachers and kids to meet it, it can work against student learning, especially for students who struggle.  Sizeable numbers of kids will learn less than they might if the instructional pace and content were developmentally appropriate and well sequenced.  This is especially true in the younger grades. You can always differentiate instruction if you need to for the kids who excel, but if you hold struggling learners to a standard they cannot meet, frustration, not learning, happens.  Inappropriately difficult standards also promote drilling for the test, adult cheating and the narrowing of the curriculum as explained in this Politico New York report on the test-driven, Success Academy Charter Schools.

Despite the important arguments and issues of genuine substance, Ms. Brown seems determined to not learn about the education policies she has inserted herself into as both an advocate and an arbitrator. Given an opportunity to respond directly on her statements about student achievement, Ms. Brown offered perhaps the most childish and taunting string of non-sequiturs I have seen since I last taught 7th grade.  She called the reaction to her use of “grade level” “histrionic,” misused the expression “begs the question,” taunted “is that all you’ve got?”to her critics, declared that public education advocates have “lost” on charter schools, tenure, and “special protections” for abusive teachers,  and said the reaction “screams desperation.”  She declared that any “reasonable person or parent” knew what she meant by her statement.  She declared that she was subject to personal sexist attacks.  She claimed critics were “feigning outrage” over her misuse of terminology and facts because they “profit off the system’s failure.”  And for good measure, she compared New York University Professor Diane Ravitch with Donald Trump.

And your mother, I guess.

Ms. Brown’s self assurance is a bit odd here.  The charter sector may be growing, but so is awareness of the scandals growing from scant oversight of finances and practices.  Anti-union forces may have won the first round of Vergara v. California trying to sue tenure out of existence, but they lost the appeal.  Ms. Brown’s comment about “special protections you want for abusive teachers” is literally just blather since she didn’t have her facts correct when she started the argument.

More interesting, however, is the complete absence of an actual argument.  Ms. Brown grudgingly acknowledges that her specific language was incorrect, but she denies that anyone was really impacted at all by it.  Mostly, she just insinuates that her critics are losers and complains about the tone of their comments to her.  To be sure, she has received some personal, even heated, criticism in the course of these debates (although before equating Dr. Diane Ravitch’s occasional criticisms of her to what Donald Trump unleashes on his critics, she might want to consult the record).   These issues, however, are of national importance, and Ms. Brown has a repeated and enthusiastic habit of getting critical facts dead wrong on issues that impact 3 million professional teachers and their 50 million students.  From her assertion that the UFT happily protects child molesters to her statements about tenure to her claims about the percentage of American children reading and doing math at grade level, she is consistently and damagingly wrong.

Perhaps the actual facts are inconvenient for her cause, but smug snarkiness when called out for substituting “truthiness” for truth is hardly an argument.

2 Comments

Filed under Media, politics, Unions

The Price of “Success”

At the end of 2014, the rapidly expanding Success Academy charter school network in New York City announced they would hire an in house ethnographer.  At the time, the network had 9,400 students in grades K-9 across 32 schools and had plans for further expansion.  The job description for the opening read:

“We want to expand the scope and quality of our data collection to focus on the lived experience within our schools,” the description reads, adding that the position would help the network focus on “questions we’ve never thought to ask.”

At the time, seeking a genuine social scientist to truly study the network gained high praise from representatives of the charter sector in public education such as Nina Rees, president and CEO of the National Alliance for Public Charter Schools, who said the move was unique among charter schools across the nation.

The post was filled by Dr. Roy Germano who got to work in early 2015, examining the culture of Success Academy and seeking potential research questions to help the network focus, as they said, on things they’d “never thought to ask.”  Dr. Germano’s early work appeared to center on the high pressure and test-score centered professional culture of the charter school network, and the potential consequences that might have for teacher and administrator behavior.  According to documents that were obtained by PoliticoNewYork, Dr. Germano used his early investigations to write a proposal for a study of possible cheating by teachers within the network in response to the organization’s incentive structure.  Dr. Germano had no conclusive proof of cheating, but his interest stemmed from various examples teachers explained to him in interviews of colleagues correcting student work or suggesting that they “rethink” their answers, and to parallels he drew between Success’ high stakes environment and the Atlanta Public Schools where widespread cheating on standardized examinations eventually surfaced.  Dr. Germano further noted that “there are no rewards at Success for ethical teachers who try their best and fail.”

The research proposal and reasons for the concern rocked the higher administration at Success Academy to its core, and immediately resulted in a top to bottom self examination of incentives and practices that might negatively impact teaching and learning within the network.  Principals were directed to give Dr. Germano full access to faculty and students and to begin a careful process of reviewing how they support teachers in fostering genuine student learning where high test scores are the outcome of an ethical and deeply enriched school environment.  The reward and career advancement structure at the network was immediately scrutinized to determine what changes could be made to be absolutely sure that rewards and bonuses do not incentivize questionable practices, and the policy of publicly stack ranking teachers based on student test scores came under question as well.  Success Academy CEO and founder Eva Moskowitz recently announced that she is “eagerly awaiting” the results of Dr. Germano’s research and learning what the network can do to continuously improve.

Ha, ha – just kidding.  She totally banned him from the schools, fired him, and wrote nasty memos about him to the staff.

Dr. Germano, who now works as a research professor at New York University, was apparently required to write a follow up report in which he noted: “I am told Eva Moskowitz made disparaging comments about me in reaction to the report…I was told to write a follow-up report that would essentially downplay my findings and told by [recently departed Success vice president] Keri Hoyt not to use the word ‘cheating’ in any future reports. Finally, I was told that I was banned from visiting schools for the remaining 4 weeks of the school year, and that I could only visit schools next year if accompanied by ‘a chaperone.’”  He also noted in that follow up, “Comments about a culture of fear at Success have been a recurring theme in my interviews.” Spokesperson Stefan Friedman told Politico: “As to the allegations raised in the title of Mr. Germano’s memo, though he interviewed just 13 teachers out of 1,400 to justify that title, we conducted a thorough investigation and found no evidence to substantiate his speculation…Any suggestion that we utilized these methods — or anything untoward — on state standardized exams is categorically false and not supported by a scintilla of fact.”

Dr. Germano’s proposed research was submitted to Success in May of 2015.  By August, he was dismissed after having been forbidden to visit schools.  With such a severe reaction and so quick a dismissal, Mr. Friedman’s assertion that Success Academy “conducted a thorough investigation” is plainly laughable.  So much for asking questions.

Dr. Germano’s questions actually come as no surprise to those who have watched Success Academy closely, nor does his prompt dismissal after actually doing the job for which he was supposedly hired.  The pressure cooker atmosphere and singular focus on standardized test results has been evident at the rapidly growing network since at least 2010, when Success Academy’s Paul Fucaloro openly told New York Magazine that his program turned their students “into little test taking machines,” and he actually said, “I’m not a big believer in special ed,” blaming bad parenting for most special needs students.  In the same article, other sources says that students who do not bend to the Success Academy method were counseled out and that founder Eva Moskowitz told the staff that “Success Academy is not a social service agency.”

A year later, The New York Times ran a story on the subtle and direct ways that the network tries to rid itself of students who do not quickly and completely comply.  The story described the experiences of Kevin Sprowal who, mere weeks into his Kindergarten year, was throwing up most mornings before school because of the constant and increasing punishments.  Recently, a series of news stories have placed further emphasis on the high pressure environment in the network.  In April of 2015, Kate Taylor ran a story in The New York Times highlighting both the very high test score results and the extreme pressure environment within Success Academy – including an incentive system for students that include publicly shaming students with low test scores.  On October 12th, veteran education reporter John Merrow did an extended segment on the PBS Newshour on the use of out of school suspensions at Success Academy – for children as young as Kindergarten:

Eva Moskowitz retaliated by lobbing a lengthy complaint against Mr. Merrow at PBS and by publishing a response that included federally protected information identifying the disciplinary record of a former Success Academy student who appeared on camera.  This earned her a cease and desist order and a formal complaint filed with the Federal Department of Education.

Before October was over, The New York Times ran another story on Success Academy – this time, a “got to go list” was leaked from Success Academy in Fort Green, Brooklyn.  In addition to the shocking targeting of specific students, other sources confirmed practices across the network such as not sending automatic re-enrollment paperwork to certain families, and a network attorney calling one student leaving “a big win for us”.  Ms. Moskowitz responded with a press conference calling the “got to go list” an aberration – and with an email to staff declaring the bad press the result of media “conspiracy theories.”  Ms. Moskowitz then took to the pages of The Wall Street Journal in an editorial piece claiming that the only real “secret” to Success Academy is imitating the teaching of Paul Fucaloro:

…I wasn’t completely sold on Paul’s approach at first, but when one of our schools was having trouble, I’d dispatch him to help. He’d tell the teachers to give him a class full of all the kids who had the worst behavioral and academic problems. The teachers thought this was nuts but they’d do so, and then a few days later they’d drop by Paul’s classroom and find these students acting so differently that they were nearly unrecognizable. Within weeks, the students would make months’ worth of academic progress.

Ms. Moskowitz wanted her readers to infer that all Success Academy has done is simply scale up the teaching methods of one man into a system of nearly 3 dozen schools and roughly 10,000 students.

But if that is the case, the public had to wonder just what kind of person Ms. Moskowitz chose to clone across her entire staff when a video of one of the network’s “exemplar teachers” surfaced.  In the video, a calm and passive Success Academy student has trouble following her teacher’s instructions and is treated to having her work paper ripped in half in front of her classmates, being sent to the “calm down chair,” and berate in angry tones.  The video was not an accident: the assistant teacher was specifically keeping her cell phone ready in order to catch an example of just that kind of behavior because she had seen it so often.  In what is now her typical fashion, Eva Moskowitz lashed out at the press for the story, calling her critics haters and bullies.

This is a long record of employing not merely high standards, but also of employing extreme high pressure and of tolerating plainly unethical practices from teachers and administrators so long as the bottom line – very high standardized test scores – remains intact.  Dr. Germano’s questions were entirely appropriate as the beginning of a research program within Success Academy precisely because the bottom line at the network is entirely tangled up with test scores first and the means to get those scores second. If it means suspending Kindergarten children repeatedly until the submit to total control of their behavior, so be it.  If it means conspiring to pressure certain families to leave the school, so be it.  If it means humiliating a little girl in front of her peers so she learns that mistakes are never tolerated, so be it.  Dr. Germano’s original proposal stated the central problem at Success Academy perfectly: “There are no rewards at Success for ethical teachers who try their best and fail.”

Incentives matter. And organizational values are completely intertwined with what is measured and rewarded.  The is well known in the business world, even though companies from Enron to General Motors do not always learn from it.  The lesson from Success Academy is that when a school is entirely obsessed with high standardized test scores and when it is removed from nearly every system of public accountability available, it can get those test scores – but at an extremely high cost to anyone who does not serve that end.  Perhaps overt, organized, cheating is not a problem at Success Academy (yet), but the organizational incentives for it exist from the very top all the way down to their youngest students.

Dr. Germano tried to warn them, but nobody at Success Academy seems capable of listening.

1 Comment

Filed under charter schools, classrooms, Corruption, Eva Moskowitz, Media, Social Justice, Success Academy

The Long Arm of the PARCC?

Dr. Celia Oyler is a professor of education at Teachers College.  Recently, a teacher contacted her with an intelligent and cogent critique of the recent PARCC examination, including a few selections of content from the test itself.  Dr. Oyler published this on her blog as the critique demonstrated very deep flaws within the test, specifically that PARCC is developmentally inappropriate, requiring students to read far above grade level, and that PARCC is dubiously aligned with the Common Core State Standards it allegedly assesses, requiring students to demonstrate skills not evident in the CCSS standards for their grade levels.  As a critique, the teacher’s observations, backed with selected material from the exam, was pointed and a very valuable contribution to the discourse on the examinations.  Because of the highly secretive nature of the exams and because of the extremely restrictive confidentiality agreements those who have access to it have to sign, it has been difficult to find critiques that are actually rooted in what the exams themselves require.

So, of course, that could not stand.

Within a week, Dr. Oyler was contacted by the CEO of PARCC, Laura Slover, with official “requests” that she remove “all of the material reproduced from the PARCC assessments.”  The letter claimed ownership of all “intellectual property” for PARCC, Inc., claimed that Dr. Oyler’s blog “infringed” on PARCC’s copyright, “amplified” the breach of confidentiality the teacher committed by revealing the content to anyone, and that as an “infringer” Dr. Oyler could “be held personally liable for the damages incurred by Parcc, Inc. and those who have contributed financially to the creation and validation of the assessments, including without limitation the possible need, not only to create replacement items, but to create and revalidate new test forms.” Ms. Slover demanded that the material be taken down within 24 hours and asked Dr. Oyler to reveal the name of the teacher who contacted her with the material.  In fact, she openly stated that PARCC’s willingness to “waive claims” against Dr. Oyler hinged not only on removal of the material from her blog, but also upon her cooperation in identifying the teacher — within 24 hours.

Dr. Diane Ravitch of New York University received a similar letter from Ms. Slover because of her blog post linking to Dr. Oyler’s, and Dr. Ravitch as well as a number of other Twitter users had tweets linking to Dr. Oyler’s post removed from the micro-blogging platform.

iN THE NAME OF PARCC

PARRC, Inc.’s heavy handed tactics lead me to a number of observations:

First: We should, once and for all, dispense with the tomfoolery from Common Core and testing proponents that the PARCC, SBAC, and other Common Core aligned exams are valuable for individual students and their families.  For some time now, they have gone on about an alleged “honesty gap” in education where students and families were told by the previous state assessments that they were doing well in school while proficiency levels on the National Assessment of Educational Progress “proved” they were actually floundering.  According to this line of thought, it is a good thing that many more students struggle to meet proficiency levels on the new exams because it is a hard “truth” that families must know.

For multiple reasons (kindly demonstrated by Jersey Jazzman both here and here), this is a load of hooey.  But it is even a bigger load of hooey that these tests demonstrate this new “reality” in any meaningful way for individual students and their families, and PARCC’s heavy handed response to test security breaches pretty well proves it.  Ms. Slover told Dr. Oyler that she could happily “view over 800 released questions from the spring 2015 tests that show the breadth and depth of the kinds of questions on the PARCC assessments.” That’s all nice, but a selection of hand curated items from the exams is not remotely the same as being able to view, and critique, the exam itself.  Without releasing the entire exam, as it is presented to students who take it, there is no real ability for parents or teachers or researchers to critically examine it to determine if it is the kind of assessment PARCC claims it to be.

Even more to the point, without returning the entire exam to both teachers and students, the claim that we are “no longer lying” to people about their education is just air. When my children take an assessment made by their teachers at school, we get to see what items they got correct and what items they got wrong.  We can inquire with their teachers about what the assessment says about their strengths and about their weaknesses.  We can find out what is going on in the school to help support our children in their learning, and we can ask what we can do at home to help support their teachers.  We can plan based on the assessment with the guidance of the professional teachers who know our children in context.

PARCC does no such thing.  Far from their claim to Dr. Oyler that “transparency is one of the hallmarks of PARCC,” the hallmark of PARCC is to label students on their proficiency scale and to provide a simple statistical comparison of students to other students.  Knowing that your child scored below, near, at, or above school, district, state, and national averages may be slightly more informative than previous assessments, but it doesn’t tell anyone jack frat about a single student’s strengths, challenges, or what can be done to better support that child.  Of course, there are many standardized exams that sort and rank students, especially college and graduate/professional school admissions examinations, but nobody pretends that those exams are meant to help individual students get a better education or to provide teachers and schools with actionable information on how to better serve students.

Those promises were made for PARCC.  They are unadulterated bull plop, and will remain so as long as the current reporting system remains in place where nobody knows a darn thing about how they actually did.

Second: I remain utterly mystified why PARCC retains such a copyright on a deployed exam in the first place.  The two testing consortia, PARCC and SBAC, were awarded $330 million in grants from the federal Department of Education to develop the assessments.  At the time, PARCC was comprised of 26 states – this year, they are down to 8 “fully participating” states.  The grant announcement in 2010 promised that PARCC would “replace the one end-of-year high stakes accountability test with a series of assessments throughout the year that will be averaged into one score for accountability purposes, reducing the weight given to a single test administered on a single day, and providing valuable information to students and teachers throughout the year.”  What we’ve gotten are – wait for it – annual end of year examinations and a set of “instructional tools” that teachers can use “at their discretion” during the school year.  States left for a variety of reasons, but the projected ongoing costs certainly played a role.  The consortium, however, still has expensive contracts with various states — New Jersey’s four year contract with PARCC could top $100 million.  Pearson, by the way, was the only bidder for the contract to write the exam.

PARCC, Inc has taken in a lot of public money to develop and produce the tests.  So one has to wonder why they get to maintain so much control of the test built for public use and on the public dime?  An architecture firm that is contracted to design a new city hall may be able to copyright the design, but they cannot tell the town who can enter the building or block off entire wings from the public.  When Northrop Grumman designed and delivered the B2 stealth bomber for the U.S. Air Force, they certainly filed patents on the technology, but they did not tell the Air Force who can see the finished product and when it could be used.  They built it with public money, and then they had to let the government decide how to use it and who could know anything about it – they relinquished control.

But not PARCC, Inc which goes so far as to continuously monitor social media to detect students and others who know test content divulging any of it in public.  While it is certainly fair for the testing consortium to keep strict control on the test as it is under development and in current use, the refusal to generally distribute the test after it is done using the copyright system is noxious and thoroughly antithetical to the stated purposes of the exam, undermining any reason for the public and for educators to have faith in it as anything other than a means of sorting and ranking children and schools without real transparency. We’ve paid for PARCC’s development as a nation. The various states pay for PARCC to distribute and to deploy the exam in their states and to score them.  But not one person has a right to see the entire exam, and not one parent or teacher has the right to see how particular students did on the exam and to learn from it.  And Ms. Slover revealed PARCC’s real reason in her letter to Dr. Oyler when she threatened to hold her “personally liable for the damages incurred by Parcc, Inc. and those who have contributed financially to the creation and validation of the assessments, including without limitation the possible need, not only to create replacement items, but to create and revalidate new test forms.”

In other words: money.  PARCC wants to recycle as much as the exam as is practical, and holding the copyright threats over those who want to study and discuss the exams is the best way of doing that.

So PARCC may hold a legal copyright – but the fact that they were allowed to do so in their contracts is absurd.

Third: Even if PARCC’s copyright is legally valid, is Ms. Slover’s application of that copyright – threatening bloggers and having content removed from social media – valid?  Copyright does not provide a complete protection from revealing material that is under copyright, and Dr. Julian Vasquez-Heilig, Professor at California State University at Sacramento, makes a pointed observation that “fair use” allows for limited reproduction of copyrighted material for a variety of purposes such as “criticism, comment, news reporting, teaching (including multiple copies for classroom use), scholarship, or research.”  The fair use doctrine is not absolute and requires a careful balancing analysis in each and every case.  For example, “fair use” would not allow someone to set up a College and Career Readiness Assessment Partnership (or, CCRAP, if you will) and then just distribute the entire test under the guise of an “educational” purpose.

However, Dr. Oyler’s post was clearly a critique and designed to inform the public about the nature of the PARCC examinations.  While fair use under that category would have to be argued by people with expertise, it is hard to imagine why such an argument cannot be made.  Diane Ravitch reports that a board member of the Network for Public Education is an attorney with significant experience in intellectual property law, and his opinion was that PARCC’s claim has little merit.  Not only were most of the materials considered objectionable descriptions rather than excerpts, but also the question of fair use for actual quotations has to be considered given the purpose of of the blog.

Another potential fair use exception should be considered as well: news reporting.  While the law on this is a complex and shifting landscape, it is true that there have been court rulings that grant bloggers the status of journalists.  Critically examining the PARCC tests could not be more in the public interest regardless of the organization’s desire to wield copyright to prevent that examination from happening.  100s of millions of dollars of federal money was spent developing them.  States are contracted to spend 100s of million of dollars more using them.  While the secrecy about the tests make them utterly useless in helping teachers and schools design better instruction for students individually and collectively, the exams are being used for very high stakes purposes.  Annual testing is a requirement under federal law, including the revised Elementary and Secondary Education Act that passed last year as the successor to No Child Left Behind.  While states and districts have more flexibility in the use of testing under the new law, there is no indication that states are rushing to remove growth measures based on standardized tests from teacher evaluations, so PARCC still has an impact on teachers’ careers.  Students and schools are still being ranked based largely on standardized test data, and under agreements with the Obama administration that are still in effect, states are obligated to identify their lowest performing schools using standardized test data.  What exactly will come when the new law is in full effect is unknown,  but there is no reason to believe that annual tests will cease to play high stakes roles in how students are sorted, how teachers are evaluated, and how schools and districts are ranked.

I find it very hard to entertain the notion that PARCC Inc’s interest in being able to continually dip into a pool of unreleased test items outweighs the public’s interest in knowing the content and the quality of tests we’ve already spent huge sums of money on and which are and will continue to be used for high stakes purposes.  PARCC needs to put down the copyright club and legitimately engage the public whose tax dollars fund its entire existence.

3 Comments

Filed under Common Core, Data, ESSA, NCLB, PARCC, Pearson, Privacy, Testing, VAMs

New York Evaluations Lose in Court

Sheri Lederman is an experienced teacher in the Long Island district of Great Neck.  This means that she, like every other teacher in the Empire State, has been subjected to an ongoing experiment of teacher evaluation roulette with increasing focus on the “value added” of individual teachers calculated using student standardized test scores plugged into complex statistical formulas.  The method, called “Value Added Modeling,” is meant to account for the various factors that might impact a student’s score on a standardized test, isolate the teacher’s input on the student’s growth during one year of instruction, and determine whether or not the student learned as much as similarly situated students.  The difference between what the VAM predicts and how the student does – for either better or worse – is used to determine whether or not an individual teacher is effective.  VAMs promise to remove some of the subjectivity of teacher evaluation by relying solely upon tests that large numbers of students take and by calculating how well a teacher’s students did all things considered – literally.  VAM formulas claim to account for differences in students’ socioeconomic backgrounds and home life and only hold teachers accountable for students’ predicted performance.

Sounds great.  Trouble is that they don’t work.

The research base on VAMs continues to grow, but the evidence against them was strong enough that the American Statistical Association strongly cautioned against their use in individual and high stakes teacher evaluation in 2014.  So, of course, New York took its already VAM heavy evaluation system and doubled down hard on the standardized testing component because Governor Andrew Cuomo decided that the evaluations were finding too many teachers competent.  The previous system was, interestingly enough, the one that Ms. Lederman ran afoul of.  According to this New York Times article, Ms. Lederman’s  students performed very slightly lower on the English exam in the 2013-2014 school year than in the previous year, which was apparently enough to cause her test based effectiveness rating to plummet from 14 out of 20 points to 1 out of 20 points.  While her overall evaluation was still positive, the VAM based portion of her evaluation still labeled Ms. Lederman as ineffective.

So she sued.  In the court filing against then New York State Commissioner (and now U.S. Secretary of Education) John King, her argument was that the growth model used in New York “actually punishes excellence in education through a statistical black box which no rational educator or fact finder could see as fair, accurate or reliable.”  In fact, we’ve seen this before when the growth model used by New York City determined that the absolute worst 8th grade math teacher in the entire city was a teacher at a citywide gifted and talented program whose students performed exceptionally on the statewide Regents Integrated Algebra Exam, a test mostly taken by tenth graders, but who did not perform as well as “predicted” on the state 8th grade mathematics test.  It is important to remember that VAMs promise to explain the differences among student test scores by isolating the teacher’s effect on learning, but in order to do this, they have to mathematically peel away everything else.  However, according to the American Statistical Association statement, most research suggests that teacher input counts for only 1-14% of the variation among student scores, so the VAMs have to literally carve away over 85% of the influences on how students do on standardized tests to work.  No wonder, then, that the Lederman V. King filing called the models a “statistical black box” given that this is an example from New York City’s effort earlier in the decade:

NYC VAM

Not only are these models difficult to impossible for teachers and most administrators to understand, they simply do not perform as advertised.  Schochet and Chiang, in a 2010 report for Mathematica, found that in trying to classify teachers via growth models, error rates as high as 26% were possible when using three years of data, meaning one in four teachers could easily be misclassified in any given evaluation even if the evaluation used multiple years of data.   Dr. Bruce Baker of Rutgers wanted to test the often floated talking point that some teachers are “irreplaceable” because they demonstrate a very high value added using student test scores.  What he found, using New York City data, was an unstable mess where teachers were much more likely to ping around from the top 20% to below that and back up again over a five year stretch.  So as a tool for providing evaluators with clear and helpful information on teachers’ effectiveness, it would perhaps be better to represent that VAM formula like this:

NYC VAMreal

NYC VAMfake

The judge in Ms. Lederman’s case ruled this week, and, as the linked news articles stated, he vacated her evaluation, saying that it had been “arbitrary and capricious.”  The judge’s ruling is, by necessity, limited in scope because the evaluation system that gave Ms. Lederman her low value added rating no longer exists, having been replaced by Governor Andrew Cuomo’s 2015 push to tie HALF of teacher evaluations to test scores and then by the New York State Education Department’s somewhat frenzied efforts to implement that which has resulted in a temporary bar on using the state tests for those evaluations.  The ruling is still significant because the judge recognized the deep, and likely unsolvable, problems with the VAM system used in the Lederman case.  According to Dr. Audrey Armein-Beardsley, the judge acknowledged:

(1) the convincing and detailed evidence of VAM bias against teachers at both ends of the spectrum (e.g. those with high-performing students or those with low-performing students); (2) the disproportionate effect of petitioner’s small class size and relatively large percentage of high-performing students; (3) the functional inability of high-performing students to demonstrate growth akin to lower-performing students; (4) the wholly unexplained swing in petitioner’s growth score from 14 [i.e., her growth score the year prior] to 1, despite the presence of statistically similar scoring students in her respective classes; and, most tellingly, (5) the strict imposition of rating constraints in the form of a “bell curve” that places teachers in four categories via pre-determined percentages regardless of whether the performance of students dramatically rose or dramatically fell from the previous year.”

Equally important as the court’s recognition of arguments against value-added models in teacher evaluation, is the ground that was broken with the ruling.  Ms. Lederman’s attorney (and husband), Bruce Lederman, sent out a message reported by New York City education activist Leonie Haimson which said, in part, ” …To my knowledge, this is the first time a judge has set aside an individual teacher’s VAM rating based upon a presentation like we made.”  The significance of this cannot be overstated.  For years now, teachers have been on the defensive and largely powerless, subjected to poorly thought out policies which, nevertheless, had force of policy and law on their side.  Lederman v. King begins the process of flipping that script, giving New York teachers an effective argument to make on their behalf and challenging policy makers to find some means of defending their desire to use evaluation tools that are “capricious and arbitrary.” While this case will not overturn whatever system NYSED thinks up next, it should force Albany to think really long and hard about how many times they want to defend themselves in court from wave after wave of teachers challenging their test-based ratings.

9 Comments

Filed under Data, John King, teaching, Testing, VAMs

How to Appreciate Teachers

It is the national PTA Teacher Appreciation Week 2016, and there are a number of ideas hosted on the PTA’s website for how you can #thankateacher.  If you are a teacher, you can start a GoFundMe campaign for classroom supplies or, if you are a parent, to personally thank your children’s teachers. The PTA offers a toolkit so you can plan events to honor teachers in your schools as part of a celebration that has taken place in the first week of May since 1984.

(The National Alliance for “Public” Charter Schools also decided to schedule their “National Charter Schools Week” for the same week this year in what I am sure was not a deliberate effort to steal some free publicity at all.)

Teacher Appreciation Week is, of course, a lovely idea, and when it was launched in 1984, I doubt any of its founders could envision the issues facing teachers and teaching today.  Teachers across the country are getting cards, flowers, baked good, and some very well deserved nachesHistorically, teachers always have been highly motivated by the affective rewards of teaching – seeing children learn, gaining affirmation from their successes, building relationships with children and colleagues – but who can say no a nicely concentrated dose of positivity?

Gift baskets and flowers, however, don’t address the other 175 days of the school year, and those remain, as they have for some time now, unnecessarily stressful and subject to policies and incentives that diminish teachers’ autonomy and satisfaction in their work.  Teachers remain with policies that reduce their ability to plan their own classrooms, subjected to evaluations based upon invalid statistical methods using standardized test scores, and blamed for everything from being lazy to putting the future of the nation in jeopardy.  No wonder that enrollments in teacher preparation programs have fallen steeply from a high of over 700,000 in 2009 to barely above 450,000 in 2014 – high school students have ears and eyes, after all.  If we keep appreciating teachers like this, we may not have very many of them left to appreciate.

How should we really appreciate our teachers all year long?  A few suggestions:

Actually Treat Teachers as Professionals.  Education reform has an unfortunate tendency to treat teachers as if they are hopelessly outdated, the equivalent of a quill pen and parchment in the digital age.  In that view, teachers need a constant stream of prescriptive measures to make certain that they don’t bungle the job: new standards, scripted curricula, computer delivered instruction, constant outside assessment.  I know very few teachers who do not welcome the opportunity to try and use new tools that could improve their teaching, but tools are no substitute for actual professionals who use them skillfully – or who evaluate them and decide to seek better ones.  In many respects, that’s an operable definition of professional: someone who knows her or his job, what is necessary to accomplish it skillfully, and is trusted to construct practice effectively out of a variety of available resources in order to meet local needs.

For more and more teachers that sense of agency and professional practice is fading in a mass of expectations and initiatives that have given them little participation and voice.  In the workplace survey conducted by the the Badass Teachers Association with the AFT, 40% of respondents said that lack of say in decision making was a source of stress, and a whopping 71% of respondents cited new initiatives without proper training and development as sources of stress. 35% were stressed by a mandated curriculum, 32% by standardized testing, and 27% by data gathering expectations. A staggering 73% of respondents said they were often stressed on the job, and those teachers were less likely to have actual decision making capacity or trust their administrators to support them.  79% of teachers do not believe that elected officials treat them with respect, and 77% do not believe that the media treats them with respect.

The opposite of this is not showing up with flowers once a year and crowd sourcing classroom supplies. What teachers need is a near 180 degree turn in the way policy and policymakers treat them. If teachers are professionals, then they need to be welcomed into policy discussions and their recommendations, and reservations, taken seriously.  Further, teachers need to be allowed sufficient autonomy to both construct curricula that match their specific students and circumstances and to make necessary adjustments based upon what happens during the school year.  Such professional decision making is nearly impossible in an environment that insists upon scripted lessons and that places enormous power in the hands of one time snap shot assessments that become ends unto themselves. Professional evaluation of teachers can incorporate a wide range of materials that actually reflect the meaningful work teachers do with students embedded within a system predicated on growth and support rather than upon measurement and punishment.  Imagine schools where teachers work collaboratively on how to best approach the needs of students and where administrators and policy makers endeavor to get them the tools and resources they need to implement those plans.  We can get there, but only with a  genuine sea change in our priorities and how we view teachers.

Give Teachers the Time and Resources to Do Their Jobs: Attitude and involvement are steps in the right direction, but without the time and resources needed to do their jobs well and to continuously grow within their teaching, it will have little meaning.  Grappling with new ideas and different ways of understanding subjects and pedagogy takes significant time within a community of other professionals who are given meaningful chances to grow.  It would be unthinkable in other professions for outsiders with no specific expertise in the field to sweep in and tell practitioners to change and change quickly, yet nearly every major initiative in school reform since No Child Left Behind has done exactly that, and we have almost nothing positive to show for it.  It is time to spend less time measuring teaching and more time enabling it. How might we do this?

  • Reducing class sizes: Research is pretty clear on this — smaller class sizes improve academic outcomes for students and increase student engagement overall, and they improve long term outcomes for students and retention of teachers.
  • Time for teacher collaboration: We’ve known this for ages. Teachers and students benefit when teachers are able to effectively collaborate with each other, and in order to do that, they need space and time.  While teachers are often willing to give some of their existing time for this, it is also a systemic responsibility that has to be enabled by policy and administration.
  • Fully fund mandates: Lawmakers love giving teachers responsibilities.  They usually fail to love funding those responsibilities.  Consider the Individuals with Disabilities in Education Act.  When it was signed into law by President Ford, Congress promised to fund 40% of the costs.  Congress has never done better than 20% in 41 years.
  • Embed needed social services for our most needy children: Children who come from highly stressed communities need far greater resources than their peers in more affluent communities, and one of the best ways to address this is to embed high quality services within their schools. Early access to nutrition, health providers, social workers, and after school support programs all have positive short and long term benefits for high needs children, and they help teachers focus on a fuller education for their students.  Certainly these services are a far better investment of resources than continuing to fund the school to prison pipeline through increasingly criminalizing school discipline.
  • Repair our schools: The federal government estimates that nearly half of our nation’s schools need repairs and modernization to  the amount of $197 billion.  This number does not capture the truly decrepit situation in some of our nation’s schools, however. Public schools in Detroit, for example, have numerous cases of buildings falling apart with mold, water damage, and even mushrooms growing from the walls. It is appalling that we can expect anyone to teach or to learn in such conditions.

The teachers that I know want to do their jobs, and they want to do their jobs well.  If we truly appreciated them we would enable that work with the time and resources necessary for them to truly do it.

Fund all of this: That might sound obvious, but it is something that has apparently escaped the federal government and our nation’s governors.  Despite the economic recovery, governors across the country from both parties still have not restored education spending to pre-2008 levels and some are still cutting.  New York remains billions of dollars annually below agreed upon funding levels from nearly a decade ago (although it did spend almost 2 million dollars arguing in court that it shouldn’t have to), and Governor Andrew Cuomo has repeatedly insisted that the money doesn’t matter.

Bollocks.  Dr. Bruce Baker of Rutgers explains:

We are being led down a destructive road to stupid – by arrogant , intellectually bankrupt, philosophically inconsistent, empirically invalid and often downright dumb ideas being swallowed whole and parroted by an increasingly inept media – all, in the end creating a massive ed reform haboob distracting us from the relatively straightforward needs of our public schools.

Many of the issues plaguing our current public education system require mundane, logical solutions – or at least first steps.

Money matters. Having more helps and yes, having less hurts, especially when those who need the most get the least.

Equitable and adequate funding are prerequisite conditions either for an improved status-quo public education system OR for a structurally reformed one.

It’s just that simple.

Everything we need to see costs more money – sometimes a lot more money – and it is well past time that we stop simply saying that teachers are “heroes” and step up as a society to fund what is necessary for them to do their jobs to the best of their ability.

Stop attacking teachers’ professionalism and professional unions: Another front in today’s education reform is to speak with one mouth about how important teachers are and how it is vital to make certain that every child has a “highly effective” teacher, and then to speak with another mouth attacking the very notion of teachers as lifelong professionals. Education reform seems far more interested in promoting “market disruption” in teacher preparation rather than strengthening actual professional education and providing career long, meaningful, professional development.

Across the country, there is a genuine war being waged with dark money against teachers’ workplace rights.  Hoping to build off of the initial – and now thankfully reversed – success of the Vergara lawsuit in California, former news anchor Campbell Brown has taken a pile of undisclosed money to fund similar efforts across the country for the purpose of turning all teachers into at will employees.  The fact that most of her arguments do not stand up to any kind of scrutiny does not appear to matter to her backers who continue to funnel money into her efforts. Worse, those same backers appear entirely disinterested in how incredibly complicated teachers’ workplaces are and how many competing interests intersect in their work – which Peter Greene very cogently explained is one of the most important reasons for the due process protections of tenure:

A private employee serves one master — the company.

A public school teacher serves many “bosses”. And on any given day, many of those bosses will fight for ascendency. A teacher cannot serve all of those interests — and yet that is the teacher’s mandate. Tenure is meant to shield the teacher from the political fallout of these battles:  to give the teacher the freedom to balance all these interests as she sees best.

I would add to this that a truly professional teacher must often be a thorn in the side of administration — advocating for the children in her classroom even if it means telling an administrator that he is wrong. But the attack on teachers personally and professionally really has very little to do with any realistic understanding of what it means to teach and to be a teacher.  It looks very much more like a concerted effort to turn teaching into a job that an idealistic person may do for a few years in her 20s before being replaced with a fresh, newly idealistic, candidate who will teach for a few years using a scripted curriculum and then move on as well. If we truly appreciate teachers, we need to embrace making their professional education improve through thoughtful and substantive preparation for a lifelong career, and we need to defend the hard won protections in the workplace that make truly professional teaching possible.  Rejecting efforts to turn them into lightly trained and easily replaced cogs is absolutely essential.

So it is Teacher Appreciation Week.  The teachers in your community surely thank you for the ways you made them smile the past five school days.  They will also truly thank you for appreciating them the rest of the school year if you truly recognize their work and  genuinely support what makes that work possible.

2 Comments

Filed under classrooms, Common Core, Data, ESSA, Funding, Media, NCLB, politics, schools, Social Justice, standards, teacher learning, teacher professsionalism, teaching, Testing, Unions, VAMs

How Far Have We Sunk? Pretty Far.

At the end of April, Washington Post education reporter Valerie Strauss wrote in her Answer Sheet blog that the Harley Avenue Primary School in the town of Elwood, N.Y. recently canceled its annual Kindergarten play so they could dedicate more time to making certain the children are prepared for “college and career.”  The cancelled show was to be performed in the middle of May, and a letter to parents explaining the rationale was dated April 25th of this year – so there is little chance that this is actually an elaborate April Fool’s prank.  In the text of the letter, the school told parents:

The reason for eliminating the Kindergarten show is simple. We are responsible for preparing children for college and career with valuable lifelong skills and know that we can best do that by having them become strong readers, writers, coworkers and problem solvers. Please do not fault us for making professional decisions that we know will never be able to please everyone. But know that we are making these decisions with the interests of all children in mind.

A Kindergarten play. Canceled. Because Kindergarten children need to be prepared. “For college and career.” And the play would taken too much time away from THAT.

picard

We can certainly start with the obvious – for five year olds, putting on a play DOES help them learn “valuable lifelong skills.”  Working together, learning dialogue and songs, taking direction, expressing themselves, pushing their boundaries, taking risks — in what possible universe are these not fantastic learning experiences for Kindergarten children?  If there is a better recent example of missing the forest for the trees, I haven’t seen it.

On a more serious note, this also rings horribly of how terribly awry childhood has been going in this age of standards and “rigor” and high stakes.  Not only are we pushing academic tasks to younger and younger ages where they are simply inappropriate, there is growing evidence that it actively harms children to do so:

New research sounds a particularly disquieting note. A major evaluation of Tennessee’s publicly funded preschool system, published in September, found that although children who had attended preschool initially exhibited more “school readiness” skills when they entered kindergarten than did their non-preschool-attending peers, by the time they were in first grade their attitudes toward school were deteriorating. And by second grade they performed worse on tests measuring literacy, language, and math skills. The researchers told New York magazine that overreliance on direct instruction and repetitive, poorly structured pedagogy were likely culprits; children who’d been subjected to the same insipid tasks year after year after year were understandably losing their enthusiasm for learning.

Very young children need play.  This is hardly in dispute.  But in recent years, there has been increasing focus on test based performance by third grade that has created pressure to ensure children are “ready” by increasing academics in earlier and earlier grades.  While very young children are capable of learning skills and knowledge that will feed into academic performance later on, they need to learn it in ways that actually meet their needs.  By the time a Kindergarten class cannot spare the time to put on a show — which, incidentally, will teach the children a lot – because of pressure to focus on “college and career” readiness, then something is horribly, horribly wrong.

It is also bizarre that a community like Elwood would feel this kind of pressure.  According the United States Census,  47.9% of the community residents have a bachelor’s degree or higher compared with statewide number of 33.7%.  Median household income in Elwood is $108,401 compared to a statewide median of $58,687, and only 2.7% of the population lives below the federal poverty line while the average is 15.6% statewide.  The median value of owner occupied homes in Elwood is $478,300 while the statewide median is $283,700.  Elwood also compares favorably to Suffolk County on Long Island as a whole.  In Suffolk County, 37.5% of the population has a B.A. or higher, the median household income is $88,323, and the median home value is $376,800.

Elwood’s public schools appear to be doing well also.  The New York State Education Department’s data portal shows exceptional performance on state standardized tests in Elwood.  Harley Avenue Elementary is a K-2 school which feeds into James H. Boyd Elementary’s 3-5 program. Although 25% of students opted out in 2015, the proficiency numbers between the 2014 and 2015 tests do not appear different in any appreciable way.  In the 2014 tests, 15% of students scored a level 4 in the ELA exams, and 38% scored at level 3 while statewide averages were 9% and 22% respectively.  In math, James H. Boyd students also out performed state average with 23% scoring level 4 and 34% at level 3 in 2014 while statewide those numbers were 14% and 22%.  While these numbers are not the highest in Suffolk County, they are well above the average.

So – we have a small town.  Better educated, wealthier, and performing better on state assessments than other communities in its county and state.  But they cannot spare time in Kindergarten to put on a play.  And while this example has raised many eyebrows, it goes without question that the high stakes environment has taken an even heavier toll on minority students in the form of narrowed curricula and ever increasing pressure to teach to the test.  Sadly, we knew this even before No Child Left Behind was passed as evidence from the so-called “Texas Miracle” showed diminished quality in education at all schools, but especially at Latino majority schools. Our ethnic minority and economically disadvantaged students were the canaries in the coalmine showing us how high stakes testing diminishes educational quality.  By the time towns like Elwood are figuring it out, we’ve pretty well killed every canary we have.

Something else stands out here as well.  Administrators in Elwood have taken significant flack from all sorts of critics for both canceling the show and then for justifying it on the grounds that those tiny Kindergarten kids need to be subjected to more rigor and more college and career readiness.  And yet, those administrators did not invent the policy environment they work within.  In today’s zero sum game of education as competition, perhaps Elwood’s administrators are looking around at the nearby schools that “outrank” them and figuring they need to up their game in order to look good enough.  The pressure to think like that is not exactly new, but recently it has increased dramatically, and three men bear far more responsibility for that than the public school administrators in Elwood:

Gates

Bill Gates spent 100s of millions of dollar rushing the Common Core State Standards into public schools without anyone having time to prepare schools and teachers for them or even knowing if they were actually any good.  Secretary of Education Arne Duncan famously said that he thought “We should be able to look every second grader in the eye and say, ‘You’re on track, you’re going to be able to go to a good college, or you’re not,’ ” – signaling how obsession with standardized testing was only going to get worse in the country.  Chief architect of the Common Core, David Coleman, expressed his disdain for writing in school that detracts from analysis and his ideas of rigor, saying that “As you grow up in this world, you realize people really don’t give a s— about what you feel or what you think.”  These three men, with their impatience, their obsession with standardized testing data, and their general disdain for anything that doesn’t match their priorities have inflicted great damage on American public education, wielding influence far beyond their wisdom.

So if Kindergarten children in Elwood, New York cannot have a play because they need to be “college and career ready,” we should aim our disgust at the people who invented that phrase and made 50 million school aged children chase it without a single public debate on the issue.

Kindergarten

 

ADDENDUM: When the article from The Washington Post was forwarded to me, I failed to notice that it was dated from April of 2014. Unfortunately, as an Elwood parents affirms in the comments, the annual Kindergarten play has not been reinstated.  I hope the children of Elwood get a return to sanity in the near future.

8 Comments

Filed under Arne Duncan, child development, Common Core, Data, Gates Foundation, Testing