testing

21 tough questions about school reform

Via the Washington Post, civil rights activist James Meredith, asks 21 tough questions about school reform

1.) Children’s Rights: Do you believe that every child in the United States has the right to an excellent public education delivered by the most qualified professional teachers; an education aggressively supported by the family and the community, and an education based on the best research and evidence?

2.) Parent Responsibilities: Would you support the idea of public schools strongly encouraging and helping parents to: be directly involved in their children’s education; support their children with healthy eating and daily physical activity; disconnect their children from TV and video games; and read books to and with them on a daily basis from birth through childhood?

3.) Educational Equity: Do you believe that America should strive to deliver educational equity of resources to all students of all backgrounds and income groups?

4.) Testing Reforms: Much of current education reform policy is built on the idea that the U.S. must catch up to nations that achieve high scores in the international PISA (Program for International Student Assessment) tests, like Finland, South Korea and Singapore. But since these nations rely on few if any of the reform strategies being promoted in the United States, like cyber-charters, frequent high-stakes standardized tests linked to teacher evaluation, teacher bonus pay, vouchers, and hiring teachers with no experience and no advanced degrees in education – - why would the U.S. implement these strategies without first field-testing them thoroughly?

5.) Teacher Qualifications: If a critical factor in the success of the highest-performing education nations like Finland, South Korea and Singapore, and of high-performing American private and parochial schools, is a highly professionalized, highly experienced and highly respected teacher force, why is the United States pursuing policies to de-professionalize the public school teacher force, including sending recent college graduates into our highest-needs, highest-poverty schools with five weeks of training, no education degree and no experience? What is the hard evidence that such policies improve student outcomes, versus teachers with at least 2 to 5 years of experience and advanced degrees in education?

6.) Evidence for Classroom Products: What rigorous, independent evidence supports the use of computer products to deliver academic benefit to K-8 students as support to, or replacements for, flesh-and-blood teachers? Specifically, what computer products have such evidence of improving student outcomes, when fully tested versus classrooms without such products, and versus classrooms without such products but with more experienced teachers?

7.) Taxpayer Spending on Products: Would you support requiring computer software and hardware companies to fund rigorous independent research to validate the delivery of academic benefit to K-8 students by their products, before billions of dollars of taxpayer money is spent on buying such products?

8.) Taxpayer Spending on Testing: According to one estimate, American taxpayers spend about $20,000,000,000 annually on standardized tests like multiple-choice “bubble tests” but many teachers and students are saying they are hijacking huge amounts of school time that should be used for authentic learning, and thereby seriously damaging our children’s education. What evidence is there that the money and time being spent on high-stakes standardized tests is improving student outcomes and delivering academic benefit to students?

9.) Dangers of Linking Standardized Testing to Teacher Evaluation: A number of experts assert that students standardized test data should not be linked to teacher pay or evaluation because the data can be highly unstable, volatile, misleading or invalid for such purposes and will incorrectly penalize teachers of both high-achieving and high-needs students; arguments presented, for example, on this fact sheet from the Center for Fair & Open Testing, or FairTest.

What is your point of view on this – are these experts correct or incorrect?

10.) Advantages for Students: If the children and grandchildren of people like President Obama and American politicians and business leaders enjoy the benefits of private schools with highly experienced teachers, small class sizes, frequent diagnostic testing and assessments designed by their teachers, rich and full curricula including the arts and physical activity, regular recess, and a minimum of standardized “bubble” tests, should we strive to give the same advantages to all public school students? If not, why not?

[readon2 url="http://www.washingtonpost.com/blogs/answer-sheet/wp/2013/06/12/james-meredith-asks-21-tough-questions-about-school-reform/"]Continue reading...[/readon2]

The Arbitrary Albatross: Standardized Testing and Teacher Evaluation

On Chicago's streets and Hollywood's silver screens, education reform has been cast as a false dilemma between students and teachers. Reputable actresses and liberal mayors have both fallen prey. At the center of this drama lie teacher evaluations. A linchpin of the debate, they weigh especially heavily around the necks of educators like me.

Think: Shaky Foundation

With the arrival of spring, testing season is now upon us: America's new national pastime. I believe student results from standardized tests should not be used to evaluate teachers because the data are imprecise and the effects are pernicious. Including such inaccurate measures is both unfair to teachers and detrimental to student learning.

As a large body of research suggests, standardized test data are imprecise for two main reasons. First, they do not account for individual and environmental factors affecting student performance, factors over which teachers have no control. (Think: commitment, social class, family.) Second, high-stakes, one-time tests increase the likelihood of random variation so that scores fluctuate in arbitrary ways not linked to teacher efficacy. (Think: sleep, allergies, the heartache of a recent breakup.)

High-stakes assessments are also ruinous to student learning. They encourage, at least, teaching to the test and, at most, outright cheating. This phenomenon is supported by Campbell's law, which states statistics are more likely to be corrupted when used in making decisions, which in turn corrupts the decision making process itself. (Think: presidential campaigns.)

As a teacher, if my livelihood is based on test results, then I will do everything possible to ensure high marks, including narrowing the curriculum and prepping fiercely for the test. The choice between an interesting project and a paycheck is no choice at all. These are amazing disincentives to student learning. Tying teachers' careers to standardized tests does not foster creative, passionate, skillful young adults. It does exactly the opposite.

[readon2 url="http://www.edutopia.org/blog/standardized-testing-and-teacher-evaluation-aaron-pribble"]Continue reading...[/readon2]

Backlash to Education Mandates Grows, Spreads

“It’s always hard to tell for sure exactly when a revolution starts,” wrote John Tierny in The Atlantic recently. “I’m not an expert on revolutions,” he continued, “but even I can see that a new one is taking shape in American K-12 public education.”

Tierney pointed to a number of signs of the coming “revolution:”

  • Teachers refusing to give standardized tests, parents opting their kids out of tests, and students boycotting tests.
  • Legislators reconsidering testing and expressing concerns about corruption in the testing industry.
  • Voucher and other “choice” proposals being strongly contested and voted down in states that had been friendly to them.

Tierney linked to a blog post by yours truly, “The Inconvenient Truth of Education Reform,” explaining how the movement known as “education reform” has committed severe harm to the populations it professes to serve while spreading corruption and enriching businesses and political figures.

Echoing Tierney, on the pages of Slate, The Nation, and elsewhere, David Kirp, education professor and author of a popular new book casting doubt on competitive driven, market-based school reform, declared that cheating scandals and parent rebellions over high stakes standardized testing were proof that much ballyhooed reform policies championed by New York City Mayor Michael Bloomberg and Education Secretary Arne Duncan are not “a proven – or even a promising – way to make schools better.”

Kirp declared that mounting evidence from school reform efforts in major U.S. metropolitan areas reveals “it’s a terrible time for advocates of market-driven reform in public education. For more than a decade, their strategy – which makes teachers’ careers turn on student gains in reading and math tests, and promotes competition through charter schools and vouchers – has been the dominant policy mantra. But now the cracks are showing.”

[readon2 url="http://educationopportunitynetwork.org/unified-backlash-to-education-mandates-grows-spreads/"]Continue reading...[/readon2]

Ohio Teachers endorse Common Core Standards

From our mailbag

At its Spring Representative Assembly in Columbus, members of the Ohio Education Association, the state’s largest education employee union, voted to support careful implementation of the Common Core State Standards for English language arts and mathematics – but warned that outdated tests and lack of support for the standards could create major obstacles for success.

To address those issues, OEA members called for immediate suspension of outdated testing that does not align with the new Common Core State Standards and demanded comprehensive state and local support for the Common Core to bolster chances for successful implementation and challenging learning opportunities for students.

The moratorium on outdated high-stakes testing must begin now, said OEA President Patricia Frost-Brooks. “It defies common sense for students, teachers, and schools to be held accountable for test scores based on standards that have been rejected by educators – and the State Board of Education. There is no benefit from teaching and testing young people on outdated standards.”

OEA warned that failure to provide professional development, technology for computer-based testing and time for collaborative planning “threaten successful implementation of the Common Core initiative.”

“The failure of policy makers to fund and support local implementation with the technology and ongoing communication with parents and communities will create unnecessary challenges for school districts and their employees,” said Frost-Brooks.

Common Core has great potential, and the issues OEA has identified are problems with implementation and support, not problems with the standards themselves, Frost-Brooks said.

“Teachers, parents and community leaders all helped create the Common Core, using research, best practices, and their hopes for the next generation,” said Frost-Brooks. “If properly implemented, Common Core learning strategies offer a dynamic foundation for lifelong learning, empowering teachers to use a wider range of strategies and their professional judgment and giving students more time to master essential knowledge and skills.”

That ought to embolden some of the tea party conspiracy theorists now popping up all over the place opposing Common Core.

Is Ohio ready for computer testing?

The Cincinnati Enquirer has a report on how Ohio schools are not going to be ready for the new online PARCC tests that are scheduled to be deployed next year.

Ohio public schools appear to be far short of having enough computers to have all their students take new state-mandated tests within a four-week period beginning in the 2014-15 school year.

“With all the reductions in education funds over the last several years and the downturn in the economy, districts have struggled to be able to bring their (computer technology) up to the level that would be needed for this,” said Barbara Shaner, associate executive director of the Ohio Association of School Business Officials.

Districts could seek state permission to deliver the new tests on paper if they can’t round up enough computers, tablets and gadgets to go around, Jim Wright, director of curriculum and assessment for the Ohio Department of Education, said. A student taking a paper test could be at a disadvantage, though. While the paper tests won’t have substantially different questions, a student taking the test online will have the benefit of audio and visual prompts as well as online tasks that show their work on computer, said Chad Colby, a spokesman for the Partnership for Assessment of Readiness for College and Careers.

The state really does need to step up and help districts fund this costly mandate that has been foisted upon them. Added to this, the computer industry is going through significant changes as more and more people move away from the traditional desktops and laptops in favor of the simpler more portable tablets. School districts could find themselves having to make costly investments again in the near future if they pick the wrong technologies.

The article makes note of the possibility of paper based test takers being at a possible disadvantage over those taking the computer based tests. There has been a significant amount of research over the years on this, and the results seem to indicate the opposite effect - that computer based test takers score lower than paper based tests.

The comparability of test scores based on online versus paper testing has been studied for more than 20 years. Reviews of the comparability literature research were reported by Mazzeo and Harvey (1988), who reported mixed results, and Drasgow (1993), who concluded that there were essentially no differences in examinee scores by mode-of-administration for power tests. Paek (2005) provided a summary of more recent comparability research and concluded that, in general, computer and paper versions of traditional multiple-choice tests are comparable across grades and academic subjects. However, when tests are timed, differential speededness can lead to mode effects. For example, a recent study by Ito and Sykes (2004) reported significantly lower performance on timed web-based norm-referenced tests at grades 4-12 compared with paper versions. These differences seemed to occur because students needed more time on the web-based test than they did on the paper test. Pommerich (2004) reported evidence of mode differences due to differential speededness in tests given at grades 11 and 12, but in her study online performance on questions near the end of several tests was higher than paper performance on these same items. She hypothesized that students who are rushed for time might actually benefit from testing online because the computer makes it easier to respond and move quickly from item to item.

A number of studies have suggested that no mode differences can be expected when individual test items can be presented within a single screen (Poggio, Glassnapp, Yang, & Poggio, 2005; Hetter, Segall & Bloxom, 1997; Bergstrom, 1992; Spray, Ackerman, Reckase, & Carlson, 1989). However, when items are associated with text that requires scrolling, such as is typically the case with reading tests, studies have indicated lower performance for students testing online (O’Malley, 2005; Pommerich, 2004; Bridgeman, Lennon, & Jackenthal, 2003; Choi & Tinkler, 2002; Bergstrom, 1992)

The Network for Public Education launches

Diane Ravitch and a host of other pro-public education supporters have launched a new and exciting endevour to counter corporate education reformers - The Network for Public Education

Here's their announcement

Our public schools are at risk. As public awareness grows about the unfair attacks on public education, parents, teachers, and concerned citizens are organizing to protect our public schools.

Public education is an essential institution in a democratic society. We believe that we must stand together to resist any efforts to privatize it.

We must also stand together to oppose unsound policies that undermine the quality of education, like high-stakes testing and school closings.

High-stakes testing takes the joy out of learning. It crushes creativity and critical thinking, the very qualities our society needs most for success in the 21st century. High-stakes testing does not tell us whether and how well students are learning or teachers are teaching; it does waste precious time and resources.

No school was ever improved by closing it. Every community should have good public schools, and we believe that public officials have a solemn responsibility to improve public schools, not close or privatize them.

The movement to support public education is growing every day:

From teachers in Seattle who are boycotting the MAP test, to students testifying in Washington about the devastating effect of school closures, to children, parents and teachers standing together in Chicago, to voters in Indiana, to students organizing against excessive testing in Providence, Rhode Island, and Portland, Oregon; from school boards in Texas opposing high-stakes testing; parents, educators, students, and other citizens are taking bold action to speak out for our schools.

We reject phony reforms that undermine our schools and set them up for failure and privatization. We oppose the constant increase in testing, with ever higher stakes attached to them. We have had enough of school closures, and the rapid expansion of selective charter schools.

Our public schools need our support. Our schools are part of our democratic heritage. They should be anchors of stability and hope in our communities.

We believe in keeping public education public. We oppose efforts to transfer public funds to private corporations. We oppose the transfer of public funds and students to for-profit corporations. We say to big business: hands off our public schools!

Today we are launching a new organization, the Network for Public Education. This group will serve to connect all those who are passionate about our schools – students, parents, teachers and OTHER citizens. We will share information an research on vital issues that concern the future of public education. We hope to inspire one another as we work together and learn together about how to resist the attacks on public education.

We are many. There is power in our numbers. Together, we will save our schools.

We hope to help support the growing social movement to support public schools. When you join this network, you will become a part of this movement. We will send out regular bulletins, and use our website to share the latest information about what is happening around the country. We will link activists, grassroots organizations, and bloggers from coast to coast, and whenever possible, support one another.

Our neighborhood schools are not just a local concern any more. It took the work of many before us to build our schools, and it will take the work of many more of us to make sure they are standing for the next generation. Let’s get started.