show

Advertorials in standardized tests?

A strange story out of New York

At least a half-dozen companies got an unexpected boost in marketing their brands to New York’s children this week — with free product placement on the state’s English exams.

Teachers and students said yesterday’s multiple-choice section of the eighth-grade tests name-dropped at least a handful of companies or products — including Mug Root Beer, LEGO and that company’s smart robots, Mindstorms.

IBM, the comic book and TV show “Teen Titans” and FIFA — the international soccer federation — were also mentioned in the test booklets, some of them with what educators referred to as out-of-place trademark symbols.

“I’ve been giving this test for eight years and have never seen the test drop trademarked names in passages — let alone note the trademark at the bottom of the page,” said one teacher who administered the exam.

How long before corporate education boosters push for companies to pay for advertising within standardized tests?

How Do Value-Added Indicators Compare to Other Measures of Teacher Effectiveness?

Via

Highlights

  • Value-added measures are positively related to almost all other commonly accepted measures of teacher performance such as principal evaluations and classroom observations.
  • While policymakers should consider the validity and reliability of all their measures, we know more about value-added than others.
  • The correlations appear fairly weak, but this is due primarily to lack of reliability in essentially all measures.
  • The measures should yield different performance results because they are trying to measure different aspects of teaching, but they differ also because all have problems with validity and reliability.
  • Using multiple measures can increase reliability; validity is also improved so long as the additional measures capture aspects of teaching we value.
  • Once we have two or three performance measures, the costs of more measures for accountability may not be justified. But additional formative assessments of teachers may still be worthwhile to help these teachers improve.

Introduction

In the recent drive to revamp teacher evaluation and accountability, measures of a teacher’s value added have played the starring role. But the star of the show is not always the best actor, nor can the star succeed without a strong supporting cast. In assessing teacher performance, observations of classroom practice, portfolios of teachers’ work, student learning objectives, and surveys of students are all possible additions to the mix.

All these measures vary in what aspect of teacher performance they measure. While teaching is broadly intended to help students live fulfilling lives, we must be more specific about the elements of performance that contribute to that goal – differentiating contributions to academic skills, for instance, from those that develop social skills. Once we have established what aspect of teaching we intend to capture, the measures differ in how valid and reliable they are in capturing that aspect.

Although there are big holes in what we know about how evaluation measures stack up on these two criteria, we can draw some important conclusions from the evidence collected so far. In this brief, we will show how existing research can help district and state leaders who are thinking about using multiple measures of teacher performance to guide them in hiring, development, and retention.

[readon2 url="http://www.carnegieknowledgenetwork.org/briefs/value-added/value-added-other-measures/"]Continue reading...[/readon2]

Do Politicians Know Anything About Schools and Education? Anything?

Diane Ravitch poses a dozen piercing questions on education and school policy. Some of them turn conventional thinking on its ear, and each could be a starting point for reporting on elections, from the presidency on down to local school boards

1. Both Republican candidates and President Obama are enamored of charter schools - that is, schools that are privately managed and deregulated. Are you aware that studies consistently show that charter schools don't get better results than regular public schools? Are you aware that studies show that, like any deregulated sector, some charter schools get high test scores, many more get low scores, but most are no different from regular public schools? Do you recognize the danger in handing public schools and public monies over to private entities with weak oversight? Didn't we learn some lessons from the stock collapse of 2008 about the risk of deregulation?

2. Both Republican candidates and President Obama are enamored of merit pay for teachers based on test scores. Are you aware that merit pay has been tried in the schools again and again since the 1920s and it has never worked? Are you aware of the exhaustive study of merit pay in the Nashville schools, conducted by the National Center for Performance Incentives at Vanderbilt, which found that a bonus of $15,000 per teacher for higher test scores made no difference?

3. Are you aware that Milwaukee has had vouchers for low-income students since 1990, and now state scores in Wisconsin show that low-income students in voucher schools get no better test scores than low-income students in the Milwaukee public schools? Are you aware that the federal test (the National Assessment of Educational Progress) shows that - after 21 years of vouchers in Milwaukee - black students in the Milwaukee public schools score on par with black students in Mississippi, Alabama, Georgia, and Louisiana?

4. Does it concern you that cyber charters and virtual academies make millions for their sponsors yet get terrible results for their students?

5. Are you concerned that charters will skim off the best-performing students and weaken our nation's public education system?=

6. Are you aware that there is a large body of research by testing experts warning that it is wrong to judge teacher quality by student test scores? Are you aware that these measures are considered inaccurate and unstable, that a teacher may be labeled effective one year, then ineffective the next one? Are you aware that these measures may be strongly influenced by the composition of a teacher's classroom, over which she or he has no control? Do you think there is a long line of excellent teachers waiting to replace those who are (in many cases, wrongly) fired?

7. Although elected officials like to complain about our standing on international tests, did you know that students in the United States have never done well on those tests? Did you know that when the first international test was given in the mid-1960s, the United States came in 12th out of 12? Did you know that over the past half-century, our students have typically scored no better than average and often in the bottom quartile on international tests? Have you ever wondered how our nation developed the world's most successful economy when we scored so poorly over the decades on those tests?

8. Did you know that American schools where less than 10% of the students were poor scored above those of Finland, Japan and Korea in the last international assessment? Did you know that American schools where 25% of the students were poor scored the same as the international leaders Finland, Japan and Korea? Did you know that the U.S. is #1 among advanced nations in child poverty? Did you know that more than 20% of our children live in poverty and that this is far greater than in the nations to which we compare ourselves?

9. Did you know that family income is the single most reliable predictor of student test scores? Did you know that every testing program - the SAT, the ACT, the NAEP, state tests and international tests - shows the same tight correlation between family income and test scores? Affluence helps - children in affluent homes have educated parents, more books in the home, more vocabulary spoken around them, better medical care, more access to travel and libraries, more economic security - as compared to students who live in poverty, who are more likely to have poor medical care, poor nutrition, uneducated parents, more instability in their lives. Do you think these things matter?

10. Are you concerned that closing schools in low-income neighborhoods will further weaken fragile communities?

11. Are you worried that annual firings of teachers will cause demoralization and loss of prestige for teachers? Any ideas about who will replace those fired because they taught too many low-scoring students?

12. Why is it that politicians don't pay attention to research and studies?

Add end And another question that came to mind after the initial posting of this article:

13. Do you know of any high-performing nation in the world that got that way by privatizing public schools, closing those with low test scores, and firing teachers? The answer: none.

Diane Ravitch is Research Professor of Education at New York University and a distinguished historian of American education.

TDS talks RttT

John Stewart of the Daily Show, talked to Melody Barnes, President Obama’s chief of domestic policy about K-12 education reforms and Race to the top (RttT). Fascinating discussion in typical TDS fashion. Check it out.

What Value-Added Research Does And Does Not Show

Worth reading in it's entirety.

For example, the most prominent conclusion of this body of evidence is that teachers are very important, that there’s a big difference between effective and ineffective teachers, and that whatever is responsible for all this variation is very difficult to measure (see here, here, here and here). These analyses use test scores not as judge and jury, but as a reasonable substitute for “real learning,” with which one might draw inferences about the overall distribution of “real teacher effects.”

And then there are all the peripheral contributions to understanding that this line of work has made, including (but not limited to):

Prior to the proliferation of growth models, most of these conclusions were already known to teachers and to education researchers, but research in this field has helped to validate and elaborate on them. That’s what good social science is supposed to do.

Conversely, however, what this body of research does not show is that it’s a good idea to use value-added and other growth model estimates as heavily-weighted components in teacher evaluations or other personnel-related systems. There is, to my knowledge, not a shred of evidence that doing so will improve either teaching or learning, and anyone who says otherwise is misinformed.*

As has been discussed before, there is a big difference between demonstrating that teachers matter overall – that their test-based effects vary widely, and in a manner that is not just random –and being able to accurately identify the “good” and “bad” performers at the level of individual teachers. Frankly, to whatever degree the value-added literature provides tentative guidance on how these estimates might be used productively in actual policies, it suggests that, in most states and districts, it is being done in a disturbingly ill-advised manner.

[readon2 url="http://shankerblog.org/?p=4358&mid=5417"]Read entire article[/readon2]

Clippy as the model for Bill Gates involvement in schools

Remember the obnoxious, hyperactive paperclip that popped up in Word when you were trying write a letter? As soon as you typed "Dear," up popped up Clippy:

It looks like you're writing a letter.
Would you like help?

Uninvited.

You'd been writing letters for decades, but Microsoft insisted you needed what they called "proactive help." And there was Clippy insisting he could show you how to do your job better. No matter how many times you clicked "Just type the letter without help," Clippy would pop up again, insisting you must need help.

Your train of thought melted as you tried to remember how to get rid of the dorky paperclip.
Writing in the Wall Street Journal , Stanford professor Clifford Nass reports, "One of the most reviled software designs of all time was Clippy, the animated paper clip in Microsoft Office. The mere mention of his name to computer users brought on levels of hatred usually reserved for jilted lovers and mortal enemies. There were 'I hate Clippy' websites, videos and T-shirts in numerous languages." Nass observes that "Clippy's problem was that he was utterly oblivious to the appropriate ways to treat people. Every time a user typed "Dear," Clippy would dutifully propose, "I see you are writing a letter. Would you like some help?" --no matter how many times the user had rejected this offer in the past."

And he wouldn't stop smiling. You're pounding the keyboard trying to find the "DIE!" function but he keeps smiling.

YouTube offers a hilarious "Wait Wait Don't Tell Me" audio segment on the death of the reviled Microsoft mascot. Listeners voted this the funniest segment of all time. The show host Peter Segal says, "One day the engineers at Microsoft said, you know, the people using our products, they're frustrated, they're angry, but they're not insane with rage. How can we focus their rage? How about if just in the middle of doing something, an animated paperclip pops up on the screen and says: 'Can I help you? What are you doing? Oh, can I see?'"

The segment includes the Bill Gate memo titled "Clippy Must Die."

But now, teachers across America are discovering that Clippy has been reborn--with Gates barnstorming the country with pronouncements about effective teaching. Never mind you've been teaching for decades, the Bill and Melinda Gates Foundation is there popping up with compulsory proactive help, insisting they can show you how to do your job better. No matter how much you beg, "Just let me teach," Clippy Bill is there insisting you must need help.

[readon2 url="http://susanohanian.org/show_commentary.php?id=986"]Continue reading[/readon2]