Claims NAEP or FCAT Scores Validate Florida Formula “Implausible” and “Violates Basic Principles of Policy Analysis”

In the December 2012 open hearing where incoming education Tony Bennett was interviewed, board of education chairman Gary Chartrand began the meeting with “good news” about how well Florida 4th graders stacked up against the rest of the world on NAEP. Former chair Kathleen Shannahan seconded the good news as it should end controversy over high-stakes testing and justify their reforms.

Not so fast says respected senior fellow from the Albert Shanker Institute, Matthew Di Carlo. From John O’Connor of StateImpact comes this from Di Carlo:

In the meantime, regardless of one’s opinion on whether the “Florida formula” is a success and/or should be exported to other states, the assertion that the reforms are responsible for the state’s increases in NAEP scores and FCAT proficiency rates during the late 1990s and 2000s not only violates basic principles of policy analysis, but it is also, at best, implausible. The reforms’ estimated effects, if any, tend to be quite small, and most of them are, by design, targeted at subgroups (e.g., the “lowest-performing” students and schools). Thus, even large impacts are no guarantee to show up at the aggregate statewide level (see the papers and reviews in the ‘s governor first footnote for more discussion).

In this sense, the first-order problem with the publicity accorded the “Florida formula,” and especially its proliferation to other states, is less about the merits of the policies themselves than the fact that they are being presented as a means to relatively immediate, large improvements in overall performance. Unfortunately, this problem – unrealistic promises based on invalid evidence – is not at all limited to Florida.****

Florida legislators and it’s current governor continue to march forward as if “relatively immediate, large improvements in overall performance” continue to occur. This narrative is largely advanced by Jeb Bush’s foundations and those closely associated with the former governor. Concludes Di Carlo:

We seem to not only expect, but demand instant gratification from interventions that, when they have any track record at all, have never been shown to have anything resembling such an impact. This is often harmful to the policy process. For example, it fosters a disincentive to invest in programs that will not have an immediate effect and, perhaps, an incentive to misuse evidence. Moreover, policies that don’t produce huge results might be shut down even if they’re working; the most effective policies are often those that have a modest, persistent effect that accumulates over time.

Whether we like it or not, real improvements at aggregate levels are almost always slow and incremental. There are no “miracles,” in Florida or anywhere else. The sooner we realize that, and start choosing and judging policies based on attainable expectations that accept the reality of the long haul, the better.

Sounds like a bomb damage assessment of the last ten years’ policy interventions in Florida. Bennett said in a recent interview that Florida hasn’t done too much too fast. He will have his chance to oversee and navigate the state’s past, present and future “reforms.” But these reforms are interrelated and interdependent in such a way that has recently caused multiple collapses which state board members agreed was making them “look bad.” And then a charismatic and persuasive Bennett convinced and reassured  them all was well and good and righteous.


About Bob Sikes

A long time ago and a planet far, far away I was an athletic trainer for the New York Mets. I was blessed to be part of the now legendary 1986 World Series Championship. My late father told me that I'd one day be thankful I had that degree in teaching from Florida State University. He was right and I became twice blesses to become a teacher in the late 1990's. After dabbling with writing about the Mets and then politics, I settled on education.
This entry was posted in EDUCATION, FLORIDA POLITICS and tagged , , , , , , , , , , , , , , , , , , , , . Bookmark the permalink.

2 Responses to Claims NAEP or FCAT Scores Validate Florida Formula “Implausible” and “Violates Basic Principles of Policy Analysis”

  1. Gary Chartrand, from top 50 in grocery store news to running our schools and we wonder why we are in trouble…

  2. Diane Kepus says:

    Since his KIPP schools are not doing well (a mess all over the country) you would think he would keep his mouth shut since he cannot even take care of his own house.

    I do wonder why all these reports are coming out from the “BUSH” friends and Florida always does so great but her own state tests do not reflect that! Could it be that the rest of the nation does not ever bother to look at the whole picture and check what the grades and stats really is? All his sleeping buddies are bound to keep him and his idea results high in the air while our children continue to suffer from all the input by non educators such as Bush and the Fl State School Board. Lets add the Florida man of the year to that list since he is the owner of Charter Schools USA and is not an educator but a business man.

    Still no response from the State Board of Education or any other the others in regard to the FOIA sent in regard to where, how, when, to who and all the other requests regarding their implication is accepting the $30M with $60M more to come from the Communist Chinese for the Charter school system. All that money is certainly not going to teach our kids Mandarin Chinese.

    By the way as to the Gaetz family the apple certainly does not fall far from the tree. That wasn;t very nice of Matt to insult all those Florida legislators who are supposed to be so smart and write all those big bills and their degrees are in psychology – makes them sound like they don’t know anything.

    Remember Scott Plakon that smart legislator who lies and said he wrote the FL. Energy Bill last year – that’s what his college degree is in.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s