New Jersey Study Commission on Testing: Keep Weighing the Pig

New Jersey's Study Commission on the Use of Student Assessments issued its report this week after a year and a half of deliberations. The commission was ostensibly formed to look into over-testing in New Jersey schools, but anyone who follows New Jersey politics at all will not be surprised that this commission told Governor Christie exactly what he wanted to hear. That is what study commissions in New Jersey are for.

The report is  a densely written 34 pages long and contains 49 recommendations, so to save you some reading time, Russ on Reading has dug into the report to summarize the findings here.

1. Keep weighing the pig every year

In the introduction the commission acknowledges the "anxiety and fear" surrounding the testing issue, but concludes that this is just so much smoke and mirrors. The report says:

... one point must be abundantly clear: the Study Commission firmly believes all students in New Jersey’s public schools who are eligible should be required to take the State standardized assessment (i.e., PARCC)

And why must New Jersey students in grades 3-8 be required to take this test every year?

Doing so will ensure all students are progressing well in their educational endeavors and all public schools are effective for all students. High-quality assessments such as PARCC will hold schools accountable for serving all of their students, including those from disadvantaged backgrounds. The Study Commission believes it will be impossible to effectively close achievement gaps between and among students without accurate and actionable information.

So there we have it. The same old education reform mantra. We need to keep testing because we need to know how students are progressing and to hold schools accountable for serving all students. In other words the Study Commission has bought into the rhetoric of No Child Left Behind, which the federal government left behind a few weeks ago.

This leads me to ask a few questions.

Are standardized tests an effective way to hold schools accountable?

All the evidence would indicate no. According to testing watchdog FairTest, multiple choice, standardized tests "cannot provide meaningful accountability" information.

Are PARCC tests "high quality?"

This is highly debatable. In New Jersey, less than half of the students who took the test in 2015 scored proficient or above. This would indicate that the test is not appropriately rigorous, but just too damn hard. New Jersey typically ranks second or third in educational attainment across the states, yet half of New Jersey's student couldn't pass the test. You can find my full report on the test results here. I have also done an analysis of readability issues with the PARCC here, here and here.

But don't take my word for it. The Gordon Commission report, produced under the sponsorship of ETS of all people, concluded that Common Core tests are currently "far from what is ultimately needed either for accountability or classroom instructional improvement." 

Are standardized tests effective in narrowing the achievement gap?

Of course not. We have twelve years of evidence through NCLB's test and punish policies that the achievement gap is not narrowed by weighing it. Narrowing the achievement gap requires a full frontal attack on inequity. Standardized tests can show us that our society and our educational opportunity are inequitable, but all we really need to do to know that is to look at the neighborhoods in leafy suburbs where kids score well and the long deteriorating neighborhoods in the inner-city where kids struggle to score well.

I have an idea. Instead of yearly testing, let's all just stipulate that the achievement gap exists and that it is in reality an opportunity gap. Then we can do away with all the tests that keep telling us what we already know and focus our attention on things that are likely to reduce the opportunity gap like cleaner, safer schools, wrap around health and wellness programs, and attracting high quality teachers.

2. What we have here is a failure to communicate

The commission seems to believe that the real problem with the testing in New Jersey is a failure to communicate just how wonderful all this testing is and those insidious grumpy pants on social media (including, I suppose, me and other bloggers) who keep spreading nastiness about testing and who fail to grasp the wonderfulness of it all. To that end they make several recommendations for putting new lipstick on the old pig.

The recommendations include creating a shared vision, a proactive communication campaign, a communication team in the NJ Department of Education and a professional email database for the quick dissemination of information. Maybe the NJDOE could enlist the services of a Hollywood public relations firm to make this all baloney look good.

3.  If there is too much testing, it must be the school districts' fault.

The Study Commission seems to not understand what all the fuss is about over-testing, since the Statewide assessments are only done once a year and are mandated by State and federal law. So, if there is over-testing, as many people who testified before the commission complained there was, then it must be the fault of the local districts. To that end the Study Commission recommends that school districts "conduct a thorough inventory of their own assessment systems." School districts are encouraged to make sure their own testing regimes are efficient and used effectively to improve student learning. 

I am sure the districts are grateful for the encouragement and waiting with bated breath for the monies that will support said inventory.


4. Using standardized tests to measure teacher accountability is honky dory.

In the area of teacher accountability and standardized tests, the Commission finds that "the positive and encouraging results of the educator evaluation system thus far, indicate that the system is working." The Study Commission dismisses educator concerns about using test scores for teacher evaluation by saying that much of the concern should be mitigated by the fact that the vast majority of teachers in the first year of the evaluation design were rated as "effective" or "highly effective" and that the ratings were pretty much the same whether student growth scores were used or not.

Once again the Study Commission thinks the biggest problem is a failure to communicate well. If only the NJDOE could get all the good news out about teacher evaluation, people would be embracing it. The Commission calls for professional learning efforts and greater transparency about how teacher evaluations are calculated. They further recommend that the NJDOE "encourage" school districts to use the information for teacher improvement, "particularly of novice and struggling teachers."

The Study Commission might have spent some time looking at all the evidence that shows how the use of standardized test scores in any proportion as a part of a teacher's evaluation is simply unsupportable. They might have read the work of Audrey Amrein- Beardsley (Vamboozled and Rethinking Value Added Models in Education) or looked at the white paper from the American Statistical Association calling into question any significant use of standardized tests as a measure of teacher effectiveness. They might have then said that these measures should be removed entirely from formal teacher evaluation, but that is not the message the Governor wanted to hear.

5. Lots of professional development will help fix the problem

Again, all this noise about standardized testing is simply a matter of misunderstanding. Professional development for teachers, developed under the NJDOE in conjunction with other statewide associations and advocacy groups, will raise the assessment literacy of the teachers in the state and help them to see how useful these standardized tests are. I can see the teachers lining up for these sessions now.

No amount of professional development will change the fact that standardized tests are not very useful for making instructional decisions about individual children because the information is not timely nor does it provide enough detail on individual students. Standardized tests have their place in long range school district curriculum planning, but we don't need yearly tests to get this information.

There is some good news for parents and educators in the report.


1. Special populations of students need special treatment in testing situations.

The Study Commission clearly heard the concerns of parents and teachers of students with special needs and ELL students. They recognize that these students need special accommodations when it comes to standardized testing. They make six recommendations in this area that boil down to acknowledging there is an issue, suggesting the NJDOE do something about it in collaboration with school districts and calling on the NJDOE to talk to the federal Department of Education who insists all these special populations take these tests, to see if more flexibility can be provided in testing these special populations.

These recommendations lack specificity, but the acknowledgment of the issue in the face of stupid federal rules is welcome. It is truly cruel and unusual punishment to insist that all students, no matter what their learning challenges take these tests.

2. Varied Assessments

The report acknowledges that a broad array of assessments is necessary for every school district including formative assessments, end of unit assessments, interim assessments and state assessments. The effective use of the first three is a best practice. Teachers use formative assessment daily through their observation of student learning to adjust teaching and provide small group and individual support when needed. End of unit assessments are designed by teachers and actually test what has been taught to see if it has been learned. Interim assessments may be used to provide a sense of student reading level (benchmark) or student performance against a level of expected performance as measured on a rubric.

All three of these types of assessments provide teachers and administrators with real actionable feedback to help them work with real actual kids. The results of these assessments are timely and they inform instruction. The fourth type of assessment, standardized tests, simply does not provide this feedback and should be used sparingly.

So, there is my quick take on the Study Commission report. Blogger, parent and teacher Marie Corfield has launched a more detailed report here. I suggest you check out what Marie has to say on each of the recommendations. Meanwhile, I know we all can't wait for the glossy, "YEAH, PARCC". public relations campaign that will be coming from the NJDOE. The best way for parents to respond to the publicity barrage will be to simply have their children opt out of the tests. Opting out brings the whole scheme crashing down on itself and impacts the quality of a child's education not at all.