Saturday, August 1, 2009

Reentry Program Evaluation

Though, as posted yesterday, there are many instances in the media of programs that appear to be successful—and many are for singular reasons—the evidence as determined by rigorous evaluation has still not identified large scale and replicable programs that reduce recidivism at a statistical level high enough to be able to effectively challenge the current 60-70% national recidivism rate.

Rigorous evaluation is the key, and James Q. Wilson describes the four things needed (the fifth, an independent third party evaluator, though not mentioned, is understood as necessary within the evaluation profession) in the text he edited with Joan Petersilia, Crime: Public Policies for Crime Control.

An excerpt.

“There are hundreds, perhaps thousands, of crime-prevention programs under way. Many may work (and, of course, all their leaders think they work). But which actually work can only be determined by a rigorous evaluation. Not many have been evaluated in this way. A rigorous evaluation requires four things to be done: First, people must be assigned randomly to either the prevention program or a control group. Random assignment virtually eliminates the chance that those in the program will differ in some unknown way from those not in it. Random assignment is better than trying to match people in the two because we probably will not know (or even be able to observe) all the ways by which they should be matched. Second, the prevention must actually be applied. Sometimes people are enrolled in a program but do not in fact get the planned treatment. Third, the positive benefit, if any, of the program must last for at least one year after the program ends. It is not hard to change people while they are in a program; what is difficult is to make the change last afterward. Fourth, if the program produces a positive effect (that is, people in it are less likely to commit crimes that similar ones not in it), that program should be evaluated again in a different location. Some programs will work once because they are run by exceptional people or in a community that facilitates its success; the critical test is to see if they will run when tried elsewhere using different people. (p. 553)