Stopping the innocent from pleading guilty: Can brain-based recognition detection tests help?

P300 Concealed Information Test

So I have another paper coming out. It’s about plea-bargaining, brain-based lie detection and the innocence problem. I wasn’t going to write about it on the blog, but then somebody sent me a link to a recent article by Jed Radoff entitled “Why Innocent People Plead Guilty”. Radoff’s article is an indictment of the plea-bargaining system currently in operation in the US. Since my article touches upon same thing, I thought it might be worth offering a summary of its core argument.

The gist of it is that I think that it may be possible to use a certain type of brain-based lie detection — the P300 Concealed Information Test (P300 CIT) — to rectify some of the problems inherent in current systems of plea bargaining. The word “possible” is important here. I don’t believe that the technology is currently ready to be used in this way. I think further field testing needs to take place. But I don’t think the technology is as far away as some people might believe either.

What I find interesting is that, despite this, there is considerable resistance to the use of the P300 CIT in academic and legal circles. Some of that resistance stems from unwarranted fealty to the status quo, and some stems from legitimate concerns about potential abuses of the technology (miscarriages of justice etc.). In the article, I try to overcome some of this resistance by suggesting that the P300 CIT might be better than other proposed methods for resolving existing abuses of power within the system. Hence my focus on plea-bargaining and the innocence problem.

Anyway, in what follows I’ll try to give a basic outline of my argument. As ever, for the detail, you’ll have to read the original paper.


1. Plea Bargaining and the Innocence Problem
Plea bargaining is the common practice whereby by a defendant charged with a particular offence will plead guilty to a lesser offence, in an effort to reduce their expected punishment. Radoff’s article describes how the practice currently operates in the US. Similar practices operate in other countries, though they are possibly less extreme than that found in the US.

Plea-bargaining is attractive to both prosecutors and defendants. It is attractive to prosecutors because they are incentivised to achieve the maximum amount of punishment for the minimum expenditure of prosecutorial resources. Plea bargaining enables them to do this by eliminating the costs associated with lengthy trials. It is attractive to defendants because they are incentivised to minimise their expected amount of punishment. Going to trial is risky from their perspective because it carries with it a higher possible sentence. If they are being prudent, pleading guilty to a lesser offence is often going to be the safer bet.

In fact, things are probably skewed more heavily in favour of entering a guilty plea than I am letting on. As Radoff points out in his article, certain changes to sentencing law (mandatory minimums) coupled with differential power as between prosecutors and (most) defence lawyers, will make entering a guilty plea nearly always the sensible thing to do. For example, most defence lawyers are at a considerable informational disadvantage when they first meet with the prosecutors. They will have had limited opportunities to meet with their clients, whereas the prosecutor will have a full police report, witness testimony and forensic evidence (assuming there is any):

Against this background, the information-deprived defense lawyer, typically within a few days after the arrest, meets with the overconfident prosecutor, who makes clear that, unless the case can be promptly resolved by a plea bargain, he intends to charge the defendant with the most severe offenses he can prove…If, however, the defendant wants to plead guilty, the prosecutor will offer him a considerably reduced charge—but only if the plea is agreed to promptly (thus saving the prosecutor valuable resources). 

(Radoff 2014)

Under these conditions who wouldn’t be inclined to plead guilty?

“The truly innocent”, you might respond. But that is not the case. Again, as Radoff points out in his article, studies have shown that a number of innocent defendants have opted to plead guilty in order to avoid more serious charges. The Innocence Project, which seeks to exonerate innocent defendants on the basis of DNA evidence, has identified 30 people (approx. 10% of their total) who pleaded guilty despite later turning out to be innocent. Similarly, the National Registry of Exonerations (in Michigan Law School) has found that 10% (or 151 cases) of legally acknowledged exonerations since 1989 have involved false guilty pleas. Of course, the real number is difficult to know since many of those who plead guilty despite their innocence will never be uncovered. But the 10% figure from these sources looks worrisome.

This is plea bargaining’s innocence problem: the incentives are such that innocent defendants are persuaded to plead guilty more often than we would like.


2. The Innocence Problem as a Signalling Problem
There are many possible causes of the innocence problem. Long-standing structural and political issues are part of the problem, as are the idiosyncrasies of particular cases and personalities. But at the heart of them all is a basic signalling problem. Innocent defendants feel the pull of the guilty plea because they know they have no way in which to credibly signal their innocence to the prosecutors.

The classic signalling problem can be found in the biblical tale of King Solomon and the two women. I think I’ve shared this many times on the blog so you’ll have to forgive me if I do it one more time. According the traditional version of the story, two women came to King Solomon with a dispute as to parental rights. Apparently, each woman had recently had a child. One woman had rolled over her child while sleeping and the child suffocated and died. She then stole the other woman’s child and claimed it as her own. This is what led to the dispute coming before King Solomon.

The problem for Solomon was that the signals sent to him by the women were the same. They both claimed to be the mother, with equal vigour, and in the absence of further evidence there was no reason to believe one over the other. Economists sometimes refer to this as a pooling equilibrium: both the fake mother and the real mother are incentivised to adopt the same signalling strategy. The claim I’m making here — and I’m certainly not the only one to make it — is that a similar sort of pooling takes place in the typical criminal case. It doesn’t matter how much the truly innocent defendant protests their innocence. Their signals will tend to be pooled with the signals of guilty defendants who also protest their innocence. In the absence of overwhelming evidence to the contrary, there is no reason for the prosecutors to believe either.

How can the signalling problem be resolved? Well, speaking in very abstract terms, you need to change the incentives so as to avoid the pooling equilibrium. That’s exactly what King Solomon did in the case of the two women. He decreed that the child be cut in half and shared equally between the them. The false mother was happy to go along with this (she had already lost her child and wished to punish the true mother), but true mother was not (she didn’t want her child to die). Consequently, she was incentivised to concede the dispute to the false mother, which allowed Solomon to work out her real identity. The signals were suddenly separated.

Can something similar be done in the case of the innocence problem? Can we change the incentives so that there is some signal that innocent defendants are more likely to send to the prosecutors than guilty ones?


3. The P300 CIT as a device for Credible Signalling
In a lengthy article, which I covered last year, Russell Covey has argued that the signalling problem can be solved by introducing a “subwager” into the pre-trial bargaining game that is being played between prosecutors and defendants. He explains the idea by analogy to a simple card game. Since I went through the details of that card game before, I’ll just skip to the conclusion here. The subwager is akin to a bet that a truly innocent defendant would be willing to take, while a guilty one would not. In other words, it is a bet with asymmetrical risks: it is high risk to the guilty defendant but low risk to the innocent.

My claim is that the willingness to undergo a voluntary P300 CIT could count as such a subwager. Now, you may be wondering, what exactly is a P300 CIT and how can it count as a subwager? In brief, a P300 CIT is a type of brain-based lie detection. Actually, no, scrap that: it’s not really a form of lie detection. Rather, it is a type of memory or recognition detection test. It provides evidence for whether or not a suspect recognises information that was present at a crime scene. Thus, it can be used (as part of an appropriate inductive inference) to either link a guilty defendant to a crime scene or separate an innocent defendant from a crime scene. It does so by detecting the presence or absence of a particular of a brainwave known as the P300. Hence the name. The assumption underlying the test — and backed up by experimental tests thereof — is that this brainwave is detected when a suspect — or, perhaps more correctly, a suspect’s brain — recognises information.

I don’t want to get into the evidence supporting the reliability of the P300 test here. I cover that at some length in my article, and there is an excellent review paper covering all the experimental evidence in favour (and against) the version of the test that I think stands the best chance of actual forensic use. Suffice to say, I think the evidence for the test is more impressive than you might think (though certainly not without its flaws). It can be used to distinguish those who recognise crime-relevant information from those who do not at a rate that is far better than chance (with several experimental tests reporting accuracy levels above 90%). To be sure, there have been dubious uses of the test in past — for instance, Lawrence Farwell’s use of a P300 “brain fingerprinting” test has been criticised — and we should guard against dubious uses in the future, but I nevertheless believe that with more extensive field testing this technology could be used in forensic contexts.

But, as I say, I don’t want to dwell on the evidence in favour of the P300. Instead, I want to highlight how it could be used to resolve the innocence problem. In brief, I think the test provides a way for innocent defendants to credibly signal their innocence to investigators and prosecutors of crimes. Why so? Because the test has the asymmetrical risk profile needed for a successful subwager. It presents a low-risk to innocent defendants (indeed, one of the nice things about the P300 test is its low rate of false positives, particularly when compared with classic forms of lie detection), but a high-risk to guilty defendants. Innocent defendants could thus voluntarily submit to such a test and credibly signal their innocence to prosecutors. In the article, I develop this argument in more detail, explaining why it is important that the use of the test be truly voluntary and why it is important not to simply infer guilt from an unwillingness to undergo such a test. To summarise the argument:

• (1) The innocence problem arises from a signalling problem: signals sent by innocent defendants are indistinguishable from the signals sent by guilty defendants.

• (2) Introducing a subwager into the pre-trial bargaining game can help solve this signalling problem by giving those with private knowledge of innocence a credible way to distinguish themselves from others.

• (3) Giving defendants the option of voluntarily submitting to a P300 CIT provides them with just such a subwager.

• (4) Therefore, giving defendants the option of voluntarily submitting to a P300 CIT can help solve the innocence problem.

Don’t read too much into the wording of this conclusion. I don’t think that my proposal will fully “solve” the innocence problem. At best it will provide a partial solution, applicable in a certain range of cases. But I think this is nothing to be sniffed at and could be considered seriously in the not too distant future.



4. Criticisms of my proposal?
This initial argument for my proposal will probably seem unpersuasive in and of itself. That’s why I insist upon developing the argument within a comparative advantage framework. In other words, within a framework that explicitly compares the proposal to other possible solutions to the innocence problem. When considered in this light, I believe it becomes a good deal more persuasive. I’ll try to explain by considering three other possible solutions to the innocence problem (there are more — for example other types of forensic evidence like DNA testing can be used and have been used by the Innocence Project — but in my analysis I’m limiting my focus to cases in which these other forms of evidence are not available).

The first solution is the one proposed by Russell Covey, from whom I got the idea of the subwager. He thinks that voluntary submission to interrogation functions as a credible signalling device for innocent defendants. In other words, if I am truly innocent, I should forego my right to silence and submit myself to robust questioning by the authorities. Since I am innocent, I am more likely to “pass” the interrogation test than a guilty defendant. The asymmetry of risks needed for the subwager is present in this decision. To be fair, Covey adduces some empirical evidence to suggest that innocent defendants really are better off if they voluntarily submit to interrogation. But I think we should be cautious about this proposal. Interrogation, particularly if the methods become more robust, is open to abuse and comes with no known error rates. The P300 CIT has an advantage over interrogation in that it is a scientifically based test, with known error rates, that has to be administered in accordance with strict protocols.

Another possible solution would be to use other methods of lie detection — e.g. fMRI lie detection. The reasoning would be similar: they represent a low risk to innocent defendants and a high risk to guilty defendants. But, again, I think we should be cautious about such a proposal. Other methods of lie detection tend to follow a control question test (CQT) format, which is open to abuse and has been used, in the past, as little more than an interrogation prop. Also, I think we should be much more suspicious of the evidence claimed on behalf of fMRI-based tests: the signals can be overinterpreted, and it is much more difficult to test whether someone is lying in a lab setting than it is to test whether they recognise certain information. I think the P300 CIT has the advantage once more.

Finally, there is what I call the “sousveillance” solution. This isn’t a subwager-like proposal. This is something far more radical. The idea behind it is that everybody wears veillance technologies at every moment in their lives. This technology will allow them to record and detail everything they have ever done. This will provide them will reliable and credible documentary evidence of their movements and, if they are truly innocent, it should provide them with a way to document their innocence. I accept that this may resolve the innocence problem. And I accept that the evidence produced by such veillance technologies may be more reliable than that produced by a P300 CIT. But, again, I think the P300 has some advantages over the sousveillance solution. For one thing, the sousveillance solution would require prospective implementation, i.e. everyone would need to be using such technologies before any crime were committed. The P300 CIT can be implemented retrospectively, i.e. to investigate crimes after they have taken place. Since we may not be able to guarantee the widespread use of sousveillence technologies, the P300 CIT seems like it could be more useful. For another thing, the widespread use of sousveillance would have a range of other social costs (and benefits) associated with it. It should not be adopted as a targeted solution to the innocence problem. Still, I accept that certain technological trends may be pushing us in this direction. (Note: The sousveillance solution is something I wanted to discuss in the article but the editor asked me to remove the discussion of it before publication. I am grateful to have the opportunity to add it in here)

When considered in light of these other possible solutions, the P300 CIT “solution” to the innocence problem looks more promising. There are other objections to the proposal too, but I’ll leave you read about those in the article itself.


5. Conclusion
To briefly sum up, there is an innocence problem inherent in existing systems of plea-bargaining. The incentives of the system are such that innocent defendants are sometimes persuaded to plead guilty. Ideally, we should avoid this problem. Although there are many possible causes, one of the chief ones is the inability of innocent defendants to credibly signal their innocence to prosecutors. I have argued that a brain-based recognition detection test — specifically the P300 CIT — may help to correct for that inability. The technology is not ready for this use just yet, but may be in the near future.