As a poster mentioned in another thread (https://antipolygraph.org/forum/index.php?topic=3906.msg29154#msg29154), MSNBC has released a major investigative report on the Department of Defense's adoption of a hand-held lie detector to be used by U.S. forces deployed in Afghanistan and Iraq. The device is to be used to screen local nationals, who will be questioned through the use of interpreters.
Bill Dedman's report, "New anti-terror weapon: Hand-held lie detector," with video and links to relevant documentation, may be read here:
http://www.msnbc.msn.com/id/23926278/
PCASS documentation obtained by MSNBC under the Freedom of Information Act has been mirrored on AntiPolygraph.org here:
https://antipolygraph.org/read.shtml#PCASS
I've posted to YouTube the following video commentary, "Warning to U.S. Troops on Hand-Held Lie Detector" (http://www.youtube.com/watch?v=y6hmEumtfvk):
http://www.youtube.com/v/y6hmEumtfvk&hl=en
I have given this development some considerable thought, and have decided that I would rather submit to this contraption than a full blown polygraph test. At least with this, the results are not manipulated or subject to interpretive opinion as a polygraph.. What I find most interesting, is the degree of training required to implement thisin the field, as stated below:
"The training is different, too. While polygraph examiners for the Defense Department must have four-year college degrees and experience in law enforcement, the PCASS operators are mostly mid-level enlisted personnel and warrant officers, some as young as 20 years old. While polygraph examiners take a 13-week course and a six-month internship, PCASS operators undergo only one week of training, though most have military training as interrogators. The Defense Department says PCASS is simple to operate, because judgment of truthfulness is left to the computer. "
My question is, why the great disparity in training?
(https://antipolygraph.org/graphics/donald-krapohl-msnbc.jpg)
DACA Deputy Director Donald Krapohl (MSNBC)
It should be borne in mind by soldiers in the field who are being asked to rely on the PCASS that those responsible for developing it, including most visibly Don Krapohl, who has been DACA (http://www.daca.mil)'s media front man for it,
know that PCASS is highly unreliable and have
deliberately overstated its accuracy. (In addition to his appearance in the video segment of the MSNBC report (http://truth.msnbc.com), Krapohl was also interviewed (http://www.npr.org/templates/story/story.php?storyId=89583855) on National Public Radio's
Weekend Edition on Saturday, 12 April.)
DACA avoided testing PCASS under anything approaching field conditions. The same methodology that was recently used in a field study that found voice stress analysis technologies to be no better than chance (https://antipolygraph.org/blog/?p=157) could have been used to test PCASS. Why didn't DACA do so before giving PCASS to our troops?
DACA also avoided testing PCASS in situations with a low base rate for deception (such as in screening for spies, terrorists, and saboteurs), preferring instead to conduct its studies in settings with an unrealistically high base rate of deception of 50%. Krapohl and others at DACA know full well that if a lower and more realistic base rate of deception, say as high as 5% were used, PCASS's evident performance as a screening tool would appear
much worse, the high number of false positives making the few true positive results of little practical use. Why didn't DACA test PCASS under realistic base rate conditions before issuing it to our troops?
And DACA avoided testing PCASS's robustness against countermeasures, despite knowing full well that Al-Qaeda (https://antipolygraph.org/documents/al-qaeda-lie-detection.shtml) and Iraqi insurgents (https://antipolygraph.org/documents/myth-of-the-lie-detector.shtml) have studied them, and any operatives sent to infiltrate U.S. installations, knowing that they're going to be tested either by polygraph or PCASS, are likely to learn how to fool such tests (https://antipolygraph.org/forum/index.php?topic=3911.msg29181#msg29181). Why didn't DACA test PCASS against countermeasures before issuing it to our troops?
As Bill Dedman of MSNBC pointed out in his report, DACA is deliberately overstating PCASS's performance in the unrealistic laboratory tests to which it
was subjected by omitting inconclusive results when calculating its accuracy. There is no scientific ground for doing this: it's willful fraud. DACA is lying to the American people, and to our troops. DACA is touting an accuracy rate of 82-90% based on (again, unrealistic) laboratory studies. But the true accuracy rate based on those studies is only 63-79%. Under field conditions, with realistic base rates, and with subjects knowledgeable about countermeasures, much lower accuracy rates than this latter range of 63-79% can be reasonably expected. And DACA knows this.
As a former soldier, interrogator, and linguist, I'm outraged that DACA is foisting this rubbish on our troops. I encourage all to tell your friends, relatives, and acquaintances in the armed forces about the MSNBC (http://truth.msnbc.com) report on PCASS and the commentary here.
Skippy, do you think the device has undergone sufficient testing? Yes or no? If not, should it be sent into the field? Yes or no. If not, why don't you do something useful for a change like use your fancy title and tell the policy makers that maybe this time they shouldn't believe your exaggerations and claims, but should evaluate the device under proper conditions?
Or, you know, you can just complain about it here, blame all the problems on those who don't believe your lies, and watch people die. That's about par for the course for you guys.
You don't give a damn about anyone dying; you're just concerned about enough people learning the truth that your profession ceases to exist and you're thrown out on your no-talent ass to get a real job. And, yes, I would like fries with that, thank you for asking.
This is just ridiculous. Even if you are upset with George for making information about beating the PCASS more widely available than it otherwise would be, thereby compromising the system unacceptably, wouldn't part of the response include, I dunno, not using the PCASS?
"Sir, the enemy has cracked our code--apparently we've been betrayed!"
"Well, keep using it! Even if they can read all our messages now, that information wasn't supposed to get out. Besides, I get kickbacks for ever encoded message we send!"
Does that make any sense? If it has been compromised--however that happened--stop telling people to use it! Oh, wait, I forgot. Logic isn't typically used among polygraph proponents. Sorry, my bad.
Q: Skippy, do you think the device has undergone sufficient testing? Yes or no?
A: YES
Q: If not, should it be sent into the field? Yes or no.
A: YES
Q: If not, why don't you do something useful for a change like use your fancy title and tell the policy makers that maybe this time they shouldn't believe your exaggerations and claims, but should evaluate the device under proper conditions?
A: I have no fancy title to use.
Q: Or, you know, you can just complain about it here, blame all the problems on those who don't believe your lies, and watch people die. That's about par for the course for you guys.
A: No answer required. Nothing of substance was said.
Q: You don't give a damn about anyone dying; you're just concerned about enough people learning the truth that your profession ceases to exist and you're thrown out on your no-talent ass to get a real job. And, yes, I would like fries with that, thank you for asking.
A: No response required, again your remarks are of no substance other than a feeble attempt at an ad hominid attack. I will respond however just to clear the record.
If the device works 65% of the time and the software keeps false negative results very low, then that's better than the 50/50 guessing method our soldiers are using now in the field.
Finally, for the record, I have been a criminal investigator for almost 38 years and will celebrate my 60th birthday in July. It would make very little difference in my life if polygraph were abolished tomorrow as I am retirement eligible and comfortable. I have a graduate degree and could probably teach criminal justice courses at the local community college where I would, no doubt meet some of the very people who frequent this forum. I might even be able to prevent their ever having to take a polygraph by failing them at school, making their transition from their life long desire to be a police officer to having the opportunity to ask people "Do you want fries with that?" even quicker. Maybe, I'll see you in class!
It doesn't surprise me that you don't know much about logical fallacies, given your great propensity to use them. But, for future reference, the correct term is "ad hominem attack", not "ad hominid attack."
And even though you are an AARP member, I still think you would be displeased if your life's work were repudiated.
But, c'mon, it has not been tested in realistic circumstances. The conditions of the testing were not at all like the conditions under which the device will actually be used. Also, look at how low you're setting the bar: a 65% success rate. Also, truth verification in the absence of a polygraph-like device is not necessarily just 50/50. Or are you admitting that you've never been able to figure out when someone was lying to you without your device? Maybe that's why you guys don't realize how ridiculous your lies appear: you don't think anyone could possibly detect them without your box.
Quote from: George_Maschke on Apr 21, 2008, 09:18 AMQ: Skippy, do you think the device has undergone sufficient testing? Yes or no?
A: YES
Skip,
The PCASS has not been shown to reliably differentiate between liars and truth-tellers at better-than-chance levels of accuracy under field conditions, nor has it been shown to be robust against countermeasures. How can you say this device has been adequately tested? Don't our troops in the field deserve better than this?
Quote from: George_Maschke on Apr 21, 2008, 09:18 AMFinally, for the record, I have been a criminal investigator for almost 38 years and will celebrate my 60th birthday in July. It would make very little difference in my life if polygraph were abolished tomorrow as I am retirement eligible and comfortable. I have a graduate degree and could probably teach criminal justice courses at the local community college where I would, no doubt meet some of the very people who frequent this forum. I might even be able to prevent their ever having to take a polygraph by failing them at school, making their transition from their life long desire to be a police officer to having the opportunity to ask people "Do you want fries with that?" even quicker. Maybe, I'll see you in class!
If you "teach" your students to treat critical thinking with the disdain which you display for it on a daily basis I've no doubt that you'll need to fail many, many students. No, on second thought, it's the ones who do think critically who fail while those who have unthinking faith in you who'll be passed. That's the way it works, doesn't it, Skip?
In any event, the "fancy title" that I alluded to in my earlier post was that of American Polygraph Association President, a post which your formerly held. I'm sorry that senility has set in even before your 60th birthday. Actually, no I'm not; it couldn't have happened to a nicer guy. Perhaps cancer is next for you?
Quote from: George_Maschke on Apr 22, 2008, 02:32 AMQuote from: George_Maschke on Apr 21, 2008, 09:18 AMQ: Skippy, do you think the device has undergone sufficient testing? Yes or no?
A: YES
Skip,
The PCASS has not been shown to reliably differentiate between liars and truth-tellers at better-than-chance levels of accuracy under field conditions, nor has it been shown to be robust against countermeasures. How can you say this device has been adequately tested? Don't our troops in the field deserve better than this?
Apparently, the PCASS is like that sweater that your aunt knitted you for Christmas: it's the thought that counts.
Brother Lethe
The troops are going to use something to assist in assessment. The choice is CVSA, PCASS, or nothing. As a nonbeliver you would choose nothing?
Quote from: George_Maschke on Apr 22, 2008, 07:57 AMBrother Lethe
The troops are going to use something to assist in assessment. The choice is CVSA, PCASS, or nothing. As a nonbeliver you would choose nothing?
In very unrealistic tests the PCASS was found to be accurate just 62.2, 63, and 79.9% of the time. In one study they found that it would only successfully identify half of the truthful subjects. As former APA President Skip Webb has pointed out, the PCASS can be defeated fairly easily without formal training, making the above numbers far worse in actuality, even before factoring in real field conditions which would further erode the accuracy.
The scientific data do not indicate that this device will detect deception with anything approaching a useful degree of accuracy in the field.
Also, since so much of the polygraph's usefulness comes from the fact that so many people have the idea that it does work, I wonder how useful it will be in Iraq and Afghanistan where, I suspect, most people have never heard of the device before.
So, yeah, I'd not use the device until it proves itself useful. Hook up people to a Xerox machine with a "He's lying" paper in it if you want a way to intimidate people into confessing; that method wouldn't invite our troops to put an unwarranted degree of confidence in it. Unfortunately, it also wouldn't make any money for the polygraph-industrial complex.
Quote from: George_Maschke on Apr 22, 2008, 07:57 AMBrother Lethe
The troops are going to use something to assist in assessment. The choice is CVSA, PCASS, or nothing. As a nonbeliver you would choose nothing?
This really makes no sense. As long as you believe the troops are going to use something, the accuracy (or lack thereof) of whatever they use is not important?
This isn't far from the often-heard argument in favor of the polygraph that goes something like, "Until something better comes along, we're going to keep using it." The accuracy of any device that purportedly detects deception is not irrelevant when determining if that device is useful or not.
If the troops are going to use something that doesn't work it is reasonable to warn them of that. Allowing them to incorrectly believe that their new handheld lie detector can actually detect lies with a high degree of accuracy simply because "they're going to use something" is senseless.
If our nation's airports were going to be supplied with metal detectors that detected metal 50% or 60% of the time, would it be unreasonable to warn people of that fact? Or would it be better to remain silent because the airports are going to use something, so whatever they use is better than nothing?
Sergeant 1107
I did not say that accuracy is unimportant or that our troops should be uninformed about expected accuracy rates, certainly undue reliance could be dangerous. My point is only that as a pragmatic matter, increasing assessment accuracy from 50% to 60% may save some young lives.
Quote from: George_Maschke on Apr 23, 2008, 07:10 AMSergeant 1107
I did not say that accuracy is unimportant or that our troops should be uninformed about expected accuracy rates, certainly undue reliance could be dangerous. My point is only that as a pragmatic matter, increasing assessment accuracy from 50% to 60% may save some young lives.
Do you have any data to indicate that current assessments are accurate at a rate of only 50%? If not, then you cannot argue that introducing the PCASS will increase accuracy from 50 to 60%. Obviously.
I thought that lots of polygraphers came from the ranks of interrogators? If so, they should know that there are ways to determine at levels better than chance whether a person is lying or not, even in the sorts of situations where the PCASS is to be used.
You're making obviously bad arguments. Have you even thought about what you're saying?
Lethe,
Yes, all of the government polygraph examiners are skilled investigators, but not all of the troops required to assess credibility are poly guys. Also, curtural and language barriers make traditional assement techniques much harder to employ. If PCASS increases their odds at all, it could save young lives. Pragmatic usefulness can exceed scientific accuracy.
Jacob, I have significant disagreements with Skip Webb over polygraph policies and proceedures, but he is not an idiot, and he is absolutely not evil. Didn't the first century rabbi you often quote warn us about that sort of judgement? Why not turn the other cheek?
Quote from: Lethe on Apr 23, 2008, 09:18 AMLethe,
Yes, all of the government polygraph examiners are skilled investigators, but not all of the troops required to assess credibility are poly guys. Also, curtural and language barriers make traditional assement techniques much harder to employ. If PCASS increases their odds at all, it could save young lives. Pragmatic usefulness can exceed scientific accuracy.
Jacob, I have significant disagreements with Skip Webb over polygraph policies and proceedures, but he is not an idiot, and he is absolutely not evil. Didn't the first century rabbi you often quote warn us about that sort of judgement? Why not turn the other cheek?
Why don't you make an argument demonstrating how his behavior doesn't qualify as either evil or stupid instead of just claiming it?
Furthermore, I make no judgments about what will happen to Mr. Webb when the books are opened at the end of days; I merely point out that he wants men and women in harm's way to rely on a device for which there is no reason to suppose it will be useful. That's either foolish or immoral.
I don't expect you to understand the argument; you're a polygrapher and your critical thinking abilities have atrophied. Indeed, polygraphers are as much victims of the box as anyone else. Look at the way you guys disdain people who disagree with you, how you don't care about the honest people that you screw over, how you wish to infantilize everyone.
Your response is what I expect. I put forth an argument demonstrating proposition P. Instead of critiquing my argument to demonstrate that it is unsound and thus cannot be used to establish the validity of proposition P, and instead of devising an argument that would demonstrate not P, you simply claim not P to be the case and assume the matter is settled after getting in a few digs at me (what Skip might incorrectly call "ad hominid attacks").
Anyway, as a member of the Church of the Polygraph you reject Jesus Christ too, so why bring him up?
One point of particular concern regarding the PCASS is that a red light on this "traffic light of truth" should not be taken as a green light for torture "enhanced interrogation techniques." (http://en.wikipedia.org/wiki/Enhanced_interrogation_techniques)
The 24 April 2008 issue of the Fort Jackson Leader, the post newspaper at the home of the Defense Academy for Credibility Assessment, includes an article on the fielding of PCASS in Afghanistan, for which destination DACA instructor James Waller departed on Sunday, 20 April. The full issue of the Leader is attached to this post as a 12.3 mb PDF file. A transcription, along with commentary, has been posted to the blog. See The Port-A-Poly Goes to Afghanistan (https://antipolygraph.org/blog/?p=189).
Hey Guys! I have an idea.
Take PCASS off the field. Let's have the soldiers in harms way simply ask their detainees if they're linked or related to Al Queda. If they say yes, because we know they'll be honest with us, then arrest them. If they say no, just give them their weapons back and send them along their merry way.
Sounds like a plan, huh?!
Sackett
P.S. Lethe and all you other human "rights" lemmings out there... stop salivating! It's not gunna happen!
But had ya going there for a minute!!! ;D
Jim,
One needn't be a "human 'rights' lemming" (whatever that may mean) to recognize the stupidity of relying on a lie detector that doesn't work, or the immorality of passing off such emperor's-new-clothes technology on our troops in harm's way (as Don Krapohl & Co. at DACA have done).
You George, as always, have once again MISSED THE POINT!
What is your alternative suggestion to the problem; in the field? You do not have one! That is MY point! I'd rather rely on something that works 80% of the time, than nothing that works none of the time...
Sackett
Jim,
The PCASS has not been shown to work 80% of the time. It has not been shown to reliably detect deception at better-than-chance levels of accuracy under field conditions. Worse still, this simplistic test can easily be passed through the use of simple countermeasures (https://antipolygraph.org/forum/index.php?topic=3911.msg29181#msg29181). Our troops are better off using their best judgment when questioning individuals, giving due consideration to available evidence and information, and reaching considered conclusions.
Quote from: Lethe on May 07, 2008, 02:50 PMYou George, as always, have once again MISSED THE POINT!
What is your alternative suggestion to the problem; in the field? You do not have one! That is MY point! I'd rather rely on something that works 80% of the time, than nothing that works none of the time...
Sackett
There is no logical requirement that a person have an alternative to an inaccurate instrument before stating that the instrument is, in fact, inaccurate.
You would rather have troops use a flawed machine and rely on possibly erroneous results than to use nothing?
Quote from: Lethe on May 08, 2008, 06:28 AMQuote from: Lethe on May 07, 2008, 02:50 PMYou George, as always, have once again MISSED THE POINT!
What is your alternative suggestion to the problem; in the field? You do not have one! That is MY point! I'd rather rely on something that works 80% of the time, than nothing that works none of the time...
Sackett
There is no logical requirement that a person have an alternative to an inaccurate instrument before stating that the instrument is, in fact, inaccurate.
You would rather have troops use a flawed machine and rely on possibly erroneous results than to use nothing?
YES!
Sackett, how accurate must a device be before it can be used? Suppose the PCASS is accurate only 55% of the time (I'm not saying that's the case, but just for instance) would that be accurate enough to warrant using it? If so, what if it were only 51% accurate? If not, how accurate would it need to be in order to be used?
Also, I'm not sure that current research has addressed the susceptibility of the PCASS to countermeasures. Former APA President Skip Webb appears pretty concerned that it can be beaten easily with CM and has tacitly implied that this is the case. Given the probability that the very people that we'd most want to detect in deception (members of Al Qaeda and similar groups) are the most likely to know how to use CM, isn't this an important point to address?
Also, I'm not sure that you can do lab experiments with Americans and assume that the same accuracy will be obtained when using the PCASS on someone whose country you have invaded and occupied and who has had you stick a gun in his face. A lot of these people in Afghanistan and Iraq probably don't really like our country nor trust our service members. Given the importance of the subject believing at least some of what the polygrapher/PCASSer says, isn't it possible that this could impact accuracy? I think these are all points worth at least investigating before giving the PCASS the Good Housekeeping Seal of Approval.
Given all of the unaddressed problems with the device, I think it is reasonable to call into question just how accurate it is going to be. You claim it will be accurate enough, but just how accurate is that?
Also, regardless of what the accuracy level is, should our troops be given accurate information about the accuracy level? Or should they just get the "it's very, very accurate" line that polygraphers like to give?
Also, George, I think it'd be a good idea to encourage soldiers who have access to the PCASS to try it out on each other and see if they can beat it. Since it is the machine--and not the operator--who makes the determinations on deception, these informal experiments should be very easy to conduct. They can help illustrate either the ease or difficulty with which the machine can be beaten; if they find it easy to beat they can decrease the confidence they put in it, if it is hard to beat they can increase such confidence. In either case, people in harm's way have more information about their tools, which is a good thing. Also, if it turns out to be easy to beat, hopefully word of this will filter out.
"Port-o-Poly" Pimps care more about money.
I wonder, do they have a strong lobby on Capitol Hill?
TC
Quote from: Lethe on May 08, 2008, 09:01 PM"Port-o-Poly" Pimps care more about money.
I wonder, do they have a strong lobby on Capitol Hill?
TC
TC, I'm no expert on that angle of the business, but I doubt it. Most decisions to use the polygraph are made by department heads and police chiefs, not by legislators. This decentralization is helpful to the polygraph-industrial complex, as it leaves fewer traces of the debate on it's usefulness and allows them to get a few individual people aside and convince them that they need to cover their ass, regardless of how reliable the polygraph may be. It also makes it easier to strong arm people with bandwagon tactics: c'mon, everyone else is doin' it, just try it, it won't hurt you the first time.
If done at the legislative level, there'd be more questions about reliability and the assumptions about the polygraph would be questioned more in depth. These proceedings would also leave records, which polygraphers want to avoid. So I doubt they have a big lobbying arm--it's not needed. They want to avoid that venue, if at all possible. Remember, the polygraph thrives on secrecy, it can only exist in the dark, not in the Light.
Quote from: Lethe on May 08, 2008, 03:49 PMYES!
When the troops use this device and it shows the detainee is being truthful, that means that the detainee is being truthful, that the machine's error rate of 10-50% (whatever you believe it to be) is causing an inaccurate reading, or that the detainee knows how to beat the port-a-poly.
If the device indicates that the detainee is being deceptive, that means the detainee is being deceptive, or they are being truthful but the device's 10-50% (whatever you believe it to be) error rate is causing an inaccurate reading, or that the detainee was trying to employ countermeasures and did such a poor job that it resulted in a "DI" score.
I don't see how that can possibly be an asset to the troops. They don't
know anything more after using the PCASS than they did before using it. After using the PCASS they'll be taking a guess and putting their lives on the accuracy of that guess.
They could also be issued a silver dollar and flip it each time they question a suspected terrorist. Sometimes the coin would be right, but would that make it better than nothing? According to your stated logic, it would. I disagree.
Quote from: Lethe on May 10, 2008, 05:49 AMQuote from: Lethe on May 08, 2008, 03:49 PMYES!
When the troops use this device and it shows the detainee is being truthful, that means that the detainee is being truthful, that the machine's error rate of 10-50% (whatever you believe it to be) is causing an inaccurate reading, or that the detainee knows how to beat the port-a-poly.
If the device indicates that the detainee is being deceptive, that means the detainee is being deceptive, or they are being truthful but the device's 10-50% (whatever you believe it to be) error rate is causing an inaccurate reading, or that the detainee was trying to employ countermeasures and did such a poor job that it resulted in a "DI" score.
I don't see how that can possibly be an asset to the troops. They don't know anything more after using the PCASS than they did before using it. After using the PCASS they'll be taking a guess and putting their lives on the accuracy of that guess.
They could also be issued a silver dollar and flip it each time they question a suspected terrorist. Sometimes the coin would be right, but would that make it better than nothing? According to your stated logic, it would. I disagree.
The Department of the Treasury would be upset with the Department of Defense if they follow your recommendation, Sergeant. They're trying to promote those new gold dollar coins now, the ones with the presidents on them.
In more seriousness, it would be very, very difficult, I think, for a soldier to go against the port-a-poly (a clever name that I'll try not to overuse). If the PCASS indicates deception, but you follow the other information that you have and decide to place some measure of trust in the person, and then anything bad happens, it's likely that your credibility before your men is going to be pretty much shot (but thank God if that's all that gets shot).
I think polygraphers underestimate the enourmous amount of pressure that will be on soldiers who want to go against the recommendation of the PCASS. I don't think very many will. I think it's likely that far too much reliance will be placed on the device. Thus the need for reliable experimental data produced in tests that more accurately reflect war zone conditions. Regardless of what data those tests produce, if the PCASS is deployed the troops must know how accurate it is.
And I really do hope they have the chance to play around with the device and try to beat it. Whether they can or can't, it'll be a very illuminating exercise.
Close to the time that Bill Dedman's excellent investigative report (http://truth.msnbc.com) appeared on MSNBC, Fox News interviewed Professor Stephen Fienberg, who chaired the National Academy of Sciences/National Research Council Committee to Review the Scientific Evidence on the Polygraph (https://antipolygraph.org/nas.shtml):
http://www.youtube.com/watch?v=JPAbVIEFGB8
On Friday, 13 June 2008, the Armed Forces Network, Afghanistan, aired a report on the use of PCASS in Afghanistan. Not surprisingly, AFN's reporting on PCASS is completely uncritical, and the segment is more a public relations release for PCASS than television journalism. I've posted the story, along with commentary on YouTube:
http://www.youtube.com/watch?v=uiP5wlYzij0
The video can also be viewed directly on YouTube here:
http://www.youtube.com/watch?v=uiP5wlYzij0