The CVSA PR campaign in Canada is receiving new, and more thoughtful, attention:
Controversial device popular with public, private employers While the tests are becoming increasingly popular, accuracy is questioned By David Baines, Vancouver Sun March 12, 2011
Bob Wall (far right) and Don Wiebe test a subject using a device called a computer voice stress analyzer. While Wall and Wiebe claim an accuracy rate of 98 per cent or better, other studies have shown the device to do no better than pure chance.Photograph by: Darren Stone, Postmedia News Files, Vancouver Sun
First in a series Public and private agencies are using a "truth verification" device that has been discredited by numerous authorities as a tool to screen hundreds of job applicants in B.C.
The tests are being administered by ITV Consulting Inc., a Victoria firm that licenses the Canadian rights to the Computerized Voice Stress Analyzer (CVSA) from a U.S. company.
As stated on ITV's website, the device "measures small frequency modulations in the voice. These inaudible variations, when detected, measured and displayed, accurately determine the truthfulness of each statement elicited from a test subject."
ITV is owned and operated by two retired Saanich police detectives, Don Wiebe and Bob Wall. An active Saanich member, Det. Sgt. Craig Sampson, is also listed as a staff member.
ITV's clients include:
- B.C. Corrections branch, which administers the province's correctional facilities and programs. The branch says ITV has conducted 645 CVSA tests to pre-screen job applicants during the past three years.
- University of Victoria campus security department, which says ITV has conducted about 50 similar tests on prospective employees during the past five years.
- Sundry financial institutions, which hire ITV to conduct tests on employees who are suspected of internal malfeasance. ITV says it has conducted 15 to 20 such tests.
ITV claims the device can definitively tell whether a person is lying: "The finished session is evaluated by the computer, rendering its findings of 'deception' or 'no deception,' removing any possibility of examiner error, as well as providing a completely objective examination," it states on its website.
The firm recommends the device be used in conjunction with "the expert interrogation techniques used and taught by ITV."
"Used in this manner, clinical studies show the accuracy score of our product to be 98 per cent with no inconclusives," it states.
This is an impressive statement. If true, the CVSA is the holy grail of lie detectors. However, there is little scientific evidence to support this claim, and much to repudiate it.
In a 2007 study funded by the U.S. Department of Justice, researchers used two voice stress analyzers systems - including the CVSA device used by ITV consulting - to quiz people who had just been arrested about their recent drug use, then compared their answers with the results of urine tests.
"Both VSA programs show poor validity -neither program efficiently determined who was being deceptive about recent drug use. The programs were not able to detect deception at a rate any better than chance," the study concluded.
It added: "The data also suggest poor reliability for both VSA products when we compared expert and novice interpretations of the output."
In other words, the expertise of the examiner didn't matter.
More generally, the researchers noted that "no published research studies have demonstrated that VSA programs can distinguish between 'general' stress and the stress related to being deceptive."
Despite numerous studies that make similar conclusions, voice stress analyzers have become very popular, particularly in the United States since the September 2001 terrorist attack on New York City.
The firm that licenses the device to ITV, the National Institute of Truth Verification (NITV), located in West Palm Beach, Fla., claims it is "used by 1,800 local, state and federal agencies, as well as by U.S. Military Special Operations and Intelligence units."
The popularity of the device, combined with its questionable accuracy, raises the question: How many false readings does it generate and, as a result, how much harm does it do?
"The people we have done it for are very pleased with it. We have had no issues in all the years I have done it," Wiebe said in an interview. "I believe in its ability to detect deception ... If I didn't have 100-percent confidence in the CVSA, I wouldn't be using it."
In any event, he said, the tests are voluntary, and job applicants are never disqualified on the basis of a CVSA "without something to back it up."
The tests are, strictly speaking, voluntary. But if you want to apply to the Saanich police force or the B.C. Corrections branch, they are mandatory. They are not mandatory at UVic, but refusal is a factor that is "weighted" against the applicant, says campus security director Peter Zacour.
Wiebe was introduced to the CVSA device in 2002, while he was still working as a Saanich police detective. He conducted a six-month study, using it for both criminal investigations and pre-employment screening, and came up with some stunning results:
"The CVSA has been used 35 times and it has shown a 100-per-cent accuracy rate. All the tests conducted have either had the results confirmed by investigation or confession," he stated in his report.
"In 21 CVSA examination that resulted in deceptive results, 17 of the subjects have admitted to the allegations. This would be an 86-per-cent confession rate, which is extraordinarily high. The other four deceptive results were confirmed by investigation."
Wiebe said the device was also used to screen prospective police members: "This has resulted in three quality candidate being hired and one possible candidate being denied due to pre-and post-test admissions during the examination. I believe that as a result we are getting a higher calibre of recruits ..."
The report included summaries of each case. Many are not as conclusive as Wiebe's report suggests. For example, he describes how tests were conducted on two people who had access to stolen drugs at a handicapped facility.
"The male was tested and showed that he was telling the truth and he was not involved in the theft of the narcotics.
"The female who was initially cooperative refused to take a test when offered the chance.
"Further information provided by the same male and other staff members showed that the female had a drug addiction problem and was suspected of stealing other items.
"The female no longer works for the facility."
As described, there is nothing remotely scientific about this case study. It is strictly anecdotal. A firm conclusion (that the device worked) was made on the basis of circumstantial evidence (that other people said she did it).
Reputable agencies in the United States, meanwhile, were conducting their own studies, and coming to quite opposite conclusions.
In November 2003, the Virginia Department of Professional and Occupational Regulation published a report entitled Study of the Utility and Validity of Voice Stress Analyzers.
The report noted there had been "no scientific studies conducted, to date, to measure the validity of the computer stress analyzer to detect deception."
"Manufacturers contest that their computer stress analyzers are 100 per cent accurate and effective by producing testimonials as a foundation to their claims, but this is not widely accepted as scientific validity."
The report said the U.S. Department of Defence Polygraph Institute -which is mandated by the U.S. Congress to study new lie detection technologies -had conducted a series of studies that "produced no evidence that the use of the CVSA provides accuracy rates better than chance."
The defence department also noted that a study conducted by the U.S. National Research Council "indicated accuracy rates at or below chance levels, and low levels of reliability, both being necessary cornerstones for a successful diagnostic tool."
Notwithstanding the dearth of scientific support for the device, Saanich police -based on Wiebe's report -decided to adopt it for both criminal investigations and screening new police recruits.
Wiebe soon realized he could not only use the device for police investigation purposes, but also for private commercial purposes.
In 2004, while still working for the Saanich police force, he began marketing CVSA testing services and interrogation techniques to other police forces, government agencies and financial institutions.
The following year, he incorporated ITV Consulting, through which he now markets these services. He was later joined by Wall, who became a business partner and co-director of ITV. In February 2008, they both retired from the police force and began working full time for the firm. At some point, Sampson, who is head of Saanich's major crimes section, became associated with the firm.
As a Saanich police officer and certified CVSA examiner, Sampson conducts pre-employment screening tests for the force.
When he is not available, the force hires ITV to screen prospective applicants. To date, ITV has conducted seven such tests, all in 2009.
Sampson also contracts his services to ITV on an as-needed basis. (He has written permission from the Saanich Police Board to perform this outside work and, in any event, he does not do any work for ITV that involves Saanich police.)
Insp. Rob McColl, who is head of Saanich's detective division (and Sampson's boss) said the force stopped using the CVSA device for criminal investigations in 2007, not because they lost faith in its ability to detect lies, but because the RCMP installed a polygraph operator in Victoria, which made it more economical to use that device.
He said Saanich police still use the CVSA device to screen prospective recruits.
I asked McColl whether he has seen any scientific study to support ITV's claim that the device is 98-per-cent accurate.
"Personally, no," he replied. "I have no technical data to back it up or take issue with it. My view of these instruments [polygraphs and CVSA devices] is that any of them are only as good as the operators. It's a tool we use, and in my view, it's an effective tool."
I asked Wiebe to show me the "clinical studies" that show the device is 98-per-cent accurate, as he advertises on his website.
To my surprise, he said he had never seen any of them. He said he simply took the claim at face value from the National Institute of Truth Verification, the Florida company that manufactures the device and sold ITV the licensing rights in Canada.
NEXT: We learn that the founder of the National Institute of Truth Verification, Dr. Charles Humble, earned his PhD in a strip mall in Indiana after six hours of bible study.
Read more:
http://www.vancouversun.com/news/Controversial+device+popular+with+public+privat...