IARPA Credibility Assessment Standard Evaluation (CASE)

[John M.]

Check this out... What fun! The DNI is funding a contest to crown a "Credibility Champion" - Learn more about it here: https://www.iarpa.gov/challenges/casechallenge.html

Recently, they posted a very interesting podcast with Dr. Dean Pollina. He explains why it's impossible to measure the accuracy of the polygraph.  https://www.youtube.com/watch?v=2wSoVH40u6g

The Intelligence Advanced Research Projects Activity (IARPA) invests in high-risk, high-payoff research programs to tackle some of the most difficult challenges of the agencies and disciplines in the Intelligence Community (IC).

IARPA's Credibility Assessment Standardized Evaluation (CASE) Challenge seeks novel methods to measure the performance of credibility assessment techniques and technologies.

Credibility assessment refers to both the assessment of the truthfulness of specific claims and to the assessment of the reliability, honesty, and trustworthiness of a source of a particular claim, whether that be an individual, group, or a broader organization or entity.

[John M.]

More from the ODNI on efforts to invent a way to accurately assess credibility -

The IARPA CASE Challenge team recently held a Q&A session where they addressed solver questions, provided clarity on the scope of the project, and reviewed the prizes. Program Manager, Alexis Jeannotte, dives deep into the world of credibility assessment and the need for this research.

https://youtu.be/o0y9zu2Yt8E

I've also attached Ms Jeannotte's slides.

[John M.]

Here's the idea that won 1st prize.

https://roc-hci.com/announcements/taylan-sen-and-kurtis-haut-scores-in-iarpa-case-challenge/

Remember, this challenge focused on the methods used to evaluate credibility assessment techniques or technologies, rather than on the techniques or technologies themselves.