Interviewing and Deception Detection
Techniques for Rapid Screening and
Credibility Assessment
Dr. Jay F. Nunamaker, Jr.
Dr. Judee K. Burgoon
Agenda
• Introduction
• Project Phases
• Project Plan
– Year One: Unique Datasets
– Year One: Sensors and Tools
– Year One: Tasks
1.
2.
3.
4.
Analysis Psycho-Physiological Datasets
Lexical Analysis
Interoperable Video Database
Collaborative Credibility Assessment Tools
• Conclusion
2
Introduction
• Identify verbal/non-verbal behaviors and
physiological cues that indicate deception and
hostile intentions in rapid screening
environments
• Experimental research to evaluate and develop
automated deception detection technology
• Develop questioning and information elicitation
strategies for border screeners
3
Project Phases
• Experimentation and analysis of credibility assessment tools
– Test new deception detection technology which incorporate verbal/nonverbal behavior and physiological measures
– Prototype automated systems and enabling technologies for detecting
deception
– Replicate knowledge learned in experiments in the field
• Analysis of interviewing techniques in screening scenarios
– Techniques for information elicitation
– Behavioral analysis and questioning strategies
• Screening and border specific analysis of detection methods
– Unobtrusive methods for behavior monitoring and deception detection
– Interview and screening techniques
4
Project Plan
Schedule (year)
Phase
1
2
3
4
5
6
(1) Experimentation and analysis of
credibility assessment tools
(2) Analysis of interviewing techniques in
screening scenarios
(3) Screening and border specific analysis
of detection methods
5
Project Plan – Year 1
Unique Datasets
• Datasets for original analysis:
– Cultural Benchmarks
• 220 international participants
• Professionally interviewed (25 questions)
• Lie or truth instructions
– Mock Crime
• 134 participants
• Realistic Mock theft
scenario
• New Proposed Experiments
6
Project Plan – Year 1
Mock Crime: Experiment Example
Stage 1: Subject arrival at
separate building
Stage 4: Subject completes credibility interview
about involvement in theft
Stage 2: Subject receives
instructions by recording
Stage 3: Subject arrives at
secretary’s office to steal ring
7
Project Plan – Year 1
Sensors and Tools
LDV
PUPILOMETRY
Equipment
supplied by:
THERMAL
EYE-TRACKING
BLINK
KINESIC
Project Plan – Year 1
Task 1: Analysis Psycho-Physiological Datasets
• Phase 1: LDV Data Analysis (Year 1)
– Unintentionally leaked psycho-physiological cues may be indicative
of deceptive behavior
– “Cultural Benchmarks” experiment captured Pulse and Respiration
data via LDV
– Determine if the LDV can provide cues that are indicative of
deception
• Phase 2: Data from multi-sensors (Year 2)
– Cultural Benchmarks Experiment – sensor data analyzed
individually – not looked at collectively
• Pulse Respiration, Kinesics (Blob, ASM, Gestures, Blinking,
Pose), and Pupilometry
• Phase 3: Data-fusion techniques (Year 2)
– How do we fuse data from distinct sources?
– Do fusion techniques provide greater accuracy in detecting
deception?
Milestones and
Deliverables
Milestone
Description and Deliverable
Timeframe
(1) Phase 1
Perform analysis of data from LDV collected
during previous deception experiment.
Determine if any psycho-physiological cues
emerge that indicate deceptive behavior.
Deliverable is the psycho-physiological cues
provided by LDV indicative of deception.
6 months
(2) Phase 2
Gather additional experimental data collected
from various sensors during deception
detection experiment. Format and prepare for
processing. Deliverable is a formatted data
set ready for analysis.
6 months
(3) Phase 3
Explore methods to fuse data into one robust
algorithm. Conduct statistical analysis to
determine if collectively the combined sensor 6 months
output is a greater predictor of deceptive
behavior.
*Year one deliverables in green
Project Plan – Year 1
Task 2: Lexical Analysis
• “words whose job it is to make things more
or less fuzzy” (Lakoff, 1972)
• e.g. perhaps, might, maybe, approximately
• Communicates speaker’s degree of
confidence (Hyland, 1998; Coates, 1987)
• Reduces strength of a statement (Zucker & Zucker,
1986)
• Expresses tentativeness and probability
• Theoretically linked to deception use
Milestones and
Deliverables
Milestone
Description and Deliverable
Timeframe
(1) Phase 1
Prepare transcriptions of cultural
benchmarks interviews for analysis
1 month
(2) Phase 2
Refine hedging dictionaries and
lexical bundle software
1 month
(3) Phase 2b
Parse text, generate features, run
classification algorithms, run
statistical analyses
2 months
Write results and discuss
implications for rapid screening,
articulate future investigations
2 months
(4) Phase 3
*Year one deliverables in green
Project Plan – Year 1
Task 3: Interoperable Video Database
Currently have many large, disparate data sources. Challenges in
managing large and diverse data sets include:
• Integrating the datasets efficiently
• Querying integrated data sets intelligently
• Example: Retrieve all data associated w/specific gesture
• Capturing tacit information
• Determining the elementary/composite data elements
• Creating semantic interoperability across the datasets
In order to begin addressing these
challenges, we need to begin to create a
framework which will help us understand
the datasets and how to manage
them holistically.
Retrieve all data
associated with shrugs
Mock Crime
Interviews
Cultural
Benchmarks
Interviews
Milestones and
Deliverables
Milestone
(1) Phase 1
(2) Phase 2
Description and Deliverable
Timeframe
Initial Data Framework and
Recommendations – an initial data framework
that integrates video datasets from two
experiments. This framework will serve as
6 month
discussion for the future data management
directions.
Prototype Implementation –implement
prototype to demonstrate solutions to various
data challenges.
Through
Year 6
*Year one deliverables in green
Project Plan – Year 1
Task 4: Collaborative Credibility Assessment Tools
Problem: Individuals are not as accurate as
machines in credibility assessment
Proposal: Use group collaboration to discover more
cues to deception
First phase Deliverable: Determine feasibility of and
requirements for collaboration tools for credibility
assessment. Create prototype(s)
Milestones and
Deliverables
Milestone
Description and Deliverable
Timeframe
(1) Phase 1
Methodically identify and adapt most useful
3 month
collaboration tools
(2) Phase 2
Design software
2 month
(3) Phase 2b Create initial prototype(s)*
1 month
*Year one deliverables in green
Conclusion
• Identify verbal/non-verbal behaviors and
physiological cues that indicate deception and
hostile intentions in rapid screening environments
• Experimental research using unique datasets to
evaluate and develop:
– Automated deception detection technology
– Experimental research to evaluate and develop automated
deception detection technology
• Four proposed tasks with deliverables in Year One