Unstructured Interview Heuristic Evaluation Modified Applied

Melissa A. Smith & Eric J. Blumberg u George Mason University
Camps, A NonTraditional Medical
Setting
•  Over 12,000 camps operate in
America, looking after
11,000,000 people each year
(American Camping
Association, 2012)
•  Camps have been historically
slow to adopt new technologies
even though the camping
industry services such a large
number of people
•  One medical technology that is
starting to gain traction in the
camping industry is electronic
medical records
Unstructured Interview
Analysis Approach
•  The overall purpose of this initial interview was to elicit the goals & purpose of CampDoc from the developers, how the tools work,
any known usability issues, and any other information about the system they felt would be pertinent to the usability analysis
•  A large portion of our knowledge about the CampDoc website was gained from this initial unstructured interview
Patient Portal Heuristic Evaluation
Heuristic Evaluation
•  Two analysts referenced a set of 11 heuristics adapted from two
previous sets developed by Nielson & Molich (2009) for text based
websites and Zhang, Johnson, Patel, Paige, & Kubose (2003) for
medical devices
•  The analysts identified a number of positive usability elements while
conducting their heuristic evaluation and over 35 potential system
errors in total
HF Heuristic
Aesthetics
Consistency
Mismatch of Expectancy
Error Prevention
Provide Feedback
Natural Dialogue
Minimize user memory
Good error messages
Provide shortcuts
User language
Resources
Provider Portal Heuristic Evaluation
# of Issues
0
4
4
2
5
1
1
0
0
1
3
HF Heuristic
Aesthetics
Consistency
Mismatch of Expectancy
Error Prevention
Provide Feedback
Natural Dialogue
Minimize user memory
Good error messages
Provide shortcuts
User language
Resources
# of Issues
0
2
4
0
1
2
0
1
1
2
1
Modified Applied Cognitive Task Analysis (ACTA)
•  Two subject matter experts (SMEs) were interviewed for the modified
ACTA using a typical scenario
•  A task diagram was constructed for the task of accessing traditional paper
patient records in a camp setting based on the initial simulation interview
ACTA Task Diagram
CampDoc
Key Findings
•  CampDoc is an electronic health records
system specifically designed for camps
and other small organizations
•  The CampDoc website can be accessed
from either a Patient Portal or a Provider
Portal
•  Input data should be saved automatically
•  The primary users of the system are
parents and non-medical camp personnel,
so the system language should be tailored
to a more general audience.
Patient Portal Home
Provider Portal Home