Using Qualtrics to
Collect Data
JANET MONAGLE PHD, RN, CNE
VIRTUAL SIMULATION VS. HIGH FIDELITY
SIMULATION: HOW DO CONFIDENCE
AND LEARNING OUTCOMES COMPARE?
Research Questions
1. Does virtual simulation promote learning and enhance
confidence when compared high fidelity simulation
method (as measured by the SET-M)?
2. Is there equivalent knowledge acquisition using vSim
and HPS methods ?
Method & Sample
A convenience sample of third year nursing students were
assigned to participate in simulation as part of course
requirements.
All students in the sample participated in one vSim and one HPS
experience.
Simulation Effectiveness Toll- Modified (SET-M) used to measure
confidence and learning (Data collected via QUATRICS)
A faculty made quiz used to measure knowledge acquisition.
(Data collected via Blackboard)
Over70 pre-licensure students from two cohorts: direct entry
students and traditional undergraduate students.
Instruments
Simulation Evaluation Tool- Modified(SET-M)
Subscales:
◦ Prebrief with 2 items was not included
◦ Learning 6 items Cronbach's alpha= .852
◦ Confidence- 6 items Cronbach's alpha= .913
◦ Debrief-5 items Cronbach's alpha= .908
10 question faculty made quiz given after each
simulation via Blackboard – reviewed by two expert
faculty
SCENARIO:
I am better prepared to respond to changes in my patient’s condition.
I developed a better understanding of the pathophysiology.
I am more confident of my assessment skills.
I felt empowered to make clinical decisions.
I developed a better understanding of medications. (Leave blank if no medications in
scenario)
I had the opportunity to practice my clinical decision making skills.
I am more confident in my ability to prioritize care and interventions
I am more confident in communicating with my patient.
I am more confident in my ability to teach patients about their illness and interventions.
I am more confident in my ability to report information to health care team.
I am more confident in providing interventions that foster patient safety.
I am more confident in using evidence-based practice to provide care.
DEBRIEFING:
Debriefing contributed to my learning.
Debriefing allowed me to verbalize my feelings before focusing on the scenario
Debriefing was valuable in helping me improve my clinical judgment.
Debriefing provided opportunities to self-reflect on my performance during simulation.
Debriefing was a constructive evaluation of the simulation.
What else would you like to say about today’s simulated clinical experience?
3
3
3
3
3
2
2
2
2
2
1
1
1
1
1
3
3
3
3
3
3
3
2
2
2
2
2
2
2
1
1
1
1
1
1
1
3
3
3
3
3
2
2
2
2
2
1
1
1
1
1
Leighton, K., Ravert, P., Mudra, V., & Macintosh, C. (2015). Update the Simulation Effectiveness Tool: Item modifications and
reevaluation of psychometric properties. Nursing Education Perspectives, 36(5), 317-323. Doi: 10.5480/1 5-1671.
Contact: Kim Leighton: [email protected]; 402-617-1401 Adapted with permission.
The Evolution of
using Qualtrics
Pilot- Two Surveys
Pilot- Branching Survey
Sending Survey
Anonymous Link
◦ Unable to do Paired Ttests
◦ Many students
ignored it
Sending Survey
E-mail sent to students
◦ Student e-mails copy
and pasted from
Blackboard
◦ More student
participation
Final Product
Conclusion
Data easily exported from
Qualtrics and imported to
SPSS for analysis.