Chapter 2
Research Methods in I/O
Psychology
Psychology Applied to Work®
Learning Objectives
• Understand the empirical research cycle.
• Know the relative advantages and disadvantages of the laboratory
experiment, quasi-experiment, questionnaire, and observation
research methods.
• Understand meta-analysis and data mining.
• Understand the purpose of organizational neuroscience.
• Understand the value of qualitative research.
• Understand the concept of correlation and its interpretation.
• Understand the limitations of assessing causality.
• Have an awareness and appreciation of the ethical issues
associated with I/O psychological research.
• Understand the difference between academic-based and
practitioner-based research.
Psychology Applied to Work®
Overview
• Generalizability
• Three goals of science
– Describe
– Predict
– Explain
Psychology Applied to Work®
The Empirical Research Process
Psychology Applied to Work®
Step 1: Statement of the Problem
• Theory
• Inductive vs. deductive method
• Why theory is important in psychology
Psychology Applied to Work®
Step 2: Design of the Research Study
• Research design
• Naturalness of the setting
• Degree of control
• External vs. internal validity
Psychology Applied to Work®
Primary Research Methods
1. Laboratory Experiment
– Causality
– Problems of generalizability
2. Quasi-Experiment
– Less control, more generalizability
Psychology Applied to Work®
Primary Research Methods (cont’d)
3. Questionnaire
– Response rate problem
– Truthfulness of responses
– Internet surveys
4. Observation
– Generate ideas for further testing
– Rich with data in environment where behavior
being studied occurs
Psychology Applied to Work®
Secondary Research Methods
1. Meta-analysis
– Statistical study of studies – aggregates results
– Estimate of “true” relationship
– Subjective decisions
– File drawer effect of non-published studies
– Problem from differences in level of analysis of
original studies
Psychology Applied to Work®
Secondary Research Methods
2. Data Mining
– "Big Data"
– Used to reveal patterns of large data sets
– Three research issues distinctive from other I/O
research methods
– Wide range of possible scale values
– Uses correlation coefficient and other statistical
indices
– Not necessarily used to test theories
Psychology Applied to Work®
Organizational Neuroscience
• Study of organizational attitudes and
behavior at the physiological level
• High cost
Psychology Applied to Work®
Qualitative Research
• Ethnography
– Etic and emic perspectives
• Still rarely used in comparison to quantitative
research
Psychology Applied to Work®
Steps 3 & 4: Measurement & Analysis
• Measurement of Variables
– Quantitative vs. categorical
– Research variables – Independent, dependent, predictor, criterion
Psychology Applied to Work®
Steps 3 & 4: Measurement & Analysis (cont’d)
• The Correlation Coefficient (r)
–
–
–
–
Reflects degree of linear relationship
Range from -1.00 to + 1.00
Direction is either positive or negative
Magnitude – size is index of strength of the relationship
• Determining Causality
– Cannot be inferred from correlation
– Determining causality through non-experimental methods is highly
controversial
Psychology Applied to Work®
Step 5: Conclusions from Research
• Boundary conditions for generalizability
– Representativeness of subjects
– Degree of fit between subjects and research task
– Research method (laboratory vs. field study)
– The debate about university students as subjects
• Research as a cumulative process
• Research as a craft
• The role of serendipity
Psychology Applied to Work®
Ethical Issues in Research
• APA Code of Ethics – Five rights of participants
–
–
–
–
–
Informed consent
Privacy
Confidentiality
Protection from deception
Debriefing
• Consequences for violating these rights during
and after
• The complexity of real-life ethical dilemmas
• Research is not value-free
Psychology Applied to Work®
Academic-based and Practitioner-based Research
• Transfer of knowledge from lab to life
(medical model)
• Scientist-practitioner gap
• Descriptive vs. prescriptive information
• Differing goals of research
Psychology Applied to Work®