Divide into three groups and read the three articles (experiment, case study, and
action research). What are the concepts and variables involved, how do they
purportedly relate and how do these authors address the validity of their results in
the discussion section? Present to the other groups.
Can you be wrong about something you can't be right about? [Philosophical
question, addresses point 1 of EBSE of having an answerable question. At least in
philosophical realism, you cannot be right if it is not possible to be wrong =
factual claim is necessary]
Is there an equivalent to "no treatment" when investigating the benefits of a
software process in an experiment? [no, very difficult to come by]
Intra versus inter individual difference (micro / macro):
o Why is time and quality positively correlated e.g., when someone writes a
MSc thesis but negatively correlated when developers try to solve a
complex task? [Perspective, the time quality tradeoff operates differently
on an inter versus intra level interpretation]
What is Simpson's paradox?
Find your own examples of phenomena for all the four quadrants of the 2x2
matrix of empirical(y/n) and theoretical (y/n) support
Cause and effects are related to what type of validity?
Explain differences between slide 37 and 38
Slide 67–70:
o The research process looks very "neat" (i.e., almost like a waterfall model).
Is this really how research is?
o Given the research questions on slide 70, ask student to evaluate strengths
and weaknesses of the three (four) research methods.
What is the relation between theory and observation?
Slide 23–27 should probably be discussed as well, e.g., what is After Action
Reviews, Postmortem Analyses?