30.10.13
London, Oct 2013 Mixed Methods Using MAXQDA Prof. Dr. Udo Kuckartz Philipps-­‐Universität Marburg/Germany Workshop Schedule 1.  Methodological Overview and the Use of MAXQDA in Mixed Methods Research à Coffee Break 2.  Live PresentaGon: Analysing Open-­‐ended QuesGons à Lunch Break 3.  Joint Displays as AnalyGcal Tools Special Features for Mixed Methods in MAXQDA 1
30.10.13
Part 1 Methodological Overview • 
• 
• 
• 
• 
• 
DefiniGon of Mixed Method Research About QUAL and QUANT Difference between Mixed Methods and TriangulaGon Mixed Methods and Mixed Models MAXQDA and Mixed Methods Different Kinds of “Mixing” DefiniIon of Mixed Methods John Creswell „Mixed methods research is the collecGon, analysis and mixing of both qualitaGve and quanGtaGve data in a single study or a mulG-­‐phase invesGgaGon.“ Jennifer Greene „Mixed method inquiry is an approach to invesGgaGng the social world that ideally involves more than one methodological tradiGon and thus more than one way of knowing, along with more than one kind of technique for gathering, analyzing, and represenGng human phenomena, all for the purpose of be[er understanding.“ Burke Johnson and Anthony Onwuegbuzie: „Mixed methods research is the class of research where the researcher mixes or combines quanGtaGve and qualitaGve research techniques, methods, approaches, concepts or language into a single study or set of related studies.“ 2
30.10.13
About QUAL and QUANT QuanItaIve Data "   numerical data usually as result of standardized research (e.g. naGon-­‐
wide survey with closed-­‐ended quesGons) QualitaIve Data "   all kinds of non-­‐numerical, in social research usually verbal data (e.g. transcript of open-­‐ended interviews, focus groups) but also pictures, audio and video … but there also “Mixed Data” like "   quesGonnaires with standardized AND open-­‐ended-­‐quesGons "   focused or problem-­‐centered interviews accompanied by a standardized quesGonnaire (e.g. with socio-­‐demographic data) Basic SituaIon in Mixed Methods Research QUAL QUANT Study 3
30.10.13
Mixed Methods Designs (Examples by Creswell & Plano) Mixed Methods Designs (Examples by Creswell & Plano) 4
30.10.13
Mixed Methods Designs (Examples by Creswell & Plano) Differences between Mixed Methods and TriangulaIon "   TriangulaGon was developed as a validaGon strategy "   It has a long history and goes back to Denzin’s contribuGon of 1978 " Denzin differenGates between four types of triangulaGon: data triangulaGon, invesGgator triangulaGon, theory triangulaGon, methodological triangulaGon "   Since some years triangulaGon has shiced to a more vague concept (Altrichter: “T. gives a more detailed and balanced picture of the situaGon”) "   TriangulaGon can be employed in quanGtaGve and quanGtaGve studies "   Mixed Methods research is not a subspecies of triangulaGon "   Mixed Methods approach is much more specific and pracGcal "   MM means to take into account the quanGtaGve and qualitaGve aspects of a phenomenon or a social problem "   MM requires researchers that are trained in qualitaGve and quanGtaGve research methods "   MM is a decision for well-­‐elaborated design-­‐types "   MM offers many ways of using QDA-­‐socware 5
30.10.13
Mixed Methods and Mixed Models Tashakkori & Teddlie "   disGnguish between mixed method and mixed model designs "   mixed method designs combine QUAL and QUANT approaches into the research of a single or mulGphased study (sequenGal, parallel, equivalent status designs etc.) "   Mixed model designs are studies that “combine the quanGtaGve and qualitaGve approaches within different stages of the research process”. Tashakkori & Teddlie differenGate between “monostrand” and “mulGstrand” mixed model studies "   QuanGfying qualitaGve data and qualifying quanGtaGve data -­‐> see Russell Bernard (Alan Bryman) Mixed Methods: QualitaIve and QuanItaIve Data Remember John Creswell‘s definiGon: „Mixed methods research is the collecGon, analysis and mixing of both qualitaGve and quanGtaGve data in a single study or a mulG-­‐phase invesGgaGon.“ Quantitative Data Analysis
Statistics (SAS, SPSS)
Research Report A
Qualitative Data Analysis
QDA-Software
(MAXQDA,Nvivo ...)
Research Report B
6
30.10.13
When and how to „mix“ QUAL and QUANT? Quantitative Data Analysis
Qualitative Data Analysis
Statistics (SAS, SPSS)
QDA-Software
(MAXQDA,Nvivo ...)
Research Report A
Research Report B
Final Report
Mixing during data collecGon, during data analysis and acer data analysis Analysis of Mixed Methods Data What does it mean to analyse mixed methods data using so^ware? "   staGsGcal analysis of the quanGtaGve data using SPSS, SAS etc. "   analysis of the qualitaGve data by use of CAQDAS e.g. MAXQDA "   mixing QUAL and QUANT using MAXQDA ① linking results on the level of research reports ② linking qualitaIve and quanItaIve on the data level ③ quanIfying the qualitaIve data in CAQDAS ④ qualifying the quanItaIve data ⑤ joint displays of qualitaIve and quanItaIve data 7
30.10.13
Examples for Using MAXQDA in Mixed Methods Data Analysis Example # 1 Linking Data on the Level of Research Reports 8
30.10.13
Linking Data on the Level of Research Reports How to do it? Research reports are imported into MAXQDA (as ri, doc or pdf files) Major subjects are linked by hyperlink techniques or Major subjects are coded (subjects are used as codes) Lexical search funcGons may be used to idenGfy major subjects in the reports. DicGonary-­‐based techniques may also be used "   Retrieval techniques of MAXQDA are used to produce a sequenGal list or side-­‐by-­‐side list "
"
"
"
 
 
 
 
Mixing Data on the Level of Research Reports: via Links 9
30.10.13
Mixing Data via Codes Mixing Data via Codes 10
30.10.13
Example # 2 Linking QualitaGve and QuanGtaGve Data QUAL & QUANT in MAXQDA QuanGfying Documents Qualifying Variables/
A[ributes Study 11
30.10.13
Mixed Methods Tools "
"
"
"
"
"
"
 
 
 
 
 
 
 
Document variables Code variables Transform codes into variables Transform codes into categorical variables Use variables as selecGon criteria Analyse word frequencies DicGonary based automaGc coding Text and Agributes (Variables) in MAXQDA 12
30.10.13
Agributes in MAXQDA: List of agributes Using Agributes as SelecIon Criteria for Themes 13
30.10.13
Result: Matrix with Coded Segments Men Age < 30 Men Age 30+ Women Age < 30 Women Age 30+ Text Segments by Peter Text Segments by Larry Text Segments by Heidi Text Segments byBarbara Text Segments by John Text Segments by Nigel Text Segments by Lina Text Segments by Joanna Text Segments by JusGn Text Segments by Robert Text Segments by Sarah Text Segments by Susan Text Segments by Bob Text Segments by Mark Text Segments by Stella Text Segments by Scarle[ Example # 3 QuanGfying QualitaGve Data 14
30.10.13
The QuanItaIve Aspect of Coding If you are aware of it or not, when coding your data you create classificaIons and „quanItaIve“ informaIon, i.e. "   Text has been coded with a parGcular code (yes or no) "   A code can be a judgement or can have evaluaGve aspects (e.g. person feels responsible for the environment (not at all, partly, highly)) "   Codes may occur at the same Gme (a[ached to the same part of the text) "   Codes may be close together or far apart in a text "   How ocen a code has been applied to a parGcular text Classification is different from quantification. A classification contains
similar information to a categorical variable!"
QuanIficaIon of QualitaIve Data "   CounGng codes "   Visual display of codes and the frequencies of their occurrences "   Visual representaGons of relaGons (like in MAXQDA Code Matrix Browser, Code RelaGons Browser) "   Transforming codes to variables "   Analyzing the qualitaGve data for word counts (content analysis) "   Word-­‐based and dicGonary-­‐based analysis 15
30.10.13
CounIng Codes and Coded Segments Visual Comparison of Different Interviews and Themes Code Matrix Browser 16
30.10.13
Number of Segments per Theme and Interview
Code Matrix Browser: Transforming Codes into Agributes A new a[ribute „emoGon“ will be created. 17
30.10.13
Using Content Analyis Techniques Word-­‐based and dicGonary-­‐
based analysis Part 2 Analyzing Open-­‐Ended QuesGons Graham Hughes -­‐> Live PresentaGon 18