MIXED

METHOD
RESEARCH
 THREE MAIN FACTS ABOUT QUALITATIVE
AND QUANTITATIVE METHODS

• There are fundamental differences

between qualitative and
quantitative methods.
• Each of them has strengths and
weaknesses
• Both can be used in a single study
to adequately address a research
problem
BASIC DIFFERENCES BETWEEN QUANTITATIVE AND
QUALITATIVE RESEARCH

Qualitative (Exploratory) Quantitative

Study (making (Confirmatory) Study
observations to develop (making observations to
theory) test theory)

Philosophical assumptions Philosophical assumptions

Subjectivity Objectivity
Contextualization Generalisability
Inductive reasoning Deductive reasoning
Depth Breadth
Words Numbers

Qualitative approaches
Quantitative approaches
Narrative
Descriptive study
Phenomenology
Correlational study
Grounded theory
Quasi-experimental study
Ethnography
Experimental study
Case study
 INTRODUCTION

• Also known as Multi method research or Mixed method

research.
• Mixed Research as a method, focuses on collecting,
analyzing, and mixing both quantitative and qualitative data
in a single study or series of studies.
• “Third Research Paradigm”
 DEFINITION

Mixed method research is a type of research in which a

researcher combines elements of qualitative and quantitative
research approaches (eg. Use of qualitative and quantitative
viewpoints, data collection, analysis and inference technique)
for the purpose of breadth and depth of understanding and
corroboration.
Johnson et al (2007)
 DEFINITION
• Mixed methods research is a procedure for collecting,
analyzing and “mixing” both quantitative and qualitative
methods in a single study or a series of studies to understand a
research problem.
Creswell & Plano Clark(2011)
 PURPOSE
• The concepts are new and poorly understood and there is a
need for qualitative exploration before more formal,
structured methods can be used.
• Neither a qualitative nor a quantitative approach, by itself, is
adequate in addressing the complexity of the research
problem.
• The findings from one approach can be greatly enhanced with
a second source of data.
• The quantitative results are puzzling and difficult to
interpret and qualitative data can help to explain the
results.
• A particular theoretical perspective might require
both qualitative and quantitative data.
• A multiphase project is needed to attain key
objectives, such as the development and assessment
of an intervention.
 ESSENCE OF MIXED METHODS
RESEARCH
1. Enriching the findings

2. Increasing the depth and

breadth

3. Testing a theory or model

4. Seeking for participants’
inputs
5. Improving the trustworthiness
RATIONALE FOR MIXED METHOD
STUDIES

Complementarity

Practicality

Incrementality

Enhanced validity

Collaboration
CHARECTERISTICS
• Collect and analyze both
quantitative and qualitative
data.
• Mix two forms of data in
different ways.
• Give priority to one or both
forms of data.
• Can be in a single study or in
multiple phases of a study.
• Design can be based on either
or both perspectives.
• Research problems can become
research questions and/or hypotheses
based on prior literature, knowledge,
experience, or the research process.
• Sample sizes vary based on methods
used.
• Data collection can involve any
technique available to researchers.
• Interpretation is continual and can
influence stages in the research process.
 PLANNING MIXED METHODS
PROCEDURES
TIMING
• Timing of their qualitative and quantitative data collection, whether it will
be in phases (sequentially) or gathered at the same time (concurrently).
• When qualitative data are collected first, the intent is to explore the topic
with participants at sites. Then the researcher expands the understanding
through a second phase in which data are collected from a large number of
people.
• When data are collected concurrently, both quantitative and qualitative data
are gathered at the same time and the implementation is simultaneous.
• Concurrent: Qualitative and quantitative data
collection happens at the same time.
• Sequential: The researcher implements the strands in
two distinct phases.
• Multiphase: The researcher does both concurrent and
sequential data collection and analysis over a longer
period of time.
WEIGHTING
• The right priority given to quantitative or qualitative research
in a particular study.
• In some studies, the weight might be equal; in other studies, it
might emphasize one or the other.
• A priority for one type depends on the interests of the
researcher, the audience for the study (e.g., faculty committee,
professional association), and what the investigator seeks to
emphasize in the study.
MIXING
• Occur at several stages: the data collection, the data
analysis, interpretation, or at all three phases.
• Mixing means either that the qualitative and
quantitative data are actually merged on one end of
the continuum, kept separate on the other end of the
continuum, or combined in some way between these
two extremes.
THEORIZING OR TRANSFORMING
PERSPECTIVES
• Guides the entire design. It may be a theory from the
social sciences or a broad theoretical lens.
• All researchers bring theories and frameworks to their
inquires and these theories may be made explicit in a
mixed methods study or be implicit and not
mentioned.
• In mixed methods studies, the theories are found
typically in the beginning sections as an orienting
lens that shapes the types of questions asked, who
participates in the study, how data are collected, and
the implications made from the study.
NOTATION AND DIGRAMMING
 Morse’s notation system
• Designated by upper case and lower case letters
• QUAL/quan designate a mixed methods study in
which the dominant approach is qualitative, while
QUAN/qual designates the reverse.
• If neither approach is dominant (i.e., both are equal),
the notation stipulates QUAL/QUAN.
• Sequencing in this system is indicated by the symbols
+ or →. The arrow designates a sequential approach.
 Example

• QUAN → qual is the notation for a primarily

quantitative MM study in which qualitative
data collection occurs in Phase II.
• When both approaches occur concurrently, a
plus sign is used (e.g., QUAL + quan).
 Creswell and Plano Clark
• Creswell and Plano Clark (2007) have suggested a
modification of Morse’s notation to include the use of
parentheses, which designate an embedded design structure.
• The notation QUAN(qual) indicates a design in which the
qualitative methods are embedded within a quantitative
design.
 Visual Diagram

PHASE I PHASE II

Develop
Collect qual Analyse qual Obtain qual Develop Collect Analyse overall quall-
data data findings instrument QUAN data QUAN data QUAN
interpretations
 TYPES OF MIXED METHODS DESIGN

Sequential Designs
(a) Sequential Explanatory Design
(b) Sequential Exploratory Design
(c) Sequential Transformative Design
Concurrent Designs
(a) Concurrent Triangulation Design
(b) Concurrent Nested Design
(c) Concurrent Transformative Design
 SEQUENTIAL EXPLANATORY

• Characterized by: Collection and analysis of

quantitative data followed by a collection and
analysis of qualitative data.
• Purpose: To use qualitative results to assist in
explaining and interpreting the findings of a
quantitative study.
• Advantages: They are straightforward and easy to
describe and can be done by a single researcher. The
results can often be summarized in two separate
papers.

• Disadvantages: Can be time consuming. The second

phase cannot begin until data from the first phase are
analyzed.

• Example: Mixing a Grounded Theory Approach with

a Randomized Controlled Trial Related to Intimate
Partner Violence: What Challenges Arise for Mixed
Methods Research?
 When do you use it?

• When you want to explain the quantitative results in

more depth with qualitative data (e.g., statistical
differences among groups, individuals who scored at
extreme levels).

• When you want to identify appropriate participants to

study in more depth qualitatively.
 SEQUENTIAL EXPLORATORY

• Characterized by: An initial phase of qualitative data

collection and analysis followed by a phase of
quantitative data collection and analysis.
• Purpose: To explore a phenomenon. This strategy
may also be useful when developing and testing a
new instrument.
Two variants:
• Instrument development model: Data from the qual
phase are used in the development of Quan
instruments.
• Theory development: The researcher identifies
important constructs and develops a theory, taxonomy
or classification system grounded in the in depth data
gathered during the QUAL phase. Then the quan
phase is used to test or explore the taxonomy or
theory with a broader group.
• Advantages: They are straightforward and easy to describe
and can be done by a single researcher. Separate phases make
the inquiry easy to explain, implement and report.

• Disadvantages: Can be time consuming. The second phase

cannot begin until data from the first phase are analyzed.
Difficult to get a front approval from ethics committee.

• Example: Development and psychometric testing of

inflammatory bowel disease fatigue (IBD-F) patient self-
assessment scale.
 When do you use it?
• To develop an instrument when one is not available
(first explore, then develop instrument)
• To develop a classification or typology for testing
• To identify the most important variables to study
quantitatively when these variable are not known
 SEQUENTIAL TRANSFORMATIVE

• Characterized by: Collection and analysis of either

quantitative or qualitative data first. The results are
integrated in the interpretation phase.

• Purpose: To employ the methods that best serve a

theoretical perspective.
 CONCURRENT TRIANGULATION

• Characterized by: Two or more methods used to

confirm, cross-validate, or corroborate findings
within a study. Data collection is concurrent.

• Purpose: Generally, both methods are used to

overcome a weakness in using one method with the
strengths of another.
 When do you use it?
• When you want to combine the advantages of quantitative
(trends, large numbers, generalization) with qualitative (detail,
small numbers, in-depth)
• When you want to validate your quantitative findings with
qualitative data
• When you want to expand your quantitative findings with
some open-ended qualitative data (e.g., survey with closed-
and open-ended data)
 CONCURRENT NESTED

• Characterized by: A nested approach that gives

priority to one of the methods and guides the project,
while another is embedded or “nested.”

• Purpose: The purpose of the nested method is to

address a different question than the dominant or to
seek information from different levels.
 CONCURRENT TRANSFORMATIVE

• Characterized by: The use of a theoretical

perspective reflected in the purpose or research
questions of the study to guide all methodological
choices.

• Purpose: To evaluate a theoretical perspective at

different levels of analysis.
 METHODOLOGICAL RATIONALE OF
MIXED METHODS DESIGN

1. Triangulation

2. Complementarity

3. Development
4. Expansion
5. Initiation

(Plano Clark, & Creswell, 2008)

Questions to reflect on
 Why do you plan to use both qualitative and quantitative
methods in your study?

 Why do you plan to use more than one data collection

strategy?

 Why do you plan to collect both qualitative and quantitative

data?

 What are the use of the qualitative and quantitative data or

findings in your study?
 Triangulation
• Using different methods to address the
same phenomenon
• “Seeks convergence, corroboration,
correspondence of results from the
different methods”

• This rationale is associated with:

Concurrent Triangulation Design
 Complementarity
• Using different methods to address the different parts of a
phenomenon
• “Seeks elaboration, enhancement, illustration, andclarification
of results.”

• This rationale is associated with:

1.Sequential Explanatory D esign
2.Sequential Exploratory Design
3.Sequential Transformative Design
4.Concurrent Nested Design
5.Concurrent Transformative Design
 Development
• Using the results of one method
to inform the other method
• “Seeks to use the results from
one method to help develop or
inform the other method...”

• This rationale is associated

with:
• 1.Sequential Exploratory Design
• 2.Sequential Transformative
Design
 Expansion
• Using different methods to address
the different parts of a phenomenon

• “Seeks to extend the breadth and

range of inquiry.”
• This rationale is associated with:
1.Sequential Exploratory Design
2.Sequential Transformative Design
3.Concurrent Nested Design
4.Concurrent Transformative Design
 Initiation
• Looking for contradictory results
and using different methods to
collect data to explain the
discrepancy
• “Seeks for discovery of paradox and
contradiction, new perspectives of
frameworks.”

• This rationale is associated with:

• 1.Concurrent Nested Design
• 2.Concurrent Transformative
Design
 DETERMINING AN APPROPRIATE MIXED
METHODS DESIGN

• Think about:
a. Sequence of the data collection
b. Kinds of data you plan to collect
c. Source of the data
• Develop research questions
• Determine the roles of qualitative and quantitative
components of the study
• Decide which mixed methods designs with their
rationales best fit the roles of a qualitative and
quantitative component (i.e. determining consistency)
 STEP 1

• Think about:

a. Sequence of the data collection

(concurrent or sequential)
b. Kinds of data you plan to collect
c. Source(s) of the data
 EXAMPLE
• Purpose Statement

The purpose of the study is to determine the relationship

between mental health stigma and help seeking behaviors
among teens with mental health problems in a low income
neighborhood in Udupi, Mangalore.

In addition, the study will focus on examining how they seek

for help to address their mental health problems.
 STEP 2
• Develop Research Questions

1. Is there a correlation between mental health stigma and help

seeking behaviors among teens with mental health problems
in a low income neighborhood in Udupi, Mangalore?

2. How do teens with mental health problems seek for help or

mental heath services?
 STEP 3
• Determine the roles of qualitative
and quantitative components of
the study
• Research Questions
1. Is there a correlation between mental
health stigma and help seeking
behaviors among teens with mental
health problems in a low income
neighborhood in Udupi, Mangalore?

2. How do teens with mental health

problem seek for help or mental heath
services?
 STEP 4
• Decide which mixed methods designs with their rationales
best fit the roles of qualitative and quantitative components
(i.e. determining consistency)
PROCESS OF CONDUCTING A MIXED
METHOD STUDIES
 SAMPLING IN MIXED METHOD
STUDY
• Onwuegbuzie and Collins (2007) have categorized
mixed methods sampling designs according to the
relationship between the quantitative and qualitative
components.
• IDENTICAL RELATIONSHIP
• It occurs when exactly the same person are in both
components of the study.
• This approach might occur if everyone in a survey or
intervention study was asked a series of probing, open ended
questions - or if everyone in a primarily QUAL study was
administered a formal instrument such as a self efficacy scale.

• PARALLEL RELATIONSHIP
• The samples in the two strands are completely different,
although they are usually drawn from the same or a similar
population.
• It can occur in either concurrent or sequential designs and with
any of the prioritization schemes.
• NESTED RELATIONSHIP
• The participants in the qualitative strand are a subset
of the participants in the qualitative strand.
• It is a common sampling approach in MM studies,
especially in those with an explanatory design.

• MULTILEVEL RELATIONSHIP
• It involves selecting samples from different levels of
hierarchy.
• This means sampling from different but related
populations (e.g. hospital administrators, clinical staff
and patients).
 DATA COLLECTION
• Can be creatively combined in a mixed method study.
• Possible sources of data for MM studies include group and
individual interviews, psychosocial scales, observations, bio-
physiologic measures, records, diaries, internet postings,
photographs and physical artifacts.
• Johnson and Turner (2003) noted that MM studies can involve both:

 Intramethod mixing (e.g. structured and unstructured self

reports)
 Intermethod mixing (e.g. biophysiologic measures and in-
depth interviews).
 ANALYSIS OF MIXED MEHOD
DATA
• Analysis occurs both within the quantitative (descriptive and
inferential numeric analysis) and the qualitative (description
and thematic text or image analysis) approach and often
between the two approaches.
• Data transformation: A researcher may quantify the
qualitative data. This involves creating codes and themes
qualitatively. Then counting the number of times they occur in
the text data .This quantification of qualitative data then
enables a researcher to compare quantitative results with the
qualitative data.

• Explore outliers: In a sequential model or an analysis of

quantitative data in the first phase can yield extreme or outlier
cases.
• Instrument development: In a sequential approach,
obtain themes and specimen from participants in an
initial qualitative data collection.
• In the next, specific items and the themes for scales to
create a survey instrument that is grounded in the
views of the participants.
• A third, final phase might be to validate the
instrument with a large sample representative of a
population.
• Examine multiple levels: In a concurrent embedded
model, conduct a survey at one level (e.g., with
families) to gather quantitative results about a sample.
• At the same time, collect qualitative interviews (e.g.,
with individuals) to explore the phenomenon with
specific individuals in the families.
• Create a meta matrix: When comparing data in a concurrent
type of approach, combine information from both the
quantitative and qualitative data collection into a matrix.
• The horizontal axis of this matrix could be a quantitative
categorical variable (e.g., type of provider-nurse, physician,
and medical assistant)
• The vertical axis would be the qualitative data (e.g., five
themes about caring relationships between providers and
patients).
• Information in the cells could be either quotes from the
qualitative data, counts of the number of codes from the
qualitative data, or some combination.
PILLAR INTERGRATION PROCESS
4 STAGES
 STAGE 1- LISTING
• Raw Data/ Group data- “listed” – QUANT DATA/
CATEGORIES or QUAL DATA/CATEGORIES
columns
• Comprehensive listing: all codes or data identified
• Selective listing: Particular codes or data identified
 STAGE 2- MATCHING
• Matching process proceeds on the opposite side of the joint
display.
• QUANT DATA: QUAL CODES
• During the matching stage, the researcher matches the
opposite column data reflecting content that relates to the
initial listed data, horizontally aligning similar data, and
refining and organizing categories that had been generated in
the two ‘‘categories’’ columns.
• Each list is organized and compared across rows of the joint
display so that the qualitative items reflect patterns, parallels,
similarities, or any other relational quality with the
quantitative items.
 STAGE 3- CHECKING/
REFLECTING
• Once the data are matched and the researcher
is satisfied with the accuracy of the match, the
data are checked for quality purposes.
• All data in the four completed outside columns
need to be cross-checked for completeness to
ensure the rows are appropriately matched.
 STAGE 4- PILLAR BUILDING

• Compares and contrasts the findings that have

developed from the listing, matching and
checking stages, and conceptualizes the
insights identified from connecting and
integrating the qualitative and quantitative
columns.
• Builds inferences about what patterns,
insights, or themes have emerged and the
possible explanations.
• They locate these themes in the PILLAR
column. The PILLAR holds the integrated
themes from each row.
• When all the themes in the PILLAR column
are viewed together, the researcher can begin
to weave together a meaningful narrative from
the integration of quantitative and qualitative
data.
APPLICATION OF MIXED METHOD
RESEARCH

• Instrument Development

• Intervention Development
 STRENGTH OF MIXED METHOD
RESEARCH
• Can be easy to describe and to report

• Can be useful when unexpected results arise from a

prior study
• Can help to generalize qualitative data
• Helpful in designing and validating an instrument

• Can position research in a transformative framework

 WEAKNESS OF MIXED METHOD
RESEARCH
• Time required.

• Discrepancies between different types of data.

• Can be difficult to decide when to proceed in
sequential designs.
• Little guidance on transformative method
 MIXED METHODS DESIGN DECISION
TOOL (MMDDT)

• Using Mixed Methods Design Decision Tool

(MMDDT) to guide you to choose an appropriate
mixed methods design.

https://www.surveymonkey.com/r/Choosing_Appropriate_Mix
ed_Methods_Design
Czuber-Dochan, W., Norton, C., Bassett, P., Berliner, S., Bredin, F., & Darvell,
M. et al. (2014). Development and psychometric testing of inflammatory
bowel disease fatigue (IBD-F) patient self-assessment scale. Journal Of
Crohn's And Colitis, 8(11), 1398-1406.
http://dx.doi.org/10.1016/j.crohns.2014.04.013
The authors from London used a five-step sequential mixed method design to
develop a fatigue scale specific to the needs and experiences of people with IBD.
The authors implemented a qualitative phase to assess patients' experience of
fatigue and its impact on their lives, and four mixed qualitative – quantitative
phases to refine the scale and to assess its psychometric properties. The participants
in the study confirmed that fatigue in IBD is burdensome. The author concluded
that the items generated and refined by people with IBD-fatigue reflect their
experience and form the basis of this new IBD-fatigue scale, which is
psychometrically robust with reliability estimates which fall within statistically
acceptable ranges. The scale can be used by patients and practitioners to assess
severity and impact of fatigue in people with IBD.
Jacobsen, F., Mekki, T., Førland, O., Folkestad, B., Kirkevold, Ø., & Skår, R. et al. (2017).
A mixed method study of an education intervention to reduce use of restraint and
implement person-centered dementia care in nursing homes. BMC Nursing, 16(1).
http://dx.doi.org/10.1186/s12912-017-0244-0
The author draws on a mixed-method intervention study to investigate which factors hindered or
facilitated staff awareness related to confidence building initiatives based on person-centered
care, as an alternative to restraint in residents with dementia in nursing homes. The education
intervention, consisting of a two-day seminar and monthly coaching sessions for six months,
targeted nursing staff in 24 nursing homes in Western Norway. The authors used P-CAT
(Person-centered Care Assessment Tool) and QPS-Nordic (The General Nordic questionnaire
for psychological and social factors at work) instruments to measure staff effects in terms of
person-centered care and perception of leadership. The qualitative data were collected through
ethnographic fieldwork, qualitative interviews and analysis of 84 reflection notes from eight
persons in the four teams who facilitated the intervention. The study highlighted that
leadership, in interplay with staff culture, turned out to be the most important factor hindering
or promoting staff awareness related to confidence building initiatives, based on person-
centered care. While quantitative data indicated variations across institutions and the extent of
this variation, qualitative data offered insight into the local processes involved. A mixed
method approach enabled understanding of dynamic contextual relationships.
Catallo, C., Jack, S., Ciliska, D., & MacMillan, H. (2013). Mixing a Grounded
Theory Approach with a Randomized Controlled Trial Related to Intimate
Partner Violence: What Challenges Arise for Mixed Methods
Research?. Nursing Research And Practice, 2013, 1-12.
http://dx.doi.org/10.1155/2013/798213
• The authors from MacMaster University employed a two-phase sequential
explanatory mixed methods study in Canada to understand how women decide to
disclose intimate partner violence in emergency department settings. The authors
tried to describe the process of implementing a sequential explanatory mixed
methods study involving a randomized, controlled trial (RCT) with a sub analysis
of quantitative data and a qualitative grounded theory approach. The main highlight
of this study is this study’s use of grounded theory as an equally weighted approach
alongside the RCT to improve the depth and richness of results when examining a
complex intervention. The most significant limitation of this study was beginning
this mixed methods study after the overall RCT was underway. This research areas
in nursing that can benefit from this type of mixed methods design such as the
evaluation of nursing interventions, exploration of patient centered care, in depth
exploration of complex phenomena, and instrument development and testing.
Burns, N., & Grove, S. K. (2008). Understanding Nursing
Research (4 ed.). Missouri: Saunders.

Brockopp, D., Hastings-Tolsma, M..(2003). Fundamentals of

Nursing Research.( 3rd ed). Boston: Jones & Bartlett.
 
Creswell, J.W. (2009). Research Design- Qualitative, Quantative
& Mixed Method Approach (3rd ed). Sage

Grove, S., Burns, N., Gray, J. (2013). The Practice of Nursing

Research. (7th ed). Missouri: Elsevier.
  
Parahoo, K. (2006).Nursing research. (2nd ed). S.l.: Palgrave
Macmillan.
 
Polit, D., Beck, C. (2017). Nursing Research. (10th ed).
Philadelphia: Lippincott Wolters Kluwer.
 
Sharma, S. (2012). Nursing Research and Statistics. Haryana:
Elsevier.

Wood, G., Haber, J. (2010). Nursing Research. (7th ed).

Missouri: Mosby Elsevier.