2 - Mixed Methods Research
2 - Mixed Methods Research
multi-method research (Johnson et al 2007). appropriate to address his or her specific research
Mixed methods research combines qualitative questions. The decision to use a mixed methods
and quantitative research in a single study, while design should be based on the additional value
multi-method research involves data collection that using both qualitative and quantitative
using two methods from the same paradigm, methods of data collection would provide, above
for example interviews and focus groups, that using a single method of data collection,
or quantitative surveys and medical record audit in answering the research question (Creswell
(Andrew and Halcomb 2009). Mixed methods and Plano Clark 2011, Scammon et al 2013).
research capitalises on the strengths of both The feasibility of undertaking a mixed methods
qualitative and quantitative research in combining study should also be considered in terms of
qualitative and quantitative data collection, while balancing the benefits of a mixed methods
compensating for their limitations, to provide an research design against the increased skills and
integrated understanding of the research topic resources required (Halcomb and Andrew 2009).
(Andrew and Halcomb 2009, Wisdom et al 2012, The research problems that are best suited to
Scammon et al 2013). Multi-method research has mixed methods designs are those in which multiple
the advantage of collecting data using multiple perspectives on the research problem may be
methods. Mixed methods research, in contrast, able to provide a more detailed understanding
has the potential to combine qualitative than could be obtained from a single perspective
and quantitative characteristics throughout (Simons and Lathlean 2010, Andrew and
the research process, from its philosophical Halcomb 2012). For example, a study that
underpinnings through to data collection, analysis developed an overall impression of a health service
and interpretation. using quantitative data might overlook factors
that affect individuals accessing the service.
Adding a qualitative component, investigating the
Core considerations experiences of individuals accessing the service,
Mixed methods research involves more than would be likely to add significant insights to such a
the collection of qualitative and quantitative study. Reasons for using mixed methods research
data within a single study. The methodological designs are provided in Box 2.
approach to mixed methods research requires
various considerations to be addressed to ensure Philosophical approach
methodological rigour. This article presents eight A philosophical approach or world view is the lens
core considerations for the novice researcher through which one views the world. A range of
in planning and undertaking mixed methods philosophical approaches may be used in mixed
research (Box 1). methods research (Mesel 2013). The researcher
should explore a philosophical approach,
Rationale for using mixed methods to understand how it fits with their personal
Research questions should reflect the rationale perceptions and with the proposed project, before
for undertaking mixed methods research and using it. Creswell and Plano Clark (2011) advocate
demonstrate the qualitative and quantitative four stances on using world views in mixed
aspects of the project (Lavelle et al 2013). A mixed methods research.
methods study should not be undertaken simply First, a single world view may be selected to
because it is possible to collect both numerical underpin the entire study. Generally, this would
and narrative data in relation to a research be either pragmatism, a transformative
question. The researcher should consider which (emancipatory) approach or critical realism
methodological approach would be the most (Andrew and Halcomb 2006, Creswell and
Plano Clark 2011, Maudsley 2011, Andrew
BOX 1 and Halcomb 2012, Walsh and Evans 2014).
A pragmatic approach involves the researcher
Core considerations of mixed methods research
using ‘what works’ to seek answers to the
Rationale for using mixed methods. research question (Creswell and Plano Clark
Philosophical approach. 2011). Pragmatism views the research problem as
Mixed methods designs. the most important issue, valuing both subjective
Skills required. and objective observations to reveal the answers
Project management.
(Andrew and Halcomb 2006, Feilzer 2010,
Integrating qualitative and quantitative aspects.
Creswell and Plano Clark 2011). In contrast,
Demonstrating rigour.
Dissemination of mixed methods research findings.
a transformative approach involves recognising
cultural differences and injustices throughout
any point in the research process. For example, when establishing a research team (Halcomb
various philosophical approaches may be used and Andrew 2009). Limited attention has been
to support the study; research questions may paid to optimal models of teamwork or the
include both qualitative (why?) and quantitative optimal composition of mixed methods research
(how often?) questions; data collection may teams, and they should include individuals with
combine open-ended questions that collect both quantitative and qualitative skills and
narrative data and rating scales; or the data knowledge, as well as those with experience
analysis may cross-tabulate themes and participant in conducting mixed methods research
demographics (Andrew et al 2008). (Bowers et al 2013).
Skills should be a particular consideration
Skills required when mixed methods designs are used by
Mixed methods research is seldom a solo postgraduate students (Halcomb and Andrew
endeavour (Bowers et al 2013, Lavelle et al 2009). Undertaking a mixed methods research
2013). Establishing a team to undertake a mixed project as a postgraduate project requires the
methods project should be carefully thought student to gain a broader range of research
out (Creswell and Plano Clark 2011). A broad skills than would be required for a project using
range of skills is required to undertake mixed either qualitative or quantitative methods alone.
methods research and this should be considered Care should be given to the composition of
TABLE 1
Mixed methods designs
Research Process Purpose Level of Priority Example
design interaction
Convergent Qualitative and To obtain Data collected Equal Peters and Cotton (2013) collected postal
parallel quantitative different but and analysed surveys and undertook unstructured
(concurrent) complementary independently. interviews with women with a physical
data to answer a disability to gain a broad understanding
single research of the barriers and enabling factors
question. associated with accessing and
experiencing screening services for
breast cancer and cervical cancer.
Sequential Quantitative Qualitative data Quantitative Quantitative Pfaff et al (2014) used a postal survey
explanatory then are collected data frame dominant to measure perceived confidence in
qualitative to explain the qualitative data interprofessional collaboration among
quantitative collection. new graduate nurses. Following analysis
findings. of the survey data, they conducted
interviews with 16 new graduate nurses
to explain the quantitative findings and
expand on them.
Embedded or Quantitative To obtain Embedded data May be either Kinser et al (2013) conducted a
nested within different data set provides qualitative or randomised controlled trial of an
qualitative or to answer a answers to a quantitative eight-week yoga intervention for women
qualitative complementary complementary dominant. with major depression. Outcomes
within research research measured included depression severity,
quantitative question. question. stress, anxiety and rumination. Qualitative
interviews were embedded in the trial to
explore the feasibility and acceptability of
the intervention.
TABLE 2
Procedures for mixing qualitative and quantitative data
Procedure Definition Example
Integration Qualitative and quantitative data are Rickard et al (2011) conducted a study to explore the roles
collected concurrently and analysed of research nurses and possible career pathways. Data were
separately. Integration occurs during the collected via a 104-item survey tool that combined three
interpretation phase. previously validated instruments and a series of semi-structured
interviews. The qualitative and quantitative data were collected
separately and only integrated during the reporting phase.
Connection One approach is based on the findings of Meixner et al (2013) surveyed providers of brain injury services
the other approach. within a region, asking about the barriers to accessing crisis
intervention services. A second phase of the study involved a
series of focus groups who investigated the survey findings to
develop greater levels of understanding.
Embedding The analysis of one type of data is Zwar et al (2010) conducted a cluster randomised controlled
embedded within the other. Generally, trial to test the uptake and effectiveness of a package of smoking
this involves a small qualitative component cessation support provided primarily by the practice nurse.
nested within a quantitative study. Qualitative interviews were conducted with patients, nurses and
general practitioners who participated in the trial to evaluate the
implementation, feasibility and acceptability of the intervention.
this into the research design before commencing for mixed methods publications and theses
the study is important when planning mixed (Halcomb and Andrew 2009, O’Cathain
methods research. The strategies used for mixing 2009). In the segregated model, qualitative and
should be clearly articulated in publications and quantitative components of a study are kept
research reports (Maudsley 2011). separate, devoting separate chapters or articles
to each. Any integration between qualitative
Demonstrating rigour and quantitative components of the study
Methods of demonstrating rigour in studies that occurs only in the discussion of the report or in
use mixed methods are still poorly defined, despite a separate article. In contrast, in the integrated
the increasing popularity of mixed methods model, findings from qualitative and quantitative
research. While the use of mixed methods may methods are interwoven within a series of
enhance validity, the researcher should still articles or chapters, each of which is focused
demonstrate rigour in the research (Lavelle et al on a single aspect of the research question or
2013). Creswell and Plano Clark (2011) advocate theme. The choice of presentation method should
that mixed methods investigations should reflect the nature of the research study to be
demonstrate rigour using the criteria that would be disseminated (Halcomb and Andrew 2009).
seen in a quantitative or qualitative investigation, Many publications reporting mixed methods
in addition to specific mixed methods criteria. research lack sufficient detail of the methods
Rigour in mixed methods research involves used (Wisdom et al (2012). Several frameworks
providing the reader with a clear audit trail and have been developed to improve dissemination of
with well-considered, justified rationales for the mixed methods research and to guide authors in
decisions made throughout the research process, writing mixed methods articles for publication.
regardless of the specific tool or method used One such framework is the Good Reporting of
(Lavelle et al 2013). A Mixed Methods Study framework (O’Cathain
et al 2008) (Box 3). Use of such frameworks
Dissemination of mixed methods research may improve the quality of reporting research
findings significantly; however, authors should also be
Disseminating mixed methods research is a aware of the manuscript submission guidelines
significant challenge for researchers (Glogowska for the relevant journal.
2011). An increase in mixed methods publications
has led to improved acceptance of mixed
methods research articles. However, reviewers’ Conclusion
lack of familiarity with mixed methods, as well Mixed methods research provides significant
as audience expectations, word limits for journal opportunities for researchers to gain a deeper
articles and the decision to publish in a mixed understanding of complex health issues
methods or clinical journal are potential than would be possible with the use of either
barriers to publication that should be considered quantitative or qualitative data alone. Researchers
(Wisdom et al 2012). who use mixed methods should plan their study
Two models of dissemination, the segregated from a qualitative, quantitative and mixed
and integrated models, have been proposed methods perspective. The main considerations
outlined in this article should be deliberated on
BOX 3 before the mixed methods study commences.
All phases of the research process should flow
Good Reporting of A Mixed Methods Study
framework logically and be clearly compatible. Reports and
publications stemming from mixed methods
1. Describe the justification for using a mixed methods
research should explicitly detail the essential
approach to the research question.
2. Describe the design in terms of the purpose, priority methodological components of the project. Mixed
and sequence of methods. methods articles have the potential to extend
3. Describe each method in terms of sampling, data nursing knowledge and to inform professional
collection and analysis. nursing practice in a wide range of complex
4. Describe where integration has occurred, how it has healthcare issues NS
occurred and who has participated in it.
5. Describe any limitation of one method associated Acknowledgement
with the presence of the other method. Nursing Standard wishes to thank Leslie
6. Describe any insights gained from mixing or
Gelling, reader in nursing at Anglia Ruskin
integrating methods.
University, for co-ordinating and developing
(O’Cathain et al 2008)
the Research series.