BNS 413 Data Collection Methods 2024
BNS 413 Data Collection Methods 2024
------------------------------------------------------------------
1. Introduction
Data collection is one of the most important stages in conducting research. It enables the
researcher to find answers to research questions. There are different types of data and several
data collection methods, techniques and tools accordingly. Each data collection method has
its own strengths, limitations. The choice of data collection method directly influences the
quality and reliability of the data collected and subsequently impacts the validity and
generalizability of the study's findings. It is therefore important for researchers to have a
mastery of the various methods, their merits and demerits, to be able to select the most
appropriate methods based on the research questions/objectives and contexts. It is worth
1
noting that there is no ideal method of data collection. Hence, rsearchers often use a
combination of methods, known as mixed methods, to gain a comprehensive understanding
of a health issue under investigation.
2. Definitions
NB: The terms "data collection method" and "data collection technique" are often
used interchangeably, but they can have slightly different connotations depending on
the context. The method is the broader concept that describes the overall approach for
gathering data, while the data collection technique refers to the specific approach used
within that method to collect the data. E.g. For Surveys is a method, its techniques
are: paper-based questionnaires, online surveys, face-to-face interviews, or
telephone interviews.
v. Data collection tools: Devices/ instruments used by the researcher to collect data. There
are different tools for various data collection methods.
vi. Data sources: These are sources from where data are collected (people, records, objects,
nature, etc)
2
3.Types of data
There are 02 main categories of data in research: Qualitative & Quantitative data
Qualitative data refers to non-numerical data. They are often descriptive in nature,
collected as text (words & sentences), pictures, sounds, signs, videos, etc. They can be
arranged into categories (categorical data). Qualitative data is often analyzed using thematic
analysis, content analysis, or other qualitative methods to identify themes, patterns, and
relationships within the data. Qualitative data provide insights into people's experiences,
beliefs, attitudes, and behaviours.
Based on data collection methods, qualitative and quantitative data may be classified as
primary or secondary data
Primary data are those which are collected for the first time by the researcher (original
data), for the purpose of the study.
Secondary data are existing data that had already been collected-by someone else for a
different purpose, but can be used for research purposes.
Both types of data have their advantages and disadvantages as presented in Tables 1 and 2.
3
Table 1: Strengths and weaknesses of primary data
Strengths Weaknesses
i. Data are tailored according to i. Expensive & time-consuming to collect.
research question. ii. May not be readily available when needed
ii. Data are current. iii. May be difficult to obtain from source due
iii. Reliability & Validity is high ethical constraints, unwillingness of
iv. Can be checked and validated participants etc.
v. Completeness of data is ensured
Table 2: Strengths and weaknesses of secondary data
Strengths Weaknesses
i. Cheaper & readily available i. Data may not be suitable for the
ii. Easier and quicker to obtain research question
iii. May be very accurate, when obtained ii. Data may be out-dated (not current).
from credible sources iii. Data Reliability & validity is uncertain
iv. Less ethical concerns iv. Incomplete or Missing information
v. Must suitable for historical events. v. Possibility of errors during extraction
from the hand written records.
a) Quantitative data collection methods involve collecting numerical data that can be
analyzed statistically (Table 3). Quantitative data collection methods seek to address
the ‘what’ research questions. They are more standardized and structured. The methods
are often used to quantify prevalence, incidence, treatment outcomes, or associations
between variables.
b) Qualitative data collection methods focus on gathering non-numerical, descriptive data
to understand social and contextual factors (Table 3). Qualitative methods address the
‘Why & How’ questions. They are less structured and are suitable for gathering in-depth
information on feelings, opinions, perceptions, and attitudes. Qualitative methods provide
insights into patients' experiences, healthcare practices, or the social determinants of
health.
4
Table 3: Data Collection methods
4.1 SURVEYS
Definition:
A survey is a method of gathering information from a representative sample of individuals
or the entire population, using a questionnaire (set of standardized questions in a
structured format)
‘A Survey is the most widely used methods to collect primary quantitative data’
Types of surveys
There are several types of surveys, including cross-sectional surveys, longitudinal surveys,
and panel surveys. Cross-sectional surveys gather data from a sample at a single point in
time, while longitudinal surveys gather data from the same sample over time.
5
A questionnaire is the main tool for surveys. A questionnaire is a research instrument
that consists of a set of questions to collect information from a respondent on the
phenomenon under study.
‘Choose a survey administration method that is appropriate for the target population’.
Strengths of surveys:
i. Surveys are useful for collecting large amounts of quantitative data quickly and
efficiently from a large number of participants.
ii. Surveys are useful for collecting data on a wide range of topics, including attitudes,
behaviours, and beliefs/perceptions related to health.
iii. Surveys can be standardized and easily replicated across different settings.
iv. They have the potential for providing reliable and valid data.
v. Survey data are easy to analyse (statistical analysis).
Limitations/Weaknesses of surveys
6
vi. Surveys may be limited by the quality of the survey instrument, including question
wording and response options.
vii. Difficulty in capturing complex responses.
Surveys are suitable for gathering large amounts of quantitative primary data on:
4.2 INTERVIEWS
Definition of interview
Types of interviews
Depending on the research question and objective, there are 03 main types of interviews are:
structured, semi-structured and unstructured.
a) Structured interviews
Structured interviews involve asking the same questions, in the same order, and in the same
manner to all respondents, using a structured interview guide. Also referred to as focused
interviews.
7
ii. All participants are exposed to same questions and response options
iii. No room for variation in responses.
iv. No follow-up questions to responses needing further elaboration (No probing)
v. No explanation of unclear questions to interviewee.
vi. The interviewer plays a neutral role (no opinion)
vii. No flexibility
Strengths
Limitations
b) Semi-structured interviews:
8
Characteristics
Strengths
i. Less costly & less time consuming compared with unstructured interview
ii. Provides both qualitative and quantitative data.
iii. Rich information compared to structured interview
Limitations
i. Useful when both qualitative & qualitative data is needed (answer the What, Why and
How Questions).
ii. Useful when the research question is less clear or when the interviewer wants to
explore new topics.
Used most frequently in health research compared to the other types of interviews
c) Unstructured interviews:
Characteristics:
i. No interview guides.
9
ii. The interviewer has a clear plan in mind to guide the discussion
iii. Interview starts with an opening question & subsequent questions depend on the
interviewee’s response.
iv. Probing by the interviewer for more information
v. Questions tend to be open-ended.
vi. High degree of flexibility
Strengths
Limitations
10
ix. Difficulty in generalizing findings to larger populations.
Interviews can be conducted: in person (face-to-face) where questions are asked directly to
respondents, over the telephone, or via video conference.
Face-to face interviews involve the physical presence of both the interviewer and the
interviewee.
Strengths
ii. Probing can be done to provide rich data for semi-structured and structured
interviews.
Limitations
11
i. Expensive and time consuming
Telephone are cconducted over the phone, particularly when face-to-face interviews are not
possible or practical. Video interviews are conducted using videoconferencing software, such
as Skype or Zoom. Video interviews are useful when face-to-face interviews are not possible
or practical, but the researcher wants to observe the participant's nonverbal behaviour.
Strengths:
Limitations
12
Introducee the interviewer and note-taker to the participant and explain their roles
and responsibilities
Establish rapport and set ground rules for the interview to enhance respectful
discussion, confidentiality, and active participation.
Follow the interview protocol
Ask open-ended questions and probe for more information to elicit detailed and
meaningful responses from the participant.
Encouragee participation and managee dominant or passive participants for
group interviews to ensure that all perspectives are represented.
Record and document the intervieww using audio or video recording equipment.
Detailed notes should be taken by the note-taker.
4.3. OBSERVATION
Definition
The observation method is the most commonly used method specially in studies relating to
behavioural sciences.
Types of observation
a) Structured observations involve the use of an observation guide (protocol) and check
list with predetermined set of criteria for observing and recording behaviour. Structured
observations are useful when the research question is clear and specific.
b) Unstructured observations: Unstructured observations involve a more open-ended
approach to observing and recording behaviour. The observer does not follow a specific
protocol and records data based on what they observe in the natural setting. Unstructured
observations are more flexible, and are useful when the research question is exploratory
and the researcher wants to gain a deep understanding of the behaviour being observed.
13
c) Participant observations involve the observer actively participating in the setting being
observed. The observer takes on the role of a participant and observer. The observer takes
part (participates)in the situation he or she observes. Example: A student researcher
assisting in a wound dressing, observing the procedure and collecting data.Participant
observations are useful when the researcher wants to gain an insider's perspective on the
behaviour being observed.
d) Non-participant observations involve the observer observing behaviour from a distane
without participating. E.g. A student researcher observes a child delivery and collecting
data without participating in the delivery. Non-participant observations are useful when
the researcher wants to maintain an objective perspective on the behaviour being
observed.
e) Overt observation: The observer observes behaviour with the knowledge or consent of
the participants. Participants are aware that they are being observed. e.g. A student
researcher observing a tooth extraction procedure with the dentist’s consent.
f) Covert observations involve the observer concealing their identity or purpose from the
setting being observed. E.g., A student observing taxi driver’s interaction with clients
without the knowledge of the drivers. Covert observations are controversial and are
generally considered unethical unless there is no other way to obtain the necessary data.
g) Controlled Observation: When observation takes place under controlled conditions. It is
generally done in laboratory (experiments).
h) Uncontrolled Observation: When the observation takes place in natural setting. It is
done to get spontaneous picture of life and persons.
Each observation type has its strengths and weaknesses and should be chosen based on the
specific research needs.
Observation Tools
14
i. Determine the purpose of the observation activity
ii. Determine what/who will be observed & How
iii. Determine what aspects to observed (characteristics, attributes, behaviours, etc.).
iv. Determine where (the site), when (time of day, date), and duration of observation.
v. Prepare and pre-test observation tools & check lists; field notebook and pen.
vi. Recruit and select field staff quality, number, train have them practice.
vii. Consider how you will present yourself (appearance, overtly or covertly)
viii. Plan how and if you will take notes during the participant observation.
ix. Conduct the observation (Collect the data).
x. Record the observations (e.g., field notes, audio or video recording).
Strengths
Weaknesses:
15
v. Limited information on the reasons/rational behind observed behaviours. Hence,
difficulties in interpreting the meaning underlying the observations.
vi. Sampling can be a problem
vii. Difficulty in generalizing results
viii. Ethical issues: observing people without their knowledge and informed consent, no
respect of privacy or invasion of privacy, etc.
Application of observation method in health research
Observation involves systematically watching and recording behaviours, events,
or phenomena in real-time.
i. Valuable method for studying people's behaviours, social interactions, and
experiences in natural or controlled settings, and environmental factors
related to health.
ii. Suitable for investigating complex or sensitive topics that cannot be easily
measured through other methods.
Key points
16
It can be done through direct observation or using tools like video recording or field
notes.
Characteristics of FGDs
Homogenous groups (in terms of age, literacy, gender, socioeconomic status, etc) to
facilitate better interaction (group dynamics) and free discussion.
6-12 participants
Discussions last for 1 and 2 hours
Trained facilitator or Moderator to guide the discussion & Notetaker
Discussion guide & Check list to stay focussed.
Tape recording of discussion and notes taking
Tools for FGDs
FGD Guide with open-ended questions
Checklist
Video and Audio equipment,
Note book
Preparation and conducting FGDs
o Formulating the research question/objectives
o Preparation and pre-testing of the discussion guide and check list
o Determining the quality, recruit, and train the Moderator & Notetaker
17
o Recruitment & informed consent of participants (Convenient sampling)
o Physical arrangements: convenient venue and sitting space.
o Conducting FGDs
o Introduction of the moderator and note-taker to the group and explain their roles and
responsibilities.
o Establishing rapport and setting ground rules for respectful discussion,
confidentiality, and active participation
o Facilitating the discussion and keep the group on track, ensuring that the
discussion guide and questions are covered.
o Encouraging participation and managing dominant or passive participants to
ensure that all perspectives are represented.
o Probing and following up on participant responses to elicit more detailed
information.
o Recording and documenting the discussion using audio or video recording
equipment, and taking detailed notes.
Strengths and Limitations of FGD
Strengths
1. FGDs generate rich and detailed data in a short period of time
2. Provide a deeper understanding and meaning of the phenomenon being studied
3. Less expensive compared with other methods
4. Do not require participants to be literate
5. Useful for exploring complex issues
6. Useful for gathering information on collective views.
7. Potential for uncovering new perspectives and idea
8. Generate hypotheses for further research.
Limitations
1. FGDs are prone to social desirability bias
2. The potential for groupthink is high (no personal opinion as people tend to centre on
what is generally or socially acceptable.
3. Requires a well-trained facilitator (Difficult to conduct if team is not well trained)
4. Lack of privacy/anonymity (ethical concerns)
18
5. Challenges in balancing the group to ensure homogeneity.
6. Risk of domination by one or two persons.
7. Not suitable for sensitive topics (members may hesitate to talk freely).
8. Time consuming to conduct
9. Data analysis is challenging and time-consuming.
10. Difficulties in generalizing results.
19
7. Historical Records: Historical records provide information preserved from the past,
including historical documents, manuscripts, archives, diaries, photographs, and oral
histories.
20
Limitations
Limited access and availability: Access to the relevant records can be a challenge,
particularly if they are restricted, classified, confidential, or stored in different
locations.
Researchers may need to navigate legal or ethical considerations, obtain permissions,
or negotiate access with data holders.
Data quality and reliability: Issues such as incomplete or missing information,
inaccuracies, inconsistencies, or biases in the records can affect the validity and
reliability of the findings.
Researchers need to critically evaluate the data sources and consider potential
limitations.
Time-consuming and resource-intensive when dealing with a large volume of
documents or complex data sources.
Missing data: Records may not always contain all the desired information, and there
may be missing data or gaps in the records.
Selective reporting: where certain information is omitted or not recorded, can
introduce bias or limit the comprehensiveness of the review
Lack of data standardization and incompatibility: Records obtained from different
sources may have variations in format, structure, or terminology.
Researchers may need to invest time and effort in data cleaning, standardizing, and
reconciling differences to ensure data consistency.
Ethical and privacy considerations: Record review may involve sensitive or
personal information, raising ethical and privacy concerns.
21
Ethical Considerations
Obtaining administrative and Ethical clearance from appropriate institutions.
Obtaining informed consents for adults and assents for children.
Protecting the confidentiality and privacy of participants throughout the process, and
removing and keeping confidential any identifying information.
Minimizing harm and discomfort to participants.
Avoiding potential biases and conflicts of interest such as the interviewer’s personal
beliefs or preferences.
Guidelines for Selecting an Appropriate Data Collection method
When selecting a data collection method in health research, researchers should consider
several criteria to ensure the method is appropriate and aligned with the research objectives.
Here are some key criteria to consider:
Research question and purpose: The data collection method should directly address the
research question and purpose of the study.
Study design: Different designs may require different data collection methods to capture the
desired information.
Practical considerations (Feasibility and resources): Consider the practicality and
feasibility of implementing the data collection method within the available resources,
including time, budget, availability of necessary equipment or personnel/expertise.
Data type and measurement: Determine the type of data (quantitative, qualitative, or
mixed) and assess whether the chosen method can collect the required data accurately.
Data quality, Validity and reliability: Choose a method that has been validated and shown
to produce reliable results in previous studies.
Researchers should employ standardized protocols, validated measurement tools, and
appropriate sampling techniques to minimize bias and measurement errors.
Population diversity/characteristics: Consider the characteristics and diversity of the target
population, including age, gender, health status, ethnicity, cultural background, etc. The
chosen method should be suitable for the population under study and can provide valid and
reliable data from the chosen sample.
Data analysis requirements: Consider the compatibility of the data collection method with
the planned data analysis techniques. Ensure that the collected data can be appropriately
analyzed to address the research objectives.
22
Ethical considerations: Ensure the data collection method adheres to ethical principles and
safeguards the rights and privacy of research participants.
REVIEW QUESTIONS
1. Which of the following is an example of quantitative data?
(a) Interview transcripts describing customer experiences
(b) Customer satisfaction ratings on a scale of 1-5
(c) Open-ended responses about a new product design
(d) Photos of a research participant's workspace
2. Qualitative data is best suited for which of the following research goals?
(a) Testing a hypothesis about a cause-and-effect relationship
(b) Understanding user experience with a new app
(c) Determining the average income of a population
(d) Measuring the effectiveness of a new teaching method
3. Data collected directly from the source for the first time is considered:
(a) Secondary data
(b) Tertiary data
(c) Primary data
(d) Processed data
4. Which of the following is NOT a common method for collecting quantitative data?
(a) Surveys with closed-ended questions
(b) Observations with pre-defined categories
(c) Interviews with ranking scales
(d) Focus groups with open-ended discussions
5. Mixed methods research involves using both:
(a) Quantitative and qualitative data in a single study
(b) Primary and secondary data sources
(c) Interviews and surveys only
(d) Observation and chart reviews exclusively
6. A researcher wants to understand patient experiences with a new medication. Which
method would be most appropriate?
23
(a) Online survey
(b) Structured observation
(c) Semi-structured interview
(d) Chart review of medical records
7. Which of the following is NOT a characteristic of a good survey question?
(a) Leading
(b) Clear and concise
(c) Multiple choice with a "don't know" option
(d) Open ended for in-depth responses
8. A researcher observes children playing in a playground. To ensure objectivity, they
should:
(a) Focus on a single child
(b) Record detailed notes with interpretations
(c) Use a pre-defined observation checklist
(d) Engage in conversation with the children
9. The best method for collecting historical data on economic trends would likely be:
(a) Structured interviews with economists
(b) Content analysis of government reports
(c) A large-scale online survey
(d) Observation of financial institutions
10. Focus groups are most beneficial for:
(a) Collecting a large amount of data quickly
(b) Encouraging in-depth discussions and group dynamics
(c) Obtaining statistically representative data
(d) Administering standardized questionnaires
11. Which of the following is NOT a common type of survey question format?
a) Open-ended
b) Dichotomous
c) Multiple choice (single answer)
d) Multiple choice (multiple answer)
24
e) True/False
12. A survey with a low response rate is more likely to suffer from:
a) Increased generalizability
b) Sampling bias
c) Improved validity
d) Reduced cost
e) Faster data collection
13. Pilot testing a survey is important for:
a) Identifying potential leading questions
b) Checking the clarity of instructions
c) Estimating the time needed to complete
d) All of the above
e) None of the above
14. When developing a survey, it's important to:
a) Use technical jargon to ensure accuracy
b) Keep questions concise and easy to understand
c) Offer incentives for participation regardless of the research topic
d) Limit the number of open-ended questions
e) Both b & d
15. Which of the following best describes the purpose of a survey?
a) To gather in-depth information from a small group
b) To collect data from a large sample population
c) To observe behavior in a natural setting
d) To analyze existing medical records
e) To explore a research topic through open-ended discussion
16. Interviews are well-suited for:
a) Gathering large amounts of quantitative data
b) Obtaining detailed information and exploring experiences
c) Distributing questionnaires to a large sample
25
d) Observing behavior in a natural setting
e) Analyzing medical records
17. Which of the following is NOT a best practice for conducting interviews?
a) Actively listening and allowing the participant to elaborate
b) Using leading questions that suggest a desired answer
c) Maintaining a neutral and objective stance
d) Tailoring questions based on the participant's responses
e) Recording the interview with informed consent
18. One advantage of structured interviews is:
a) Increased flexibility in questioning
b) More standardized and comparable data
c) Deeper exploration of participant experiences
d) Reduced need for training in interviewing techniques
e) Improved anonymity for participants
19. Semi-structured interviews are beneficial because they allow for:
a) A rigid question order and standardized format
b) Following a predetermined list of questions
c) Probing deeper based on participant responses
d) Minimal interaction with the participant
e) Distributing the interview via email
20. When conducting interviews, it's important to:
a) Offer incentives for participation without prior disclosure
b) Maintain confidentiality of the participant's identity
c) Pressure participants to finish within a specific timeframe
d) Focus on your own research agenda and disregard participant responses
e) End the interview abruptly if the participant provides unexpected information
21. Participant observation, where the researcher becomes part of the group, is most
appropriate for:
a) Large-scale surveys
b) Analyzing medical charts
26
c) Understanding a culture from within
d) Collecting quantitative data on behavior
e) Distributing questionnaires electronically
22. Non-participant observation allows the researcher to:
a) Directly influence the behavior being observed
b) Maintain a more objective stance
c) Gather detailed information about participants' thoughts
d) Reduce the potential for observer bias
e) Both b & d
23. When conducting observations, it's important to:
a) Clearly define what behaviors will be observed
b) Maintain a neutral and unobtrusive presence
c) Take detailed notes throughout the observation period
d) All of the above
e) None of the above
24. A major limitation of observational research is:
a) Wide applicability across different research questions
b) The potential for observer bias
c) The ability to collect large amounts of data quickly
d) The ease of data analysis
e) The ability to generalize findings to a larger population
25. Which of the following is an advantage of using chart reviews for data collection?
a) It provides real-world data on patient experiences.
b) It allows for in-depth exploration of individual cases.
c) It is a cost-effective way to gather large amounts of data.
d) It is well-suited for collecting subjective information.
26. A potential limitation of using chart reviews for research is:
a) Easy access to electronic medical records.
b)Incompleteness or inaccuracies in the recorded data.
27
c) Ability to gather data on a wide range of variables.
d) Reduced burden on participants compared to surveys.
27. Before conducting a chart review study, researchers should:
a) Obtain informed consent from each patient. (Not applicable for retrospective studies)
b) Ensure they have proper access authorization to the medical records.
c) Develop a standardized data extraction form.
d) All of the above.
28. Which of the following is NOT a common type of data collected through chart reviews?
a) Demographic information (age, gender)
b) Medical history and diagnoses
c) Laboratory test results
29. When analyzing data from chart reviews, researchers should be aware of:
a) The potential for selection bias in the sample.
b) The generalizability of findings to other populations.
c) The influence of the reviewers' own biases.
d) All of the above.
30. The ethical principle of informed consent requires that participants:
a) Are compensated for their involvement in the study.
b) Are not pressured to participate.
c) Understand the risks and benefits of the research.
d) Have their identities revealed in the research report.
31. Which of the following is NOT a way to protect participant confidentiality?
a) Anonymizing data collection and analysis.
b) Using data only for the intended research purposes.
c) Storing data securely with restricted access.
d) Sharing data freely with other researchers without consent.
32. Researchers have a responsibility to:
a) Conduct research that is likely to produce positive results.
b) Minimize potential risks to participants.
28
c) Focus on personal gain from research findings.
d) Ignore ethical guidelines if they hinder progress.
33. When conducting research involving vulnerable populations (e.g., children, elderly),
researchers should take extra precautions to ensure:
a) They are able to participate actively in the research design.
b) Their decision-making capacity is not compromised.
c) They receive the same level of benefits as other participants.
d) The research has direct relevance to their specific needs.
34. A researcher discovers unexpected findings during their study. They should:
a) Ignore them if they don't fit the original hypothesis.
b) Report all findings accurately, regardless of their impact.
c) Focus only on the positive results to maintain funding.
d) Withhold the findings if they could potentially harm the reputation of a particular
group.
Structural Questions
1. Distinguish between quantitative and qualitative data. Explain how each type of data
contributes to research findings.
2. Provide two examples of each:
- Quantitative data (e.g., numerical data, counts)
- Qualitative data (e.g., text responses, observations)
3. Compare and contrast probability sampling and non-probability sampling. When would
you choose one over the other?
4. Describe two data collection methods that are well-suited for gathering information about:
- Public opinion on a new policy (e.g., surveys, focus groups)
- Employee experiences in a workplace (e.g., interviews, observations)
5. What are the different types of survey questions (e.g., open-ended, closed-ended)? Explain
the advantages and disadvantages of each type.
2. Design a brief survey question (closed-ended) to measure participant satisfaction with a
new product. Indicate the type of data (nominal, ordinal, interval, or ratio) the question would
generate.
6.Differentiate between structured interviews, semi-structured interviews, and unstructured
interviews. Explain the level of control the interviewer has in each type.
29
7. Imagine you are interviewing a participant about their childhood memories. What are some
strategies you would use to conduct a successful in-depth interview?
8. Distinguish between participant observation and non-participant observation. Provide an
example of each.
9. What are some potential challenges associated with using observation as a data collection
method? How can researchers minimize these challenges?
10.Compare and contrast using chart reviews with conducting surveys for data collection.
When would one method be preferred over the other?
11.Describe the steps involved in developing a standardized data extraction form for a chart
review study.
12.Explain the concept of informed consent in research. What information should be included
in an informed consent form?
13. Describe two ethical considerations specific to research involving vulnerable populations
(e.g., children, elderly). How would you address these considerations in your research
design?
30