Unit 1 Notes
Unit 1 Notes
Unit 1 Notes
• Data collection
• Measurement
• Analysis
The research problem an organization faces will determine the design, not vice-
versa. The design phase of a study determines which tools to use and how they are
used.
Research Design Elements
Impactful research usually creates a minimum bias in data and increases trust in the
accuracy of collected data. A design that produces the slightest margin of error in
experimental research is generally considered the desired outcome. The essential
elements are:
• Neutrality: When you set up your study, you may have to make
assumptions about the data you expect to collect. The results projected in
the research should be free from bias and neutral. Understand opinions
about the final evaluated scores and conclusions from multiple individuals
and consider those who agree with the results.
• Reliability: With regularly conducted research, the researcher expects
similar results every time. You’ll only be able to reach the desired results
if your design is reliable. Your plan should indicate how to form
research questions to ensure the standard of results.
• Validity: There are multiple measuring tools available. However, the only
correct measuring tools are those which help a researcher in gauging
results according to the objective of the research.
The questionnaire developed from this design will then be valid.
• Generalization: The outcome of your design should apply to a population
and not just a restricted sample. A generalized method implies that your
survey can be conducted on any part of a population with similar
accuracy.
The above factors affect how respondents answer the research questions, so they
should balance all the above characteristics in a good design.
• Qualitative research
It determines relationships between collected data and observations based on
mathematical calculations. Statistical methods can prove or disprove theories
related to a naturally existing phenomenon. Researchers rely on qualitative
research methods that conclude “why” a particular theory exists and “what”
respondents have to say about it.
• Quantitative research
It is for cases where statistical conclusions to collect actionable insights are
essential. Numbers provide a better perspective for making critical business
decisions. Quantitative research methods are necessary for the growth of any
organization. Insights drawn from complex numerical data and analysis prove to be
highly effective when making decisions about the business’s future.
You can further break down the types of research design into five categories:
1. Descriptive: In a descriptive composition, a researcher is solely interested in
describing the situation or case under their research study. It is a theory-based
design method created by gathering, analyzing, and presenting collected data. This
allows a researcher to provide insights into the why and how of research.
Descriptive design helps others better understand the need for the research. If the
problem statement is not clear, you can conduct exploratory research.
The independent variables are manipulated to monitor the change it has on the
dependent variable. Social sciences often use it to observe human behavior by
analyzing two groups. Researchers can have participants change their actions and
study how the people around them react to understand social psychology better.
Secondary data analysis involves a researcher using the information that someone
else has gathered for his or her own purposes. Researchers leverage secondary data
analysis in an attempt to answer a new research question, or to examine an alternative
perspective on the original question of a previous study.
Primary data is original data that researchers collect for a specific purpose.
Secondary data, on the other hand, is collected for a different purpose other than the
one for which it is used.
Although the entrepreneur would not be collecting the data his or herself, census
data includes information that could greatly benefit the entrepreneur, such as the
average age, household income and education level in a particular geographical
region.
By digging into this census data to inform the decision of whether or not the
entrepreneur should open the new business, the entrepreneur is performing
secondary data analysis.
There are certain factors that a researcher must consider before deciding to move
forward with secondary data analysis.
Because the researcher did not collect the data that he or she will be working with,
it’s imperative for him or her to become familiar with the data set. This
familiarization process entails:
One of the most noticeable advantages of using secondary data analysis is its cost
effectiveness.
Because someone else has already collected the data, the researcher does not need
to invest any money, time, or effort into the data collection stages of his or her
study.
Also, the data from a secondary data set is typically already cleaned and stored in an
electronic format, so the researcher can spend his or her time rolling up their sleeves
and analyzing the data instead of spending time having to prepare the data for
analysis.
For instance, leveraging the findings from studies that the government has conducted
provides researchers with access to a volume of data that would have simply been
impossible for the researcher to amass themselves.
Longitudinal data at this scale is extremely powerful. The government could have
been collecting data on a single population for long, extended periods of time.
Instead of investing that time, by using the government’s publically available data
to perform secondary data analysis, the researcher has avoided years of intensive
labor.
Without being the one who is actually developing surveys and distributing them to
the appropriate populations, it’s impossible to know the extent to which the
researchers that collected the data went to ensure validity or quality, or if they
experienced issues such as low response rates or respondents misunderstanding what
a question was truly asking.
Simply put, since the researcher conducting the study did not collect the data he or
she will be using, he or she ultimately has no control over what their secondary data
set contains.
Conclusion
Secondary data analysis is a convenient and powerful tool for researchers looking to
ask broad questions at a large scale.
While it has its benefits, such as its cost effectiveness and the breadth and depth of
data that it provides access to, secondary data analysis can also force researchers to
alter their original question, or work with a data set that otherwise is not ideal for
their goals.
The next time you’re looking to perform a large-scale research study, consider
secondary data analysis.
Research is a continuous process that needs improvement as time goes by, and
as such is non-exhaustive. Although, a lot of researchers working on novel
projects, most researchers work on existing theories or formulations and build
on them.
Researchers may decide to work on a problem that has not been studied very
clearly to establish priorities, develop operational definitions and improving
the final research design. This type of research is what is called exploratory
research.
Exploratory research is the process of investigating a problem that has not been
studied or thoroughly investigated in the past . Exploratory type of research is
usually conducted to have a better understanding of the existing problem, but
usually doesn’t lead to a conclusive result.
There are several exploratory research methods available for data gathering
and research. However, exploratory research has been classified into two main
methods, namely the primary and secondary research methods. The process of
conducting research tends to be more difficult when dealing with a problem
that hasn’t been deeply investigated before.
Primary Research Methods
• Observations
In this primary research method, the researcher does not come in close contact
with the subject. Rather, the subject is being watched from afar. Subject
observation can be done in two ways.
The first is that the subject is aware that he/she is being observed while the
second way is that the subject is not aware of it. The latter method is said to
gather fairer data because the subject may behave differently when he/she is
aware that (s)he is being watched.
• Surveys
Surveys are used to collect data from a predefined subject(s). It can be used
collected to study trends, opinions, and behaviour of a group of people.
Online form builders like Formplus have made it easier to conduct surveys
online and reach diverse demography of participants from all over the world.
Although, rarely in use these days, researchers can also conduct offline
surveys.
• Interviews
Focus group is often used by researchers when trying to collect data from a
group of people with similar characteristics. The research can be done using
any of the three methods explained above.
Secondary research method uses existing resources on the subject under study.
Existing sources like newspapers, magazines, articles, papers, etc. are what
researchers conduct for exploratory research.
All the resources used must be cited in publications. Some of the secondary
research methods used in exploratory research include:
• Literature
• Online Sources
With the advent of technology, this research has gained much popularity
among millennials. Online research sources are the cheapest and easiest
method of research.
The setback of this method is the difficulty of combing through the many
online resources to find genuine information. Researchers face the possibility
of ending up with incorrect data because false information may be difficult to
identify.
• Case Study
A case study could be research that solved the queuing problem in a shopping
mall. This research will be studied and modified to suit that of the airport
queuing problem.
A researcher may decide to get more creative by using informal sources like
email newsletter subscription, RSS feeds, google alerts, google trends or even
design a bot that combs through the large repository of data online.
This is a common starting point for all types of research. Here, the researcher
identifies the purpose of the research by answering the “what question”.For
example, when investigating a crime scene, the FBI needs to first identify what
happened. Was it theft, murder or a case of child abuse?
After identifying the problem, the researcher goes ahead to check whether
there have been prior investigations regarding the subject matter. But when the
researcher realizes that there are no previous investigations, he/she arrives at a
hypothesis based on the questions obtained while identifying the problem.
To conduct further research, the researcher needs to first obtain relevant data
that will assist in the research process. Some of the methods of collecting data
include interviews, surveys, online sources, etc.
Once the data has been collected, the researcher will continue the investigation
through descriptive methods. This process uses qualitative data.
Adapted from Agatha Christie’s novel, we see in this movie that the first thing
detective Hercule Poirot did was to identify the problem which is the murder
of Ratchett. After that was the question of how he was killed.
The how consists of the murder weapon, how it was used, the time he was
murdered, etc. The last piece of information the detective needed to nail the
culprit was the why.
By discovering why Ratchett was murdered, the detective can easily arrive at
a hypothesis on who the murderer is. In the search for why the detective used
a primary research approach to collect relevant data that will aid the
investigation.
When an avalanche stops the Orient Express dead in its tracks, the world’s
greatest detective–Hercule Poirot–arrives to interrogate all passengers and
search for clues before the killer can strike again. After a series of interviews,
the detective was able to arrive at a hypothesis on who the killer was.
The results of any criminal investigation will remain a hypothesis until tried
under a court which will either confirm or nullify the hypothesis. The evidence
acquired during the investigation is what will assist the court in making a
decision.
Exploratory Research Example on Product Research
For example, if telegram adds a status feature to its app, the beta research stage
of the app is not exploratory. This is because this feature is something that is
already in existence, and they can easily get enough information from
WhatsApp.
However, if it is a new feature like the Snapchat filters when they just came
out, the research is explanatory. In this case, exploratory research is carried out
using a focus group of beta testers.
Trend Analysis
This kind of research is better carried out when the subject is not aware they
are under observation. An alternative to this approach is using the case study
method.
Although this research may not have been done in this specific community,
something similar may have been done in the past. If that is the case, the
research can be easily carried out by investigating the case study to get relevant
information.
This will make the research process easier and a hypothesis easier to come by.
This is the final stage where you customise your form and start sharing with
respondents.
Feel free to customise your forms as you please. You can also add logic in the
settings before sharing.
• Copy the link or click on the “Preview Form” button to see how your
form looks like.
Conclusion
Research is built on the incredible inquisitive and resourceful minds of
researchers and the urge to solve problems. This stems from the child-like
tendency to frequently ask questions like what, why and how—a trademark of
exploratory research.
This method is not only about “what” people think but also “why” they think so. For
example, consider a convenience store looking to improve its patronage. A
systematic observation concludes that the number of men visiting this store are more.
One good method to determine why women were not visiting the store is to conduct
an in-depth interview of potential customers in the category.
For example, on successfully interviewing female customers, visiting the nearby
stores and malls, and selecting them through random sampling, it was known that
the store doesn’t have enough items for women and so there were fewer women
visiting the store, which was understood only by personally interacting with them
and understanding why they didn’t visit the store, because there were more male
products than female ones.
The results of qualitative methods are more descriptive and the inferences can be
drawn quite easily from the data that is obtained.
Qualitative research methods originated in the social and behavioral sciences. Today
our world is more complicated and it is difficult to understand what people think and
perceive. Online qualitative research methods make it easier to understand that as it
is more communicative and descriptive.
The following are the qualitative research methods that are frequently used. Also,
read about qualitative research examples:
1. One-on-one interview:
One of the advantages of this method provides a great opportunity to gather precise
data about what people believe and what their motivations are. If the researcher is
well experienced asking the right questions can help him/her collect meaningful
data. If they should need more information the researchers should ask such follow
up questions that will help them collect more information.
These interviews can be performed face-to-face or on phone and usually can last
between half an hour to two hours or even more. When the in-depth interview is
conducted face to face it gives a better opportunity to read the body language of the
respondents and match the responses.
2. Focus groups:
A focus group is also one of the commonly used qualitative research methods, used
in data collection. A focus group usually includes a limited number of respondents
(6-10) from within your target market.
The main aim of the focus group is to find answers to the “why” “what” and “how”
questions. One advantage of focus groups is, you don’t necessarily need to interact
with the group in person. Nowadays focus groups can be sent an online survey on
various devices and responses can be collected at the click of a button.
Focus groups are an expensive method as compared to the other online qualitative
research methods. Typically they are used to explain complex processes. This
method is very useful when it comes to market research on new products and testing
new concepts.
3. Ethnographic research:
Ethnographic research is the most in-depth observational method that studies people
in their naturally occurring environment.
This method requires the researchers to adapt to the target audiences’ environments
which could be anywhere from an organization to a city or any remote location. Here
geographical constraints can be an issue while collecting data.
This research design aims to understand the cultures, challenges, motivations, and
settings that occur. Instead of relying on interviews and discussions, you experience
the natural settings first hand.
This type of research method can last from a few days to a few years, as it involves
in-depth observation and collecting data on those grounds. It’s a challenging and a
time-consuming method and solely depends on the expertise of the researcher to be
able to analyze, observe and infer the data.
The case study method has evolved over the past few years and developed into a
valuable qualitative research method. As the name suggests it is used for explaining
an organization or an entity.
This type of research method is used within a number of areas like education, social
sciences and similar. This method may look difficult to operate, however, it is one
of the simplest ways of conducting research as it involves a deep dive and thorough
understanding of the data collection methods and inferring the data.
5. Record keeping:
This method makes use of the already existing reliable documents and similar
sources of information as the data source. This data can be used in new research.
This is similar to going to a library. There one can go over books and other reference
material to collect relevant data that can likely be used in the research.
6. Process of observation:
Qualitative observation deals with the 5 major sensory organs and their functioning
– sight, smell, touch, taste, and hearing. This doesn’t involve measurements or
numbers but instead characteristics.
Qualitative data collection allows collecting data that is non-numeric and helps us to
explore how decisions are made and provide us with detailed insight. For reaching
such conclusions the data that is collected should be holistic, rich, and nuanced and
findings to emerge through careful analysis.
Qualitative data analysis such as notes, videos, audio recordings images, and text
documents. One of the most used methods for qualitative data analysis is text
analysis.
Text analysis is a data analysis method that is distinctly different from all other
qualitative research methods, where researchers analyze the social life of the
participants in the research study and decode the words, actions, etc.
There are images also that are used in this research study and the researchers analyze
the context in which the images are used and draw inferences from them. In the last
decade, text analysis through what is shared on social media platforms has gained
supreme popularity.
At the end of the interview, it was realized that most of the books in the stores were
suitable for adults and there were not enough options for children or teenagers.
By conducting this qualitative research the bookstore owner realized what the
shortcomings were and what were the feelings of the readers. Through this research
now the bookstore owner can now keep books for different age categories and can
improve his sales and customer outreach.
Such qualitative research method examples can serve as the basis to indulge in
further quantitative research, which provides remedies.
• Theiranalytical objectives
• Types of questions asked
• Types of data collection instruments
• Forms of data they produce
• Degree of flexibility
Types of
questions Open-ended questions Closed-ended questions
asked
Form of data
Descriptive data Numerical data
produced
There are many valuable reasons to utilize an observational study design. But, just as
in research experimental design, different methods can be used when you’re considering this
type of study. In this article, we’ll look at the advantages and disadvantages of an observational
study design, as well as the 3 types of observational studies.
This differs from an experimental study, where the scientists are manipulating who is
exposed to the treatment, intervention, etc., by having a control group, or those who are not
exposed, and an experimental group, or those who are exposed to the intervention, treatment,
etc. In the best studies, the groups are randomized, or chosen by chance.
Any evidence derived from systematic reviews is considered the best in the hierarchy
of evidence, which considers which studies are deemed the most reliable. Next would be any
evidence that comes from randomized controlled trials. Cohort studies and case studies follow,
in that order.
Cohort studies and case studies are considered observational in design, whereas the randomized
controlled trial would be an experimental study.
Cohort, cross sectional, and case-control studies are often referred to as observational studies
because the investigator simply observes. No interventions are carried out by the investigator.
With the recent emphasis on evidence based medicine and the formation of the Cochrane
Database of randomised controlled trials, such studies have been somewhat glibly maligned.
However, they remain important because many questions can be efficiently answered by these
methods and sometimes they are the only methods available.
Table 1
While an appropriate choice of study design is vital, it is not sufficient. The hallmark of good
research is the rigor with which it is conducted. A checklist of the key points in any study
irrespective of the basic design is given in box 1.
Study purpose
Sample
The sample should accurately reflect the population from which it is drawn.
The sampling method should be described and the sample size should be justified.
The number of patients lost to follow up should be stated and explanations given.
Control group
Reproducibility—can the results be repeated or is there a reason to suspect they may be a “one
off”?
Completeness
Deaths
Distorting influences
Extraneous treatments—other interventions that may have affected some but not all of the
subjects.
Confounding factors—Are there other variables that might influence the results?
Validity
All studies should be internally valid. That is, the conclusions can be logically drawn from the
results produced by an appropriate methodology. For a study to be regarded as valid it must be
shown that it has indeed demonstrated what it says it has. A study that is not internally valid
should not be published because the findings cannot be accepted.
The question of external validity relates to the value of the results of the study to other
populations—that is, the generalisability of the results. For example, a study showing that 80%
of the Swedish population has blond hair, might be used to make a sensible prediction of the
incidence of blond hair in other Scandinavian countries, but would be invalid if applied to most
other populations.
Every published study should contain sufficient information to allow the reader to analyse the
data with reference to these key points.
In this article each of the three important observational research methods will be discussed with
emphasis on their strengths and weaknesses. In so doing it should become apparent why a given
study used a particular research method and which method might best answer a particular
clinical problem.
COHORT STUDIES
These are the best method for determining the incidence and natural history of a condition. The
studies may be prospective or retrospective and sometimes two cohorts are compared.
A group of people is chosen who do not have the outcome of interest (for example, myocardial
infarction). The investigator then measures a variety of variables that might be relevant to the
development of the condition. Over a period of time the people in the sample are observed to
see whether they develop the outcome of interest (that is, myocardial infarction).
In single cohort studies those people who do not develop the outcome of interest are used as
internal controls.
Where two cohorts are used, one group has been exposed to or treated with the agent of interest
and the other has not, thereby acting as an external control.
These use data already collected for other purposes. The methodology is the same but the study
is performed posthoc. The cohort is “followed up” retrospectively. The study period may be
many years but the time to complete the study is only as long as it takes to collate and analyse
the data.
The use of cohorts is often mandatory as a randomised controlled trial may be unethical; for
example, you cannot deliberately expose people to cigarette smoke or asbestos. Thus research
on risk factors relies heavily on cohort studies.
As cohort studies measure potential causes before the outcome has occurred the study can
demonstrate that these “causes” preceded the outcome, thereby avoiding the debate as to which
is cause and which is effect.
A further advantage is that a single study can examine various outcome variables. For example,
cohort studies of smokers can simultaneously look at deaths from lung, cardiovascular, and
cerebrovascular disease. This contrasts with case-control studies as they assess only one
outcome variable (that is, whatever outcome the cases have entered the study with).
Cohorts permit calculation of the effect of each variable on the probability of developing the
outcome of interest (relative risk). However, where a certain outcome is rare then a prospective
cohort study is inefficient. For example, studying 100 A&E attenders with minor injuries for
the outcome of diabetes mellitus will probably produce only one patient with the outcome of
interest. The efficiency of a prospective cohort study increases as the incidence of any
particular outcome increases. Thus a study of patients with a diagnosis of deliberate self harm
in the 12 months after initial presentation would be efficiently studied using a cohort design.
Another problem with prospective cohort studies is the loss of some subjects to follow up.
This can significantly affect the outcome. Taking incidence analysis as an example (incidence
= cases/per period of time), it can be seen that the loss of a few cases will seriously affect the
numerator and hence the calculated incidence. The rarer the condition the more significant this
effect.
Retrospective studies are much cheaper as the data have already been collected. One
advantage of such a study design is the lack of bias because the outcome of current interest was
not the original reason for the data to be collected. However, because the cohort was originally
constructed for another purpose it is unlikely that all the relevant information will have been
rigorously collected.
Retrospective cohorts also suffer the disadvantage that people with the outcome of interest are
more likely to remember certain antecedents, or exaggerate or minimise what they now
consider to be risk factors (recall bias).
Where two cohorts are compared one will have been exposed to the agent of interest and one
will not. The major disadvantage is the inability to control for all other factors that might differ
between the two groups. These factors are known as confounding variables.
A confounding variable is independently associated with both the variable of interest and the
outcome of interest. For example, lung cancer (outcome) is less common in people with asthma
(variable). However, it is unlikely that asthma in itself confers any protection against lung
cancer. It is more probable that the incidence of lung cancer is lower in people with asthma
because fewer asthmatics smoke cigarettes (confounding variable). There are a virtually
infinite number of potential confounding variables that, however unlikely, could just explain
the result. In the past this has been used to suggest that there is a genetic influence that makes
people want to smoke and also predisposes them to cancer.
The only way to eliminate all possibility of a confounding variable is via a prospective
randomised controlled study. In this type of study each type of exposure is assigned by chance
and so confounding variables should be present in equal numbers in both groups.
Finally, problems can arise as a result of bias. Bias can occur in any research and reflects the
potential that the sample studied is not representative of the population it was drawn from
and/or the population at large. A classic example is using employed people, as employment is
itself associated with generally better health than unemployed people. Similarly people who
respond to questionnaires tend to be fitter and more motivated than those who do not. People
attending A&E departments should not be presumed to be representative of the population at
large.
If the data are readily available then a retrospective design is the quickest method. If high
quality, reliable data are not available a prospective study will be required.
The first step is the definition of the sample group. Each subject must have the potential to
develop the outcome of interest (that is, circumcised men should not be included in a cohort
designed to study paraphimosis). Furthermore, the sample population must be representative
of the general population if the study is primarily looking at the incidence and natural history
of the condition (descriptive).
If however the aim is to analyse the relation between predictor variables and outcomes
(analytical) then the sample should contain as many patients likely to develop the outcome as
possible, otherwise much time and expense will be spent collecting information of little value.
Key points
Cohort studies
Each variable studied must be accurately measured. Variables that are relatively fixed, for
example, height need only be recorded once. Where change is more probable, for example,
drug misuse or weight, repeated measurements will be required.
To minimise the potential for missing a confounding variable all probable relevant variables
should be measured. If this is not done the study conclusions can be readily criticised. All
patients entered into the study should also be followed up for the duration of the study. Losses
can significantly affect the validity of the results. To minimise this as much information about
the patient (name, address, telephone, GP, etc) needs to be recorded as soon as the patient is
entered into the study. Regular contact should be made; it is hardly surprising if the subjects
have moved or lost interest and become lost to follow up if they are only contacted at 10 year
intervals!
Beware, follow up is usually easier in people who have been exposed to the agent of interest
and this may lead to bias.
Examples
There are many famous examples of Cohort studies including the Framingham heart study,2 the
UK study of doctors who smoke3 and Professor Neville Butler‘s studies on British children
born in 1958.4 A recent example of a prospective cohort study by Davey Smith et al was
published in the BMJ5 and a retrospective cohort design was used to assess the use of A&E
departments by people with diabetes.6
These are primarily used to determine prevalence. Prevalence equals the number of cases in a
population at a given point in time. All the measurements on each person are made at one point
in time. Prevalence is vitally important to the clinician because it influences considerably the
likelihood of any particular diagnosis and the predictive value of any investigation. For
example, knowing that ascending cholangitis in children is very rare enables the clinician to
look for other causes of abdominal pain in this patient population.
At one point in time the subjects are assessed to determine whether they were exposed to the
relevant agent and whether they have the outcome of interest. Some of the subjects will not
have been exposed nor have the outcome of interest. This clearly distinguishes this type of
study from the other observational studies (cohort and case controlled) where reference to
either exposure and/or outcome is made.
The advantage of such studies is that subjects are neither deliberately exposed, treated, or not
treated and hence there are seldom ethical difficulties. Only one group is used, data are
collected only once and multiple outcomes can be studied; thus this type of study is relatively
cheap.
Many cross sectional studies are done using questionnaires. Alternatively each of the subjects
may be interviewed. Table 2 lists the advantages and disadvantages of each.
Any study with a low response rate can be criticised because it can miss significant differences
in the responders and non-responders. At its most extreme all the non-responders could be
dead! Strenuous efforts must be made to maximise the numbers who do respond. The use of
volunteers is also problematic because they too are unlikely to be representative of the general
population. A good way to produce a valid sample would be to randomly select people from
the electoral role and invite them to complete a questionnaire. In this way the response rate is
known and non-responders can be identified. However, the electoral role itself is not an entirely
accurate reflection of the general population. A census is another example of a cross sectional
study.
Market research organisations often use cross sectional studies (for example, opinion polls).
This entails a system of quotas to ensure the sample is representative of the age, sex, and social
class structure of the population being studied. However, to be commercially viable they are
convenience samples—only people available can be questioned. This technique is
insufficiently rigorous to be used for medical research.
Formulate the research question(s) and choose the sample population. Then decide what
variables of the study population are relevant to the research question. A method for contacting
sample subjects must be devised and then implemented. In this way the data are collected and
can then be analysed
The most important advantage of cross sectional studies is that in general they are quick and
cheap. As there is no follow up, less resources are required to run the study.
Cross sectional studies are the best way to determine prevalence and are useful at identifying
associations that can then be more rigorously studied using a cohort study or randomised
controlled study.
The most important problem with this type of study is differentiating cause and effect from
simple association. For example, a study finding an association between low CD4 counts and
HIV infection does not demonstrate whether HIV infection lowers CD4 levels or low CD4
levels predispose to HIV infection. Moreover, male homosexuality is associated with both but
causes neither. (Another example of a confounding variable).
Often there are a number of plausible explanations. For example, if a study shows a negative
relation between height and age it could be concluded that people lose height as they get older,
younger generations are getting taller, or that tall people have a reduced life expectancy when
compared with short people. Cross sectional studies do not provide an explanation for their
findings.
Rare conditions cannot efficiently be studied using cross sectional studies because even in large
samples there may be no one with the disease. In this situation it is better to study a cross
sectional sample of patients who already have the disease (a case series). In this way it was
found in 1983 that of 1000 patients with AIDS, 727 were homosexual or bisexual men and 236
were intrvenous drug abusers.6 The conclusion that individuals in these two groups had a higher
relative risk was inescapable. The natural history of HIV infection was then studied using
cohort studies and efficacy of treatments via case controlled studies and randomised clinical
trials.
Examples
An example of a cross sectional study was the prevalence study of skull fractures in children
admitted to hospital in Edinburgh from 1983 to 1989.7 Note that although the study period was
seven years it was not a longitudinal or cohort study because information about each subject
was recorded at a single point in time.
A questionnaire based cross sectional study explored the relation between A&E attendance and
alcohol consumption in elderly persons.9
A recent example can be found in the BMJ, in which the prevalence of serious eye disease in a
London population was evaluated.10
Key points
In contrast with cohort and cross sectional studies, case-control studies are usually
retrospective. People with the outcome of interest are matched with a control group who do
not. Retrospectively the researcher determines which individuals were exposed to the agent or
treatment or the prevalence of a variable in each of the study groups. Where the outcome is
rare, case-control studies may be the only feasible approach.
As some of the subjects have been deliberately chosen because they have the disease in
question case-control studies are much more cost efficient than cohort and cross sectional
studies—that is, a higher percentage of cases per study.
Decide on the research question to be answered. Formulate an hypothesis and then decide what
will be measured and how. Specify the characteristics of the study group and decide how to
construct a valid control group. Then compare the “exposure” of the two groups to each
variable.
When conditions are uncommon, case-control studies generate a lot of information from
relatively few subjects. When there is a long latent period between an exposure and the disease,
case-control studies are the only feasible option. Consider the practicalities of a cohort study
or cross sectional study in the assessment of new variant CJD and possible aetiologies. With
less than 300 confirmed cases a cross sectional study would need about 200 000 subjects to
include one symptomatic patient. Given a postulated latency of 10 to 30 years a cohort study
would require both a vast sample size and take a generation to complete.
In case-control studies comparatively few subjects are required so more resources are available
for studying each. In consequence a huge number of variables can be considered. This type of
study is therefore useful for generating hypotheses that can then be tested using other types of
study.
This flexibility of the variables studied comes at the expense of the restricted outcomes studied.
The only outcome is the presence or absence of the disease or whatever criteria was chosen to
select the cases.
The major problems with case-control studies are the familiar ones of confounding variables
(see above) and bias. Bias may take two major forms.
Sampling bias
The patients with the disease may be a biased sample (for example, patients referred to a
teaching hospital) or the controls may be biased (for example, volunteers, different ages, sex
or socioeconomic group).
As the study assesses predictor variables retrospectively there is great potential for a biased
assessment of their presence and significance by the patient or the investigator, or both.
Ideally the cases studied should be a random sample of all the patients with the disease. This
is not only very difficult but in many instances is impossible because many cases may not have
been diagnosed or have been misdiagnosed. For example, many cases of non-insulin dependent
diabetes will not have sought medical attention and therefore be undiagnosed. Conversely
many psychiatric diseases may be differently labelled in different countries and even by
different doctors in the same country. As a result they will be misdiagnosed for the purposes
of the study. However, in reality you are often left studying a sample of those patients who it
is possible to recruit. Selecting the controls is often a more difficult problem.
To enable the controls to represent the same population as the cases, one of four techniques
may be used.
1. A convenience sample—sampled in the same way as the cases, for example, attending
the same outpatient department. While this is certainly convenient it may reduce the
external validity of the study.
2. Matching—the controls may be a matched or unmatched random sample from the
unaffected population. Again the problems of controlling for unknown influences is
present but if the controls are too closely matched they may not be representative of the
general population. “Over matching” may cause the true difference to be
underestimated.
The advantage of matching is that it allows a smaller sample size for any given effect to be
statistically significant.
3. Using two or more control groups. If the study demonstrates a significant difference
between the patients with the outcome of interest and those without, even when the
latter have been sampled in a number of different ways (for example, outpatients, in
patients, GP patients) then the conclusion is more robust.
4. Using a population based sample for both cases and controls. It is possible to take a
random sample of all the patients with a particular disease from specific registers. The
control group can then be constructed by selecting age and sex matched people
randomly selected from the same population as the area covered by the disease register.
Overcoming retrospective recall bias can be achieved by using data recorded, for other
purposes, before the outcome had occurred and therefore before the study had started. The
success of this strategy is limited by the availability and reliability of the data collected.
Another technique is blinding where neither the subject nor the observer know if they are a
case or control subject. Nor are they aware of the study hypothesis. In practice this is often
difficult or impossible and only partial blinding is practicable. It is usually possible to blind the
subjects and observers to the study hypothesis by asking spurious questions. Observers can
also be easily blinded to the case or control status of the patient where the relevant observation
is not of the patient themselves but a laboratory test or radiograph.
Key points
Case-control studies
Blinding cases to their case or control status is usually impracticable as they already know that
they have a disease or illness. Similarly observers can hardly be blinded to the presence of
physical signs, for example, cyanosis or dyspnoea.
As a result of the problems of matching, bias and confounding, case-control studies, are often
flawed. They are however useful for generating hypotheses. These hypotheses can then be
tested more rigorously by other methods—randomised controlled trials or cohort studies.
Examples
Case-control studies are very common. They are particularly useful for studying infrequent
events, for example, cot death, survival from out of hospital cardiac arrest, and toxicological
emergencies.
A recent example was the study of atrial fibrillation in middle aged men during exercise.11
https://doi.org/10.1136/bmj.316.7147.1784
Research methods are procedures that span the steps from nonspecific assumptions to detailed
approaches of data collection, analysis, and interpretation. These are essentially well-planned,
value-neutral and scientific.
Generally, the research method includes experimental study, focus groups, survey method,
numerical schemes, theoretical procedures, etc. However, each study domain demands a
specific type of research method.
For instance, for research that requires investigation of characteristics, opinions or behaviours
of a group of people, survey method can be used.
Whereas, research that demands explanation based on observations, collected facts, and
measurements, the experiment research method is used.
There are various attributes that are formative of and unique to experimental research in
addition to its main purpose. Understanding these is key to understanding this kind of research
in-depth and what to expect when performing it.
Experimental research encompasses three subtypes that researchers can implement. They all
fall under experimental research, differing in how the subjects are classified. They can be
classified based on their conditions or groups.
This entails a group or several groups to be observed after factors of cause and effect are
implemented.
1. Researchers implement this research design when they need to learn whether further
investigation is required for these particular groups.
2. Pre-experimental research has its own three subtypes:
1. One-shot Case Study Research Design
2. One-group Pretest-posttest Research Design
3. Static-group Comparison
Quasi-experimental Research Design
Representing half or pseudo, the moniker “quasi” is used to allude to resembling true
experimental research, but not entirely.
1. The participants are not randomly assigned, rather they are used when randomization
is impossible or impractical.
2. Quasi-experimental research is typically used in the education field.
3. Examples include: the time series, no equivalent control group design, and the
counterbalanced design.
This kind of experimental research design studies statistical analysis to confirm or debunk a
hypothesis.
variables, determination of cause & effect of a study hypothesis, and can be used in
collaboration with other research designs.
▪ Survey method
Derived from Latin word ‘supervidere’ (meaning – to see), survey method, best suited
for descriptive research, studies the opinion, behaviours, attributes and feelings of an
individual or a group of people. This process collection of numbered data and statistically
analysing responses to the questions in order to test the hypothesis about the nature of
relationships within a group.
For instance, if you are intended to study the happiness levels among employees’ working in
a specific organisation. Here the data will be collected through questionnaires, phone calls,
Emails, etc. Upon collecting the data regarding the individuals’ perceived emotional states,
statistical tests such as getting the weighted mean can be utilised to assess the responses.
Based on the design, survey research method can be divided into three types of studies: cross-
sectional, longitudinal and correlational study.
Survey method offers several benefits of which include – primary data collected is easy to
analyse, data can be collected at a faster rate and easily, offers precise information, and is
flexible.
Data gathering is a flexible and exciting process; especially when you use surveys. There are
different survey methods that allow you to collect relevant information from research
participants or the people who have access to the required data.
For instance, you can conduct an interview or simply observe the research participants as they
interact in their environment. Typically, your research context, the type of systematic
investigation, and many other factors should determine the survey method you adopt.
In this article, we will discuss different types of survey methods and also show you how
to conduct online surveys using Formplus.
A survey method is a process, tool, or technique that you can use to gather information in
research by asking questions to a predefined group of people. Typically, it facilitates the
exchange of information between the research participants and the person or organization
carrying out the research.
Survey methods can be qualitative or quantitative depending on the type of research and the
type of data you want to gather in the end. For instance, you can choose to create and administer
an online survey with Formplus that allows you to collect statistical information from
respondents. For qualitative research, you can conduct a face-to-face interview or organize a
focus group.
Interviews
An interview is a survey research method where the researcher facilitates some sort of
conversation with the research participant to gather useful information about the research
subject. This conversation can happen physically as a face-to-face interview or virtually as a
telephone interview or via video and audio-conferencing platforms.
During an interview, the researcher has the opportunity to connect personally with the research
subject and establish some sort of relationship. This connection allows the interviewer
(researcher) to gain more insight into the information provided by the research participant in
the course of the conversation.
An interview can be structured, semi-structured, or unstructured. In a structured interview, the
researcher strictly adheres to a sequence of premeditated questions throughout the
conversation. This is also known as a standardized interview or a researcher-administered
interview and it often results in quantitative research findings.
In a semi-structured interview, the researcher has a set of premeditated interview questions but
he or she can veer off the existing interview sequence to get more answers and gain more clarity
from the interviewee. The semi-structured interview method is flexible and allows the
researcher to work outside the scope of the sequence while maintaining the basic interview
framework.
Just as the name suggests, an unstructured interview is one that doesn’t restrict the researcher
to a set of premeditated questions or the interview sequence. Here, the researcher is allowed to
leverage his or her knowledge and to creatively weave questions to help him or her to get useful
information from the participant. This is why it is also called an in-depth interview.
Advantages of Interviews
Disadvantages of Interviews
Surveys
A survey is a data collection tool that lists a set of structured questions to which respondents
provide answers based on their knowledge and experiences. It is a standard data gathering
process that allows you to access information from a predefined group of respondents during
research.
In a survey, you would find different types of questions based on the research context and the
type of information you want to have access to. Many surveys combine open-ended and closed-
ended questions including rating scales and semantic scales. This means you can use them for
qualitative and quantitative research.
Surveys come in 2 major formats; paper forms or online forms. A paper survey is a more
traditional method of data collection and it can easily result in loss of data. Paper forms are
also cumbersome to organize and process.
Online surveys, on the other hand, are usually created via data collection platforms like
Formplus. These platforms have form builders where you can create your survey from scratch
using different form fields and features. On Formplus, you can also find different online survey
templates for data collection.
One of the many advantages of online surveys is accuracy as it typically records a lower margin
of error than paper surveys. Also, online surveys are easier to administer as you can share them
with respondents via email or social media channels.
Advantages of Surveys
1. Surveys allow you to gather data from a large sample size or research population. This
helps to improve the validity and accuracy of your research findings.
2. The cost of creating and administering a survey is usually lower compared to other
research methods.
3. It is a convenient method of data collection for the researcher and the respondents.
Disadvantages of Surveys
1. The validity of the research data can be affected by survey response bias.
2. High survey dropout rates can also affect the number of responses received in your
survey.
Observation
Just as the name suggests, observation is a method of gathering data by paying attention to the
actions and behaviors of the research subjects as they interact in their environment. This
qualitative research method allows you to get first-hand information about the research subjects
in line with the aims and objectives of your systematic investigation.
If you have tried out this survey method, then you must have come across one or more of the
4 types of observation in research. These are; Complete observer method, observer as
participant method, participant as observer method, and complete participant method.
In the complete observer method, the researcher is entirely detached or absorbed from the
research environment. This means that the participants are completely unaware of the
researcher’s presence and this allows them to act naturally as they interact with their
environment. You can think of it as a remote observation.
The observer as participant method requires the researcher to be involved in the research
environment; albeit with limited interaction with the participants. The participants typically
know the researcher and may also be familiar with the goals and objectives of the systematic
investigation.
A good example of this is when a researcher visits a school to understand how students interact
with each other during extra-curricular activities. In this case, the students may be fully aware
of the research process; although they may not interact with the researcher.
In the participant as observer method, the researcher has some kind of relationship with the
participants and interacts with them often as he or she carries out the investigation. For instance,
when an anthropologist goes to a host community for research, s/he builds a relationship with
members of the community while the host community is aware of the research.
In the complete participant method, the researcher interacts with the research participants
and is also an active member of the research environment. However, the research participants
remain unaware of the research process; they do not know that a researcher is among them and
they also do not know that they are being observed.
1. It is one of the simplest methods of data collection as it does not require specialization
or expertise in many cases.
2. The observation method helps you to formulate a valid research hypothesis for your
systematic investigation. You can test this hypothesis via experimental research to get
valid findings.
1. When the participants know they are being observed, they may act differently and this
can affect the accuracy of the information you gather.
2. Because observation is done in the participant’s natural environment; that is an
environment without control, the findings from this process are not very reliable.
Focus Groups
In a focus group, the researcher can act as the moderator who sets the tone of the conversation
and guides the discourse. The moderator ensures that the overall conversations are in line with
the aims and objectives of the research and he or she also reduces the bias in the discussions.
If you are conducting qualitative research with a large and diverse research population, then
adopting focus groups is an effective and cost-efficient method of data collection. Typically,
your focus group should have 6-10 participants, usually 8; including the moderator.
Based on the focus of your research, you can adopt one or more types of focus groups for your
investigation. Common types of focus groups you should consider include:
1. Participants may not communicate their true thoughts and experiences and this affects
the validity of the entire process.
2. Participants can be easily influenced by the opinions of other people in the group.
As we’ve mentioned earlier, an online survey allows you to gather data from a large pool of
respondents easily and conveniently. Unlike paper forms, online surveys are secure and it is
also easy to distribute them and collate responses for valid research data.
Formplus allows you to create your online survey in a few easy steps. It also has several features
that make data collection and organization easy for you. Let’s show you how to conduct online
surveys with Formplus.
• Create your Formplus account here. If you already have a Formplus account, you can
log in at www.formpl.us.
• On your Formplus dashboard, you will find several buttons and options. Click on the
“create new form” button located at the top left corner of the dashboard to begin.
• Now, you should have access to the form builder. The Formplus builder allows you to
add different form fields to your survey by simply dragging and dropping them from
the builder’s fields section into your form. You will find the fields section at the left
corner of the form builder.First, add the title of your form by clicking on the title tab
just at the top of the builder.
• Next, click on the different fields you’d like to have in your survey. You can add rating
fields, number fields, and more than 30 other form fields as you like.
• After adding the fields to your survey, it is time to populate them with questions and
answer-options as needed. Click on the small pencil icon located beside each field to
access their unique editing tab.
• Apart from adding questions and answer-options to the fields, you can also make
preferred fields to be compulsory or make them read-only.
• Save all the changes you have made to the form by clicking on the save icon at the top
right corner. This gives you immediate access to the builder’s customization section.
• Formplus has numerous customization options that you can use to change the outlook
and layout of your online survey without any knowledge of CSS. You can change your
form font, add your organization’s logo, and also add preferred background images
among other things.
• To start collecting responses in your online survey, you can use any of the Formplus
multiple form sharing options. Go to the builder’s “share” section, choose your
preferred option, and follow the prompt provided. If you have a WordPress website,
you can add the survey to it via the WordPress plugin.
• Don’t forget to track your form responses and other important data in our form analytics
dashboard.
1. Online surveys are a faster method of data collection: They help you to save time
by accelerating your data collection process. Typically, respondents would spend ⅓ of
the time used in completing a paper survey for an online survey. This means you will
record almost-immediate responses from participants.
2. Apart from saving time, you also get to save cost. For instance, you do not have to
spend money on printing paper surveys and transporting them to respondents. Also,
many online survey tools have a free subscription plan and also support affordable
premium subscription plans. You can check out Formplus pricing here.
3. Online surveys reduce the margin of error in data collection. This allows you to gather
more accurate information and arrive at objective research findings.
4. It is flexible and allows participants to respond as is convenient. For instance, Formplus
has a save and resume later feature that allows respondents to save an incomplete survey
and finish up when it is more convenient. The order of the questions in an online survey
can also be changed.
5. Online surveys make the data collection process easy and seamless. By leveraging the
internet for distribution, you can gather information from thousands of people in your
target population.
6. Because online surveys are very convenient, they result in increased survey response
rates because participants can complete the survey according to their own pace, chosen
time, and preferences.
Conclusion
When conducting research, many survey methods can help you to gather, analyze and process
data effectively. In this article, we have looked at some of these methods in detail including
interviews, focus groups, and the observation approach.
As we’ve shown you, each of these survey methods has its strengths and weaknesses. This is
why your choice should be informed by the type of research you are conducting and what you
want to get out of it. While some of these methods work best for qualitative research, others
are better suited for quantitative data collection.
Key differences between experiment and survey method
Commonly
employed in Utilised in descriptive
Utilised in experimental research
research
(research type)
Experiment
Conducted in lab or field study Conducted in field research
performed in
Choosing the right research method is vital for any research. Hence make sure you understand
the requirements of your study and choose the research method accordingly.