Unit 2 RM
Unit 2 RM
Neutrality: When you set up your study, you may have to make
assumptions about the data you expect to collect. The results projected in
the research design should be free from bias and neutral. Understand
opinions about the final evaluated scores and conclusions from multiple
individuals and consider those who agree with the derived results.
Validity: There are multiple measuring tools available. However, the only
correct measuring tools are those which help a researcher in gauging
results according to the objective of the research.
The questionnaire developed from this design will then be valid.
For example: Consider a scenario where a juice bar owner feels that
increasing the variety of juices will enable increase in customers, however
he is not sure and needs more information. The owner intends to carry out
an exploratory research to find out and hence decides to do an exploratory
research to find out if expanding their juices selection will enable him to get
more customers of if there is a better idea.
For example: A company has low sales. It can be easily explored from
available statistics and market literature if the problem is market related or
organization related or if the topic being studied is regarding financial
situation of the country, then research data can be accessed through
government documents or commercial sources.
Projective Techniques
Projective techniques are derived from clinical psychology, and many remain
rooted in this discipline. For example, the Rorschach Ink Blot Test is one of the
most well-known. This involves showing subjects images of ink blots, and
analysing their perceptions of them to determine personalities and mental states.
Many other traditional projective techniques have been tailored for use in market
research.
There are a wide variety of projective techniques available to choose from. Below
is a list of some of the most popular methods:
Word Association
This is a method in which participants are presented with a word and asked to
quickly respond with the first word that comes to mind. This allows insight into
immediate reactions, personal connections, as well as understanding language
used. This technique is used to gain feedback on new brand names, uncovering
product or brand attributes, and building a picture of how a product is positioned.
This technique can be effectively visualised using a word cloud, where the size of
the word represents the number of times it was mentioned.
Sentence/Story Completion
This is a more developed version of word association. Here, participants are
presented with a sentence or story that contains a blank, and asked to fill in the
missing word or words. Similarly, to word association, this is often asked to be
completed quickly, to capture initial thoughts before the response is rationalised.
This encourages creative thinking and can uncover thoughts and attitudes
associated with various situations.
Photo/Picture Sorts
Many people are visual thinkers and may find it difficult to articulate their
opinions. Photo sorts is a technique in which participants are presented with a stack
of photos or images. They are then asked to pick those that they most associate
with a brand or attribute. These could be photos of people, scenes or emotions.
This technique can uncover stereotypes that may exist, as well as underlying brand
associations. More recently emoji’s have been used as a method for participants to
represent their feelings on a series of situations. This has been effective in gaining
insight into emotions that might not have immediately come to mind.
Brand Personalities
This involves asking participants to personify a brand or product, and then describe
various characteristics of the ‘person’ (e.g. what they look like, what personality
traits they possess) and why these were chosen. This is particularly useful in
branding studies, to better understand a brand’s perceived personality, values and
voice. This exercise can identify personality traits that are unique to the brand.
These can then be built on to create a brand personality that is emotionally
engaging and relevant to its users.
Getting to the emotions is all well and good, but so what? B2B buyers surely leave
their emotions at home and make rational decisions, don’t they? WRONG! We
believe that in B2B markets emotions account for a up to 50% of the buying
decision. Therefore, projective techniques can help us tap in to B2B emotions to
help companies have a deeper understanding of their customers and thus more
closely develop communications that resonate. For example:
Customer surveys help you gather data at specific touch points (e.g.,
immediately after a sale, when a potential customer chooses to leave a
website without purchasing, or after a customer support ticket gets
resolved and closed), and acting on the insight you collect will help you
improve the experience for both your current and future customers.
Pick one touchpoint in the customer journey you want to study. Here
are a few examples of things you could study at different stages in a
typical ecommerce customer journey:
Editor’s note: already know what survey to run and which questions to
ask? Skip ahead to the templates below.
Tracking your CSAT over time is very useful, because a sudden drop can
quickly alert you to a pressing issue.
The Net Promoter Score® survey asks how likely someone is, on a scale
of 0-10, to recommend your company/product to a colleague or a
friend. It also allows you to ask ‘why?’ follow up questions, so you can
compare your percentage of detractors (0-6 answers) to your
percentage of promoters (9-10 answers), and have both a numerical
benchmark for improvement and a qualitative list of elements that you
need to fix.
Step 3: decide which types of questions to ask
When you look at our survey templates below, you’ll notice that each
survey uses different types of questions. These questions weren’t
chosen at random—each one serves a specific purpose, and each
question type has its own advantages and disadvantages.
The following are some of the most common types of questions you’ll
find in customer experience surveys.
1. Open-ended questions
The data is a touch more challenging to analyze, but there are lots of
techniques to make analyzing open-ended questions easier.
2. Multiple-choice questions
Example: How easy was your onboarding process? (1: not easy at all - 5:
very easy)
5. Nominal questions
1 - Strongly disagree
2 - Somewhat disagree
3 - Neither agree nor disagree
4 - Somewhat agree
5 - Strongly agree
When you are ready to build your survey, the specific steps you'll take
will depend on the tool(s) you use.
The researcher has a lot of flexibility and can adapt to changes as the
research progresses.
It is usually low cost.
It helps lay the foundation of a research, which can lead to further
research.
It enables the researcher understand at an early stage, if the topic is
worth investing the time and resources and if it is worth pursuing.
It can assist other researchers to find out possible causes for the
problem, which can be further studied in detail to find out, which of
them is the most likely cause for the problem.
Even though it can point you in the right direction towards what is the
answer, it is usually inconclusive.
The main disadvantage of exploratory research is that they provide
qualitative data. Interpretation of such information can be
judgmental and biased.
Most of the times, exploratory research involves a smaller sample,
hence the results cannot be accurately interpreted for a generalized
population.
Many a times, if the data is being collected through secondary
research, then there is a chance of that data being old and is not
updated.
Importance of Exploratory research Design
Descriptive-survey
This way, the researcher can describe the qualifications possessed by the
employed demographics of this community.
Descriptive-normative survey
If the score of the team is one standard deviation above the mean, it is very
satisfactory, if within the mean, satisfactory, and one standard deviation below
the mean is unsatisfactory.
Descriptive-status
A survey will be carried out to gather enough data about the income of the
employees, then their performance will be evaluated and compared to their
income. This will help determine whether a higher income means better
performance and low income means lower performance or vice versa.
Descriptive-analysis
Descriptive classification
Descriptive-comparative
In descriptive-comparative research, the researcher considers 2 variables which
are not manipulated, and establish a formal procedure to conclude that one is
better than the other. For example, an examination body wants to determine the
better method of conducting tests between paper-based and computer-based
tests.
A random sample of potential participants of the test may be asked to use the 2
different methods, and factors like failure rates, time factors, and others will be
evaluated to arrive at the best method.
Correlative Survey
An academic institution may wish 2 compare the performance of its junior high
school students in English language and Mathematics. This may be used to
classify students based on 2 major groups, with one group going ahead to study
while courses, while the other study courses in the Arts & Humanities field.
Scientific Classification
Human Behavior
This may be done by observing how its target reacts to a competitor's product,
then use it to determine their behaviour.
Quantitativeness
Qualitativeness
It can also be carried out using the qualitative research method, to properly
describe the research problem. This is because descriptive research is more
explanatory than exploratory or experimental.
Uncontrolled variables
The results of descriptive research can be further analyzed and used in other
research methods. It can also inform the next line of research, including the
research method that should be used.
This is because it provides basic information about the research problem, which
may give birth to other questions like why a particular thing is the way it is.
It helps to measure the changes in data over some time through statistical
methods. Consider the case of individuals who want to invest in stock markets,
so they evaluate the changes in prices of the available stocks to make a decision
investment decision.
Brokerage companies are however the ones who carry out the descriptive
research process, while individuals can view the data trends and make decisions.
Comparison
Descriptive research is also used to compare how different demographics
respond to certain variables. For example, an organization may study how
people with different income levels react to the launch of a new Apple phone.
This kind of research may take a survey that will help determine which group of
individuals are purchasing the new Apple phone. Do the low-income earners
also purchase the phone, or only the high-income earners do?
Further research using another technique will explain why low-income earners
are purchasing the phone even though they can barely afford it. This will help
inform strategies that will lure other low-income earners and increase company
sales.
When you are not sure about the validity of an existing condition, you can use
descriptive research to ascertain the underlying patterns of the research object.
This is because descriptive research methods make an in-depth analysis of each
variable before making conclusions.
Conducted Overtime
The researcher may decide to influence the result of the research due to
personal opinion or bias towards a particular subject. For example, a
stockbroker who also has a business of his own may try to lure investors
into investing in his own company by manipulating results.
A case-study or sample taken from a large population is not representative
of the whole population.
Limited scope:The scope of descriptive research is limited to the what of
research, with no information on why thereby limiting the scope of the
research.
Observational Method
The observational method allows researchers to collect data based on their view
of the behaviour and characteristics of the respondent, with the respondents
themselves not directly having an input. It is often used in market research,
psychology, and some other social science research to understand human
behaviour.
Survey Research
Survey research can be carried out both online and offline using the following
methods
Formplus has amazing tools and features that will help increase response rates.
Offline Surveys: This includes paper forms, mobile offline forms, and
SMS-based forms.
Researchers in economics, psychology, medicine, epidemiology, and the other social sciences all
make use of cross-sectional studies in their work. For example, epidemiologists who are
interested in the current prevalence of a disease in a certain subset of the population might use a
cross-sectional design to gather and analyze the relevant data.
Both types are useful for answering different kinds of research questions. A cross-
sectional study is a cheap and easy way to gather initial data and
identify correlations that can then be investigated further in a longitudinal study.
Cross-sectional vs longitudinal exampleYou want to study the impact that a low-carb diet has on
diabetes. You first conduct a cross-sectional study with a sample of diabetes patients to see if there are
differences in health outcomes like weight or blood sugar in those who follow a low-carb diet. You
discover that the diet correlates with weight loss in younger patients, but not older ones.
You then decide to design a longitudinal study to further examine this link in younger patients.
Without first conducting the cross-sectional study, you would not have known to focus on
younger patients in particular.
ExampleYou want to know how many families with children in New York City are currently low-income
so you can estimate how much money is required to fund a free lunch program in public schools.
Because all you need to know is the current number of low-income families, a cross-sectional study
should provide you with all the data you require.
Sometimes a cross-sectional study is the best choice for practical reasons – for
instance, if you only have the time or money to collect cross-sectional data, or if the only
data you can find to answer your research question was gathered at a single point in
time.
As cross-sectional studies are cheaper and less time-consuming than many other types
of study, they allow you to easily collect data that can be used as a basis for further
research.
An analytical study tries to answer how or why a certain outcome might occur.
A descriptive study only summarizes said outcome using descriptive statistics.
Descriptive vs analytical exampleYou are studying child obesity. A descriptive study might look at the
prevalence of obesity in children, while an analytical study might examine exercise and food habits in
addition to obesity levels to explain why some children are much more likely to be obese than others.
Prominent examples include the censuses of several countries like the US or France,
which survey a cross-sectional snapshot of the country’s residents on important
measures. International organisations like the World Health Organization or the World
Bank also provide access to cross-sectional datasets on their websites.
However, these datasets are often aggregated to a regional level, which may prevent
the investigation of certain research questions. You will also be restricted to whichever
variables the original researchers decided to study.
If you want to choose the variables in your study and analyze your data on an individual
level, you can collect your own data using research methods such as surveys. It’s
important to carefully design your questions and choose your sample.
Advantages
Because you only collect data at a single point in time, cross-sectional studies are
relatively cheap and less time-consuming than other types of research.
Cross-sectional studies allow you to collect data from a large pool of subjects and
compare differences between groups.
Cross-sectional studies capture a specific moment in time. National censuses, for
instance, provide a snapshot of conditions in that country at that time.
Disadvantages
Longitudinal studies are a type of correlational research in which researchers observe and collect
data on a number of variables without trying to influence those variables.
While they are most commonly used in medicine, economics, and epidemiology, longitudinal
studies can also be found in the other social or medical sciences.
One of the longest longitudinal studies, the Harvard Study of Adult Development, has
been collecting data on the physical and mental health of a group of Boston men for
over 80 years!
These statistics are generally very trustworthy and allow you to investigate changes
over a long period of time. However, they are more restrictive than data you collect
yourself. To preserve the anonymity of the participants, the data collected is often
aggregated so that it can only be analyzed on a regional level. You will also be
restricted to whichever variables the original researchers decided to investigate.
If you choose to go this route, you should carefully examine the source of the dataset as
well as what data is available to you.
In a retrospective study, you collect data on events that have already happened.
In a prospective study, you choose a group of subjects and follow them over time,
collecting data in real time.
Retrospective studies are generally less expensive and take less time than prospective
studies, but are more prone to measurement error.
Retrospective vs prospective exampleIn a retrospective study, you might look at past medical records of
patients to see whether those who developed this cancer had previously smoked. In a prospective study,
you might follow a group of both smokers and non-smokers over time to see if they develop cancer later
on.
Advantages
Longitudinal studies allow researchers to follow their subjects in real time. This means
you can better establish the real sequence of events, allowing you insight into cause-
and-effect relationships.
ExampleA cross-sectional study on the impact of police on crime might find that more police are
associated with greater crime and wrongly conclude that police cause crime when it is the other way
around. However, a longitudinal study would be able to observe the rise or fall in crime some time after
increasing the number of police in an area.
Longitudinal studies also allow repeated observations of the same individual over time.
This means any changes in the outcome variable cannot be attributed to differences
between individuals.
ExampleYou decide to study how a particular weight-training program affects athletic performance. If
you choose a longitudinal study, the impact of natural talent on performance should be eliminated,
since that would not change over the study period.
Prospective longitudinal studies eliminate the risk of recall bias, or the inability to
correctly recall past events.
ExampleYou are studying the effect of low-carb diets on weight loss. If you asked your subjects to
remember how many carbs or how much they weighed at any point in time in the past, they might have
difficulty doing so. In a longitudinal study, you can keep track of these variables in real time.
Disadvantages
Longitudinal studies are time-consuming and often more expensive than other types of
studies, so they require significant commitment and resources to be effective.
Since longitudinal studies repeatedly observe subjects over a period of time, any
potential insights from the study can take a while to be discovered.
ExampleIn the study examining the links between smoking and stomach cancer, you have to wait several
years to see any results since the negative effects of smoking accumulate over decades.
Attrition, which occurs when participants drop out of a study, is common in longitudinal
studies and may result in invalid conclusions.
ExampleIn your study on the impact of low-carb diets on weight loss, participants who are not seeing
much success might feel more discouraged and thus more likely to drop out. The diet might therefore
appear to be more successful than it actually is
EXPERIMENTAL DESIGN
1. Independent Measures:
Independent measures design, also known as between-groups, is an
experimental design where different participants are used in each
condition of the independent variable. This means that each condition of
the experiment includes a different group of participants.
This should be done by random allocation, which ensures that each
participant has an equal chance of being assigned to one group or the
other.
Independent measures involve using two separate groups of participants;
one in each condition. For example:
Con: More people are needed than with the repeated measures
design (i.e., more time consuming).
Pro: Avoids order effects (such as practice or fatigue) as people
participate in one condition only. If a person is involved in several
conditions, they may become bored, tired and fed up by the time
they come to the second condition, or becoming wise to the
requirements of the experiment!
Con: Differences between participants in the groups may affect
results, for example; variations in age, gender or social
background. These differences are known as participant variables
(i.e., a type of extraneous variable).
Control: After the participants have been recruited, they should be
randomly assigned to their groups. This should ensure the groups
are similar, on average (reducing participant variables).
2. Repeated Measures:
Repeated Measures design is an experimental design where the same
participants take part in each condition of the independent variable. This
means that each condition of the experiment includes the same group of
participants.
Repeated Measures design is also known as within groups, or within-
subjects design.
CONCEPT OF CAUSE
The formal cause is the form or pattern or shape that a thing as- sumes. .
The efficient cause is what we commonly refer to today as "cause and
effect," the process by which the substance is given its particular form.
The final cause is the end, aim, or purpose of the formed substance, the.
CAUSAL RELATIONSHIP
A causal relation between two events exists if the occurrence of the
first causes the other. The first event is called the cause and the second
event is called the effect. A correlation between two variables does not
imply causation.
CONCEPT OF INDEPENDENT AND DEPENDENT VARIABLE
You can apply just two levels (e.g. the new medication and the placebo)
in order to find out if the independent variable has an effect at all.
You can also apply multiple levels (e.g. three different doses of the new
medication) to find out how the independent variable affects the
dependent variable.
Example 1
EXTRANEOUS VARIABLE
In an experiment, an extraneous variable is any variable that you’re not
investigating that can potentially affect the outcomes of your research
study.
TREATMENT
In an experiment, the factor (also called an independent variable) is an
explanatory variable manipulated by the experimenter. Each factor has
two or more levels, i.e., different values of the factor. Combinations of
factor levels are called treatments.
CONTROL GROUP
The control group is composed of participants who do not receive the
experimental treatment. When conducting an experiment, these people
are randomly assigned to be in this group. They also closely resemble
the participants who are in the experimental group or the individuals
who receive the treatment.