Reliability and Validity
Reliability and Validity
By Tayyeb Ramzan
Reliability and Validity
• Reliability is about the consistency of a measure
• Validity is about the accuracy of a measure
What does it tell you?
• Reliability • Validity
• The extent to which the results • The extent to which the results
can be reproduced when the really measure what they are
research is repeated under the supposed to measure.
same conditions.
How is it assessed?
• Reliability • Validity
• By checking the consistency of • By checking how well the results
results across time, across correspond to established
different observers, and across theories and other measures of
parts of the test itself. the same concept.
How do they relate?
• Reliability • Validity
• A reliable measurement is not • A valid measurement is generally
always valid: the results might reliable: if a test produces
be reproducible, but they’re not accurate results, they should be
necessarily correct. reproducible.
Type of reliability
Type of reliability What does it assess? Example
Test-retest The consistency of a measure across time: do A group of participants complete a
you get the same results when you repeat the questionnaire designed to measure personality
measurement? traits. If they repeat the questionnaire days,
weeks or months apart and give the same
answers, this indicates high test-retest reliability.
Interrater The consistency of a measure across raters or Based on an assessment criteria checklist, five
observers: do you get the same results when examiners submit substantially different results
different people conduct the same for the same student project. This indicates that
measurement? the assessment checklist has low inter-rater
reliability (for example, because the criteria are
too subjective).
Internal consistency The consistency of the measurement itself: do You design a questionnaire to measure self-
you get the same results from different parts of esteem. If you randomly split the results into
a test that are designed to measure the same two halves, there should be a strong
thing? correlation between the two sets of results. If
the two results are very different, this indicates
low internal consistency.
Types of validity To assess the validity of a cause-and-effect
relationship, you also need to consider internal
validity (the design of the experiment)
and external validity (the generalizability of the
results).