• Psychology: research methods and statistics

What is the difference between reliability and validity?

Written with AI (How we create content)Target level: Grade 10Last updated: Report an error
Quick answer

The difference between reliability and validity is consistency versus accuracy. A measure is reliable when it gives the same result again under the same conditions, and valid when it measures what it claims to measure. A measure can be reliable without being valid, like a scale that is always two kilograms off, but it cannot be valid without being reliable.

The topic explained

Two different questions about a measure

Every questionnaire, test or observation scheme in psychology is judged by two questions. Reliability asks whether the measure is consistent: would the same person, measured again in the same conditions, get the same result? Validity asks whether it measures what it claims to: does a stress questionnaire measure stress, or only how willing people are to complain? So the difference between reliability and validity is the difference between consistent and accurate.

A target makes the difference visible. If every shot lands in a tight group away from the center, the shooting is reliable but not valid. If the shots land in a tight group on the center, it is both. If they are scattered, it is neither, and then it cannot be valid either, because a measure that jumps about cannot be hitting the right spot on purpose.

Three targets with five shots each: on the first the shots are close together but off the center, reliable but not valid; on the second they are close together on the center, reliable and valid; on the third they are scattered, neither.reliable, not validreliable and validneither
An illustration: the center is what the test should measure, each shot one measurement.

How reliability is checked

There are three common checks. Test-retest reliability: the same people take the test twice, some weeks apart, and the two sets of scores are correlated. Inter-rater reliability: two observers or markers score the same behavior or the same answers on their own, and their scores are compared; it matters for open questions and observations, not for multiple choice. Internal consistency: the items of one test should agree with each other, because they are meant to measure the same thing.

Each check gives a coefficient from 0, no consistency, to 1, perfect consistency. Israel's National Institute for Testing and Evaluation uses the rule of thumb that a high-stakes test should reach at least 0.80. Its 2016 report gives the psychometric entrance exam a median internal consistency of 0.95 for the general score, so the exam is very reliable.

A table of three kinds of reliability and how each is checked: test-retest, test twice and correlate the scores; inter-rater, two raters score and their scores are compared; internal consistency, the items are compared with each other.Kind of reliabilityHow it is checkedtest-retesttest twice, correlateinter-ratertwo raters, compareinternal consistencycompare the items

Kinds of validity

Face validity asks whether the measure looks right to the people taking it. Content validity asks whether it covers the whole topic, usually judged by experts. Construct validity asks whether scores behave as the theory says they should, for example rising with other measures of the same trait. Predictive validity asks whether scores forecast a later outcome. Ecological validity asks whether a finding from a study holds in everyday life.

The psychometric exam again gives real numbers. Its general score correlated 0.43 with first-year university grades, against 0.36 for the bagrut average, and 0.46 for the two combined, in a sample of 100,863 students. These are moderate correlations, the usual size for predicting human behavior, and evidence that the exam adds something beyond the bagrut.

Bar chart of predictive validity for first-year university grades in Israel: bagrut average 0.36, psychometric general score 0.43, the two combined 0.46.0.36bagrut average0.43psychometric0.46combined
Correlation with first-year grades, 100,863 students, 2005/6 to 2009/10 cohorts (NITE, 2016).

Reliable is not the same as valid

The most common mistake is to write that a study is valid because it was repeated and gave the same result. Repetition shows reliability only. A bathroom scale that always shows two kilograms too much is perfectly reliable and never valid. A personality quiz can give each person the same type every time and still not predict anything about them. Reliability is a condition for validity, but it is not enough: a good answer names which kind of each is meant and gives the evidence for it.

Free printable worksheet

Practice: reliability and validity

For 10th grade psychology students. Answer each question from the page, then check your work against the answers.

Free, no sign-up. The answer key prints on the second page. Regenerating a new worksheet on the same topic needs a free account.

Free printable worksheetlessoons.com
Practice: reliability and validityName:
  1. In one sentence each, define reliability and validity.

  2. Describe each target: reliable, valid, both or neither?

    The three targets again, with five shots each, and a question mark under each target in place of its description.???
  3. Write the question each kind of validity asks.

    A table of five kinds of validity, face, content, construct, predictive and ecological, with the question each asks replaced by question marks.Kind of validityThe question it asksface?content?construct?predictive?ecological?
  4. Two teachers mark the same 20 essays and give very different grades. Which kind of reliability is low, and how could it be raised?

  5. Read the chart. Which predicts first-year grades best, and what kind of validity does the chart show?

    The bar chart of predictive validity again: bagrut average 0.36, psychometric general score 0.43, combined 0.46.0.36bagrut average0.43psychometric0.46combined
  6. A bathroom scale always shows 2 kilograms more than your real weight. Is it reliable? Is it valid? Explain.

  7. A website offers a 10-question quiz that claims to measure how good a leader you are. Suggest how you would test its reliability and its validity.

More topics and worksheets at lessoons.com© 2026 Lessons

Common questions

Can a test be valid but not reliable?

Not really. If a test gives different results each time, it cannot be measuring the right thing consistently, so its validity is limited by its reliability. That is why test developers check reliability first.

What is the difference between internal and external validity?

Internal validity asks whether a study really shows that the independent variable caused the change, with no confounding variable. External validity asks whether the result applies to other people, places and times, of which ecological validity is one part.

What is a good reliability coefficient?

For a test used to make important decisions, a common rule is at least 0.80, the rule Israel's National Institute for Testing and Evaluation applies to its exams. Research questionnaires are sometimes accepted a little lower.

Is a laboratory experiment low in validity?

It is often high in internal validity, because conditions are controlled, but may be lower in ecological validity, because the task and setting differ from everyday life. A field experiment trades some control for more realism.

How is reliability calculated?

Usually as a correlation. For test-retest, the two sets of scores are correlated; for inter-rater, the two raters' scores; for internal consistency, a statistic compares all the items. Each gives a value from 0 to 1.

Still have a question? Ask Lessi

Any question about this subject. Lessi answers right here, step by step.

Try asking

Asking needs a free account; your question is kept while you sign up. Answers are written by AI and can contain mistakes. Lessi doesn’t give medical or legal advice.

Learn it with a teacher

Learn this topic live with Lessi

Lessi, the AI teacher, explains it out loud on a board, with short quizzes, at your pace. The first 60 minutes are free.