Norm and Criterion-Referenced Tests

Norm and criterion-referenced tests 1
Norm-referenced and criterion-referenced tests as indicators of success in the classroom
Norm-referenced and criterion-referenced tests serve a variety of purposes due to the
array of educational situations that exist in today’s schools. Testing can rank students with each
other or some other sociocultural norm, or testing can be based on some performance criteria that
focus on assessing certain understandings or skill set. Ideally, a combination of both testing
types exists in a way that is valid, reliable, and fair. Thus, given that many classrooms contain
students with different socioeconomic and cultural backgrounds, testing becomes quite a
challenge. Therefore, in order to assure that all students receive the most appropriate feedback, a
variety of testing techniques is needed so that proper decisions and actions can be made that best
suit the learner.
Virtually all students have taken some kind of standardized test by the time they enter
high school or college. Moreover, many standardized tests (i.e., high stakes tests) are used as a
condition of graduation, acceptance, or financial aid. Because these tests are used as a way to
rank or compare students, they are often referred to as norm-referenced tests (NRT) (Kubiszyn
and Borich, 2007). NRTs are commonly used when stakeholders are interested in the central
tendency of the results of a group of students, as when descriptive statistics are used to find the
average, mean, median, and mode of a particular data set. When using tests to diagnose or to
figure the aptitude of a student, inferences are made based on how students compare with each
other or some other sample based on a social norm. Since results are “objective” – test items are
usually in terms of right and wrong answers – and since many tests can be applied at once, NRTs
are typically more appropriate for making decisions that are non-instructional based.
In addition to NRTs being used externally to rank students (e.g., SAT, ACT, etc.),
teachers oftentimes use NRTs to test students in the classroom. Multiple-choice, true-false,
matching, and essay questions are common testing types that fall under this same category. Test
results are gathered, averaged, and ranked in order for teachers to make their best inference as to
what level a student has understood, obtained the necessary skill set, or developed the intended
disposition based on the goals and objectives of the classroom. Subsequently, instructional
decisions are often made based on these results either by reviewing past information that students
continue to struggle with or continuing on with new information that makes up part of the
curriculum. Having framed NRT first as an external instrument, such as an ACT, then as an
internal instrument used by teachers in their classrooms, one can see a noticeable difference in
why they are being used in each circumstance. The former is to make decisions regarding
achievement while the latter is to make decisions regarding instruction. This distinction is
important when talking about a second type of test that is based on criteria.
Instead of ranking students to some certain norm, another testing method aids in basing
students performance in terms of meeting certain criteria. Kubiszyn and Borich (2007) define
criterion-referenced test (CRT) as tests that “tells us about a student’s level of proficiency in or
mastery of some skill or set of skills” (p. 66). Wiggins and McTighe (2005) also put forth the
notion of promoting the six facets of understanding (e.g., explain, interpret, apply, perspective,
empathy, and self-knowledge) when testing students regarding what they know and their
disposition they possess. In other words, CRTs can provide teachers with greater insight on
instructional decision-making adjustments when student performances are assessed in terms of
performance criteria. Rubrics are often used in order to qualitatively assess performances and
products. Arter and McTighe (2001) distinguish between a holistic and analytical trait rubric
when they state “A holistic rubric gives a single score or rating for an entire product or
performance based on an overall impression of a student’s work” and “an analytical trait rubric
divides a product or performance into essential traits or dimensions so that they can be judged
separately-one analyzes a product or performance for essential traits” (p. 18).
Communicating these “essential traits” with students provides the basis for what constitutes a
“good” and “bad” performance or product, and is essential in setting the expectations between
teacher and student. Indeed, CRTs are specifically suited for assessing understandings,
knowledge, skills, and dispositions in terms of subsequent inferences towards instructional
decision-making adjustments and adjustments to student learning tactics.
Regardless of the test being administered, reliability, validity, and “absence-of-bias”
(Popham, 2008, p. 73) drive the level of predictability an instrument has in making proper
inferences on a student’s achievement. Reliability in NRTs is of high concern since many
versions of the ACT, for example, are expected to contain test items that measure the same
content. Similarly, the same ACT should yield similar results (i.e., a high correlation coefficient)
if students retake the exam without being exposed to a learning intervention in the interim. The
validity of a test pertains to the three Cs: “content, criterion, and construct” (Popham, 2008, p.
53). Content validity addresses how test items represent concepts that are covered in the
curriculum. Criterion validity in NRTs deals with how accurate the testing items are in
predicting future behavior (e.g., ACT and SAT scores and subsequent academic success or
failure). Criterion validity in CRTs deals with rubric traits and how valid they are in terms of a
student’s future performance. The final C, construct validity, has to do with how a student’s
performance over time is gauged in terms of meeting criteria that is aligned to the curriculum.
And finally, absence-of-bias centers on how test items present information that is fair; that is,
does not lean towards a certain group of people based on socioeconomic status, race, ethnic
background, gender, or sexual orientation.

NRTs and CRTs should not be considered dichotomous, but are two different approaches
to assessing students in a complementary way. Ranking and comparing students has a purpose
when the goal is to measure achievement and to predict future academic success. Conversely,
testing understandings, knowledge, skills, and disposition through performance and product
criteria serves a vital role in making inferences that influence instructional decisions and student
tactic adjustments. In order for tests to be valid, reliable, and absent of bias, test designers
should conduct a variety of reviews to assure that tests measure curricular aims, are reliable
within the same and different versions of an exam, and do not discriminate minority groups
based on age, race, gender, socioeconomic status, or sexual orientation. Tests are the link
between the written and taught curriculum, the ideal and the reality of what schools are for all its
stakeholders. Thus, in order to continue the development and improve the feedback that tests
provide all of its stakeholders, a collaborative effort is needed in bringing together a community
of practice that addresses these important aspects of testing and assessment.

References
Arter, J. and McTighe, J. (2001). Scoring rubrics in the classroom: Using performance criteria
for assessing and improving student performance. Thousand Oaks: CA: Corwin Press.
Kubiszyn, T. and Borich, G. (2007). Educational testing and measurement: Classroom

application and practice. Hoboken, NJ: Wiley and Jossey-Bass Education.
Popham, W. (2008). Classroom assessment: What teachers need to know. New York: Pearson.
Wiggins, G. and McTighe, J. (2005). Understanding by design. Alexandria, VA: ASCD.

Norm and Criterion-Referenced Tests

Uploaded by

Copyright:

Available Formats

Norm and Criterion-Referenced Tests

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Norm and Criterion-Referenced Tests

Uploaded by

Copyright:

Available Formats

Norm and criterion-referenced tests 1

Norm-referenced and criterion-referenced tests as indicators of success in the classroom

Norm-referenced and criterion-referenced tests serve a variety of purposes due to the

suit the learner.

instructional decision-making adjustments when student performances are assessed in terms of

separately-one analyzes a product or performance for essential traits” (p. 18).

knowledge, skills, and dispositions in terms of subsequent inferences towards instructional

decision-making adjustments and adjustments to student learning tactics.

Regardless of the test being administered, reliability, validity, and “absence-of-bias”

inferences on a student’s achievement. Reliability in NRTs is of high concern since many

background, gender, or sexual orientation.

of practice that addresses these important aspects of testing and assessment.

Kubiszyn, T. and Borich, G. (2007). Educational testing and measurement: Classroom

Wiggins, G. and McTighe, J. (2005). Understanding by design. Alexandria, VA: ASCD.

You might also like

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.