We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 22
8th
Principles of Language Assessment 01 Practicality Practicality Has to do with → Resources, Time and Materials.
→ People: → Materials: → Time:
● Test ● Space (rooms) ● Development developers ● Equipment time ● Test users (Paper, pen, ● Specific ● Task writers recorders…) activity ● Graders, markers ● Test An effective test is practical This means that it…
- is not excessively expensive,
- stays within appropriate time constraints, - is relatively easy to administer, and - has scoring procedure that is specific and time-efficient. if it… - takes a student five hours to complete it.
- takes a few minutes for a student to take
and several hours for an examiner to evaluate.
- can be scored only by computer and the
test takes place a thousand miles away from the nearest computer. How to ensure the test is practical? Key concepts: ❏ The cost of administering and marking. ❏ The time of administering and marking. ❏ The time available for marking the test. ❏ The number of people for administering and marking. ❏ The ease of interpretations. 02 Authenticity Example An actual driving test which is an authentic assessment is the best way to determine if you are going to be a good driver. Simply passing a written test isn't enough to determine driving ability. When it comes to test English…
Does the language in test represent
real-world language use?
❏ Authenticity involves creating tests
that mirror real-life language use. Authenticity may be present in the following ways: ❏ The language in the test is as natural as possible. ❏ Items are contextualized rather than isolated. ❏ Topics are meaningful for the learner. ❏ Real world or simulate real-world tasks. Reliability It is consistent and dependable
If you gave the same test to the
same person on two different occasions, the test should yield similar results Factors that contribute to the unreliability of a test Students- Temporary illness, fatigue, a “bad day”, anxiety. related reliability may make an "observed” score deviate from one's "true" score. Test Photocopying administrat variations, the amount ion of light, street noise outside reliability Inter-rater reliability: Two Rater or more scorers yield inconsistent scores reliability - Apply the same standards Intra-rater reliability: unclear scoring criteria, fatigue, bias towards “good” or “bad” student -Score half of the test Measurement errors, Test The test is too long-> fatigue Poorly writing test -> reliability ambiguity, more than one answer Which is better to have a test that is valid and reliable or one that is practical? Effects the test has Washback on instruction in terms of how students prepare for the test/ teaching- learning process. Positive Washback Interactiv e Match Prompt feedback what is taught and To use the language But not if they Give what is learned receive a simple suggestio grade Have access ns Goal to On how student Student gain a The teacher to might improve sense of discuss feedback accomplishment and evaluation Negative Washback Discrepancy over the objectives and focus on the test
Teaching to the test
05 Validity Ensures that a language assessment measures what it is intended to measure. A valid test... - Does not measure → irrelevant variables. - Relies on → empirical evidence (performance). - Offers useful information about → a test-taker's ability. - Is supported by → a theoretical rationale or argument. Content The test aligns with the content it intends to validity measure within the language curriculum. Do experts agree that this test measures what it is supposed to measure?
Criterion Does the test results
indicates outcomes that it validity is supposed to indicate? Construct How well a test measures the idea or concept it validity evaluates.
Involves considering all the
Consequent consequences of a test, ial validity including its impact on test- takers and social consequences
Refers to the perception of
Face test-takers regarding the fairness, relevance, and validity usefulness of an assessment in improving learning. Thank you!