TUTORIAL

1. Based on samples of formative and

summative assessment, discuss aspects of
reliability / validity that must be considered in
the assessments.
Prepared by:
- Bhavani Ramasamy
- Dhurga Kanabathu

Summative Assessment

According to Brown (2010), a reliable test

can be described as follows:
Consistent in its conditions across two or more
administrations
Gives clear directions for scoring / evaluation
Has uniform rubrics for scoring / evaluation
Lends itself to consistent application of those
rubrics by the scorer
Contains item / tasks that are unambiguous to
the test-taker

VALIDITY
One of the important characteristic of
good tests is validity, which refers to
whether the test is actually measuring
what it claims to measure. This is
important for us as we do not want to
make claims concerning what a student
can or cannot do based on a test when
the
test
is
actually
measuring
something else.


Facevalidity: Do the assessment items appear to be appropriate?

Contentvalidity: Does the assessment content cover what you

want to assess? Have satisfactory samples of language and
language skills been selected for testing?

Constructvalidity: Are you measuring what you think you're

measuring? Is the test based on the best available theory of
language and language use?

Concurrent (parallel) validity: Can you use the current test score
to estimate scores of other criteria? Does the test correlate with
other existing measures?

Predictive validity: Is it accurate for you to use your existing

students scores to predict future students scores? Does the test
successfully predict future outcomes?

J:\-Exam-English-Year-3-20
12-2.doc

FORMATIVE
ASSESSMENT

J:\formative-assessment.docx

VALIDITY
1 . Face Validity
measures the knowledge of Nouns.
2. Content validity
covers most of the content of the nouns
e.g: singular and plural nouns, countable
and uncountable nouns, collective
nouns, concrete and abstract nouns.

RELIABILITY
1. Student-related Reliability
. Physical/ Psychological Factors
. all types of questions
2. Intra-Rater Reliability
. Only one marker

2. Discuss measures that

teacher can take to ensure high
validity of language assessment
for the primary classroom.

http://ocw.jhsph.edu/courses/hsre/pdfs/hsre_lect7_weiner.pdf

Relationship between
Reliability and Validity

They are closely inter-dependent .

- There can not be validity without
reliability .
- There can be reliability without
validity.

Type of
Validity

Test

Face

Looks like a good one to learner

Content

Accurately reflects the syllabus it is based on

Predictive

Accurately predicts future performance

Concurrent

Gives similar results to already validated tests

or other immediate external criteria (eg.
Teachers subjective assessment)

Construct

Reflects closely a valid theory of foreign

language learning that it takes as its model.

Thank you