You are on page 1of 25

VALIDITY AND RELIABILITY

Topic Learning Outcomes


At the end of this lecture, students should be able to;
• describe the concept of validity
• explain different types of validity
• describe the concept of reliability
• explain factors affecting the reliability of a research
instrument
• illustrate methods of determining the reliability of an
instrument
• differentiate validity and reliability in qualitative research

2
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
The concept of validity

Is the research If so, is it providing


investigation these answers using
appropriate methods
providing answers and procedures?
to the research
questions for
which it was
undertaken?
3
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
The concept of validity
• Are we measuring what we think we are measuring?
• Validity is the ability of an instrument to measure
what it is designed to measure.
• Key questions;
– Who decides whether an instrument is measuring what it is
supposed to measure?
– How can it be established that an instrument is measuring what
it supposed to measure?

4
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
Types of validity in quantitative research

Face and
content
validity Concurrent
and
Construct predictive
validity validity
5
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
Face and content validity
• The judgement that an instrument is measuring what it is
supposed to.
– primarily based upon the logical link between questions and
objectives of the study.
• Advantage: easy to apply
• Face validity – establishment of logical link between
questions and objectives of study
• Content validity – assessment if items and questions
covers the full range of the issue being measured.
– Judge which statements or questions represent the issue they
are supposed to measure

8
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
Face and content validity (cont.)
• Problems;
– Judgement is based upon subjective logic
– The extent to which question reflect the objectives of a study
may differ.

9
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
Concurrent and predictive validity

• Predictive validity – judged by how well an instrument


can forecast an outcome.
• Concurrent validity – judged by how well an instrument
compares with a second assessment concurrently done.

10
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
Construct validity
• Construct validity – determined by ascertaining the
contribution of each construct to the total variance
observed in a phenomenon.
• Based upon statistical procedure.
• The greater the variance attributable to the construct, the
higher the validity of the instrument.

11
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
Measures to ensure validity of a research include, but not
limited to the following points:

a) Appropriate time scale for the study has to be selected;


b) Appropriate methodology has to be chosen, taking into
account the characteristics of the study;
c) The most suitable sample method for the study has to be
selected;
d) The respondents must not be pressured in any ways to
select specific choices among the answer sets.
The concept of reliability
• Reliability is if a research tool is consistent and
stable hence predictable and accurate.
• The greater the degree of consistency and stability in a
research instrument, the greater the reliability.
• A scale or test is reliable to the extent that repeat
measurements made by it under constant conditions will
give the same result.
• Reliability is the degree of accuracy or precision in the
measurements made by a research instrument.
– The lower the degree of ‘error’ in an instrument, the higher the
reliability.
13
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
Factors which can affect reliability:

•The length of the assessment – a longer assessment generally


produces more reliable results.
•The suitability of the questions or tasks for the students being
assessed.
•The phrasing and terminology of the questions.
•The consistency in test administration – for example, the length
of time given for the assessment, instructions given to students
before the test.
•The readiness of students for the assessment – for example, a
hot afternoon or straight after physical activity might not be the
best time for students to be assessed.
Significance / Necessity for Reliability

1. To know the truth.


2. Effective Result
3. Statistic at power
4. Relationship of Variables.
How to be sure that a formal assessment tool is reliable

Check in the user manual for evidence of


the reliability coefficient.

These are measured between zero and 1. A coefficient of 0.9 or


more indicates a high degree of reliability.
Reliability vs. Validity

17
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
Factors affecting reliability
The wording of questions

The physical setting

The respondent’s or
interviewer mode

The regression effect

The nature of interaction

18
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
Methods of determining the reliability
• Internal consistency procedures – items or questions
measuring the same phenomenon, should produce
similar results irrespective of their number in an
instrument
– The split-half technique
• External consistency procedures – compare findings
from two independent process of data collection with
each other as a means of verifying the reliability of the
measure
– Test/retest
– Parallel form of the same test

19
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
Split-half technique
• To correlate half of the items with the other half in a
research instruments
• Questions are divided in half in such way that any two
questions intended to measure the same aspect fall into
different halves.
• The scores obtained by administering the two halves are
correlated.
• Reliability is calculated using product moment correlation
between scores

20
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
Test/ retest (repeatability test)
• An instrument is administered once, and then again,
under the same or similar conditions.
• The ratio between test and retest score is an indication
of the reliability of the instrument
– The greater the value of the ratio, the higher the reliability of the
instrument
• Advantage - it permits the instrument to be compared
with itself.
• Disadvantage – a respondent may recall the responses
that they gave in the first round
– Overcome by increasing the time span between two tests
21
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
Parallel forms of the same test
• Two instrument intended to measure the same
population is constructed and administered to two similar
population.
• The results obtained from one test is compared with
another
– If similar, the instrument is reliable.
• Advantage – does not suffer from the problem of recall
and time lapse between two test is not required.
• Disadvantage – need to construct two instrument instead
of one.

22
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
Validity & reliability in qualitative
research
Traditional criteria forjudging Alternative criteria forjudging
quantitative research qualitative research
Internal validity Credibility
External validity Transferability
Reliability Dependability
Objectivity Confirmability

23
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
Validity & reliability in qualitative
research
• Credibility
• Transferability
• Dependability
• Confirmability

24
S C HO O L O F NUT R I T I O NA ND D I E T E T I C S • UNI V E R S I T I S UL T A NZ A I NA L A B I D I N
T h a n k You

19

You might also like