Professional Documents
Culture Documents
repertoires. Textbook evaluation, thus, is at its heart a process of discovery by which the
teachers, through the lens of their teaching practice and classroom circumstances, can
uncover and examine for themselves the maximum possible effects that a textbook has to
offer to a specific language learning program.
Purpose of the Study
Taking it on trust that a textbook evaluation is, in its own right, a useful activitity
and a substantial contribution to any language teaching procedures, this paper sets forth
to evaluate the future potential performance of one particular textbook, namely American
Headway 2 (AH2), in the context of a non-English major class in the Ho Chi Minh City
Open University. Resting on the position that materials only take value in context
(Nunan, 1991, p. 211), the evaluation focuses to appraise AH2 in terms of its potential
correspondence with and contribution to the particular situation in which it will be used.
Ultimately, the paper seeks to:
a) Identify the degree to which AH2 can match up with the aims and objectives of
the course.
b) Identify the implications that the use of AH2 may have for the given teachinglearning situation.
Organization of the Study
To this end, the discussion in the paper is organized in four main sections. The first
section briefly presents the studys background and purposes. The second section grounds
the textbook evaluation process with a critical review of existing evaluative instruments.
The third section presents the evaluation results. The final section draws a brief
conclusion and put forward some suggestions on how AH2 can be best used in the
teaching situation it is intended to serve.
what constitutes an ideal textbook the criteria, and (c) their proposed methods and
procedures to evaluate textbooks. The common ground between the frameworks is first
established, then each framework is further investigated in reference to their own
contribution and what difference they can bring to the discussion of textbook evaluation
literature.
As production of new ELT textbooks has been on the increase, discussion on the
design of an evaluative means to look inside them is equally vigorously developed.
Whilst this plentiful supply of evaluative schemes supposedly suggests a growing
concern for the individuality of different teaching-learning situations, a close examination
on these frameworks reveals that a majority of them contain a number of similar general
criteria, implying in some way that there inherently exists on the back of our minds a
universal model of what constitute a good material, or what Chambers (1997, p. 29)
referred to as the Platonic ideal.
What most differentiates the frameworks, then, appears to be the degree of
emphasis placed on the criteria and the methods by which these criteria are constructed.
Cunningsworths (1995), for example, is a manageable, thoroughly developed forty-fiveitem checklist encompassing eight main criteria, aiming to provide a basic quickreference framework for evaluation. While emphasizing criteria such as content areas,
methodology and practical consideration, Cunningsworths checklist is less attentive to
issues that address learners interests, motivation and autonomy apparently considered
as desirable criteria in many other checklists of the same time (Breen and Candlin, 1987;
McDonough and Shaw, 1993; Rubdy, 2003). In regard to the method of evaluation,
Cunningsworths model, though simple and straightforward, seems not to be structured to
facilitate the dissection of what underlying values the textbook itself can possibly offer.
Tomlinson (2003, p. 17) perceives this limitation of Cunningsworths checklist as caused
by the mixing of analysis questions with evaluation questions, echoing the view of
Littlejohn (1998) and Sheldon (1988) that such a discursive format can hinder the
process of an in-depth analysis necessary for textbooks to speak for themselves.
Cunningworths framework, thus, might operate effectively if the primary concern is to
analyze the textbook at a straightforward surface level (Rubdy, 2003, p. 46); for the
purpose of searching for what essentially lay behind it, however, the checklists may fall
short of being an appropriate choice.
Bringing to the fore the need to separate description, guidance and criticism (p.
241), Sheldons framework aims to serve as an evaluative tool not only for published
coursebooks, but also for teacher-produced materials. Covering a total of 17 criteria with
53 questions, Sheldons checklist, upon the first encounter, appears to be quite
cumbersome compared to Cunningsworths. The method of evaluation, however, is welldirected to inviting for more evaluative stance from the part of evaluators, extending
details of the questions enough to the point that such questions can only be settled
through a deep critical probe into the embedded philosophy and principles of the
textbook in question. Another merit the checklist offers is its discernable emphasis on the
pedagogical implications a textbook can have for specific learning program, a
consideration upon which Cunningsworths checklist appears to inadedquately draw.
Though it can substantially benefit from a clearer, less abstract explanation for some
criteria listed (is it pitched at the right level of maturity and language, does the
introduction of new linguistic items seem to shallow/ steep enough for your students),
Sheldons checklist as a whole is extensive in its coverage of what features analysts
should examine in a textbook and elaborate in its technique for eliciting their position
towards such features.
Particulary aiming to look for the underlying thinking of materials, Littlejohns
framework proposed certain further aspects to be taken into account, most notably the
nature of teachers-learners roles suggested by the materials (1998, p. 184). Compared to
Sheldons checklist in terms of the consideration given to the textbook underspinnings,
Littlejohns offers more various guidance on how to uncover the relationship between the
means and the ends realized in the textbook itself, making this inference process
completely explicit to evaluators consciousness with the use of a three-level
investigation (What is there, What is required of users and What is implied).
Essentially, what makes Littlejohns checklist different from, if not superior to, other
established frameworks is its emphasis on drawing the line where objective judgement,
reporting, stops and where subjective judgement, interpreting, begins. By
highlighting this line, Littlejohn particularly asks teacher-analysts to become more
concious of, presumably also to be more responsible in, making their evaluation: for the
explicit nature of the materials, little is asked of teachers in terms of the inference
involvement; yet, for the account of the implicit nature, teachers are expected to
operate the analysis at a necessarily higher level of deduction. In this way, Littlejohns
proposed framework outshines the others, offering not simply a tool that helps teachers to
evaluate, but also a tool that helps teachers to learn how to evaluate.
Having examined three common checklists proposed to aid teacher-analysts in
evaluating materials, the current study decides to use Littlejohns as the conceptual
framework within which the analysis on AH2 can be carried out. Certain modifcation
with reference to the given situations requirements will be made, the detailed discussion
of which can be found in the next section.
Analysis of the Coursebook
This section first provides a brief analysis of the information most pertinent to the
teaching-learning situation in which AH2 will be used. The analysis is carried out using a
modification of the model suggested by Richard (2001, p. 256). The analysis of the
coursebook will then pursue, using the modified framework by Littlejohn mentioned
above.
teacher before the course begins and (b) the teachers experience in working in a
somewhat similar teaching situation.1
General English 1 is designed to provide basic users (A2) with a general capacity
program
the program
syllabus
The coursebook is the core and the only book used in the program.
The teacher in
the program
The learners
All the learners are provided (by the program) with the photocopies of the student
The objectives
of the
coursebook in
in the
program
main sections: 1/ Language Input (Grammar, Vocabulary and Everyday English) and 2/
Skills Development (Reading, Listening, Speaking and Writing). A set of learning
objectives (related to the three subsections Grammar, Vocabulary and Everyday English)
accompanies each chapter and the 12 chapters are complemented by 4 instructional
resources (Writing, Audio Scripts, Grammar Reference, Pairwork Activities, Extra
Materials and Word List).
Part B
Grammar
Vocabulary
Everyday
1. Exercise; 2. Speaking
English
Percentage
Initiate
54%
Respond
45%
Not quired
0%
Total
11
100%
b. Focus
Frequency
Percentage
Language system
54%
Meaning
27%
Meaning-system relationship
18%
Total
11
100%
Percentage
Repeat selectively
9%
2%
0%
11%
Select information
11%
Hypotheses
2%
2%
2%
11%
Negotiate
0%
6%
Total
26
100%
10
2. WHO WITH?
Frequency
Percentage
25%
6%
0%
37%
18%
16
100%
11
Percentage
Materials
10
50%
Teacher
25%
Learners
25%
Total
45
100%
12
Percentage
Metalinguistic comment
57%
Linguistic item
0%
Non-fiction
28%
Fiction
0%
14%
Total
100%
13
The result shows that about half of the types of content of the tasks in Unit 11 are
metalinguistic comment. This again indicates the prominent role of grammar in the
textbook and also the prefered approach of dealing with grammar in a same manner (both
the two grammar focuses in this Unit are dealt with in the same way). Though the
integration of skills into the instruction and practice of grammar admittedly helps learners
to get a chance to perceive the language learning process as a whole, this integration can
be more balanced, as intended by the textbook, should the instruction of Grammar is
made more varied and skills delopment should be made to more revolve around
Vocabulary or Everyday Use.
Conclusion and Recommendations
The degree to which AH2 can match up with the aims and objectives of the course.
As a whole, AH2 can fit into this program to a certain extent. At its best, AH2 is able to
help learners to perceive and experience language as a whole, which is quite necessary
for the development of general language learning. However, meaning the essenssial
concern of communicative language teaching apparently is not dealt with effectively in
AH2. The pedagogical values that AH2 can offer concerning the development of
communicative competence, thus, can not be as expected.
The implications that the use of AH2 may have for the given teaching-learning
situation. The use of AH2 in this particular teaching-learning situation needs to
compensate for the abovementioned void. At the decision-making stage, this means that
the teacher can choose to reassign the focus when using the textbook so as to be
consistent the course overall objectives. At the design stage, the teacher can adapt or
develop new tasks so as to have more skills and vocabulary integration. Tasks and
activities that involve more critical awareness and personalization are also needed.
14