Professional Documents
Culture Documents
www.elsevier.com/locate/foodcont
Food, Consumer Behaviour and Health Research Centre, University of Surrey, Guildford, Surrey GU2 7XH, UK
b
School of Management, University of Surrey, Guildford, Surrey GU2 7XH, UK
c
School of Biomedical and Molecular Sciences, University of Surrey, Guildford, Surrey GU2 7XH, UK
Received 2 May 2005; received in revised form 2 August 2006; accepted 5 August 2006
Abstract
This review summarises the methods and results of studies conducted worldwide on the eVectiveness of food safety and food hygiene
training in the commercial sector of the food industry. In particular it focuses on those studies that have tried to evaluate the eVectiveness
of such training. Forty-six studies of food hygiene training are included which used some outcome measure to assess the eVectiveness of
training. The short-term nature and variety of measures used limited the majority of studies. The need for the development of evaluation
criteria of eVectiveness of food hygiene training is discussed.
2006 Elsevier Ltd. All rights reserved.
Keywords: Food safety; Training; Evaluation; HACCP
1. Introduction
Food safety remains a critical issue with outbreaks of
foodborne illness resulting in substantial costs to individuals, the food industry and the economy (Kaferstein,
Motarjemi, & Bettcher, 1997). Within England and Wales
the number of food poisoning notiWcations rose steadily
from approximately 15,000 cases in the early 1980s to a
peak of over 60,000 cases in 1996 (Wheeler et al., 1999).
This may be partly attributed to improved surveillance
(GriYth, Mullan, & Price, 1995; Kaferstein & Abdussalam,
1999) but may equally reXect increased global trade and
travel, changes in modern food production, the impact of
modern lifestyles, changes in food consumption and the
emergence of new pathogens (Collins, 1997; Tauxe, 1997).
Recent years have seen a reversal in this trend but food poisoning remains a high priority for the public and government (Parliamentary OYce of Science & Technology, 2003).
*
0956-7135/$ - see front matter 2006 Elsevier Ltd. All rights reserved.
doi:10.1016/j.foodcont.2006.08.001
Mishandling of food plays a signiWcant role in the occurrence of foodborne illness. Improper food handling may be
implicated in 97% of all foodborne illness associated with
catering outlets (Howes, McEwan, GriYths, & Harris,
1996). In two studies of general outbreaks of infectious
intestinal disease (IID) in England and Wales the primary
causes were related to poor food-handling practices
(Djuretic, Ryan, & Wall, 1996; Evans et al., 1998). Improper
practices responsible for microbial foodborne illnesses have
been well documented (Bryan, 1988) and typically involve
cross-contamination of raw and cooked foodstuVs, inadequate cooking and storage at inappropriate temperatures.
Food handlers may also be asymptomatic carriers of food
poisoning organisms (Cruickshank, 1990).
Food handler training is seen as one strategy whereby
food safety can be increased, oVering long-term beneWts to
the food industry (Smith, 1994). A postal survey of manufacturing, retail and catering food businesses by Mortlock,
Peters, and GriYth (2000) revealed that less than 10% had
failed to provide some food hygiene training for staV. Less
encouraging was the fact that less than 20% of managers
1181
1182
3. Overview of studies
1183
Table 1
Food hygiene training evaluation studies using a descriptive design
Study and year
Country
Al-Dagal (2003)
Burch and Sawyer (1991)
Participants (number)
Attitude, behaviour
and working practices
None
None
Questionnaire
Sanitation quiz
(8 questions)
Self-reported practices
Researcher survey
None
Self-reported hygiene
practices
Italy
None
UK
None
Not assessed
USA
Face-to-face
interviews
using structured
questionnaire
Questionnaire
Written examination
USA
USA
USA
Questionnaire,
self-reported practices
Comparison of post-course
sanitation inspection scores
Pre- and post-training
questionnaires
Interview
Not assessed
None
Not assessed
Questionnaire
None
Not assessed
Microbiological study
None
Questionnaire
Restaurants (n D 16)
Restaurant managers
(n D 500)
Johnston et al. (1992)
New Zealand Managers of food
service outlets (n D 300)
Little et al. (2002)
UK
Take-away restaurants
and sandwich bars
Manning and Snider (1993) USA
Food handlers (n D 64)
McElroy and Cutter (2004)
USA
Nigeria
UK
USA
Tebbutt (1986)
UK
Tebbutt (1991)
UK
Tebbutt (1992)
UK
UK
UK
Worsfold (1993)
UK
Wyatt (1979)
USA
Malaysia
Questionnaire
Questionnaire,
observation checklist
Not assessed
Self-reported changes in
Food safety
Participants (n D 1,448)
food safety behaviours
workshop
in Statewide Food safety
assessed by questionnaire
CertiWcation program (SFSCP) (16hrs)
Hospital food handlers
None
Not assessed
Structured interview,
(n D 161)
observation of some
practices
StaV in 30 food premises
CIEH basic certiWcate Basic food hygiene
Frequency inspection
in food hygiene
certiWcate examination ratings
Food service employees
Programmed texts for Oral test
Quality of work assessed,
(n D 11) of university
two food service tasks
time for doing tasks
residence halls
measured
Premises selling sliced
None
Not assessed
Microbiological sampling,
cooked meats (n D 160)
questionnaire on cleaning
and disinfection
StaV in 89 restaurants
None
Multiple choice
Premises assessed
questions
StaV in 75 premises producing None
Multiple-choice
Numerical scores for
high-risk foods
questions
premises based on 20
variables
Food hawkers (n D 100)
None
Structured on-site
Thirteen attitude items
from 15 sites
interview
using a Likert scale
Hospitality managers (n D 27) None
Not assessed
Survey of hygiene
management
Food handlers (n D 444),
None
Multiple-choice
Not assessed
from 104 small food businesses
questions
Members of the Womens
Royal Society of
Pre-course
End-of-course evaluation
Royal Voluntary
Health Basic Food
questionnaire
Service (n D 93)
hygiene course
None
Not assessed
Semi-structured interview
Small or medium sized
with manager; observation
businesses handling high-risk
of hygiene practices
foods (n D 66)
Managers or owners of food
None
Questionnaire
Questionnaire on attitudes,
markets (n D 219)
opinions, experiences and
practices
Food handlers (n D 430)
None
Questionnaire
Questionnaire evaluating
attitude and practice
1184
Table 2
Food hygiene training evaluation studies using an audit design
Study and year
Country
Participants (number)
Training
intervention
Knowledge
Attitude, behaviour
and working practices
UK
None
Not assessed
UK
None
Not assessed
Australia
Food premises
(n D 5,000)
Manufacturers of
ready to eat meat
products (n D 24)
Food service
operations (n D 19)
None
Not assessed
Table 3
Food hygiene training evaluation studies using a before-after design
Study and year
Training intervention
Cotterchio
et al. (1998)
USA
Kneller and
Bierma (1990)
Laverack (1989)
USA
None
UK
Medeiros
et al. (1996)
USA
Palmer
et al. (1975)
Sparkman
et al. (1984)
USA
USA
Tracey and
USA
Cardenas (1996)
3 groups of trainee
restaurant managers
(n D 96)
Food service facilities
(n > 400)
Food handlers
Knowledge
Not assessed
Not assessed
Table 4
Food hygiene training evaluation studies using a comparative-experimentalist design
Study and year
Costello
et al. (1997)
USA
Howes
et al. (1996)
Canada
Kirby and
UK
Gardiner (1997)
Training intervention
Knowledge
Employees of 6 quick
Two teaching methodslecture Questionnaire25
service restaurants (n D 43) format or computer
multiple-choice
interactive method
questions; pre- and
post-training tests
Food handlers (n D 69)
Home study food-handler
Pre- and post-instruction
certiWcation course
tests using 50
multiple-choice
questions
StaV in 30 food premises
CIEH basic certiWcate in
Not assessed
food hygiene
Nabali
et al. (1986)
Rinke
et al. (1975)
USA
Food production
personnel in university
residence halls (n D 60)
Attitude, behaviour
and working practices
Not assessed
Pre-observation of 16 food
safety practices; postobservation of two hand
washing practices
Pre- and post-training
hygiene
audit for each premise
Pre- and post-course
inspection surveys
of premises
Not assessed
training. Evaluation of training is complex given the number of variables that may inXuence the outcome, including
who is being trained, the level of training, motivation and
cultural dimensions. Unfortunately few of the studies were
1185
Table 5
Food hygiene training evaluation studies using a randomised controlled experimental design
Study and year
Waddell and
Rinke (1985)
USA
Wright and
Feun (1986)
USA
Training intervention
Knowledge
Self-administered test
of 20 questions
Not assessed
StaV at 46 community
based adult care facilities
Questionnaire to assess
attitude to training using
Likert scale
Pre-inspection of premises;
two post-inspections soon
after course
1186
those used and lack of controls. In a follow up study, Mathias, Sizto, Hazelwood, and Cocksedge (1995) examined the
eVects of inspection frequency and food handler education
on restaurant inspection violations. Those restaurants with
any staV having food handler education did signiWcantly
better on the overall inspection score than those with staV
who had no such education.
In a further review of the eVectiveness of Canadian public health interventions in food safety 15 studies were examined and three categories of interventions identiWed
(Campbell et al., 1998). These were inspections, food handler training and community-based education. Once again
there was some evidence that interventions can result in
improved food safety, but the authors emphasize that
because of diVerences in protocols many studies are not
useful in establishing guidelines.
This work was recently extended (Mann et al., 2001) and
now includes 55 papers of which seven were rated as moderate and 48 rated as weak. The authors concluded that
four of the seven studies provided good evidence to support
the eVectiveness of the food safety interventions with positive results for the main outcome measured. Five of the
seven studies included in the review focused on food handler training and or certiWcation, three of which (Cotterchio
et al., 1998; Rinke et al., 1975; Waddell & Rinke, 1985) provided evidence for the eVectiveness of the intervention.
Several other reviews have attempted to identify the key
features of an eVective training programme (Sprenger,
1991; Rennie, 1994; Taylor, 1996). Training in the workplace is one such feature. Current training is often conducted away from the workplace and there may be
diYculties in translating theory into improved food handling. Rennie (1994) concluded that the need for improvements in food handling practices might be better served by
training in the workplace, allowing for practical reinforcement of the hygiene message. Taylor (1996) reiterated this,
arguing that the impact of food handler training is minimal
and would be more eVective if conducted in the workplace,
where it can be job speciWc. She cites the minimal eVect of
training courses on knowledge, attitudes and behaviour of
food handlers as well as their inability to inXuence operational practices.
Another critical issue is that of eVective management
training. In an evaluation of a fast food management training programme Jackson, Hatlen, and Palmer (1977), concluded that management training can be eVective if it is
administered on a continuous basis, supported by the owners and includes frequent follow-up. Nabali et al. (1986),
concluded from their study that training of managers was
eVective in improving hygiene standards. A microbiological
study of open, ready-to-eat, prepared salad vegetables from
retail or catering premises by Sagoo, Little, and Mitchell
(2003b), identiWed a direct relationship between food
hygiene training of management, increased conWdence in
the food business management and the presence of food
safety procedures. In a study of ready-to-eat stuYng from
retail premises in the northeast of England, Richardson and
1187
1188
measures there was much variation and incomplete reporting of the details of the intervention methods and outcome
measures. For example, few studies reported details of the
questionnaires used. The majority of the studies were only
short-term and while these can provide useful information,
longer-term interventions and evaluations are needed to
assess behavioural change. Another limitation of the studies involving interventions was the lack of information on
costs or cost-eVectiveness, an issue often cited as a barrier
to training.
The limitations of measures used to assess training interventions are further discussed by Ehiri and Morris (1996).
They found the use of pre- and post-training test scores limited for evaluation purposes as they often measure knowledge of items not reXected in behaviour change. They also
highlighted the lack of correlation between examination
scores and improvements in food safety by reference to the
studies of Luby, Jones, and Horan (1993) and Laverack
(1989). The use of food hygiene inspection scores as a
means of evaluation is limited by the lack of correlation
between training and inspection scores. It is worth noting
also that these studies were based solely in the commercial
sector. Commercial food safety is very dependant on organisational structures and cannot easily be related to individual behaviour.
EVorts to reduce the incidence of foodborne illness
through interventions have had mixed results. The focus of
interventions, in the commercial sector, has been on
improving food handling practices. A primary aim and
therefore a primary criterion for evaluation of any training
is a change in behaviour towards less risky food handling
practices. A related goal is to improve knowledge about food
safety practices such as cross-contamination, temperature
control and personal hygiene. Related to these is the issue
of measuring outcomes. The principal conclusions of this
review of the literature are:
Current evidence for the eVectiveness of food hygiene
training is limited. This review has shown that many of the
studies on food hygiene training are limited both by a lack
of methodological detail and of well deWned outcomes,
Comparisons between studies are restricted and it becomes
impossible to deWne eVective interventions due to these
diVerences. There is a need to identify meaningful performance indicators at an individual level that can be used to
measure the eVectiveness of food hygiene training.
Questionnaires are a convenient measure of knowledge
and attitudes but direct observation has limited value. Reliable data from the workplace is essential to develop, implement and evaluate eVective food hygiene training, however
information on food hygiene behaviours obtained by direct
observation has limited value. Such observations are usually restricted to a small number of practices because of the
variety and complexity of roles involved in food handling.
StaV may also exhibit altered behaviours in the presence of
the observer to present what is perceived to be a more desirable image. There are also practical considerations in relation to time and cost involved in such observations.
1189
Howes, M., McEwan, S., GriYths, M., & Harris, L. (1996). Food handler
certiWcation by home study: measuring changes in knowledge and
behaviour. Dairy, Food and Environmental Sanitation, 16(11), 737744.
Jackson, B., Hatlen, J., & Palmer, B. (1977). Evaluation of a fast food management training program: one year later. Journal of Food Protection,
40(8), 562565.
Johnston, M. C., Arthur, J., & Campbell, I. (1992). Foodhandling practices
of Dunedin caterers: a cause for concern. New Zealand Medical Journal, 105(938), 289291.
Kaferstein, F., & Abdussalam, M. (1999). Food safety in the 21st century.
Bulletin of the World Health Organization, 77(4), 347351.
Kaferstein, F. K., Motarjemi, Y., & Bettcher, D. W. (1997). Foodborne disease control: a transnational challenge. Emerging Infectious Diseases,
3(4), 503510.
Kirby, M. P., & Gardiner, K. (1997). The eVectiveness of hygiene training
for food handlers. International Journal of Environmental Health
Research, 7(3), 251258.
Kirby, R. (1994). HACCP in practice. Food Control, 5(4), 230236.
Kirkpatrick, D. L. (1967). Training and development handbook; a guide to
human resource development. New York: McGraw-Hill.
Kneller, P., & Bierma, T. (1990). Food Service CertiWcationmeasuring
the eVectiveness of a state program. Journal of Environmental Health,
52(5), 292294.
Lambiri, M., Mavridou, A., & Papadakis, J. (1995). The application of hazard analysis critical control point (HACCP) in a Xight catering establishment improved bacteriological quality of meats. Journal of the
Royal Society of Health(February), 2630.
Laverack, G. R. (1989). Content analysis of a food hygiene course and the
assessment of its eVectiveness in fulWlling the training needs of food
handlers. Master of Science thesis. University of Manchester Medical
School.
Little, C. L., Barnes, J., & Mitchell, R. T. (2002). Microbiological quality of
take-away cooked rice and chicken sandwiches: eVectiveness of food
hygiene training of the management. Communicable Disease and Public
Health, 5(4), 289298.
Luby, S. P., Jones, J. L., & Horan, J. M. (1993). A large salmonellosis outbreak associated with a frequently penalized restaurant. Epidemiology
and Infection, 110(1), 3139.
Mann, V., DeWolfe, J., Hart, R., Hollands, H., LaFrance, R., Lee, M., et al.
(2001). The eVectiveness of food safety interventions Canada: Kingston
and Frontenac and Lennox and Addington Health Unit (pp. 1105).
Manning, C. K., & Snider, O. S. (1993). Temporary public eating places:
food safety knowledge, attitudes and practices. Journal of Environmental Health, 56(1), 2428.
Manpower Services Commission (1981). Glossary of training terms (3rd
ed.). London: HMSO.
Mathias, R. G., Riben, P. D., Campbell, E., Wiens, M., Cocksedge, W.,
Hazlewood, A., et al. (1994). The evaluation of the eVectiveness of routine restaurant inspections and education of food handlers: restaurant
inspection survey. Canadian Journal of Public Health, 85(Suppl. 1),
S61S66.
Mathias, R. G., Sizto, R., Hazelwood, A., & Cocksedge, W. (1995). The
eVects of inspection frequency and food handler education on restaurant inspection violations. Canadian Journal of Public Health, 86(1),
4650.
McElroy, D. M., & Cutter, C. N. (2004). Self-reported changes in food
safety practices as a result of participation on a statewide food safety
programme. Food Protection Trends, 24(3), 150161.
Medeiros, L. C., George, R. T., Burns, K., Chandler, C., Crusey, S., Fittro,
J., et al. (1996). The safe food handling for occasional quantity cooks
curriculum. Journal of Nutrition Education, 28(1), 3943.
Morrison, P., CaYn, N., & Wallace, R. (1998). Small establishments present challenge for Australian food safety code. International Journal of
Contemporary Hospitality Management, 10(3), 101106.
Mortlock, M. P., Peters, A. C., & GriYth, C. (1999). Food hygiene and hazard analysis critical control point in the United Kingdom food industry: practices, perceptions and attitudes. Journal of Food Protection,
62(7), 786792.
1190
Mortlock, M. P., Peters, A. C., & GriYth, C. (2000). HACCP in the raw.
Environmental Health Journal, 108(6), 186189.
Nabali, H., Bryan, F. L., Ibrahim, J., & Atrash, H. (1986). Evaluation of
training food service managers in Bahrain. Journal of Environmental
Health, 48(6), 315318.
National Advisory Committee on Microbiological Criteria for Foods
(NACMCF) (1998). Microbiological safety evaluations and recommendations on fresh produce. Food Control, 9(6), 321347.
Oteri, T., & Ekanem, E. E. (1989). Food hygiene behaviour among hospital
food handlers. Public Health, 103(3), 153159.
Ovretveit, J. (1998). Evaluating health interventions: an introduction to evaluation of health treatments, services policies and organisational interventions. Buckingham: Open University Press.
Palmer, B. J., Hatlen, J. B., & Jackson, B. B. (1975). Implementation and
evaluation of management training in a fast food restaurant chain.
Journal of Environmental Health, 37(4), 364368.
Parliamentary OYce of Science and Technology (POST) (2003). Food poisoning. January. Number 193. Available from http://www.parliament.uk/post/pn193.pdf.
Penninger, H., & Rodman, V. (1984). Food Service Managerial CertiWcation: how eVective has it been? Dairy and Food Sanitation, 4(7), 260264.
Powell, S. C., Attwell, R. W., & Massey, S. J. (1997). The impact of training
on knowledge and standards of food hygienea pilot study. International Journal of Environmental Health Research, 7(4), 329334.
Reicks, M., Bosch, A., Herman, M., & Krinke, U. B. (1994). EVectiveness of
a food safety teaching strategy promoting critical thinking. Journal of
Nutrition Education, 26(2), 97100.
Rennie, D. M. (1994). Evaluation of food hygiene education. British Food
Journal, 96(11), 2025.
Rennie, D. M. (1995). Health education models and food hygiene education. Journal of the Royal Society of Health, (April), 7578.
Riben, P. D., Mathias, R. G., Campbell, E., & Wiens, M. (1994). The evaluation of the eVectiveness of routine inspections and education of food
handlers: critical appraisal of the literature. Canadian Journal of Public
Health, 85(Suppl. 1), S56S60.
Riben, P. D., Mathias, R. G., Wiens, M., Cocksedge, W., Hazlewood, A.,
Kirschner, B., et al. (1994). Routine restaurant inspections and education of food handlers. Recommendations based on critical appraisal of
the literature and survey of Canadian jurisdictions on restaurant
inspections and education of food handlers. Canadian Journal of Public
Health, 85(Suppl. 1), S67S70.
Richardson, I. R., & Stevens, A. M. (2003). Microbiological examination of
ready-to-eat stuYng from retail premises in the north-east of England.
The Get StuVed survey. Journal of Applied Microbiology, 94(4), 733737.
Rinke, W. J., Brown, N. E., & McKinley, M. M. (1975). Two methods for
instructing personnel about food service sanitation. Journal of the
American Dietetic Association, 67(4), 364367.
Sagoo, S. K., Little, C. L., GriYth, C. J., & Mitchell, R. T. (2003a). Study of
cleaning standards and practices in food premises in the United Kingdom. Communicable Disease and Public Health, 6(1), 34.
Sagoo, S. K., Little, C. L., & Mitchell, R. T. (2003b). Microbiological quality of open ready-to-eat salad vegetables: eVectiveness of food hygiene
training of management. Journal of Food Protection, 66(9), 15811586.
Smith, R. (1994). Food hygiene training: the chance to create a coherent
training policy. British Food Journal, 96(7), 4145.
SoneV, R., McGeachy, F., Davison, K., McCargar, L., & Therien, G.
(1994). EVectiveness of two training methods to improve the quality of
food service in small facilities for adult care. Journal of the American
Dietetic Association, 94(8), 869873.
Sparkman, A. F., Briley, M. E., & Gillham, M. B. (1984). Validated food
service training manual for supervisors with limited experience. Journal
of the American Dietetic Association, 84(12), 14751478.
Sprenger, R. A. (1991). Hygiene for management: a text for food hygiene
courses. Doncaster, UK: HighWeld Publications.
Sumbingco, S., Middleton, R., & Konz, S. (1969). Evaluating a programmed text for training food service employees. Journal of the American Dietetic Association, 54(4), 313317.