Professional Documents
Culture Documents
Ergonomics
Publication details, including instructions for
authors and subscription information:
http://www.tandfonline.com/loi/terg20
To cite this article: H. Haines , J.R. Wilson , P. Vink & E. Koningsveld (2002)
Validating a framework for participatory ergonomics (the PEF), Ergonomics, 45:4,
309-327, DOI: 10.1080/00140130210123516
Taylor & Francis makes every effort to ensure the accuracy of all
the information (the “Content”) contained in the publications on our
platform. However, Taylor & Francis, our agents, and our licensors
make no representations or warranties whatsoever as to the accuracy,
completeness, or suitability for any purpose of the Content. Any opinions
and views expressed in this publication are the opinions and views of
the authors, and are not the views of or endorsed by Taylor & Francis.
The accuracy of the Content should not be relied upon and should be
independently verified with primary sources of information. Taylor and
Francis shall not be liable for any losses, actions, claims, proceedings,
demands, costs, expenses, damages, and other liabilities whatsoever
or howsoever caused arising directly or indirectly in connection with, in
relation to or arising out of the use of the Content.
This article may be used for research, teaching, and private study
purposes. Any substantial or systematic reproduction, redistribution,
reselling, loan, sub-licensing, systematic supply, or distribution in any
form to anyone is expressly forbidden. Terms & Conditions of access
and use can be found at http://www.tandfonline.com/page/terms-and-
conditions
Downloaded by [Aston University] at 14:20 13 January 2014
ERGONOMICS, 2002, VOL. 45, NO. 4, 309 ± 327
1. Introduction
The growth in participatory ergonomics over the past 15 years has been
considerable. Much ergonomics practice will necessarily always have been
participative to some degree. However, ergonomics research and interventions,
especially concerned with work design and workplace improvements for health and
safety, have increasingly and explicitly cited a participatory ergonomics approach
and methods. Such a `strong’ approach to participatory ergonomics has been de®ned
as `the involvement of people in planning and controlling a signi®cant amount of
their own work activities, with su cient knowledge and power to in¯uence both
processes and outcomes to achieve desirable goals’ (Wilson and Haines 1997).
Growth in participatory ergonomics has been fed by the recognition by
companies of there being room for improvement in working methods (e.g. Vink
and Peeters 1998) whilst not having resources to bring in ergonomics specialists for
every need (Wilson 1994), the increasingly participatory nature of approaches to
industrial health and safety generally, and the related processes of the total quality
movement (e.g. Eklund 2000).
Reasons to promote a participatory ergonomics (PE) approach include improved
design ideas and solutions, smoother implementation, and a number of systemic
outcomes of value to both organizations and individuals (Wilson and Haines 1997).
Against this, di culties include the (perceived) time and cost involved, the eVort
required to turn interventions into continuous improvement programmes, the need
to motivate participants and know how to embrace those represented but not active
in the process, i.e. the non-participator y stakeholders.
Despite the vastly increased number of PE endeavours, there is still little in the
way of an agreed theoretical structure for participatory ergonomics or a framework
for practical advice and guidance. It is also di cult to compare across diVerent PE
projects in terms of process and of outcomes. In fact, the literature highlights
participatory ergonomics as not being a unitary concept, but rather as an umbrella
term covering a fairly broad range of ideas and practices. Recognizing the diversity
of PE, and the need for better research and practice guidance, the Health and Safety
Executive in the UK commissioned a project that de®ned a series of dimensions
across which to describe PE initiatives, and presented a ®rst general framework for
PE (Haines and Wilson 1998). The framework and dimensions were based on
Downloaded by [Aston University] at 14:20 13 January 2014
previous work by the authors (e.g. Wilson 1991, Wilson and Haines 1997) and others
(e.g. Cohen 1996, Liker et al. 1989), and was informed by the views of a number of
European ergonomists who were interviewed during study visits. Importantly, the
framework also drew upon related work in management and business administration
(e.g. Dachler and Wilpert 1978, Cotton 1993).
Subsequently, an adapted set of dimensions was produced as a conceptual
framework for understanding PE Ð the participatory ergonomics framework (PEF).
Although the primary aim has been to provide clarity and organization for the ®eld
of participatory ergonomics, it is hoped that the approach could play a role in the
development of focused and practical guidance for the implementation of PE
initiatives.
Any such framework requires validation before becoming the basis for guidance,
but such multifactorial concepts as PE are not easy to validate. In the event, the PEF
was validated within a structured exercise, involving case studies previously carried
out by peers. The researchers on the case studies also retrospectively de®ned their
own projects across the dimensions of the framework. Thus the framework has been
produced in the UK by two of the authors (H. H., J. W.) and has been validated
using PE cases in The Netherlands, which were managed within a programme
directed by the other two authors (P. V., E. K.).
This paper begins by describing the framework to be tested and the methods
employed in the validation exercise. The results of the exercise are then presented
and discussed, and implications are drawn for the development of the framework.
Figure 1. Version of the participatory ergonomics framework (PEF) used in the validation
exercise.
basis and may take place outside the normal organizational structures. Alternatively,
ongoing participatory mechanisms may be developed which may well be much more
integrated into the structure of the organization.
Categories for permanence: Temporary Ð Ongoing
Alternatively, representative s may not set out to actively represent the views of
others, but instead participate because they represent a typical subset of a larger
group. To recognize this latter form of representation a category has been introduced
into this dimension, termed `partial direct participation’.
Categories for involvement: Direct participation Ð Partial direct participation Ð
Representative participation
3. Validation exercise
Testing the PEF was undertaken during a 2-day workshop at TNO’s headquarters.
TNO is a large research and consultancy organization with a substantial ergonomics
group. There were a number of reasons why this organization was a valuable test
site. First, they are enthusiastic about participatory ergonomics and are keen to
exchange ideas with other researchers (although importantly, the speci®c work of
individual staV members was not well known to the framework developers). Second,
they have undertaken a large volume of participatory ergonomics work, much of
which remains unpublished in scienti®c literature, which could be used in the
validation exercise. Third, being based in The Netherlands (albeit with a very
international perspective) they oVered a good opportunity to examine the cross-
cultural validity of the PEF.
A number of speci®c aims were identi®ed for the validation exercise:
(6) To investigate whether the framework would bene®t from further modi®ca-
tion and if so, to identify the changes which should be considered.
The ®rst day of the validation exercise involved the framework developers (H. H., J.
W.) collecting data on a range of participatory projects undertaken by TNO. The
project managers of seven separate PE projects, previously unpublished in English
(with one exception Ð Project F; de Jong and Vink 2000), were interviewed for
about 45 min each, using a semistructured format (see appendix 1); not all the
interview data gathered are reported in this paper. None of the project managers had
previously seen the PEF, and the interviews were designed to question project
managers about their project on a general basis only, and not explicitly on the
speci®c features of the framework. All of the interviews were recorded on audiotape
and key responses were also noted on an interview proforma sheet. Once all the
interviews had been completed, the framework developer subsequently used the
Downloaded by [Aston University] at 14:20 13 January 2014
4. Results
4.1. First-level analysis
A ®rst level of analysis was undertaken to identify whether the project managers and
the framework developers were positioning each project in a roughly similar manner.
The pattern of responses for each project are shown in table 2 along with percentage
Validating a framework for participatory ergonomics (the PEF) 315
E daycare for children to reduce physical overall steering group and daycare
workload for steering group involving: regional
employees working and local management, employees
with children
G tractor assembly to reduce the lead time, task force involving: senior and
increase e ciency and line management; blue collar
improve ergonomics workers; production planning; and
external experts
disagreement scores (disagreement was noted when the project manager and
framework developer did not select any of the same categories for a particular
dimension). The aim of this ®rst level of analysis was to identify areas where there is
no overlap between the thinking of the two parties. For example, table 2 shows that
316 H. Haines et al.
Downloaded by [Aston University] at 14:20 13 January 2014
for Project A there was a very low level of disagreement between the framework
developer and project manager. The only area where there was no overlap at all
between the two views was for the dimension `decision-making’.
Dimension Categories A B C D E F G
Permanence on-going D
temporary MD M D MD MD MD MD
Mix of operators MD MD MD MD MD MD
participants supervisors M D M M
middle management D MD D MD MD D
union personnel
specialist/technical MD M D MD D D MD
staV
senior management MD MD MD MD
Require- compulsory MD MD D D MD
ments voluntary M M MD MD M
developer. As the total number of categories ticked will in¯uence the percentage
agreement calculation, table 3 shows both the project manager’s agreement with the
framework developer and the framework developer’s agreement with the project
Validating a framework for participatory ergonomics (the PEF) 319
manager. Taking Project A for example, the ®rst percentage agreement score of 85%
was based on the fact that, of the 13 categories selected as re¯ecting the project by
the framework developer, the project manager and their team agreed with 11 of
these. The second percentage agreement score of 73% shows that the framework
developer agreed with 11 of the 15 categories selected by the project manager and
team.
Finally, to look more closely at how each of the dimensions of the framework
was interpreted, results from the seven projects were combined (table 4). A `strict
agreement’ score was calculated for each dimension, with agreement only being
recorded where there was an exact match between the categories ticked by the
project manager and the framework developer. For example, taking the ®rst
dimension `permanence’, where two possible categories could be selected, the
framework developer and project manager selected the same category in ®ve of the
seven projects. However, for the dimension `remit’ where there were six possible
Downloaded by [Aston University] at 14:20 13 January 2014
categories to choose from, there was an exact match for categories selected in only
one of the seven projects examined.
asked assign a score to each dimension using the following scoring system: 0, not
important; 1, important; and 2, very important. The results are shown in table 5.
5. Discussion of results
The results tabulated above are discussed in the following sections. Results are
examined ®rstly by individual project and then for each dimension of the framework.
and framework developers’ view of each project more closely, through the
calculation of a percentage agreement score for all categories across dimensions.
As has already been mentioned, the total number of categories selected will in¯uence
the percentage agreement calculation. For four of the projects, the total number of
categories selected by the project manager exceeded that of the framework
developer, for a further two projects the converse was true, and the remaining
project had equal numbers of categories selected by both the project manager and
the framework developer. The slight tendency for project managers to select more
categories may be related to the framework developers’ view that some of the
dimensions are composed of mutually exclusive categories or to the project
managers’ more in depth knowledge of the projects. This issue is expanded further
in the discussion section.
In general the level of agreement was quite high (table 3). It varied from 88 to
50% (project manager agreement with framework developer) and 86 ± 44%
(framework developer agreement with project manager). Looking at the lower
scoring projects, one of these Ð Project B Ð was a complicated mixture of
instrument development and implementation and was less well understood by the
researcher than were some of the higher scoring projects. The other lower scoring
framework developers. Five of the nine dimensions failed to reach a 50% `strict
agreement’ level but, not surprisingly, three of these (mix of participants, remit and
role of ergonomics specialist) are also the dimensions with the greatest number of
possible categories. There is no accepted way of deciding on acceptable levels of
agreement (although see St Vincent et al. 1998 who also used 50% although in a
diVerent context of identifying risk factors). However, we believe the cut-oV of 50%
to be supportabl e since it appears to distinguish projects where there is reasonable
consistency, albeit masked by extra categories chosen by manager or developer, from
those where there is less consistency.
It is more important to understand where and why there is lack of agreement;
examining the pattern of results (table 2) provides further insight into areas of
(mis)understanding . In most cases the interpretations below are supplemented either
by notes made by project managers on their response sheets or by points raised
during the subsequent group discussion session.
5.2.2. Involvement: There was agreement between the researcher and project
manager for four of the seven projects. For the remaining projects, disagreement
arose over the distinction made between partial direct and representative
participation. It may be that these particular terms were not su ciently clear;
through discussion, project managers agreed that there was a need to distinguish
between participants who represent themselves as a typical member of the workforce
and those whose role is to actively represent the views of a group of their colleagues.
5.2.3. Level of in¯uence: This dimension achieved the greatest number of strict
agreements (six out of a possible seven). However, one project manager pointed out
that this dimension did not accommodat e projects that had in¯uence beyond a
particular organization (Project F was applied across a whole industry sector).
322 H. Haines et al.
5.2.4. Decision-making : There were some di culties with the dimension of
decision-making, with strict agreement being reached for only three of the projects.
Disagreements seemed to arise largely because the framework developers had
intended this dimension to refer to the decision-makin g power of the group as an
entity whereas some of the project managers made a distinction between the
decision-making power of diVerent group members. Some project managers also
highlighted the fact that the power to make decisions might be related to the remit of
the group. For example, the responsibility to identify problems may be delegated to a
group although the decision to implement changes may well be retained by higher
management.
5.2.5. Mix of participants: This dimension achieved the lowest number of strict
agreements (none across the seven projects examined), seeming to stem largely
from diVerences in terminology used within UK and Dutch industry. In
Downloaded by [Aston University] at 14:20 13 January 2014
5.2.6. Requirement: There was agreement between the framework developers and
project managers for four of the seven projects, but some di culties with this
dimension did arise. In particular both the framework developers and project
managers recognized that in some cases the requirement to participate may be
related to the participant’s job or function, and therefore will not necessarily be the
same for all members of the group.
5.2.7. Focus: It is not clear why this dimension did not achieve a greater number of
strict agreements (only three out of a possible seven). It could be that the implied
distinction between a physical category (`designing/specifying equipment or tasks’)
and a work organizational category (`designing jobs, teams or work organization’ )
was not always appreciated by the project managers; there is considerable overlap
between the notions of tasks and job.
5.2.8. Remit: The term `remit’ itself was not generally understood by the Dutch
project managers. Beyond this, the low number of agreements across this dimension
(one out of a possible seven) seemed to be related to the distinction made between the
categories `solution generation’, `solution evaluation’ and `solution implementation’.
Some project managers felt that the category `project evaluation’ should have been
included for this dimension.
Table 5 shows that project managers rated ®ve dimensions of the PEF as particularly
important in de®ning a project: `decision-making’, `mix of participants’, `remit’, `role
of ergonomics specialist’ and `involvement’. Some of the project managers argued, in
line with the developers, that the entire framework should be viewed as a whole
package and that these ratings should not be used as the basis for discarding any of
the dimensions.
that these choices are not always made su ciently explicit, and that the PEF may act
as a form of a checklist to ensure that the issues and options are made clear to all
parties at the outset.
For any framework to be useable in practise, it must be easily understood and
widely applicable. It is acknowledged that there were potential limitations with the
validation exercise, most notably because it required the framework developers to
understand quickly a range of non-UK projects through relatively short, intensive
interviews. However, the exercise did enable the framework developers to identify a
number of ways in which the framework’s usefulness and generalizability might be
enhanced. The modi®cations that have now been made and the revised PEF are
described in table 6.
7. Conclusions
This paper describes a ®rst eVort to provide structure to the increasingly prevalent
participatory ergonomics (PE) initiatives. Since many reports of PE projects extol
the virtues of the approach and suggest relative success, it may seem that no
structure or fundamental understanding is required. However, the authors believe
that reported successes are often only partial reports which may be di cult to
transfer to other settings, that one-oV cases are not usually translated into the
potentially more powerful company-wide programmes, and that better guidance on
PE process and methods is required to motivate and support companies and even
ergonomics practitioners. It was for these reasons that the original version of a PE
framework was developed for the UK Health and Safety Executive (Haines and
Wilson 1998).
The validation of a modi®ed version of this framework, the PEF, is a rare
example of formal peer review of such developments in ergonomics. The exercise had
a series of six aims related to evaluation of the framework itself and its potential
usefulness and to its modi®cation and improvement, which were identi®ed earlier in
this paper. Our conclusions with respect to these aims are as follows:
(1) The level of agreement amongst those using the PEF to classify PE cases
lends support to its appropriac y and validity (at least for such classi®catory
purposes).
(2) The project managers and their colleagues, primarily ergonomists or those
with a strong interest in ergonomics, were able to understand and generally
324 H. Haines et al.
Involvement Replace the categories `partial direct’ and Full direct participation Ð
`representative’ participation with the categories Direct representative
`direct representative participation’ (i.e. a participation Ð Delegated
subgroup of possible participants) and `delegated participation
participation’
Role of Replace category `acts as team member’ with Initiates and guides process Ð
ergonomics’ `acts as expert’. Add category `not involved’ Acts as expert Ð Trains
specialist3 participants Ð Available for
consultation Ð Not involved
(Continued)
Validating a framework for participatory ergonomics (the PEF) 325
agree the components of the PEF and were happy that a variety of diVerent
PE projects can be covered. Some suggestions were made (with varying
degrees of force) for modi®cations and improvements.
(3) One of the strongest outcomes of this study was the acceptance amongst a
number of PE managers and researchers of the potential usefulness of the
PEF to conceptualize PE (see also point 5 below).
(4) The exercise has led to the conclusion that, in a modi®ed form, the PEF could
become the basis for a PE taxonomy.
(5) The framework was thought to be a particularly valuable tool to establish
and agree an agenda amongst stakeholders at the outset of a PE initiative,
and to make structured comparisons across such projects.
(6) A number of valuable modi®cations to the PEF emerged from the validation
exercise, and a revised version is reported in table 6. A number of possible
additions to the PEF were suggested and these will now be examined closely
Downloaded by [Aston University] at 14:20 13 January 2014
The authors conclude that the PEF has an applied role, for setting up and helping
support participatory ergonomics initiatives and programmes. The PEF also makes
a contribution to the better fundamental understanding of what is involved in
participative processes for ergonomics change. On the basis of modi®cations
suggested by the exercise reported in this paper and the further corroboration of the
PEF in future case studies, it is hoped that the framework can support focused
practical guidance for the implementation of participatory ergonomics.
Acknowledgements
The original work on the participatory ergonomics framework was funded by the
Economic and Social Research Council and the UK Health Safety Executive, under
Grant No. 3563/R49.007, with much support (moral and practical) from Trevor
Shaw. All views are the authors’, however. The authors acknowledge the support of
their colleagues at both the University of Nottingham and the TNO in helping them
to develop their ideas of participatory ergonomics over the years, and they are
especially grateful for the enthusiastic eVorts of those who took part in the validation
exercise. Finally, the authors are grateful for the insightful comments of the referees
on an original version of the paper; their careful reading and suggestions have
improved it considerably.
Table 6 (continued).
1
It is now recognized that in some cases (e.g. decision-making, mix of participants and brief)
the dimensions of the framework may be linked. It will be useful in the future to add tools to
support the framework that identify how these linkages may operate.
2
The permanence dimension will be re-examined in the light of high impact ergonomics
programmes which might include a pervasive but discontinuous intervention at all levels.
3
This dimension speci®cally looks at the role of ergonomics specialists within the participatory
process. It is recognized that in some cases a change agent (who is not necessarily an
ergonomics specialist) will be involved in the process Ð something which might be identi®ed
using the earlier dimension `mix of participants’.
326 H. Haines et al.
References
COCH, L. and FRENCH, J. R. P. 1948, Overcoming resistance to change, Human Relations, 1,
512 ± 532.
COHEN, A. L. 1996, Worker participation, in A. Battacharya and J. McGlothlin (eds),
Occupational Ergonomics: Theory and Applications (New York: Marcel Dekker), 235 ±
258.
COTTO N, J. L. 1993, Employee Involvement: Methods for Improving Performance and Work
Attitudes (Newbury Park: Sage).
DACHLER, H. P. and WILPERT, B. 1978, Conceptual dimensions and boundaries of participation
in organizations: a critical evaluation, Administrative Science Quarterly, 23, 1 ± 39.
DE JONG, A. M. and VINK, P. 2000, The adoption of technological innovations for glaziers:
evaluation of a participatory ergonomics approach, International Journal of Industrial
Ergonomics, 26, 39 ± 46.
EKLUND , J. 2000, Development work for quality and ergonomics, Applied Ergonomics, 31,
641 ± 648.
EPOC RESEARCH GROUP 1997, New Forms of Work Organisation. Can Europe Realise its
Potential? (Dublin: European Foundation for the Improvement of Living and Working
Downloaded by [Aston University] at 14:20 13 January 2014
Conditions).
HAINES, H. M. and WILSON, J. R. 1998, Development of a Framework for Participatory
Ergonomics (Sudbury: HSE Books).
LIKER, J. K., NAGAMA CHI, M. and LIFSHITZ, Y. R. 1989, A comparative analysis of participatory
ergonomics programs in US and Japan manufacturing plants, International Journal of
Industrial Ergonomics, 3, 185 ± 189.
ST-VINCENT, M., CHICOLNE, D. and BEAUGRAND, S. 1998, Validation of a participatory
ergonomics process in two plants in the electrical sector, International Journal of
Industrial Ergonomics, 21, 11 ± 21.
VINK, P. and PEETERS, M. 1998, Balancing organizational, technological and human factors:
the vision of production management, in P. Vink, E. Koningsveld and S. Dondt (eds),
Human Factors in Organizational Design and Management Ð VI (Amsterdam: Elsevier),
7 ± 11.
WILSON, J. R. 1991, A framework and a foundation for ergonomics?, Journal of Occupational
Psychology, 64, 67 ± 80.
WILSON, J. R. 1994, Devolving ergonomics: the key to ergonomics management programmes,
Ergonomics, 37, 579 ± 594.
WILSON, J. R. and HA INES, H. M. 1997, Participatory ergonomics, in G. Salvendy (ed.),
Handbook of Human Factors and Ergonomics, 2nd edn (New York: Wiley), 490 ± 513.
Next, some more questions about how the project was structured.
. Who participated Ð how many people Ð which occupational groups Ð were
they internal/external to organization?
. Did all people likely to be aVected by the project participate or were some
participants acting as representative s of others?
Validating a framework for participatory ergonomics (the PEF) 327