You are on page 1of 6

Soc Psychiatry Psychiatr Epidemiol (2004) 39 : 576–580 DOI 10.

1007/s00127-004-0791-z

ORIGINAL PAPER

J. I. Røssberg · Ø. Eiring · S. Friis

Work environment and job satisfaction


A psychometric evaluation of the Working Environment Scale-10

Accepted: 18 February 2004

■ Abstract Background The working environment in


mental health wards has been shown to have profound ef- Introduction
fects on the health and work stability of mental health
workers. Despite an apparent need for regular measure- An extensive literature has been generated about the mi-
ment of work environment,development of short and re- lieu in which health professionals work and the impact
liable instruments for such measurements has been it has on both mental and physical health [1–5]. The po-
largely neglected. The aim of the present study was to tentially stressful nature of mental health work has been
evaluate the psychometric properties of the Working En- amply demonstrated. Several studies have reported a
vironment Scale-10 (WES-10). Methods During the pe- high level of burnout and poor mental health among
riod 1990 through 2000, a total of 640 staff members on psychiatric staff members [6–11]. A poor work environ-
42 wards for psychotic patients completed the WES-10. ment has proved to be associated with reduced job sat-
To establish the number of subscales, a factor analysis isfaction, absenteeism, somatic complaints, burnout and
was carried out.The internal consistency of the subscales depression [12–17]. It has been reported how a poor
was calculated as Cronbach’s alpha.We also collected data work environment might influence the work perfor-
concerning satisfaction with the ward, its patients and mance negatively [18], and promote negative and cyni-
staff, and for how long the respondents had worked and cal attitudes towards patients and colleagues [19]. A
expected to continue to work at the ward. Results We poor work environment is probably one of the main rea-
identified four subscales named: Self Realization, Work- sons for the high staff turnover rate [1, 20, 21] and poor
load, Conflict and Nervousness. The psychometric prop- inpatient satisfaction and outcome [22, 23].
erties of the subscales proved to be acceptable. All the Against this background, there is an obvious need for
subscales were significantly correlated with at least one regular studies of the work environment on psychiatric
satisfaction item, and/or the time the staff expected to wards. As pointed out by Burnard et al. [24], the working
continue at the ward. Most notably, the Self Realization environment should be regularly measured, as one way
subscale was strongly correlated to general satisfaction to measure service quality. Measures of the working en-
with the ward, and to the time the staff expected to work vironment and job satisfaction may also be useful
on the ward in the future,while Conflict was strongly neg- benchmarks for evaluating future changes and develop-
atively correlated with liking for staff. Conclusion The ments in the psychiatric wards, and to monitor and im-
WES-10 appears to measure four clinically meaningful prove the clinical working environment.
subscales. It seems well suited for use in further research To regularly study the working environment, we need
and for evaluation of clinical milieus. an instrument that is clinically meaningful, easy to use
and with acceptable psychometric properties. To be clin-
■ Key words work environment – psychometrics – staff ically meaningful, the instrument has to measure the
members – satisfaction – questionnaires central dimensions. Reviewing the literature, it seems
that previous studies have identified three core dimen-
sions named: Workload (Work pressure, Task require-
J. I. Røssberg, MD () · Ø. Eiring, MD · S. Friis, MD, PhD ments) [2, 21, 24–26], Personal growth (Professional
Dept. of Psychiatry growth, Support, Achievement value and growth) [14,
Ullevaal University Hospital 21, 26] and Conflict [2, 25, 27]. Some studies come up
0407 Oslo, Norway
with additional dimensions like safety, role clarity,
SPPE 791

Tel.: +47-22/118370
Fax: +47-22/117848 salary, work hazards, home-work conflict, professional
E-Mail: j.i.rxssberg@psykiatri.uio.no status and organizational issues [7, 14, 21, 24, 25].
577

Many of the original instruments seem to have been ■ Statistics


so large and complex that they have been difficult to use. To establish the number of subscales of the WES-10, we carried out a
Consequently, many studies of the working environ- factor analysis (PCA) with varimax rotation. For each factor, we made
ment tend to have small and unrepresentative samples a corresponding subscale. Items were included into the subscales if
of psychiatric staff members [8]. Admittedly, several they had a loading on the corresponding factor ≥ 0.50 and if the dif-
ference between this loading and the highest loading on non-corre-
working environment scales have been used in short sponding factors was ≥ 0.05.
forms to facilitate ease of use or they have been changed The internal consistency of the subscales was calculated as Cron-
to become more suitable for mental health workers [28], bach’s alpha. We calculated the Corrected Item Total subscale Corre-
but, as indicated in a recent review, analysis of the psy- lation (CITC) for the subscale, which comprised four items. Pearson
chometric properties of different instruments seems correlations were used to assess the relationships between the sub-
scales and between the subscales and the other variables.
mostly to be lacking [6].
To overcome many of the previous difficulties, we
have developed a short and user-friendly ten-item
working environment scale. We collected data from a Results
large number of psychiatric staff members on 42 differ-
ent psychiatric wards. The main aims of this study were A total of 105 individual therapists and 529 nursing staff
to evaluate the psychometric properties of the Working members completed the WES-10. A total of six staff
Environment Scale-10 (WES-10) on a ward level. We de- members did not report whether they were individual
cided to examine whether the WES-10 measures clini- therapists or nursing staff. All staff members were in-
cally meaningful subscales worth using in future re- cluded in the study except for night staff. The limitation
search and in a clinical context.Another objective was to was due to difficulties in obtaining an acceptable num-
examine how these subscales were related to general job ber of completed questionnaires from the latter group of
satisfaction and the staff member’s intention to leave employees.
their job. More specifically, we wanted to answer the fol- All staff members were asked for how long they had
lowing questions: worked at the psychiatric ward and how long they ex-
1. Does the factor structure of the WES-10 point to spe- pected to work on the ward. A total of 15 % of the staff
cific subscales? members had been employed less than 6 months, 22 %
2. What are the internal consistencies’, mean scores, between 6 months and 18 months and 20 % between 18
standard deviations, and intercorrelations of the sub- months and 3 years. Of the staff members, 43 % had been
scales? employed more than 3 years. A total of 15 % were plan-
3. What is the relationship between the WES-10 sub- ning to quit their jobs during the following 6 months.An
scales and the staff members’ general satisfaction additional 15 % were planning to quit before 1 year had
with the psychiatric ward, liking for patients and passed. The largest group, 47 %, thought they would con-
staff? tinue to work at the same psychiatric ward somewhere
4. What is the relationship between the WES-10 sub- between 1 and 3 years. A total of 23 % were planning to
scale scores and how long the staff members have continue for more than 3 years. For each ward, we calcu-
worked at the psychiatric wards and how long they lated the percentage of staff members who had been
intend to work at the wards? working: (a) for less than 18 months, and (b) for more
than 3 years. We also calculated the percentage that in-
tended to continue: (a) for less than 1 year, and (b) for
Subjects and methods more than 3 years.
The factor analysis revealed four factors with an
During the period 1990 through 2000, a total of 640 staff members on Eigenvalue > 1. These four factors accounted for 79 % of
42 wards for psychotic patients completed the WES-10. The WES-10
is a self-report questionnaire and comprises the ten items displayed
the variance. The factor loadings of the items are listed
in Appendix 1. Three items (items 1, 2 and 3) were taken from the Per- in Table 1. The four subscales were named: Self Realiza-
sonal Development Scale developed by Moos [29]. The other seven tion, Workload, Conflict and Nervousness.
items were developed by a clinical research group at Ullevaal Univer- The Self Realization subscale explained 37 % of the
sity Hospital (1981) with the intention to evaluate the restructuring of variance and comprised four items (items 1, 2, 5 and 6).
an acute ward [30]. The items comprising the WES-10 were rated on
a five-point scale ranging from 1, not at all or never, to 5, very often or This subscale measures to what extent the staff members
to a large extent. feel supported, whether they achieve more confidence
This study included wards where more than two-thirds of the pa- and whether they experience being able to use their
tients were diagnosed in the psychotic spectrum of mental diseases. knowledge working on the ward. The Workload subscale
Most of the wards were short-term (n = 36), but some intermediate
and long-term wards (n = 6) were also included. explained 19 % of the variance and comprised two items
Three questions were applied to capture general satisfaction with (items 9 and 10). This subscale measures the number of
the milieu. The questions were rated on a five-point scale ranging tasks imposed on the staff members and also to what ex-
from 1, not at all, to 5, very much, and were: (1) “How satisfied are you tent they feel they should have been on several places at
with this ward?”, (2) “How much do you like the patients on this
ward?” and (3) “How much do you like the staff on this ward?”. The
the same time. The last two subscales, Conflict and Ner-
mean and SD concerning these three questions were respectively: 4.03 vousness, each comprised two items and explained re-
(0.33), 4.20 (0.20) and 4.43 (0.21). spectively 13 % and 12 % of the variance. The Conflict
578

Table 1 The factor loadings for each item. Only factor loadings ≥ 0.30 are included Table 3 The intercorrelations between the four subscales and general satisfaction
with the psychiatric wards, patients and staff members
Items from the I II III IV
WES-10 How satisfied How much do you How much do you
are you with like the patients like the staff on
1 0.82 this ward? on this ward? this ward
2 0.86
Self Realization 0.56** 0.49** 0.40**
3 0.94
Conflict –0.41** –0.16 –0.61**
4 –0.45 0.32 0.63
Workload –0.20 –0.15 0.17
5 0.63 –0.43
Nervousness –0.30 –0.27 –0.15
6 0.91
7 0.83 ** Correlation is significant at the 0.01 level (2-tailed)
8 0.85 * Correlation is significant at the 0.05 level (2-tailed)
9 0.91
10 0.91 Table 4 The correlations between the four subscales and how long the staff mem-
bers have been employed and how long they expect to work at the psychiatric ward

% worked % worked % intend % intend


subscale measures to what extent the staff members’ ex- < 18 months > 3 years to continue to continue
perience conflicts and loyalty problems among them < 1 year > 3 years
(items 7 and 8). The Nervousness subscale measures to
Self Realization –0.16 0.07 –0.38* 0.32*
what extent the staff members are worried about going
Conflict –0.05 0.15 0.25 –0.26
to work and to what extent they feel nervous or tense on
Workload –0.37* 0.26 0.28 –0.29
the ward (items 3 and 4). All the items were included in
the subscales. Nervousness 0.17 –0.05 0.38* –0.25
The psychometric properties of the subscales proved * Correlation is significant at the 0.05 level (2-tailed)
to be satisfactory. Cronbach’s alpha for the four sub-
scales were: Self Realization: 0.85, Workload: 0.84, Con-
flict: 0.69 and Nervousness: 0.66. The four items in the (Self Realization and Nervousness) were significantly
Self Realization subscale had a mean CITC of 0.52. The related to the time the staff expected to work on the ward
intercorrelations between the two items comprising the in the future. The relationship was most pronounced for
last three subscales were respectively: Workload: 0.72, Self Realization, which was moderately negatively corre-
Conflict: 0.53 and Nervousness: 0.49. lated with the percentage who intended to continue less
The mean scores and standard deviations for the four than 1 year, and positively with the percentage who in-
subscales were respectively: Self Realization: 3.73 (0.23), tended to continue for more than 3 years.
Workload: 3.41 (0.36), Conflict: 2.06 (0.28) and Nervous-
ness: 1.98 (0.21).
As seen from Table 2, the subscales were only moder- Discussion
ately intercorrelated (range: 0.13–0.37, median: 0.30).
As seen from Table 3, the Self Realization subscale The main finding of this study is that the WES-10 fea-
was most strongly correlated with general satisfaction tures acceptable psychometric properties on a ward
and liking for the patients. The Conflict subscale was level.Although not directly compared to other scales,the
most strongly correlated (negatively) with liking for the results of this study clearly indicate that the core aspects
other staff members. of the working environment can be captured with an
Table 4 shows that only the Workload subscale was easy-to-use instrument that only comprises ten items.
significantly correlated with the time staff members had The instrument seems well suited for use in research and
worked at the ward. This subscale showed a moderate evaluation as it reliably measures four clinically mean-
negative correlation with the percentage that had ingful subscales.
worked less than 18 months at the ward. Two subscales The validity is demonstrated by the fact that Conflict
was strongly negatively correlated with liking for staff,
while Self Realization was fairly strongly positively cor-
Table 2 The intercorrelations between the four subscales related with liking for patients. Furthermore, three of
the four WES subscales were significantly related to gen-
Self Realization Conflict Workload Nervousness eral satisfaction with the ward. It also makes sense that
Self Realization X –0.37* –0.13 –0.35* Nervousness was significantly related to a high percent-
Conflict X 0.20 0.34* age who intended to continue at the unit for less than 1
Workload X 0.25
year.
Nervous X
It seems that the WES-10 is able to capture the core
dimensions of the working environment. The Workload
* Correlation is significant at the 0.05 level (2-tailed) and Conflict subscales frequently appear in other stud-
579

ies and the importance of measuring these two dimen-


Appendix 1
sions of the work environment is widely described [2, 25,
27]. The Self Realization subscale measures the same as- ■ The Working Environment Scale 10 (WES-10) [Friis, 1981]
pect of the work environment as the Professional
growth, Personal growth, Support and Achievement Please mark the answer you think best describes what you feel.
value and growth dimensions of other studies [21, 26, 1. Does what you do on the ward give you a chance to see how good your abili-
31]. The Nervousness subscale, measuring how nervous ties really are?
or tense the staff members feel at the psychiatric ward,     
Not at all To a small To some To a large To a very
seems to appear less frequently in other studies. It obvi- extent extent extent large extent
ously measures an important dimension and is probably
strongly correlated with several issues of safety and in- 2. Does what you do on the ward help you to have more confidence in yourself?
security, which, in some studies, have proved to be im-     
portant factors of the work environment [28]. Not at all To a small To some To a large To a very
extent extent extent large extent
By only including ten items in the WES-10, some of
the previously reported dimensions (e. g. salary, man- 3. To what extent do you feel nervous or tense on this ward?
agement issues, safety issues, and home-work conflicts)     
are not captured by this instrument. It could be argued Not at all To a small To some To a large To a very
extent extent extent large extent
that a suitable instrument should include more items,
thus making the measurement of more aspects of the 4. How often does it happen that you are worried about going to work?
working environment possible. However, the main aim     
of this study was not to develop an instrument that was Very often Often Occasionally Rarely Never
able to capture all possible aspects of the work environ- 5. To what extent do you feel that you get the support you need, when you are
ment, but to examine and evaluate a short and easy-to- faced with difficult treatment problems?
use instrument that captures the core dimensions. The     
short format, evaluated in this study, leaves an opportu- Very often Often Occasionally Rarely Never
nity to use other instruments that capture other aspects 6. To what extent do you find that you can use yourself, your knowledge and ex-
of inpatient treatment without overloading the staff perience in the work here on this ward?
members.     
Three of the four subscales captured in this study Not at all To a small To some To a large To a very
comprised only two items. By aggregating the data on extent extent extent large extent
ward level, it was still possible to achieve acceptable re- 7. To what extent do you find that the patient treatment is complicated by con-
liability. To achieve reliable results on an individual level flicts among the staff members?
would probably have needed a much more extensive in-     
strument comprising more items. However, as also sup- Not at all To a small To some To a large To a very
extent extent extent large extent
ported by the findings of Melchior et al. [32], a consen-
sual perception of the working environment provides 8. To what extent do you find that it can be difficult to reconcile loyalty towards
enough information to capture in what way most of the your team with loyalty towards your own profession?
psychiatric staff members perceive the work environ-     
ment. This can be achieved by using a short, easy-to-use Not at all To a small To some To a large To a very
extent extent extent large extent
instrument.In this cross-sectional study,we did not con-
duct any analyses on the test/retest reliability of the 9. What do you think about the number of tasks imposed on you?
WES-10. This important subject needs to be examined     
in other studies with the WES-10. This study clearly in- Far too few Too few Sufficient Too many Far too many
dicates that the working environment is strongly related 10. How often does it happen that you have a feeling that you should have been
to staff satisfaction. To what extent the work environ- on several places at the same time?
ment, as perceived by staff, is related to inpatient satis-     
faction and outcome is still unclear [23, 33, 34]. To our Very often Often Occasionally Rarely Never
knowledge only two studies [35, 36] have examined the
relationship between the psychosocial ward climate and
the working environment. No clear conclusion could be References
drawn from the two studies. The WES-10 seems well
worth using in future studies of this topic. 1. Schaefer JA, Moos RH (1996) Effects of work stressors and work
climate on Long term Care Staff ’s job morale and functioning.
Res Nurs Health 19:63–73
2. Gray-Toft P, Anderson JG (1981) The Nursing Stress Scale: De-
velopment of an Instrument. J Behav Assess 3:11–23
3. Decker FH (1997) Occupational and Non occupational Factors in
Job Satisfaction and Psychological Distress Among Nurses. Res
Nurs Health 20:453–464
580
4. McNeese-Smith DK (1999) A content analysis of staff nurse de- 21. Alexander JA, Lichtenstein R, Oh HJ, Ullmann E (1998) A causal
scriptions of job satisfaction and dissatisfaction. J Adv Nurs 29: model of voluntary turnover among nursing personnel in long-
1332–1341 term psychiatric settings. Res Nurs Health 21:415–427
5. Baruch-Feldman C, Brondolo E, Ben-Dayan D, Schwartz J (2002) 22. Tzeng HM, Ketefian S, Redman RW (2002) Relationship of
Sources of Social Support and Burnout, Job Satisfaction, and nurses’ assessments of organizational culture, job satisfaction,
Productivity. J Occupational Health Psychol 7:84–93 and patient satisfaction with nursing care. Int J Nurs Studies 32:
6. Edwards D, Burnard P (2003) A systematic review of stress and 79–84
stress management interventions for mental health nurses. J Adv 23. Atkins PM, Stevenson Marshall B, Javalgi RG (1996) Happy em-
Nurs 42:169–200 ployees lead to loyal patients. J Health Care Marketing 16:15–23
7. Brown D, Leary J, Carson J, Bartlett H, Fagin L (1995) Stress and 24. Burnard P, Morrison P, Phillips C (1999). Job satisfaction
the community mental health nurse: the development of a mea- amongst nurses in an interim secure forensic unit in Wales. Aust
sure. J Psychiatr Mental Health Nurs 2:9–12 N Z J Mental Health Nurs 8:9–18
8. Kilfedder CJ, Power KG, Wells TJ (2001) Burn out in psychiatric 25. Cushway D, Tyler PA (1996) Development of a stress scale for
nursing. J Adv Nurs 34:383–396 mental health professional. Br J Clin Psychol 35:279–295
9. Dawkins JE, Depp FC, Selzer NE (1985) Stress and the psychiatric 26. Abraham IV, Foley TS (1984) The work environment scale and
nurse. J Psychosoc Nurs 23:9–15 the ward atmosphere scale (short forms): Psychometric data.
10. Leiter MP, Harvie PL (1996) Burnout among mental health work- Perceptual and Motor Skills 58:319–322
ers: A review and a research agenda. Int J Soc Psychiatry 42: 27. Davis MK (1974) Intrarole Conflict and Job Satisfaction on Psy-
90–101 chiatric units. Nurs Res 23:482–488
11. Melchior MEW, Bours JJW, Schmitz P, Wittich Y (1997) Burnout 28. Dallender J,Nolan P,Soares J,Thomsen S,Arnetz B (1999) A com-
in Psychiatric Nursing: A metaanalysis of related variables. J Psy- parative study of the perceptions of British mental health nurses
chiatr Mental Health Nurs 4:193–201 and psychiatrists and their work environment. J Adv Nurs 29:
12. McCowan B (2001) Self reported stress and its effects on nurses. 36–43
Nurs Standard 42:33–38 29. Moos R (1974) Evaluating treatment environments: A social eco-
13. Fagin L, Carson J, Leary J, De Villiers N, Bartlett H, O’Malley P, logical approach. New York Wiley
West M, McElfatrick S, Brown D (1996) Stress, Coping and Burn 30. Vaglum P, Karterud S, Jørstad J (1984). Institusjonsbehandling i
out in mental health nurses: Findings from three research stud- moderne psykiatri. Universitetsforlaget, Oslo
ies. Int J Soc Psychiatry 42:102–111 31. Coffey M, Coleman M (2001) The relationship between support
14. Onyett S, Pillinger T, Muijen M (1997) Job satisfaction and and stress in forensic community mental health nursing. J Adv
burnout among members of community mental health teams. J Nurs 34:397–407
Mental Health 6:65–66 32. Melchior MEW, van den Berg AA, Halfens R, Abu Saad HH,
15. Gulliver P, Towell D, Peck E (2003) Staff morale in the merger of Philipsen H, Gassman P (1997) Burnout and the work environ-
mental health and social care organizations in England. J Psy- ment of nurses in psychiatric long-stay care settings. Soc Psychi-
chiatr Mental Health Nurs 10:101–107 atry Psychiatr Epidemiol 32:158–164
16. Edwards D, Burnard P, Coyle D, Fothergill A, Hannigan A (2001) 33. Anderson FD, Beard LW, Maloney JP (1998) A descriptive, corre-
A stepwise multivariate analysis of factors that contribute to lational study of patient satisfaction, provider satisfaction and
stress for mental health nurses working in the community. J Adv provider workload at an army medical center. Military Med 163:
Nurs 36:805–813 90–94
17. Jones JG,Janman K,Payne RL,Rick JT (1987) Some determinants 34. Tzeng HM, Ketefian S (2002) The relationship between Nurses’
of stress among psychiatric nurses. Int J Nurs Stud 24:129–144 Job Satisfaction and Inpatient Satisfaction: An Exploratory
18. Landerweerd JA, Boumans NP (1988) Nurses’ work satisfaction Study in a Taiwan Teaching Hospital. J Nurs Care Qual 16:39–49
and feelings of health and stress in three psychiatric depart- 35. Kirby SD, Pollock PH (1995) The relationship between a medium
ments. Int J Nurs Stud 25:225–234 secure environment and occupational stress in forensic psychi-
19. Maslach C, Jackson SE (1982) Burnout in Health Professions: A atric nurses. J Adv Nurs 22:862–867
Social Psychological Analysis. In: Sanders G, Suls J (eds) Social 36. Dorr D, Honea S, Pozner R (1980) Ward Atmosphere and job sat-
Psychology of health and illness. Lawrence Erlbaum, Hillsdale, isfaction. Am J Comm Psychol 8:455–461
New Jersey, pp 227–251
20. Ito H, Eisen S, Sederer LI,Yamada O, Tachimori H (2001) Factors
affecting psychiatric nurses’ intention to leave their current job.
Psychiatr Serv 52:232–234

You might also like