Professional Documents
Culture Documents
Safety Science
journal homepage: www.elsevier.com/locate/ssci
Department of Human Factors Engineering and Product Ergonomics, Technical University Berlin, Sekr. KWT 1, Fasanenstr. 1, Eingang 1, Berlin D-10623, Germany
School of Mechanical and Automotive Engineering, Xiamen University of Technology, 600 Jimei Ligong Road, Xiamen 361024, PR China
c
School of Management, Hefei University of Technology, 193 Tunxi Road, Hefei 230009, PR China
d
Department of Industrial Engineering and Management, Tokyo Institute of Technology, 1-12-1 Oh okayama Meguro-ku, Tokyo 152-8552, Japan
b
a r t i c l e
i n f o
Article history:
Received 21 December 2012
Received in revised form 18 August 2013
Accepted 26 August 2013
Available online 23 September 2013
Keywords:
Human reliability analysis
SHELL
Medical device safety
Failure modes and effects analysis
Fuzzy linguistic
a b s t r a c t
Medical device systems have become increasingly complex, interconnected, and interoperating. A major
challenge is how to ensure and improve the safety, security, and reliability of medical devices. An efcient
human reliability analysis and assessment for medical devices is essential for improving the quality of
medical treatment and preventing an iatric accident. This paper explores qualitative and quantitative
methods to analyze human reliability for medical devices. First, the SHELL (named after the initial letters
of its components names, Software, Hardware, Environment, Live-ware and Central Live-ware) model is
developed to make a qualitative analysis for human reliability of medical devices. The SHELL model is to
consider human as an integrated and inseparable component of the productive system. After that, failure
modes and effects analysis (FMEA) is proposed to evaluate the potential failures in human reliability of
medical devices. Failure mode and effects analysis (FMEA) is a method to assess a system, design, process
or service for possible ways, in which failures (problems, errors, risks and concerns) can occur. The most
important issue of FMEA is the determination of risk factors like the occurrence, severity, and detection
using the opinions of different experts. This paper applies fuzzy linguistic theory to convert the subjective
cognition of experts into an information entity to obtain the numerical values of risk factors. The aim of
this study is to analyze and build an assessment model for human reliability of medical devices to
improve the safety of medical devices.
2013 Elsevier Ltd. All rights reserved.
1. Introduction
Medical devices are special products that are directly related to
patients health and lives. They are associated with adverse events
which result in death or serious injury, or have malfunctions which
could lead to death/serious injury (Cheng et al., 2011). The design
of medical devices has become more intricate. The designers are
more concerned about the efcacy, safety, and reliability. The users
and patients both want the device to operate as specied, perform
in a safe manner, and continue to perform over a long period of
time without failure (Fries, 2012).
In recent years, the reliability of software and hardware equipment has greatly improved, because of the advances in security
measures. But, along with the increasing complexity of equipment
and the increase in the workload of operators, the number of
accidents caused by the unreliability of the operators behavior
has risen. So the risk of use-error is becoming the main factor in
Corresponding author at: School of Management, Hefei University of Technology, 193 Tunxi Road, Hefei 230009, PR China.
E-mail addresses: qinglian.lin@awb.tu-berlin.de (Q.-L. Lin), wg_lin@yahoo.cn
(W.-G. Lin), huchenliu@foxmaill.com, lisalin685@gmail.com (H.-C. Liu).
0925-7535/$ - see front matter 2013 Elsevier Ltd. All rights reserved.
http://dx.doi.org/10.1016/j.ssci.2013.08.022
249
Hardware:
Equipment
Tools
Manuals
Environment
Climate
Temperature
Noise
Central Live-ware
Live-ware
Operator
Team
Management
Software:
Norms
Procedures
Practices
250
Occurrence
Construction
assessment
group
Determine
potential
failure modes,
causes, and
effects
Calculate
RPN
Severity
Human
reliability
assessment
Detection
Based on
SHELL
Rating
scale
Weights
Fuzzy
linguistic
Pei
W ei Pz
i1 P ei
; i 1; 2; 3; . . . ; z
Table 1
Occurrence rating scale.
Rating
Description
10
9
8/7
6/5
4/3
2
1
Failure
Failure
Failure
Failure
Failure
Failure
Failure
occurs at least once a day, or, failure occurs almost every time
occurs predictably, or, failure occurs every 3 or 4 days
occurs frequently, or failure occurs about once per week
occurs about once per month
occurs occasionally, or failure occurs once every 3 months
occurs rarely, or failure occurs about once per year
almost never occurs; no one remembers the last failure
251
Description
Denition
10
Extremely
dangerous
Very dangerous
Dangerous
Failure could cause death of a customer or total system breakdown, without any prior warning
9/8
7
6/5
4/3
2
Moderate danger
Low to moderate
danger
Slight danger
No danger
Failure could cause major or permanent or serious system disruption with interruption in service, with prior warning
Failure causes minor to moderate injury with a high degree of customer dissatisfaction or major system problems requiring major
repairs or signicant re-work
Failure causes minor injury with some customer dissatisfaction or major system problems
Failure causes very minor or no injury but annoys customers or results in minor system problems that can be overcome with minor
modications to the system or process
Failure causes no injury and customer is unaware of problem; however, the potential for minor injury exists; little or no effect on
system.
Failure causes no injury and has no impact on system
Table 3
Detection rating scale.
Rating
Description
Denition
10
9/8
7/6
5
4/3
2
1
No chance of detection
Very remote/unreliable
Remote
Moderate chance of detection
High
Very high
Almost certain
Membership
values
Low
Very Low
Moderate
High
Very High
1.0
Performance
10
by respondent m for interface j and failure mode k, and the membership function of triangular fuzzy number W m
jk 2 S.
m
m
m
m
Om
jk LOjk ; MOjk ; UOjk ; Ojk 2 T;
W jk W 1jk W e1 W 2jk W e2 W m
jk W em
6
Sm
jk
UOm
jk
m
where 0 6 LOm
jk 6 MOjk
6 10
m
m
LSm
jk ; MSjk ; USjk ;
USm
jk
2
Sm
jk
2 T;
where 0 6
LSm
jk
MSm
jk
6 10
m
m
m
m
m
m
Dm
jk LDjk ; MDjk ; UDjk ; Djk 2 T; where 0 6 LDjk 6 MDjk
6 UDm
jk 6 10
m
m
m
m
m
m
Wm
jk LW jk ; MW jk ; UW jk ; W jk 2 S; where 0 6 LW jk 6 MW jk
6 UW m
jk 6 1
where Ojk , Sjk , and Djk , are occurrence, severity and detection values
of expert opinion for interface j and failure mode k, W jk is importance evaluated by expert for interface j and failure mode kj, and
Wei is the ith expert weight and m is the number of expert,
respectively.
This study adopts FMEA with fuzzy linguistic theory to evaluate
human reliability for medical devices. Since the output of the fuzzy
system is a fuzzy set, the defuzzication procedure is used to convert the fuzzy result into a numerical value in order to represent
the human reliability of medical devices. Braae and Rutherford
(1978), Runkler and Glesner (1993) compared the Mean-of-maxi-
252
Very
Unimportant
Unimportant
Medium
Very
Important
Important
1.0
Important
0.2
0.6
0.4
0.8
mum (MOM) defuzzication and center-of-area (COA) defuzzication methods and concluded that COA yields better results than
MOM (Wu et al., 2010). The COA is a simple and practical method
to defuzzicate the value and the importance of occurrence, severity and detection. Eqs. (10)(13) show the values of fuzzy occurrence, severity and detection and fuzzy weight of importance of
each failure mode, respectively.
DOi
10
DSi
11
DDi
12
DW i
UW i LW i MW i LW i
LW i 8i
3
13
Finally, the RPND is calculated with DOi, DSi, DDi, and DWi.
14
Step 4. Calculate RPN Score: The risk priority number (RPN) is the
product of the occurrence (O), severity (S), and detection (D) of a
failure.
RPN O S D
15
RPNk
m
X
RPNkj ;
j 1; 2; . . . ; m
16
j1
where RPNk is the total RPN score of kth sub-system, RPNkj presents
the RPN score of jth failure mode in kth sub-system, and j symbolizes the number of failure modes in the sub-system, respectively.
Step 6. Output: After step 5, we can nd out which sub-system
has the highest RPN score. The failure modes with higher RPN score
are assumed to be more important and will be given higher priorities for correction.
Table 4
Experts weights.
Experts
E1
E2
E3
E4
E5
Weights
0.1
0.15
0.2
0.3
0.25
4. Case study
The application of the human reliability assessment method
was undertaken for a medical device in a medical devices design
company. The application steps of the human reliability assessment methods are given in this section.
Step 1. Construct assessment group: The human reliability assessment group was constructed from multidisciplinary experts, which
includes designers, users of medical devices, and human reliability
researchers. There are ve experts in the assessment group, one is
a researcher, two are designer experts, and two are users. The
weights of each expert (as shown in Table 4) are assigned based
on the experts individual background and calculated by using
Eq. (1).
Step 2. Analyze and determine potential failure modes: According
to the introduction of the SHELL model, the four interfaces of the
human reliability of medical devices SHELL model are dened.
The users of medical devices are the most important part in the
medical device design. They operate the devices directly. So the
users of the medical devices are dened as the Central Live-ware.
Following the review of literature and multidisciplinary experts,
we got the failures of the four interfaces: LH, LS, LE and LL.
The SHELL model for human reliability of medical devices is given
in Fig. 5. In the LH sub-system, we must consider the interface,
instruments and work space components. In the LS sub-system,
we consider the training, organizational rules and procedures. In
the LE sub-system, we study the thermal environment, acoustic
environment, luminous environment, and environment pressure
components. In the LL sub-system, we consider the leadership,
communication and cooperation components. Based on these components, we analyze the potential failure modes of each
component.
The potential failure modes are determined by the SHELL model. After analysis of the four sub-systems, LH, LS, LE, and LL,
we found the failure modes of each sub-system, as Fig. 6 shows.
There are seven failure modes in the LH sub-system, ve failure
253
Standard
Identify
Consistency
Space size
Interface size
Thermal
environment
Information display
Interface
Low
temperature
Instrument
Work space
High
temperature
Information capacity
Operation
training
Hardware
Training
Thermal
radiation
Environment
Acoustic
environment
Noise
Central Live-ware
Knowledge
training
Software
Organizational
rules
Live-ware
Planning
Luminous
environment
Too bright
Environment
pressure
Leadership
Communication
Cooperation
Too dark
Allocation
Procedures
Work flow
Too many
related person
Leadership
challenge
Communication
between
operators and
designers
Communication
among operators
Individual
different
Cognitive
difference
modes in the LS sub-system, six failure modes in the LE sub-system, and ve failure modes in the LL sub-system.
Step 3. Determine the probability of occurrence (O), severity (S),
and detection rating (D): The fuzzy numbers of the ve linguistic
scales for O, S, and D values are VL, L, M, H, and VH. The weight
of importance of each failure mode fuzzy linguistic are AU, U, M,
I, and VI. The ve experts give their O, S, and D fuzzy evaluation
for each failure mode according to their own understanding. Based
on the experts opinions, the O, S, and D values of failure modes and
L-H
Interface
L-S
Work
space
Instrument
Training
Organizational
rules
L-E
Procedures
Thermal
environment
L-L
Acoustic
environment
Luminous
environment
Environment
pressure
Communication
Cooperation
Cognitive problem
Individual problem
Communication
problem among
operators
Communication
problem between
designer and operators
Low leadership
Too dark
Too bright
Noise
Radiation
Too cold
Too hot
Non-standard work
flow
Unsuitable allocation
Lack knowledge
planning
Lack knowledge
training
Lack operation
training
Non-consistency
Non-identity
Non-standard
Wrong information
capacity
Wrong information
display
Wrong size
Leadership
254
Table 5
The OSD value of each failure mode.
Sub-system
Expert
E1 (0.1)
E2 (0.15)
E3 (0.2)
E4 (0.3)
E5 (0.25)
Value
LH
M11
M12
M13
M14
M15
M16
M17
L
M
M
M
M
H
M
M
H
H
H
M
H
M
L
M
L
M
M
M
VH
L
M
M
M
M
M
M
M
H
H
H
M
H
M
L
L
L
M
M
L
H
L
M
M
M
M
M
M
H
M
H
H
M
M
M
L
L
L
M
L
L
H
L
M
M
M
L
M
L
M
M
M
H
M
M
M
VL
M
L
M
M
L
H
M
M
M
M
L
H
L
M
M
M
H
M
M
M
L
L
L
M
M
L
H
LS
M21
M22
M23
M24
M25
M
M
M
M
H
H
M
H
H
H
L
H
M
M
M
M
H
M
M
H
H
M
H
H
H
M
M
M
M
M
M
H
L
L
H
H
H
H
H
H
M
M
M
M
M
M
H
M
M
H
H
M
M
M
H
M
M
M
M
M
M
H
M
M
VH
H
H
M
M
M
L
M
M
M
M
LE
M31
M32
M33
M34
M35
M36
M37
M
M
M
M
M
M
L
M
M
M
M
M
M
M
L
L
H
L
L
L
L
L
L
M
M
M
M
L
M
M
M
M
M
M
L
L
L
M
L
VL
L
L
M
M
M
M
M
L
M
M
M
H
M
M
M
L
L
L
H
L
L
L
M
M
M
M
M
M
M
L
M
M
M
M
M
M
M
L
L
M
L
L
L
M
M
L
M
M
M
L
H
L
M
M
M
M
M
L
M
L
H
L
L
L
M
LL
M41
M42
M43
M44
M45
H
M
M
H
M
H
M
M
H
H
H
M
M
M
M
H
M
M
H
M
H
H
M
H
H
H
M
M
M
M
H
M
M
H
M
M
M
M
H
H
H
M
L
M
M
H
M
M
H
M
M
M
M
H
H
H
M
M
M
M
H
M
M
M
M
M
M
M
H
H
H
H
M
H
M
Table 6
The weight of importance of each failure mode.
Table 7
The PRND value of each failure mode.
Sub-system
Expert
E1 (0.1)
E2 (0.15)
E3 (0.2)
E4 (0.3)
E5 (0.25)
LH
M11
M12
M13
M14
M15
M16
M17
M
VI
I
I
M
I
I
M
I
I
M
M
I
M
I
VI
M
I
I
M
I
U
I
I
I
U
M
I
I
VI
M
I
I
I
I
M21
M22
M23
M24
M25
VI
I
M
M
U
VI
I
U
M
U
I
M
M
M
M
VI
I
M
I
U
VI
I
I
M
U
M31
M32
M33
M34
M35
M36
M37
M
M
I
U
M
M
M
M
I
I
U
M
M
M
I
M
M
U
I
I
M
U
M
I
M
M
M
M
M
M
I
M
I
I
M
M41
M42
M43
M44
M45
M
VI
I
M
I
M
VI
I
U
I
I
I
M
M
I
M
VI
I
M
M
I
I
I
I
I
LS
LE
LL
system in human reliability analysis for medical devices. So the designer must pay more attention to the LL system (Leadership,
Communication and Cooperation) and develop an action plan.
Subsystem
Failure mode
RPND
LH
17.55273
84.65625
48.80859
133.5938
43.83984
56.79932
99.43828
LS
140.7656
163.193
72.35156
79.24219
82.5
LE
Too hot
Too cold
Radiation
Noise
Too bright
Too dark
Too many related person
30.0354
26.875
122.7188
24.21875
33.6875
29.66797
32.539
LL
Low leadership
Communication problem between designer and
operator
Communication problem among operators
Individual problem
Cognitive problem
193.7988
130.0078
78.75
152.2705
126.5625
As a result of this study, we learn that the most important interface system on the human reliability of medical devices is the LL
system, i.e. the interaction between the Live-ware and Central
Live-ware. The problems in the LL system (Leadership, Communication, and Cooperation) could cause a great number of accidents.
The medical devices designer must analyze the LL system in
greater detail. The leadership, communication, and cooperation
in the LL system are complicated to analyze. It requires a multidisciplinary approach for a fully comprehensive analysis. The next
step following this research is to focus on the application of the
LH
LS
LE
LL
RPN score
484.69
538.05
299.739
681.39
6. Conclusion
Human reliability assessment (HRA) involves the use of qualitative and quantitative methods to assess the human contribution to
risk. A great number of tools are used for HRA. Such as the second
generation HRA methods like ATHEANA has been developed to
evaluate the probability of a human error occurring throughout
the completion of specic task (NUREG, 2000). But most of the
tools fail to consider such things as the impact of context, organizational factors and errors of commission (Bell and Holroyd, 2009).
As a result, known potential failures are difcult to identify in HRA
research. Failure mode and effects analysis are tools for evaluating
a system, design, process or service for possible ways in which failures can occur. It is a structured approach that starts with known
potential failure modes at one level, and investigates the effects at
the next level. After that, a complete analysis is obtained of the system spanning all levels. Therefore, FMEA is a suitable approach to
solve difculties in HRA research.
The design of medical devices has become more complex. It requires greater efcacy, safety, and reliability. A human reliability
assessment model has been developed for this purpose in this paper. The strengths of the developed model are:
The use of the SHELL model to analyze the human reliability of medical devices from four interface systems, LH, L
S, LE, and LL. This provides a comprehensive analysis.
The FMEA is a bottom-up approach to analyze the failure
modes in a system. It can look at the whole system for
potential failure modes of the system.
In the FMEA procedure, the RPN value is based on experts
fuzzy linguistic evaluation. As the human reliability
assessment of medical devices involves many qualitative
assessment factors, there is not sufcient data for the
qualitative factors. Hence, the experts fuzzy judgement,
based on their professional knowledge, is a more efcient
method.
255
Acknowledgments
The writers of this thesis would like to thank the authors of all
references mentioned. Their work has contributed greatly to the
completion of this thesis. The authors also wish to thank the editor
and reviewers for their constructive suggestions.
References
Bell, J., Holroyd, J., 2009. Review of Human Reliability Assessment Methods.
Research Report RR679, SHE.
Braae, M., Rutherford, D.A., 1978. Fuzzy relations in a control setting. Kybernetes 7
(3), 185188.
Braglia, M., 2000. MAFMA: multi-attribute failure mode analysis. International
Journal of Quality and Reliability Management 17 (9), 10171033.
Capunzo, M. et al., 2004. A FMEA clinical laboratory case study: how to make
problems and improvements measureable. Clinical Leadership Management
Review 18 (1), 3741.
Cebi, S., Kahraman, C., 2010. Developing a group decision support system based on
fuzzy information axiom. Knowledge-Based System 23 (1), 316.
Cheng, S.F., Das, D., Pecht, M., 2011. Using failure modes, mechanisms, and effects
analysis in medical device adverse event investigations. In: ICBO: International
Conference on Biomedical Ontology, Buffalo, NY, USA, pp. 340345.
Cooper, S.E., Brown, W.S., Wreathall, J., 2006. A human reliability-centered approach
to the development of job aids for reviewers of medical devices that use
radiological byproduct materials. In: International Conference on Probabilitstic
Safety Assessment and Management, New Orleans.
Cuschieri, A., 2000. Human reliability assessment in surgery a new approach for
improving surgical performance and clinical outcome. Annals of the Royal
College of Surgeons of England 82, 8387.
Dhillon, B.S., 2000. Medical Device Reliability and Associated Areas. CRC Press, Boca
Raton.
Dhillon, B.S., 2003. Human Reliability and Error in Medical System. World Scientic
Pub, Singapore.
Edwards, E., 1972. Man and machine: systems for safety, proceedings of British
airline pilots associations. In: Technical Symposium British Airline Pilots
Associations, pp. 2136.
Fries, R.C., 2012. Reliable Design of Medical Devices, third ed. CRC Press, Boca
Raton.
Grandjean, E., 1980. Fitting the Task to the Man. Taylor and Francis.
Hawkins, F.H., 1987. Human Factors in Flight, second ed. Ashgate Pub, Aldershot.
Hoelscher, U., Liu, L., Gruchmann, T., 2006. International encyclopedia of
ergonomics and human factors, second ed. CRC Press, Boca Raton.
Hollnagel, E., 2005. Human Reliability Assessment in Context. Nuclear Engineering
and Technology 37 (2), 159166.
IEC 60601-1-6, 2004. Medical Electrical Equipment Part 16: General
Requirements for safety Collateral standard: usability. In: International
Electrotechnical Commission, Geneva, 2004.
ISO 14971, 2000. Medical Devices Application of Risk Management to Medical
Devices. In: International Organization for Standardization, Geneva, 2000.
Kohn, L.T., Corrigan, J.M., Donaldson, M.S., 1999. To Err Is Human: Building a Safer
Health System. National Academy Press, Washington DC.
Lin, Q.L. et al., 2012. Intergrating hierarchical balanced scorecard with fuzzy
linguistic for evaluating operating room performance in hospitals. Expert
Systems with Applications. http://dx.doi.org/10.1016/j.eswa.2012.10.007.
Liu, H.C. et al., 2011. Failure mode and effects analysis using fuzzy evidential
reasoning approach and grey theory. Expert Systems with Applications 38 (4),
44034415.
Liu, H.C. et al., 2012. Risk evaluation in failure mode and effects analysis with
extended VIKOR method under fuzzy environment. Expert Systems with
Application 39 (17), 1292612934.
Lyons, M. et al., 2004. Human reliability analysis in healthcare: a review of
techniques. International Journal of Risk and Safety in Medicine 16, 223237.
Moraru, R.I., Babut, G.B., Cioca, L.I., 2010. Development and application of a human
reliability assessment model for mine dispatchers in a Romanian hard coal
basin. WSEAS Transactions on Environment and Development 6 (6), 395404.
Nichols, J.H. et al., 2004. Reducing medical errors through barcoding at the point of
care. Clinical Leadership Management Review 18 (6), 328334.
NUREG, 2000. Technical Basis and Implementation Guidelines for A Technique for
Human Event Analysis (ATHEANA). NUREG 1624 Rev. 1. U.S. Nuclear
Regulatory Commission, Washington, DC.
256
Olcer, A.I., Odabasi, A.Y., 2005. A new fuzzy multiple attributive group decision
making methodology and its application to propulsion/maneuvering system
selection problem. European Journal of Operational Research 166, 93114.
Reichert, T.A., 2004. Applying Failure Mode and Effects Analysis (FMEA) in
Healthcare. Raleigh: 2004 Society for Health Systems Presentation.
Reiling, J.G., Knutzen, B.L., Stoecklein, M., 2003. FMEA the cure for medical errors.
Quality Progress 8, 6771.
Reinhart, R.O., 1996. Basic Flight Physiology, second ed. McGraw-Hill Pub, New
York.
Runkler, T.A., Glesner, M., 1993. A set of axioms for defuzzication strategies
towards a theory of rational defuzzication operators. In: Second IEEE
International Conference on Fuzzy Systems, pp. 11611166, San Diego.
Sankar, N.R., Prabhu, B.S., 2001. Modied approach for prioritization of failures in a
system failure mode and effects analysis. International Journal of Quality and
Reliability Management 18 (3), 324336.
Taghipour, S., Banjevic, D., Jardine, A.K.S., 2010. Reliability analysis of maintenance
data for complex medical devices. Quality and Reliability Engineering
International 27 (1), 7184.
URL1, 2011. SHELL Model of Human Factors. <http://wikiofscience.wikidot.com/
technology:shell-model-of-human-factors> (cited 01.01.12).
Wang, Y.M. et al., 2009. risk evaluation in failure mode and effects analysis using
fuzzy weighted geometric mean. Expert Systems with Application 36 (2), 1195
1207.
Wetterneck, T.B. et.al. 2004. Challenges with the Performance of Failure Mode and
Effects Analysis in Healthcare Organizations: An IV Medication Administration
HFMEA. In: The Annual Conference of the Human Factors and Ergonomics
Society, New Orleans.
Wu, C.T. et al., 2010. Government performance evaluation using a balanced
scorecard with a fuzzy linguistic scale. The Service Industries Journal 30 (3),
449462.