Professional Documents
Culture Documents
Medical Products
PHARMACEUTICALS
DENTAL
DRUG DELIVERY
SYSTEMS
PERSONAL CARE
AGENDA
Acceptance Sampling Plan Basics
Sampling Plans to Meet Validation
Objectives
Sampling Plans and Statistics
Throughout Validation Lifecycle
Interactive Exercises (Throughout)
J.L. Schroeder , 3M, March 2014
Acceptance Sampling
Plan Basics
Sampling Plans
A sampling plan is a
procedure for making
accept/reject decisions:
Take 300 samples from a lot
and accept if there are zero
defects
Count a
ACCEPT
Compare
count to
accept
number
a
Count > a
REJECT
N=100
Sampling Plans
Devised to serve different purposes:
Neubauer Acceptance
Sampling Facts
(LTPD, )
Specify a Plan
Two points on OC Curve (AQL, 1-) (LTPD, )
Four values may be used to characterize the
OC curve
AQL = Acceptable Quality Level
RQL or LTPD = Reject Quality Level or Lot
Tolerance Percent Defective
= Producers Risk
Sampling Risks
= Consumer Risk
1
Single: n=30, a=0
Single: n=300, a=0
0.5
0
0
10
Percent Defective
Resource: Dr. Wayne Taylor
Validation Sampling Plan Class
- 2008
0.18
~25%
Producers =0.05
Consumers
= 0.05
(AQL, 0.95)
(LTPD, 0.05)
Sampling Risk
Summary
Purpose of a sampling plan is to make
accept/reject decisions
Sampling Plans can serve many different
purposes (i.e. consumer/producer
protection, compliance sampling)
Every sampling plan has its own OC curve
that defines protection
OC Curve Defined by Two Points
(AQL, 1-)
(LTPD, )
J.L. Schroeder, 3M, March 2014
Representative Sample
Obtaining a representative sample for
validation is more difficult than obtaining a
representative sample in manufacturing
Want sample that is representative of all
, not just one lot:
3 lots
Manufactured under what regulations call
anticipated conditions (material lots,
operators, setups, tooling, )
Resource: Dr. Wayne Taylor
Validation Sampling Plan Class 2008
Objective of Validation
Demonstrate that the product or process
consistently meets pre-determined
performance requirements
A sampling plan can be used to demonstrate
that a required performance level is met with
certain confidence (AQL, LTPD, alpha, beta)
What is AQL?
What is routinely accepted
AQL
.05 or .10
LTPD
Confidence Statements
Validation sampling plans are designed to
demonstrate that the product or process
meets a specified performance level with
certain confidence:
Confidence Statement General Form:
With 95% confidence the requirement is
met
Confidence Levels must be documented in validation procedures
Resource: Dr. Wayne Taylor
Validation Sampling Plan Class 2008
Summary
A sampling plan can be used to
demonstrate that a required
performance level is met with certain
confidence
Passing the plan n=300, a=0 allows one to
state: With 95% confidence the defect
level is below 1% defective.
Summary
(AQL, 0.95)
= =0.05
AQL=.72
LTPD.05=9.1
Design/Process
Development
Validation Plan
Installation Qualification
Document (IQ)
Operational Qualification
Document (OQ)
Statistically Designed
Experiments
Performance Qualification
Document (PQ)
Cont. Process
Verification
Design
Qualification
Risk
Assessment
Equipment
Qualification
Design
Verification
- PPU
Process
Validation
Control
Step 1:
Risk
Critical
Major
Minor
OQ
5% (95% Conformance)
10% (90%
Conformance)
20% (80%
Conformance)
PQ
1% (99% Conformance)
3% (97% Conformance)
5% (95% Conformance)
Key Points
In order to pass a validation study
,
the process must be significantly
better than the validation performance level
Answered by AQL:
If my process is good, what are the chances of
passing the validation study?
Resource: Dr. Wayne Taylor
Validation Sampling Plan Class 2008
Interactive Excercise
The table shows how the sample size depends on the
selected performance level and confidence level
IN CLASS EXERCISE ANSWER THE FOLLOWING:
With 95% confidence the defect rate is below 5% defective. How
many samples free of defects does this require?
With 90% confidence the defect rate is below 1% defective. How
many samples free of defects does this require?
Resource:
Dr. Wayne
Taylor
Validation
Sampling
Plan Class 2008
Performance Level
20%
n = 10, a = 0
n = 14 , a = 0
10%
n = 22, a= 0
n = 28 , a = 0
6.5%
n = 34, a = 0
n = 45 , a = 0
5%
n = 45 , a = 0
n = 60 , a = 0
4%
n = 56 , a = 0
n = 75 , a = 0
3%
n = 75 , a = 0
n = 100 , a = 0
2.5%
n = 90 , a = 0
n = 120 , a = 0
1.5%
n = 150 , a = 0
n = 200 , a = 0
1%
n = 230 , a = 0
n = 300 , a = 0
0.65%
n = 350 , a = 0
n = 460 , a = 0
0.4%
n = 575 , a = 0
n = 750 , a = 0
0.3%
n = 770, a = 0
n = 1000 , a = 0
0.25%
n = 920 , a = 0
n = 1200 , a = 0
0.15%
n = 1530 , a = 0
n = 2000 , a = 0
0.1%
n = 2300 , a = 0
n = 3000 , a = 0
0.065%
n = 3540 , a = 0
n = 4600 , a = 0
Step 2:
Digress
START
Take a representative
sample of n1 units and
count number of defectives
Count a1
Compare
count
ACCEPT
Count r1
REJECT
ACCEPT
Compare
count
Count > a2
REJECT
Interactive Exercise
Which LTPD.05 Plan is Best?
1
Pa
AQL HigherChances of
Passing Are Better
0.5
0
0
Percent Defective
Defective/Nonconforming Units
Single: n=300, a=0
Single: n=630, a=2
Double: n1=325, a1=0, r1=3, n2=580, a2=3
J.L. Schroeder , 3M, March 2014
LTPD = 1%
(Attribute 95% Confidence)
Sampling Plan
AQL
LTPD0.05
n=300, a=0
0.02%
1%
n=470, a=1
0.08%
1%
0.09%
1%
n=630, a=2
0.13%
1%
0.15%
1%
n=770, a=3
0.18%
1%
0.18%
1%
Assumptions:
Representative Sample
Measurements are Normally Distributed:
Should formally test for normality
Multiple lanes, multiple positions, may cause
non normal data sublott by position
Transform data to normal or find best non
normal distribution
J.L. Schroeder , 3M, March 2014
LSL
2.3%
Out of Spec
50
51
52
53
54
55
Numerator
LSL
Denominator
Target
J.L. Schroeder , 3M, March 2014
USL
Interpreting Ppk
Ppk
Defect Level)
1.5
Distance From
Spec
4.5
1.33
32 dpm
1.167
3.5
233 dpm
0.14%
0.833
2.5
0.62%
0.78
2.3
0.89%
0.67
2.3%
0.5
1.5
6.7%
3.4 dpm
Is Ppk Ppk
ACCEPT
Resource: Dr. Wayne Taylor
Validation Sampling Plan Class 2008
Yes
No
REJECT
Normality Assumption
Requires separate normality test
Normal probability plot or histogram alone
are not enough.
Data must be in control for future process
predictions.
Step 2:
Step 2:
Step 2:
AQL
LTPD0.05
n=300, a=0
0.017%
1.0%
n=470, a=1
0.076%
1.0%
n=630, a=2
0.13%
1.0%
n=770, a=3
0.18%
1.0%
LTPD0.05 = 1% Plans
Pa
Defective/Nonconforming Units
Single: n=300, a=0
Single: n=470, a=1
Single: n=630, a=2
Single: n=770, a=3
0.5
0
0
Percent Defective
AQL
LTPD0.05
n=15, Ppk=1.17
0.00017% (Ppk=1.55)
1% (Ppk=0.78)
n=20, Ppk=1.10
0.0012% (Ppk=1.41)
1% (Ppk=0.78)
n=30, Ppk=1.02
0.008% (Ppk=1.26)
1% (Ppk=0.78)
Process Ppk
estimate (accept
95% of time)
Ppk value
that will fail
LTPD = 1%
(Variables 1-sided 95% Confidence)
Sampling Plan
AQL
LTPD0.05
n=15, Ppk=1.17
0.00017% (Ppk=1.55)
1% (Ppk=0.78)
n=20, Ppk=1.10
0.0012% (Ppk=1.41)
1% (Ppk=0.78)
n=30, Ppk=1.02
0.008% (Ppk=1.26)
1% (Ppk=0.78)
n=40, Ppk=0.98
0.02% (Ppk=1.18)
1% (Ppk=0.78)
n=50, Ppk=0.95
0.04% (Ppk=1.12)
1% (Ppk=0.78)
n=60, Ppk=0.94
0.05% (Ppk=1.10)
1% (Ppk=0.78)
n=80, Ppk=0.91
0.09% (Ppk=1.04)
1% (Ppk=0.78)
n=100, Ppk=0.89
0.13% (Ppk=1.01)
1% (Ppk=0.78)
LTPD = 1%
(Variables 2-sided 95% Confidence)
Sampling Plan
AQL
LTPD0.05
0.00016% (Ppk=1.55)
1% (Ppk=0.78)
0.001% (Ppk=1.42)
1% (Ppk=0.78)
0.007% (Ppk=1.27)
1% (Ppk=0.78)
0.018% (Ppk=1.19)
1% (Ppk=0.78)
0.033% (Ppk=1.13)
1% (Ppk=0.78)
0.044% (Ppk=1.11)
1% (Ppk=0.78)
0.08% (Ppk=1.05)
1% (Ppk=0.78)
0.11% (Ppk=1.02)
1% (Ppk=0.78)
Interactive Exercise
Suppose:
2-sided
LTPD.05 = 1%
Have data
where
Ppk = 1.06
Sampling Plan
AQL
LTPD0.05
0.00016% (Ppk=1.55)
1% (Ppk=0.78)
0.001% (Ppk=1.42)
1% (Ppk=0.78)
0.007% (Ppk=1.27)
1% (Ppk=0.78)
0.018% (Ppk=1.19)
1% (Ppk=0.78)
0.033% (Ppk=1.13)
1% (Ppk=0.78)
0.044% (Ppk=1.11)
1% (Ppk=0.78)
0.08% (Ppk=1.05)
1% (Ppk=0.78)
0.11% (Ppk=1.02)
1% (Ppk=0.78)
Step 3:
Document Sampling Plan
and Analysis Methods in Protocol
Document in Protocol
Test method, products to be tested, and specifications
(variables or attribute data)
Worst case product(s)
Step 3:
Document Sampling Plan
and Analysis Methods in Protocol
Example
Interactive Exercise
LTPD = 1%
Attribute Plans with 90% Confidence
Type
Parameters
AQL
LTPD0.1
Type
Parameters
AQL
LTPD0.05
Single
n=230, a=0
0.02%
1%
Single
n=300, a=0
0.02%
1%
Single
n=390, a=1
0.09%
1%
Single
n=470, a=1
0.08%
1%
Double
0.11%
1%
Double
0.09%
1%
Single
n=530, a=2
0.15%
1%
Single
n=630, a=2
0.13%
1%
Double
0.18%
1%
Double
0.15%
1%
Single
n=670, a=3
0.20%
1%
Single
n=770, a=3
0.18%
1%
Double
0.21%
1%
Double
0.18%
1%
Parameters
AQL
LTPD0.05
Parameters
AQL
LTPD0.05
n=15, P pk =1.17
1% (Ppk =0.78)
1% (P pk=0.78)
n=20, P pk =1.10
1% (Ppk =0.78)
0.001% (P pk =1.42)
1% (P pk=0.78)
n=30, P pk =1.02
0.008% (P pk =1.26)
1% (Ppk =0.78)
0.007% (P pk =1.27)
1% (P pk=0.78)
n=40, P pk =0.98
0.02% (P pk =1.18)
1% (Ppk =0.78)
0.018% (P pk =1.19)
1% (P pk=0.78)
n=50, P pk =0.95
0.04% (P pk =1.12)
1% (Ppk =0.78)
0.033% (P pk =1.13)
1% (P pk=0.78)
n=60, P pk =0.94
0.05% (P pk =1.10)
1% (Ppk =0.78)
0.044% (P pk =1.11)
1% (P pk=0.78)
n=80, P pk =0.91
0.09% (P pk =1.04)
1% (Ppk =0.78)
0.08% (P pk =1.05)
1% (P pk=0.78)
0.13% (P pk =1.01)
1% (Ppk =0.78)
0.11% (P pk =1.02)
1% (P pk=0.78)
L C R
Step 4 & 5
Execute Sampling Plan given in Protocol
Document Results and Conclusion in Final Report
EXAMPLE
PQ Analysis
Process Capability Sixpack of Lot 1 Grouped
Sample M ean
Xbar Chart
Capability Histogram
UCL=1.2199
LSL
Specifications
LSL 1
1.20
_
_
X=1.1483
1.15
1.10
LCL=1.0766
1
11
13
15
17
19
Sample Range
R Chart
1. Is Normality an
issue with the Grouped
Data?
0.2
UCL=0.1804
0.1
_
R=0.0701
0.0
LCL=0
1
11
13
15
17
19
1.0
Within
StDev 0.04139
Cp
*
Cpk
1.19
PPM
170.42
1.15
1.10
5
10
1.1
1.2
1.3
Capability Plot
Last 20 Subgroups
1.20
V alues
15
20
Within
O verall
Overall
StDev 0.03836
Pp
*
Ppk
1.29
Cpm
*
PPM
55.65
Specs
Sample
Distribution
Analyzer at
www.variation.com
Distribution
Analyzer
Capability Histogram
Sample M ean
UCL=1.1797
LSL
S pecifications
LS L 1
1.16
_
_
X=1.1235
1.12
1.08
LCL=1.0673
1
11
13
15
17
19
1.00
1.04
Sample Range
R Chart
1.08
1.12
1.16
1.20
1. Is Normality an
issue with the Grouped
Data?
A D : 0.597, P : 0.116
0.16
UCL=0.1414
0.08
_
R=0.0549
0.00
LCL=0
1
11
13
15
17
19
1.0
Last 20 Subgroups
1.15
1.10
5
10
15
20
Sample
Distribution
Analyzer at
www.variation.com
1.1
1.2
Capability Plot
Within
StDev 0.03245
Cp
*
Cpk
1.27
PPM
70.59
1.20
V alues
Within
Ov erall
Specs
Overall
StDev 0.03598
Pp
*
Ppk
1.14
Cpm
*
PPM
299.16
Distribution
Analyzer
Xbar Chart
Capability Histogram
UCL=1.2212
LSL
1.20
S pecifications
LS L 1
_
_
X=1.1293
1.12
1.04
LCL=1.0374
1
11
13
15
17
19
1.00
1.05
1.10
Sample Range
R Chart
1.15
1.20
1.25
UCL=0.2313
0.2
_
R=0.0898
0.1
0.0
LCL=0
1
11
13
15
17
19
1.0
Last 20 Subgroups
V alues
1.20
1.12
1.04
10
15
20
Sample
Distribution
Analyzer at
www.variation.com
1.2
1.3
Capability Plot
Within
StDev 0.05306
Cp
*
Cpk
0.81
PPM
7423.40
1.1
1. Is Normality an
issue with the Grouped
Data?
W ithin
O v erall
Overall
StDev 0.05365
Pp
*
Ppk
0.80
Cpm
*
PPM
7983.88
Specs
Distribution
Analyzer
Step 5
Results: Validation Report
Data
Analysis and Conclusions
Was acceptance criteria met?
Did validation pass?
What confidence statement can be made if
criteria was met?
Step 5
Results: Validation Report Example
ABC
XYZ
Questions?
Contact Information
Jacalyn L. Schroeder 3M Company
Title: Statistician, Process Validation/Quality
Specialist
E-mail: jlschroeder2@mmm.com
Work Phone: 605-696-1355
References
1. Dr. Wayne A. Taylor, Guide to Acceptance Sampling,
version 1, www.variation.com, Taylor Enterprises,Inc.
Note: Version 2 of new book 2013-2014.
2. GHTF/SG3/N99-10:2004 (Edition 2) , Quality
Management Systems - Process Validation Guidance,
January 2004
3. Acceptance Sampling in Quality Control, 2nd edition,
Schilling & Neubauer
4. Validation Sampling Plan Course, Wayne Taylor, March
2008
5. Acceptance Sampling and Control Class, Neubauer, 2012
6. Standards: ANSI Z1.4, ANSI Z1.9, ISO 2859-1, ISO 39511
7. Schilling/Johnson, Tables for the Construction of
Matched Single, Double, and Multiple Sampling Plans
with application to MIL-STD-105D, Journal Quality
Technology, October, 1980