Professional Documents
Culture Documents
NIS81
EDITION 1 • MAY 1994
Contents
Section Page
1 Introduction 2
2 Concept of uncertainty 2
3 Steps in establishing an uncertainty budget 3
4 Compliance with specification 8
5 References 10
Appendix I Summary of equations used 11
Appendix II Examples of uncertainty budgets 12
1 Radiated emissions 12
2 Conducted emissions 14
3 Radiated immunity 15
Appendix III Calculation of hp 17
Appendix IV Calculation of uncertainty in logarithmic or
linear quantities 18
© Crown Copyright 1994
NAMAS Executive, National Physical Laboratory, Teddlngton, Middlesex; TW11 OLW j England
Tel: 081';;9437140 Fax: 081-943 7134 Telex: 262344 N~L G
1 Introduction
1. 1 The general requirements for the estimation and reporting ofuncertainty are
given in the NAMAS Accreditation Standard, M10. General gUidance on the
estimation and reporting of uncertainties in testing is given in NAMAS
publication, NISBO. This publication provides specific gUidance on the
application of the principles set out in NISBO for laboratories seeking or
holding NAMAS accreditation for EMC testing.
2 Concept of uncertainty
2.1 When a measurement is made the result will be different from the true or
theoretically correct value. This difference is the result of an error in the
measured value and it should be the aim of the measurement process to
minimise this error. In practice the extent to which this can be achieved may
be limited and a statement of uncertainty is used to reflect the
quality/ accuracy of the measured result as compared with the true value.
A statement of uncertainty is incomplete without an accompanying
statement of the confidence that can be placed in the value of the
uncertainty.
2.2 Uncertainties arise from random effects and from imperfect correction for
systematic effects. The recommendations ofthe InteITlational Committee for
Weights and Measures (CIPM)[l], which will be followed by NAMAS, are that
uncertainty components be grouped into two categories, based on their
method of evaluation. These categories are referred to as Type A and Type B.
3.2.1 Random effects result in errors that vary in an unpredictable way while the
measurement is being made or is repeated under the same conditions. The
uncertainty associated with these contributions can be evaluated by
statistical techniques from repeated measurements. An estimate of the
standard deviation, s(qJ, of a series of n readings, qk' is obtained from:
(1)
1 ~ -2
( Lt (qk-q)
--1)
n k-)
s(q) (2)
3.2.3 Practical considerations will normally mean that the number of repeat
readings will be very small and will often be limited to only a single reading.
It is satisfactory to use a predetermination of S(qk) for the measurement
system, based on a larger number of repeats, provided the system, method,
configuration and conditions etc. are truly representative of the test.
However, such a predetermination will not include the contributions of the
particular EUT. The value of n to be used to obtain s( q) under these
circumstances is the number of measurements made in the process of
testing and not the number of measurements made in the predetermination.
Repeat measurements should be undertaken when the measured result is
close to the specification limit.
3.2.5 A value for the random contributions of the measurement system is in any
case an essential part of the uncertainty assessment and a type A evaluation
should be made on the 'typical' processes and configuration involved in the
test. For example, in the case of open site measurements, the type A
evaluation could include reconnecting the antenna and receiver and
adjusting the antenna height to maximise the receiver reading.
3.3.1 Contributions to uncertainty arising from systematic effects are those that
remain constant while the measurement is being made but can change if the
measurement conditions, method or equipment is altered. If there is any
doubt about whether a contribution is significant it should be included in
the uncertainty budget in order to demonstrate that it has been considered.
3.3.2 Normally, all corrections that can be applied to the measured result should
be applied. However, in some cases it may be impractical or unnecessary to
correct for all known errors. For example. the calibration certificate for an
EMC receiver may give actual measured input results at specific readings.
with an associated uncertainty. It is possible to correct subsequent readings
by using this calibration to achieve the lowest possible uncertainty. However.
it is more practical to use indicated values with no corrections applied, in
which case the manufacturer's specified uncertainty should be used,
provided it has been confirmed by an accredited calibration or, where this
is not obtainable, a route acceptable to NAMAS.
3.3.6 The basis of the RSS approach relies upon uncorrelated contributions. The
judicious selection of test equipment and measurement method can ensure
that adverse correlation between individual contributions is avoided or
minimised. If adverse correlation between any contributions is known or
suspected then the most straightforward approach is to sum the standard
uncertainty of these contributions arithmetically. In some situations it is
necessary to use the same items of test equipment for different steps in the
measurement process. For example, in the pre-calibration for radiated
immunity measurements it is essential that the same transmit antenna is
used for the calibration and testing.
3.4. I Normal:
uncertainty
For Normal Distributions: utXI) = ---:---..::..
k
(4)
3.4.2 Rectangular:
This distribution means that there is equal probability ofthe true value lying
anywhere between the prescribed limits. A rectangular distribution should
be assigned where a manufacturer's specification limits are used as the
uncertainty, unless there is a statement of confidence associated with the
specification, in which case a normal distribution can be assumed.
3.4.3 V Shaped:
M
For V-Shaped Distributions: (6)
.fi
PAGE 6 OF 18 EDITION 1 • MAY 1994
NIS 81 • TREATMENT OF UNCERTAINTY IN EMC MEASUREMENTS
The combined uncertainty, Ue(y), is obtained by taking the square root of the
sum of squares of the individual standard uncertainties. If any of the
standard uncertainties are not already in tenns of the measured quantity
then they should be converted using the appropriate functional relationship.
Cl' for example, the uncertainty in the measurement distance on an open
site should be converted to the uncertainty in the received signal strength,
then:
(7)
(8)
The result of the measurement, after all approprtate corrections have been
made, is y and may typically be reported as follows:
Alternatively an overall uncertainty may be given for results that are plotted
or tabulated.
4.2 For some products and circumstances it may be appropriate for the user to
make a judgement of compliance based on whether the measured result is
within the specified limits, with no account taken of the uncertainty. This
is sometimes referred to as "shared rtsk" since the end user takes some of
the risk of the product not meeting the specification. The implications of
such a rtsk will vary considerably. It may be acceptable to ignore
measurement uncertainty for non-safety crttical performance, such as the
EMC immunity characteristics of radio and television for example, but when
testing a heart pacemaker or the ADS system on a vehicle the user may
require that the risk of the product not complying is negligible. In which
case the uncertainty must be taken into account.
4.3 EMC testing is carried out on a very wide range of products intended for a
vartety of applications. It is not therefore possible, or appropriate, for
NAMAS to recommend standard rules for judging compliance. If a test
specification lays down the criteria then this should be followed, but this is
a rare occurrence. If there is a recognised agreement, between
regulatory/ certification bodies and manufacturers for instance, then this
can be followed but again this is not common. If neither the test
specification nor regulatory bodies set down rules for compliance then the
gUidance given in this publication should be followed.
TA
TA 1
upper
limit ---+- A
1
T
A 1
1
The product complies The measured result Is The measured result Is The product does not
below the specification above the specification comply
limit by a margin less limit by a margin less
than the measurement than the measurement
uncertainty: It Is not uncertainty; It Is not
therefore possible to therefore possible to
determine compliance at determine compliance at
a level of confidence of a level of confidence of
95%. However, the 95%. However. the
measured result measured result
Indicates a higher Indicates a higher
probability that the probability that the
product tested complies product tested does not
wtth the specification comply wtth the
limit. specification limit.
5 References
(1) Guide to the Expression of Uncertainty in Measurement. BIPM, IEC. IFCC,
ISO. IDPAe, IDPAP, OIML. International Organisation for Standardization,
Geneva. Switzerland, ISBN 92-67-10188-9, First Edition, 1993
(5) Guide to the evaluation and expression oJuncertainties associated with the
results of electrical measurements. Def Stan 0026/lssue 2 Sept 1988.
(6) Uncertainties in the measurement of mobile radio equipment characteristics.
ETSI Technical Report, ETR028, March 1992. .
(7) Hams, LA. and Warner, F.L. Re-examination oJmismatch uncertainty when
measuring power and attenuation. lEE Proc. Vol 128 Pt H No.l February
1981.
APPENDIX I
1 ~ - 2
--1)
( L (qk - q)
n k-I
s(q)
9. expanded uncertainty:
APPENDIXll
Example 1
Uncertainty (dB)
Probability
81conlcal Antenna Log periodic
Contribution Distribution
Antenna
3m lOm 3m lOm
Ambient signals - - - -
Antenna factor calibration normal (k = 2) ±1.0 ±1.0 ±1.0 ±1.0
Antenna factor variation with height rectangular ±2.0 ±2.0 ±0.5 ±0.5
Mismatch
Receiver VRC: r l= 0.2
Antenna VRC: r e= 0.67 (81) 0.3 (Lp) U-shaped +1.1 +1.1 ±0.5 ±O.5
Uncertainty limits 20Log(l±r1r e) -1.25 -1.25
System repeatablllty (previous assessment Std Deviation ±0.5 ±O.5 ±0.5 ±0.5
of s(q,J from 5 repeats. 1 reading on EUT)
Repeatablllty of EUT • - - - -
Combined standard uncertainty u,,(y) normal +2.19 +2.16 +2.52 +1.74
-2.21 -2.20 -1.82 -1.72
In this example it is probable that uc(y) / S(qk) > 3, unless the repeatability of the
EUT is particularly poor, and a coverage factor of k = 2 will ensure that the level of
confidence will be approximately 95%, therefore:
U = 2 uc(y) = 2 x ±2.19 = ±4.38 dB
1. 1 Ambient signals have not been considered in this budget since the
uncertainty will be very dependent on relative signal levels and will not affect
all frequencies equally. The effect on a measurement result due to ambient
signals should be assessed at the time measurement is made and, if
necessary, the uncertainty should be increased.
1.2 The antenna and cable will reqUire traceable calibrations for which an
uncertainty would have been estimated using NAMAS recommendations 1•
based on a normal probability distribution with k = 2.
1.4 The antenna factor uncertainty does not take account ofantenna directivity.
Unless a detailed analysis is made of all the variables and their effect on the
received signal, an estimation has to be made of the limit values and a
rectangular distribution assumed. The angle ofincidence with respect to the
antenna bore sight will generally be greater for a 3 m range. Since the
antenna calibration is with respect to bore sight it is reasonable to assume
that the actual signal strength will not be less than the indicated reading,
but could be higher by an unknown amount, resulting in an asymmetric
uncertainty .
1.5 The antenna factor may vary with height and since the height will not always
be the same in use as when the antenna was calibrated an additional
uncertainty is required. A calibration certificate from NPL will normally give
gUidance on the value for this contribution.
1.6 The phase centre for log periodic antennas will vary with frequency and is
not accounted for in calibration.
1.7 The uncertainty in the measurement distance will be relatively small but will
have some effect on the received signal strength. The increase in
measurement distance as the antenna height is increased is an inevitable
consequence of the method reqUired by most radiated emission specification
standards and is therefore not considered to be a contribution to
uncertainty.
1.8 Site imperfections are difficult to quantify but may include the following
contributions:
The specified limits for the difference between measured site attenuation and
the theoretical value (±4 dB) need not be included in total since the
measurement of site attenuation includes uncertainty contributions already
allowed for in this budget, such as antenna factor.
1.9 The contribution from repeatability of the EUT needs to be assessed at the
time. It would be reasonable to base this on repeat measurements at one
or two frequencies. There is no need to make an accurate assessment of the
repeatability of the EUT if the results are clearly well within the specification
limit.
Example 2
Mismatch
Receiver VRC: f l= 0.03
LlSN VRC: f a= 0.8 (9 kHz) 0.2 (30 MHz)
Uncertainty limits 20Log(l±f.fa) U-shaped 0.2 0.05
System repeatablllty (previous assessment of standard dev. 0.2 0.35
S(qk) from 10 repeats. 1 reading on EUTl
Repeatabillty of EUT • - -
Combined standard uncertainty u.,(y) normal 1.26 1.30
2
'" ± + 0.2 + 0.2 2 '" ± 1.26 dB
-y
As with example 1 it is probable that uc(y) / S(qk) > 3 and k =2 will suffice.
therefore:
2.1 It is probable that there will be an attenuator at the receiver input, providing
a low VRC, so even though the LISN output is not close to son, particularly at
low frequencies, the mismatch uncertainty is relatively insignificant.
2.2 Since the two budgets produce almost the same total it would be sensible to
quote a single figure covertng the whole frequency range, say ±2.6dB.
Example 3
Radiated ElectIic Field Immunity Measurements at 3 V/m and 30 MHz to 300 MHz.
Uncertainty (±VIm)
Contribution Distribution
30 MHz - 300 MHz
Repeatabtlily of EUT • -
Combined standard uncertainty normal 0.35
since uc(y) / S(qk) < 3 Appendix III was used to obtain a value for k p
0.35 4
veJf = -0-.-3-:-4 --0-.-1-8-5....,..4 = 7.4
--:r- --00-
+
3.2 In this case the field strength monitor reading and the specification limit will
be in terms of V/m, while the monitor calibration uncertainty and the system
repeatability will most probably be given in dBs. It is recommended that the
uncertainty is calculated in terms of V/m if this how the specification limit is
defined, however, if the calculation is made in dBs the difference in this case
is insignificant.
3.3 In order to determine the probability of compliance at a level of confidence of
95% it is necessary to test at a field strength of 3.84 V/m (specification level
+ 0.84 V/m). If a failure is detected at this level but not at the specification
limit this is equivalent to case B in section 4.5, case C occurs when the
product fails at a level of 3.0 - 0.84 = 2.16 V/m and above.
3.4 The system repeatability should be based on repeat measurements of the field
uniformity calibration, including re-positioning the transmit antenna and
resetting the input power level, at a number of field monitor locations and
frequencies.
• A value for the uncertainty attributable to the equipment under test is not
included in these examples. It will need to be considered dUring the testing
and included in the uncertainty of the test if it is a significant contribution.
APPENDIX "I
Calculation of k p
When random errors in a measurement system are comparable to the systematic
errors the expanded uncertainty calculated using equation (8) may be an
underestimation, unless a large number of repeat readings have been made.
U:(y)
velf = -:-----..,..---:-------:--
u~(y) ui(y) r.4(y) ~(y)
- - + - - + - _...... + - -
VI v2 v3 vm
The degrees of freedom, Vt' of the standard uncertainties based on type B evaluation
can be assumed to be infmite in most cases. For standard uncertainties obtained
from a type A evaluation V t = n - 1, where n is the number of readings used to
calculate S(qk)'
The value of ~ is obtained from t-distribution tables for the appropriate level of
confidence. The following table gives values of ~ for various degrees of freedom vel[
for a level of confidence of 95%, (actually 95.45%). Values of k p for other levels ot
confidence are. given in reference [1]
Veil
kp
1
13.97
2
4.53
3
3.31
4
2.87 2.65
5
2.52
6
2.43
7 8
2.37
10
2.28
20
2.13
50
2.05
-
2.0
The criteria given in para 6.3 to detennine the need to use the procedure given in
this Appendix is based on the conclusion that if uc(y) / u(CJk ) > 3 and all the other
contributions are assumed to have infinite degrees of freedom, then velf > 81 (3 4 ),
giving a value for ~ of less than 2.05, which can be approximated by k = 2.
APPENDIX IV
which is in a form that can be treated by the RSS approach. However, by taking
logs of equation IV(2) then:
10g[1 ± V] = 10g[1 ± u(xt )] + 10g[1 ± u(X2)] + 10g[1 ± u(-X3)] + 10g[1 ± u(xJ] IV(4)
this is a more exact expression for the total uncertainty than equation IV(3) and is
also amenable to RSS treatment. However, if u(Xil in linear terms is relatively large
then:
log[ 1 + u(xl)) :I' log[l - u(xJ] IV(5)