You are on page 1of 7

J Clin Epidemiol Vol. 47, No. I, pp.

81-87, 1994
Copyright 0 1994 Elsevier Science Ltd
Pergamon 0895-4356(93)EOO2O-C Printed in Great Britain. All rights reserved
08954356/94166.00
+ 0.00

DETERMINING A MINIMAL IMPORTANT CHANGE IN A


DISEASE-SPECIFIC QUALITY OF LIFE QUESTIONNAIRE

ELIZABETH F. JUNIPER,‘* GORDON H. GuYA’rr,‘*Zt ANDREW WILLAN’ and


LAUREN E. GRIFFITH’
‘Department of Clinical Epidemiology and Biostatistics and 2Department of Medicine, McMaster
University Medical Centre, Hamilton, Ontario, Canada

(Received 31 May 1993)

Abstract-This study was carried out to determine whether the minimal important
difference, in evaluative quality of life instruments which use a 7-point scale, is similar
across individual domains and for both improvement and deterioration. Thirty nine
adults with asthma were studied, using an 8 week cohort with assessments at 0, 4 and
8 weeks. The outcomes were the Asthma Quality of Life Questionnaire and global rating
of change. For overall asthma-specific quality of life and for all individual domains
(activities, emotions, symptoms), the minimal important difference of quality of life
score per item was very close to 0.5 (range: 0.42-0.58); differences of approximately 1.O
represented a moderate change (range: 0.77-1.51); differences greater than 1.5 rep-
resented large changes. Changes for improvement and deterioration were very similar.
The changes in quality of life score that represent a minimal important difference are
very similar to those observed for other evaluative instruments. The observation that
the minimal important difference is consistent across domains and for both improve-
ment and deterioration will facilitate interpretation of results of studies examining
quality of life.

Quality of life Asthma

INTRODUCTION professionals seldom use quality of life measures


in clinical practice. In clinical trials, where qual-
Repeated experience with a wide variety of
ity of life instruments are being used increasingly
physiological measures allows clinicians to
as primary outcome measures, it is simple to
make meaningful interpretation of results.
determine the statistical significance of changes
For instance, experienced clinicians have
in quality of life but placing the magnitude of
little difficulty interpreting a 10mmHg fall
these changes in a context that is meaningful for
in diastolic blood pressure or a 0.5 litre increase
health professionals has not been so easy.
in forced expiratory volume in one second
Ascertaining the magnitude of change that
(FEV,). In contrast, the meaning of a change
corresponds to a minimal important difference
in score of 1.0 on a quality of life instrument
would help to address this problem. The mini-
is less intuitively apparent, not only because it
mal important difference can be defined as “the
has no familiar units, but also because health
smallest difference in score in the domain of
interest which patients perceive as beneficial and
*Requests for reprints and the questionnaire should he
addressed to: Elizabeth Juniper MCSP MSc., Depart- which would mandate, in the absence of trou-
ment of Clinical Epidemiology and Biostatistics, Mc- blesome side-effects and excessive cost, a change
Master University Medical Centre, 1200 Main Street in the patient’s management” [I]. A variety of
West, Hamilton, Ontario, Canada L8N 325.
tDr Guyatt is a Career Scientist of the Ontario Ministry of methods has been proposed for estimating the
Health. minimal important difference [2]. In this study,

81
82 ELIZABETHF. JUNIPERet al.

we have focused on one of these methods Asthma Quality of Life Questionnaire


which relates change in quality of life scores to The Asthma Quality of Life Questionnaire
patients’ estimate of their global rating of change. contains 32 items in four domains: activities (12
Seven point scales are frequently used as items, 5 of which are individualized), asthma
response options in disease-specific quality of symptoms (11 items), emotional function (5
life instruments that have been developed for items) and environmental exposure (4 items) [7,
assessing within-subject change over time (eval- Appendix]. Patients are asked to indicate how
uative instruments) [3]. During the validation they have been during the previous 2 weeks.
studies for the Chronic Respiratory Question- Response options are presented as 7-point
naire [4] and the Chronic Heart Failure Ques- scales. We have demonstrated that the question-
tionnaire [5], pooled results suggested that a naire is reproducible when patients are stable
change in mean score of 0.5 may be considered (intraclass correlation coefficient of 0.92) [8].
the smallest difference which the patient per- The questionnaire has proved responsive in
ceives as beneficial and hence can be considered before-after studies [8,9] and in clinical trials
the minimal important difference [l]. This value [lo]. Construct validity has been supported by
was substantiated by further work in random- significant relationships with both conventional
ized trials in individual subjects [6]. In this measures of asthma severity and generic quality
study, we have investigated whether similar of life instruments [S, 91.
changes in score in the newly validated Asthma We calculate scores on the questionnaire do-
Quality of Life Questionnaire [7] also represent mains as averages of all items on that domain.
a minimal important difference. If so, this would Scores thus have a range of l-7.
suggest that similar evaluative quality of life
instruments, which present response options as Global Rating of Change Questionnaires
7-point scales, would show similar measurement Four global questions were used to classify
characteristics, thus making it unnecessary to patients according to whether they had im-
determine the magnitude of the minimal import- proved or deteriorated. The questions were
ant difference in every new instrument. We have worded as follows: “Since your last clinic visit,
also investigated whether the significance of has there been any change in activity limitation/
improvements are similar to those of deterio- symptoms/emotions/overall quality of life, re-
ration and have estimated whether the magni- lated to your asthma?“. If patients indicated
tude of the important change for the instrument that there had been no change, they were given
as a whole is similar to that of each of the a score of zero. If they indicated that there had
individual domains. been an improvement or a deterioration, they
were asked to score the change on the following
MATERIALS AND METHODS scale:
Subjects
-7 A very great deal worse
Thirty nine adults with symptomatic asthma -6 A great deal worse
participated in the study. If asthma symptoms -5 A good deal worse
were inadequately controlled at either the first -4 Moderately worse
or second visits, inhaled steroids were either -3 Somewhat worse
added or increased above the current treatment -2 A little worse
regimen. The subjects were selected to represent -1 Almost the same, hardly any worse at all
a wide range of clinical asthma severity and 0 No change
airway hyperresponsiveness (Table 1). 1 Almost the same, hardly any better at all
2 A little better
Study design
3 Somewhat better
Subjects were evaluated on three occasions, 4 Moderately better
each assessment being separated by 4 weeks. At 5 A good deal better
each visit, the Asthma Quality of Life Question- 6 A great deal better
naire was administered and at the two follow-up 7 A very great deal better
visits Global Rating of Change Questionnaires
were completed for the domains of activities, During each clinic visit, patients completed
asthma symptoms and emotional function as two generic quality of life questionnaires and a
well as for overall asthma-related quality of life. clinical asthma questionnaire. A methacholine
Minimal Important Difference 83

Table 1. Patient characteristics - 1 (Almost the same, hardly any worse at ail)
Number and 1 (Almost the same, hardly any better at all)
Age, yr (SD) :;.0 (13.7)
24115
should be classified as fundamentally un-
Gender F/M
FEV,% pred. (SD) 84.8 (14.2) changed, or having experienced a small but
PC,, mg/ml (range) 1.16(0.03-15.9) important change. This disagreement led us to
Medication requirements-number ponder the issue further, and before analyzing
No medications 2 the current data set, we decided to reverse our
Bronchodilators only 8
Inhaled steroid and bronchodilators 29 prior decision and count those scoring - 1 and
Baseline quality of life scores-mean and (SD)
1 as unchanged. Fortunately, only a very small
Activities 5.21 (0.97) proportion (2%) of those who were classified as
Symptoms 4.97 (1.01) unchanged chose - 1 or 1, and this was also true
Emotions 5.17(1.14)
4.99 (1.22)
in prior studies.
Environment
Overall Quality of Life 5.07 (0.86) For the three domains of the Asthma Quality
of Life Questionnaire (activities, symptoms and
emotions), the scores have been compared with
inhalation test was conducted. In order to maxi- their corresponding global ratings of change.
mize independence of response, the Asthma There was no global rating of change for prob-
Quality of Life Questionnaire was always com- lems experienced as a result of environmental
pleted at the beginning of the visit and the exposure, and we have therefore omitted the
global rating questions were completed at the environmental domain from further consider-
end. ation.
In the analysis, data from the two time inter-
Statistical analysis vals were combined. For the present analysis,
We calculated the change in mean item score combining the data assumes only that the re-
for each domain of the Asthma Quality of Life lationship between the Global Ratings of
Questionnaire for each patient for each time Change and the Asthma Quality of Life Ques-
interval. Change in overall quality of life was tionnaire were similar during the two periods,
calculated from the mean of all the items. We which proved to be the case.
classified patients whose score on the Global
Rating of Change Questionnaire was 0, 1 or - 1
as unchanged. We considered patients whose RESULTS
score was 2, 3, - 2 or - 3 as having experienced Thirty nine subjects completed the first time
a small change equivalent to the minimal im- interval (visit l-visit 2) and 37 completed the
portant difference [l]. Those with scores of 4, 5, entire study. The two subjects who dropped out
-4 and - 5 were considered to have experi- did so for non-medical reasons. We present
enced moderate change and those with scores of demographic characteristics of the patients, and
6, 7, -6 and - 7 were considered to have the mean and standard deviation of the scores
experienced large change. In patients who re- on each of the four relevant domains and the
ported a change (global rating 22 or > -2) overall score of the questionnaire, in Table 1.
the change in quality of life scores was com- For patients who reported that they had not
bined by changing the sign of the scores for changed (global rating score = 0) or that they
those who deteriorated. had hardly changed at all (score = 1 or - l), the
The designation of what global ratings mean change in overall quality of life score was
suggest patients are fundamentally unchanged 0.11 with the individual domains ranging from
and what global ratings suggest patients have 0.07 to 0.20 (Table 2). For those indicating a
experienced a small but important improvement change of 2, 3, - 2 or - 3 on the global rating,
or deterioration is inevitably subjective and the mean change in quality of life score was 0.52
arbitrary. In our initial work [l, 61 we classified for overall quality of life, with the individual
patients as unchanged only if they said there was domains ranging from 0.42 to 0.58. As global
no change whatsoever. Patients were classified rating of change increased further there was a
as having small but important change if their corresponding increase in the mean change in
global rating was -1, -2 -3, 1, 2 or 3. In quality of life scores both overall and for all
presenting our results at scientific meetings and domains. For a moderate change (global rating
to our colleagues locally we have found dis- 4, 5, -4 and -5), the mean change in overall
agreement as to whether patients with ratings of asthma quality of life score was 1.03 and when

CE47:1-F
ELIZABETH
F. JUNIPERet al.

Table 2. Changes in quality of life scores vs global rating of change-better


and worse data combined
Quality of life Global rating of change
Mean change/item 2-3 45
Overall QGL 0.1 Ci.391’ 0.52 [0.41] 1.03 [0.62] 2.29Ti.711
(n = 38) (n = 10) (n = 23) (n = 5)
Activity limitation 0.12 [0.34] 0.47 [0.51] 0.87 [0.54] 1.83 [0.76]
(?I = 39) (n = 10) (n = 23) (n = 4)
Symptoms 0.20 [0.52] 0.49 [0.56] 1.13 [0.83] 2.21 [1.34]
(n = 23) (n = 23) (n = 21) (n = 9)
Emotional function 0.20 [0.87] 0.58 [0.56] 1.51 [1.23] 2.70 [1.56]
(n = 54) (n = 11) (n = 9) (?I = 2)
*Standard deviations in square brackets.

the change was large (global rating 6,7, -6 and extremely imprecise. Taking into account data
- 7), the mean change in overall asthma quality from the current study and previous work [ 1,6],
of life was 2.29. a change in score of greater than 1.5 is likely to
When improvement and deterioration were represent a large change. The results further
examined individually, the same pattern demonstrate that these interpretations apply not
emerged (Table 3). In patients who were con- only to the instrument as a whole but also to the
sidered to have experienced a minimal import- individual domains, and both to patients who
ant improvement (global rating 2 and 3), the improve and those who deteriorate.
overall change in quality of life score was 0.41 This is the third study to demonstrate that in
and for a minimally important deterioration disease-specific quality of life instruments, using
(global rating - 2 and - 3), the change in score ‘I-point scale response options, a change in score
was -0.62. For a moderate improvement, the of 0.5 represents the minimal important differ-
change was 1.10 and for a deterioration -0.93. ence [l, 51. The finding that comparable changes
For a large improvement, the change was 2.29 in score represent minimal, moderate and large
and for a deterioration the change was -2.67. changes across individual domains suggests that
A similar pattern was observed in all the indi- the results are generalizable to all areas of
vidual domains. health-related quality of life The importance of
this observation lies in the fact that health
professionals interpreting the results of health-
DISCUSSION related quality of life studies can apply the same
The results of this study demonstrate that, standards for judging the magnitude of effects
when using 7-point scale response options in the across a wide variety of instruments.
Asthma Quality of Life Questionnaire, a within- In some clinical trials, treatments may be
subject change in score of 0.5 represents the designed to affect only one domain of a quality
minimal important difference. A change in score of life instrument (e.g. a coping skills program
of 1.0 may be considered a moderate change in might be expected to focus primarily on
quality of life. Because only a small number of emotional function). Since the results were con-
patients had a large change in health-related sistent across domains and also consistent with
quality of life, the current study’s estimate of the overall score, changes of greater than 0.5 per
what constitutes a large change in score is item within an individual domain signifies an

Table 3. Change in quality of life scores vs global rating of change


Global rating of change

Quality of life Better Same Worse


Mean change/item 7&6 5&4 3&2 l&O&- 1 -2&-3 -4&L-5 -6&r-7
Overall QOL 2.19 1.10 0.41 0.11 -0.62 -0.93 -2.67
(n = 4) (n = 14) (n = 5) (n = 1)
Activity limitation 1.83 0.92 0.56 (Z!
(n=4) (n=l3) (n=5) (n-0.81
=‘lO) (!=oo,)
Symptoms 1.19 1.37 0.40
(n = 7) (PI= 12) (n = 8) (n = 2)
Emotional function 2.70 0.96 0.73
(n = 2) (n = 5) (n = 6) (n -= 0)
Minimal Important Difference 85

important improvement or deterioration in that 2. Guyatt GH, Feeny D, Patrick D. Proceedings of


the international conference on the measurement
aspect of quality of life. of quality of life as an outcome in clinical
The same development strategy was used in trials: postscript. CoatroBed CIin Trials 1991; 12:
each of the instruments in which we have estab- 266S-2698.
3. Kirshner B, Guyatt GH. A methodologic framework
lished the minimal important difference [3, 111. for assessing health indices. J Cbron Dis 1985; 38:
It would be very convenient if all evaluative 27-36.
instruments using 7-point scale response options 4. Guyatt GH, Berman LB, Townsend M, Pugsley SO,
Chambers LW. A measure of quality of life for clinical
demonstrated similar properties. Full confi- trials in chronic lung disease. Thorax 1987; 42:
dence in this conclusion must await replication 773-778.
of these findings by other investigators. Our 5. Guyatt GH, Nogradi S, Halcrow S et al. Development
and testing of a new measure of health status for
sample was small and may not have been repre- clinical trials in heart failure. J Can Intern Med 1989:
sentative, and this further highlights the need 4: 101-107.
for replication. Our findings are also limited in 6. Jaeschke R, Guyatt GH, Keller J, Singer J. Interpret-
ing changes in quality of life score in N of 1 random-
that a change in score of 0.5 is important when ized trials. Controlled Clin Trials 1991: 12t4Sl: ~I

the instrument is used for examining within- 226-233.


patient changes but this does not necessarily 7. Juniper EF, Guyatt GH, Epstein RS, Ferrie PJ,
Jaeschke R. Hiller TK. Evaluation of imoairment of
mean that a difference of 0.5 will signify the health-related quality of life in asthma: devklopment of
minimal important difference when the instru- a questionnaire for use in clinical trials. Thorax 1992;
ment is used to discriminate between patients 47: 76-83.
8. Juniper EF, Guyatt GH, Ferrie PJ, Griffith LE.
[12]. Nevertheless, the results provide grounds Measuring quality of life in asthma. Ant Rev Respir Dis
for optimism regarding the easy interpretation 1993; 147: 832-838.
of results of health-related quality of life 9. Rowe BH. Steroid treatment of asthma exacerbations:
a meta-analysis, evaluation of a quality of life instru-
measures. ment, and design of a randomized factorial trial. Msc.
Thesis 1991; McMaster University, Hamilton, Canada.
Acknowledgements-We thank MS Penelope Ferrie for 10. Juniper EF, Johnston P, Borkhoff C, Haukioja A.
carrying out the interviews and collating the data and Derek Effect of salmeterol on asthma quality of life. Am Rev
King for his help with the data analysis. This study was Respir Dis 1993; 147: A60.
supported in part by a grant from Astra Pharma. 11. Guyatt GH, Bombardier C, Tugwell PX. Measuring
disease-specific quality of life in clinical trials. Can Med
Assoc J 1986; 134: 889-895.
REFERENCES 12. Malo J-L, Boulet L-P, Dcwitte J-D, Cartier A,
L’Archeveque J, Cote J, Bedard G, Boucher S, Cham-
1. Jaeschke R, Singer J, Guyatt GH. Measurements of pagne F, Messier G, Contandriopoulos A-P, Juniper
health status: ascertaining the minimal clinically im- EF, Guyatt GH. A quality of life questionnaire for
portant difference Controlled Clin Trials 1989; 10: asthma: clinical validation of discriminative properties.
407415. J AUergy Clin Immunol 1993; 91: 1121-I 127.

APPENDIX

The Asthma Quality of Life Questionnaire


This questionnaire is designed to find out how you have been feeling during the last 2 weeks. You will be asked about
ways in which your asthma has limited your activities, the symptoms you have experienced as a result of your asthma,
and how these have made you feel.
I should like you to think of the ways in which your asthma limits your life. I am particularly interested in activities
that you still do, but which are limited by your asthma. You may be limited because you do these activities less often, or
less well, or because they are less enjoyable. These should be activities which you do frequently and which are important
in your day-to-day life.

[RECORD IDENTIFIED ACTIVITIES]


I shall now read a list of activities in which some people with asthma are limited. I shall pause after each item long enough
for you to tell me if you have been limited in this activity because of your asthma in the last 2 weeks. If you have not
done the activity or it hasn’t bothered you during the last 2 weeks, just answer “no”.
[READ ACTIVITIES, OMITTING THOSE WHICH THE RESPONDENT HAS VOLUNTEERED
SPONTANEOUSLY]

1. Bicycling 6. Gardening
2. Clearing snow off car 7. Hurrying
3. Dancing 8. Jogging/exercising/running
4. Doing home maintenance 9. Laughing
5. Doing housework 10. Mopping/scrubbing the floor
86 F. JUNIPERet al.
ELIZABETH

11. Mowing the lawn 19. Talking


12. Playing with pets 20. Running upstairs or uphill
13. Playing with children 2 1. Vacuuming
14. Playing sports 22. Visiting friends or relatives
15. Shovelling snow 23. Going for a walk
16. Singing 24. Walking upstairs or uphill
17. Social activities 25. Woodwork or carpentry
18. Sexual intercourse 26. Work activities

(The aim of this list is to help patients select activities that are important in their day-to-day lives. The list may be altered
to suit different cultures and climates.)
Of the activities which you have identified, I should like you to tell me which are the five most important in your
day-to-day life.

[READ ALOUD THE LIST OF IDENTIFIED ACTIVITIES-WRITE THE FIVE ACTIVITIES IN


QUESTIONS l-5 OF THE QUALITY OF LIFE QUESTIONNAIRE]

1. Please indicate how much you have been limited by your asthma in [Activity 1: . . . . . . . .] during the last two weeks
by choosing one of the following options. [GREEN CARD]
[REPEAT FOR EACH OF THE 5 IDENTIFIED ACTIVITIES]
6. How much discomfort or distress have you felt over the last two weeks as a result of CHEST TIGHTNESS? [RED
CARD]
7. In general, how much of the time during the last two weeks have you FELT CONCERNED ABOUT HAVING
ASTHMA? [BLUE CARD]
8. How often during the past two weeks did you feel SHORT OF BREATH as a result of your asthma? [BLUE CARD]
9. How often during the past two weeks did you experience asthma symptoms as a result of being EXPOSED TO
CIGARETTE SMOKE? [BLUE CARD]
10. How often during the past two weeks did you experience a WHEEZE in your chest? [BLUE CARD]
11. How often during the past two weeks did you feel that you had to AVOID A SITUATION OR ENVIRONMENT
BECAUSE OF CIGARETTE SMOKE? [BLUE CARD]
12. How much discomfort or distress have you felt over the last two weeks as a result of COUGHING? [RED CARD]
13. In general, how often during the past two weeks did you feel FRUSTRATED as a result of your asthma? [BLUE
CARD]
14. How often during the past two weeks did you experience a feeling of CHEST HEAVINESS? [BLUE CARD]
15. How often during the past two weeks did you feel CONCERNED ABOUT THE NEED TO USE MEDICATION
for your asthma? [BLUE CARD]
16. How often during the past two weeks did you feel the need to CLEAR YOUR THROAT? [BLUE CARD]
17. How often during the past two weeks did you experience asthma symptoms as a result of being EXPOSED TO DUST?
[BLUE CARD]
18. How often during the past two weeks did you experience DIFFICULTY BREATHING OUT as a result of your
asthma? [BLUE CARD]
19. How often during the past two weeks did you feel that you had to AVOID A SITUATION OR ENVIRONMENT
BECAUSE OF DUST? [BLUE CARD]
20. How often during the past two weeks did you WAKE UP IN THE MORNING WITH ASTHMA SYMPTOMS?
[BLUE CARD]
21. How often during the past two weeks did you feel AFRAID OF NOT HAVING YOUR ASTHMA MEDICATIONS
AVAILABLE? [BLUE CARD]
22. How often during the past two weeks were you bothered by HEAVY BREATHING? [BLUE CARD]
23. How often during the past two weeks did you experience asthma symptoms as a result of WEATHER OR THE AIR
POLLUTION OUTSIDE? [BLUE CARD]
24. How often during the past two weeks have you been WOKEN AT NIGHT by your asthma symptoms? [BLUE CARD]
25. How often durina the uast two weeks did vou feel that vou had to AVOID OR LIMIT GOING OUTSIDE BECAUSE
OF THE WEAfHER OR AIR POLLUTION? [BLUE CARD]
26. How often during the past two weeks did you experience asthma symptoms as a result of BEING EXPOSED TO
STRONG SMELLS OR PERFUME? [BLUE CARD]
27. How often during the past two weeks did you feel AFRAID OF GETTING OUT OF BREATH? [BLUE CARD]
28. How often during the past two weeks did you feel that you had to AVOID A SITUATION OR ENVIRONMENT
BECAUSE OF STRONG SMELLS OR PERFUME? [BLUE CARD]
29. How often during the past two weeks has your asthma INTERFERED WITH GETTING A GOOD NIGHTS
SLEEP7 [BLUE CARD]
30. How often during the past two weeks have you had a feeling of FIGHTING FOR AIR? [BLUE CARD]
31. Think of the OVERALL RANGE OF ACTIVITIES that you would have liked to have done during the past two weeks.
How much has your range of activities been limited by your asthma? PELLOW CARD]
32. Overall, among ALL THE ACTIVITIES that you have done during the past two weeks, how limited have you been
by your asthma? [GREEN CARD]

DOMAIN QUESTIONS
SYMPTOMS 6,8,10,12,14,16,18,20,22,24,29,30
ACTIVITIES 1I2I3,4 15, 11,19,25,28,31,32
EMOTIONS 7,13,15,21,27
Minimal Important Difference 87

RESPONSE OPTIONS
GREEN CARD RED CARD
I. Totally limited, couldn’t do activity at all 1. A very great deal of discomfort or distress
2. Extremely limited 2. A great deal of discomfort or distress
3. Very limited 3. A good deal of discomfort or distress
4. Moderate limitation 4. A moderate amount of discomfort or distress
5. Some limitation 5. Some discomfort or distress
6. A little limitation 6. Very little discomfort or distress
7. Not at all limited 7. No discomfort or distress

BLUE CARD YELLOW CARD


1. All of the time 1. Severely limited-most activities not done
2. Most of the time 2. Very limited
3. A good bit of the time 3. Moderately limited-several activities not done
4. Some of the time 4. Slightly limited
5. A little of the time 5. Very slightly limited-very few activities not done
6. Hardly any of the time 6. Hardly limited at all
7. None of the time 7. Not limited at all-have done all activities that I wanted
to do

You might also like