Professional Documents
Culture Documents
Summary
Background Pneumonia is the biggest cause of deaths in young children in developing countries, but early diagnosis Lancet Infect Dis 2015
and intervention can effectively reduce mortality. We aimed to assess the diagnostic value of clinical signs and Published Online
symptoms to identify radiological pneumonia in children younger than 5 years and to review the accuracy of WHO March 11, 2015
http://dx.doi.org/10.1016/
criteria for diagnosis of clinical pneumonia. S1473-3099(15)70017-4
See Online/Comment
Methods We searched Medline (PubMed), Embase (Ovid), the Cochrane Database of Systematic Reviews, and http://dx.doi.org/10.1016/
reference lists of relevant studies, without date restrictions, to identify articles assessing clinical predictors of S1473-3099(15)70029-0
radiological pneumonia in children. Selection was based on: design (diagnostic accuracy studies), target disease Swiss Tropical and Public
(pneumonia), participants (children aged <5 years), setting (ambulatory or hospital care), index test (clinical features), Health Institute, University of
Basel, Basel, Switzerland
and reference standard (chest radiography). Quality assessment was based on the 2011 Quality Assessment of
(C Rambaud-Althaus MD,
Diagnostic Accuracy Studies (QUADAS-2) criteria. For each index test, we calculated sensitivity and specificity and, F Althaus MD, Prof B Genton MD,
when the tests were assessed in four or more studies, calculated pooled estimates with use of bivariate model and V D’Acremont MD); Department
hierarchical summary receiver operation characteristics plots for meta-analysis. of Ambulatory Care and
Community Medicine,
University of Lausanne,
Findings We included 18 articles in our analysis. WHO-approved signs age-related fast breathing (six studies; pooled Lausanne, Switzerland
sensitivity 0·62, 95% CI 0·26–0·89; specificity 0·59, 0·29–0·84) and lower chest wall indrawing (four studies; 0·48, (C Rambaud-Althaus, F Althaus,
0·16–0·82; 0·72, 0·47–0·89) showed poor diagnostic performance in the meta-analysis. Features with the highest Prof B Genton, V D’Acremont);
and Infectious Disease Service,
pooled positive likelihood ratios were respiratory rate higher than 50 breaths per min (1·90, 1·45–2·48), grunting
Lausanne University Hospital,
(1·78, 1·10–2·88), chest indrawing (1·76, 0·86–3·58), and nasal flaring (1·75, 1·20–2·56). Features with the lowest Lausanne, Switzerland
pooled negative likelihood ratio were cough (0·30, 0·09–0·96), history of fever (0·53, 0·41–0·69), and respiratory rate (Prof B Genton)
higher than 40 breaths per min (0·43, 0·23–0·83). Correspondence to:
Dr C Rambaud-Althaus, Health
Intervention Unit, EPH, Swiss
Interpretation Not one clinical feature was sufficient to diagnose pneumonia definitively. Combination of clinical
Tropical and Public Health
features in a decision tree might improve diagnostic performance, but the addition of new point-of-care tests for Institute, Basel 4051,
diagnosis of bacterial pneumonia would help to attain an acceptable level of accuracy. Switzerland
clotilde.rambaud@unibas.ch
Funding Swiss National Science Foundation.
of Systematic Reviews (CDSR), without date or independently did the search using a two-step process:
language restrictions. We did our first search on first, assessing the title and abstract, and second,
Sept 30, 2013, with an update on Nov 6, 2014. In assessing the full text, using the seven selection criteria
Medline, we used the following search terms: listed in the panel. Any disagreement was resolved
“pneumonia”[MeSH terms] in combination with: through discussion and consensus.
“predictive value of tests”[MeSH terms] OR “sensitivity
and specificity”[MeSH terms] OR “reproducibility of Quality assessment
results”[MeSH terms] OR “diagnostic test” OR We assessed the quality of selected studies and potential
“diagnostic tests” OR “physical examination”[MeSH risk of bias with the 2011 revised version of the Quality
terms] OR “medical history taking”[MeSH terms], and Assessment of Diagnostic Accuracy Studies (QUADAS-2),8
See Online for appendix the following age filters: “infant 1–23 months” and adapted to the review question (appendix), as recom-
“preschool child 2–5 years”. In Embase, we used mended by the Cochrane Collaboration. For this Article,
“diagnostic accuracy”/exp OR “predictor variable”/exp all clinical index tests were considered to be appropriate,
OR “breathing rate”/exp in combination with irrespective of the way they had been assessed by the
“pneumonia” OR “lower respiratory tract infection” clinician, except for respiratory rates, which we required
OR “respiratory tract infection”, and with “child”. We to be measured by observation in 1 min in a calm child, as
did an additional manual search of the reference lists recommended by WHO. Therefore, the index test domain
from eligible articles and identified reviews to complete of the QUADAS-2 was separated into two sections: one for
our search. Two reviewers (CR-A and VD’A) the respiratory rate (defining fast breathing) and one for
the other index tests. For the reference standard, the best
existing one for bacterial pneumonia is endpoint
Panel: Criteria for study selection pneumonia on chest radiograph (WHO criteria).3,9 For this
Design review, we selected all studies using chest radiograph as
We selected studies that assessed diagnostic accuracy, clinical predictors or derived reference standard, irrespective of criteria used for
prediction rules. Narrative reviews, letters, editorials, comments, and case series of fewer interpretation. When the interpretation criteria differed
than 20 patients were excluded. Systematic reviews and meta-analyses were considered for from WHO criteria, we reported in the methodological
their reference lists. quality assessment that there were great concerns about
the applicability of the results to the research question.
Target disease The quality assessment was done independently by two
Studies that assessed pneumonia. authors (CR-A and VD’A). Any disagreement was resolved
Participants through discussion and consensus.
Studies needed to include children aged between 2 months and 6 years (ie, although our
reference standard was younger than 5 years, we accepted some studies of age 5 years and Data extraction
younger). We excluded studies including only adults or only children younger than 6 months Data were extracted by one author (CR-A). A second
or older than 6 years. Studies were excluded of patients at higher risk of pneumonia because author (VD’A) cross-checked all extracted data compiled
of pre-existing immune suppression (due to HIV infection, neutropenia, and malnutrition), in a table (Microsoft Excel 2010) comparing them to the
comorbidities (cystic fibrosis, mechanical ventilation, and burn injuries), or because of original data available from the selected full texts (or in
restrictive inclusion criteria (including only patients with wheeze). the subset of data sent by authors when applicable) to
ensure that data were accurate. Identified errors were
Setting discussed and corrected. We recorded characteristics of
We selected studies including either ambulatory patients or patients admitted into the study (design, year of publication, study country, and
hospitals. Studies in intensive care units were excluded. Studies done in developed and health-care setting), study population (size, age range,
developing countries were both considered. inclusion and exclusion criteria, and proportion of
Index test patients with pneumonia), reference standard (chest
We selected studies that assessed clinical features (symptoms and physical signs). radiograph procedure, masking, number of readers, and
interpretation criteria), and index tests (definition,
Reference standard procedures, and link with inclusion criteria) on
We selected studies in which the reference standard for pneumonia diagnosis was based on a predefined forms. Index tests were categorised as related
chest radiograph, whatever the interpretation criteria. to demographic and environmental factors, symptoms,
Data reporting or signs. When it was not possible to establish whether
Studies were selected if reconstruction of the two-by-two table was possible. Studies that the index test was obtained through caretaker interview
included children older than 5 years of age were selected only if age stratified analyses were (symptom) or through clinical examination (sign), the
available (so that children older than 5 years could be excluded). When the data for this age index test was not included in the review and meta-
group were not available, authors were contacted and studies included when data provided. analysis. Combinations of signs were not considered in
When more than one article was published on the same patients’ population, we selected this review. Signs or symptoms assessed at different
only the most recent article with appropriate analyses to the review question. thresholds were considered as different index tests, with
a separate analysis for each threshold.
Wafula et al Kenya; paediatric <5 years 377 67% Admission to the Patients with no chest 2 independent Not Lobar pneumonia or Symptoms: cough; signs: stridor, nasal flaring, chest
(1984)12 observation observation ward with radiograph traceable (attending reported bronchopneumonia indrawing, cyanosis, temperature >38°C, respiratory
ward features of ARI excluded from analyses radiologist and rate >50 breaths per min
a senior
radiologist)
Campbell The Gambia; 0–4 years 216 12% Cough, and one of: Not reported 1 paediatric Yes Lobar consolidation Symptoms: vomiting, refusing to feed, rapid
et al (1989)13 community respiratory rate >50 breaths radiologist breathing; signs: chest indrawing, nasal flaring,
per min, indrawing, respiratory rate >50 breaths per min, respiratory rate
wheeze, and stridor >60 breaths per min, heart rate >160 beats per min,
axillary temperature >37·5°C, temperature >38·5°C,
crepitation, bronchial breathing or reduced air entry,
rhonchi, grunting
Wafula et al Kenya; 5–59 150 60% History of cough <2 weeks Already on medication, 1 paediatric Not Lobar pneumonia or Symptoms: fever, rapid breathing, poor feeding; signs:
(1989)14 outpatient months heart failure, congenital radiologist reported bronchopneumonia respiratory rate >40 breaths per min, >60 breaths per
department heart disease, moderate to min, heart rate >140 beats per min, nasal flaring,
severe dehydration, cyanosis, chest indrawing, stridor, ronchi, crepitations,
metabolic disorders, and rectal temperature >37·5°C
chest deformities
Lucero et al Philippines; <5 years 199 69% Cough <3 weeks’ duration Not reported Not reported Not Not reported Signs: respiratory rate >40 breaths per min,
(1990) outpatient reported >50 breaths per min
research department
institute
Lucero et al Philippines; <5 years 199 29% Cough <1 week duration Not reported Not reported Not Not reported Signs: respiratory rate >40 breaths per min,
(1990) outpatient reported >50 breaths per min
health department
centre15
Harari et al Papua New 8 weeks to 185 30% Cough (n=95); cough and Wheeze, stridor, measles, 1 paediatric Yes Radiographic evidence Age <24 months; symptoms: fever, cough >2 days,
(1991)16 Guinea; 6 years respiratory rate ≥40 breaths and pertussis radiologist of pneumonia breath-less, poor feeding, poor sleeping; signs: axillary
outpatient per min (n=90) temperature >38°C, chest indrawing, nasal flaring,
department crepitations, cyanosis, respiratory rate >50/40 breaths
per min*, >50 breaths per min
Lozano et al Colombia; <3 years 200 65% Cough ≤7 days, living at Cardiovascular, 1 radiologist Yes Any kind of infiltrate Symptoms: fever, rapid breathing, difficult breathing,
(1994)17 emergency high altitude, and chest pulmonary, or (alveolar or interstitial) chest retractions, grunting, loss of appetite, food
department radiograph part of neurological congenital refusal (liquid, solid, breastfeeding), difficult to wake
emergency department defects; birth before term; up, abdominal distension, cold to the touch, seizures;
evaluation chronic diseases (asthma, signs: retractions, grunting, nasal flaring, respiratory
cancer, metabolic rate, abnormal respiratory sounds (wheezes,
disorders, crepitation, rhonchi, decreased breath sounds),
immunosuppression) abdominal distension, seizures
Dai et al China; 2–59 541 63% Cough Antibiotics received in 3 radiologists, Yes Criteria not specified; Signs: respiratory rate >50/40 breaths per min*, rales,
(1995)18 outpatient months past 4 weeks independently; 4 categories: nasal flaring, chest indrawing (lower chest wall),
department majority pneumonia, bronchitis, cyanosis of the tongue
opinion any abnormality, normal
prevailed
Palafox et al Mexico; clinical 3 days to 5 110 32% Cases: pneumonia clinical Symptoms >2 weeks, 1 radiologist Yes Presence of Signs: respiratory rate >60 breaths per min,
(2000)19 unit years diagnosis by a paediatrician; chronic diseases, genetic micronodular or >50 breaths per min, >40 breaths per min, chest
matched controls: next abnormalities, macronodular indrawing, alveolar rales
child with ARI (cough or neurological diseases, infiltrations or
rhinorrhoea, and infectious bronchial asthma, condensations in the
signs) without pneumonia septicaemia lung
(Table 1 continues on next page)
5
6
Articles
Setting Age range Patients Pneu- Inclusion criteria Exclusion criteria Reference standard Index tests
(N) monia
pre-
valence
Readers Masking Positivity criteria
(Continued from previous page)
Sigaúque Mozambique; 0–23 634 43% Admitted to hospital with Evidence of asthma, 2 primary Not Evidence of Age ≤12 months; symptoms: duration of fever,
et al (2009)27 inpatient months cough or difficult breathing congenital heart disease, readers and 1 reported consolidation or pleural duration of cough; signs: nasal flaring, crepitations,
department and fast breathing neonatal asphyxia, and external WHO effusion: confirmed wheezing or rhonchi, vomiting, prostration,
(respiratory rate >50/40 chronic respiratory radiologist pneumonia; non- hypoxaemia, temperature ≥37·5°C, temperature
breaths per min*), and disorders endpoint pneumonia: >39°C
chest indrawing (WHO interstitial or normal
clinical definition for severe chest radiograph
pneumonia)
Bilkis et al Uruguay and 1–4 years† 178† 69% Fever or history of fever Chronic respiratory 2 paediatric Yes Pulmonary Symptoms: fatigue, loss of appetite, loss of sleep,
(2010)28 Argentina; during the past 48 h, and disease, congenital radiologists, consolidation or cough, chest pain, abdominal pain, vomiting; signs:
emergency clinically suspected cardiopathy, together asymmetric infiltrate temperature >39°C, grunting, intercostal retraction,
department pneumonia oesophagogastric reflux, (diagnoses nasal flaring, wheezing, rales, decreased breath sounds
tumoural disease, cerebral correlated with
palsy, immunodeficiency, diagnosis of
asthmatic crisis requiring the evaluating
treatment, pneumonia in paediatricians)
the last 2 months, use of
antibiotics in the last
15 days; chest radiograph
already taken and
interpreted
Wingerter USA; emergency ≤5 years 2008 16% Chest radiograph done for Pre-existing medical 1 of the Not Definite pneumonia if Symptoms: history of fever; signs: temperature ≥38°C,
et al (2012)29 department clinical suspicion of disorders with increased attending reported “consolidation”, wheezing, WHO classification for pneumonia
pneumonia risk for pneumonia: sickle- radiologists at “infiltrate”, or
cell disease, complex the time of “pneumonia” on chest
congenital heart disease, emergency radiograph report;
immunodeficiency, department conservative definition
chronic lung disease other evaluation of pneumonia also
than asthma (ie, cystic included “atelectasis
fibrosis or broncho- versus infiltrate”,
pulmonary dysplasia) or a “atelectasis versus
severe neurological pneumonia”, or “likely
disorder atelectasis but cannot
exclude pneumonia”
All studies were cross-sectional, except for Palafox and colleagues,19 which was a case-control study. ARI=acute respiratory infection. LRTI=lower respiratory tract infection. URTI=upper respiratory tract infection. DPT=diphtheria, pertussis, and tetanus.
*Respiratory rate >50 breaths per min in children aged 2–11 months and >40 breaths per min in children aged 12–59 months. †Subgroup of participants aged below 5 years, provided by contacted author.
the 19 studies. 16 studies were done in low-income and Of the 78 clinical index tests, 18 were assessed in four
middle-income countries—ie, Asia (seven), Africa (five), different studies or more. The most frequently assessed
Latin America (three), and the Middle East (one), and index tests were: fast breathing (12 studies, with four
three took place in the USA. Seven studies were done in different definitions), chest indrawing (10 studies, with
outpatient departments, seven in emergency departments seven different definitions), nasal flaring (eight studies),
or related structures, four in inpatient departments, and elevated temperature (seven studies, with seven
one study recruited patients at community level. Except different definitions), crepitations (seven studies),
for one case-control study,19 all studies included history of fever (six studies), and wheezing (six studies).
consecutive patients with acute respiratory infection. In For each index test considered in four studies or more,
these studies, the inclusion criterion was cough alone the HSROC plot of point estimates of sensitivity and
(five), clinical suspicion of pneumonia as per specified specificity with 95% confidence and 95% prediction
criteria (seven), and suspicion of pneumonia without regions, computed using the bivariate method, are
specified criteria (six; table 1). The proportion of shown in figure 2A (symptoms) and figure 2B (signs).
radiological pneumonia in the studied populations varied Table 3 shows pooled estimates of each diagnostic
across studies from 7% to 69% (median 30%; IQR 15–63). performance measure (sensitivity, specificity, and
Table 2 shows quality assessment of included studies positive and negative likelihood ratio) for these index
(potential bias and applicability concerns). tests. Although most of the index tests showed poor
From the 19 studies, we found 57 different clinical diagnostic performance with a high degree of
features assessed for their accuracy in diagnosis of heterogeneity, some respiratory danger signs had
radiological pneumonia: five related to demographic and specificities higher than 0·80, such as cyanosis (two
environmental factors, 32 to symptoms, and 20 to signs. studies, 0·98 [95% CI 0·93–1·00] and 0·94 [0·89–0·96]),
Age, duration of illness, duration of cough, heart rate, stridor (two studies, 0·92 [0·86–0·96] and 1·00
respiratory rate, and temperature were assessed using [0·94–1·00]), and grunting (five studies, 0·87
different thresholds. Seven different definitions of chest [0·65–0·96]). Classic auscultation signs, such as
indrawing were used. 78 index tests were assessed in the crepitations, showed poor accuracy (table 3). Among
19 studies. The number of index tests assessed per study other auscultation signs, bronchial breathing had high
ranged from one to 25 (median eight, IQR four to 12). The specificity in two studies 0·97 [0·93–0·99] and 0·97
appendix contains coupled forest plots for each study and [0·95–0·98]). Two symptoms had high sensitivity with
the estimated sensitivity and specificity with 95% CI for little heterogeneity: history of fever (pooled sensitivity of
each of the 78 index tests. six studies, 0·94, 0·88–0·97) and cough (five studies,
NA=not applicable.
A
History of fever Cough Difficult breathing Rapid breathing Poor feeding Vomiting
1·0
0·8
Sensitivity
0·6
0·4
0·2
0
1·0 0·8 0·6 0·4 0·2 0 1·0 0·8 0·6 0·4 0·2 0 1·0 0·8 0·6 0·4 0·2 0 1·0 0·8 0·6 0·4 0·2 0 1·0 0·8 0·6 0·4 0·2 0 1·0 0·8 0·6 0·4 0·2 0
B
Nasal flaring Grunting Indrawing Respiratory rate Age-related fast breathing Respiratory rate
>40 breaths per min >50 breaths per min
1·0
0·8
Sensitivity
0·6
0·4
0·2
0·8
Sensitivity
0·6
0·4
0·2
0
1·0 0·8 0·6 0·4 0·2 0 1·0 0·8 0·6 0·4 0·2 0 1·0 0·8 0·6 0·4 0·2 0 1·0 0·8 0·6 0·4 0·2 0 1·0 0·8 0·6 0·4 0·2 0 1·0 0·8 0·6 0·4 0·2 0
Specificity Specificity Specificity Specificity Specificity Specificity
Figure 2: Hierarchical summary receiver operating characteristic (HSROC) plots for sensitivity versus specificity for six symptoms (A) and for 12 signs (B)
Each circle represents a study, with the size being proportional to the study size. The square represents the summary operating point of test performance and the zone outlines surrounding it represent
the 95% confidence and 95% prediction regions of this summary estimate respectively.
0·96, 0·91–0·98). Two features that are the backbone of geneous), respiratory rate higher than 40 breaths per
the WHO definition for clinical pneumonia4 (age-related min, and history of fever (table 3).
fast breathing and lower chest wall indrawing) had a Table 4 shows the performance of age-related fast
very high degree of heterogeneity in sensitivities and breathing and chest indrawing in the studies that
specificities (table 3). Fast breathing was assessed at generated the evidence leading to the adoption of WHO
different respiratory rate thresholds within and between clinical diagnosis of pneumonia in the 1990s.30 Sensitivity
studies. Figure 3 shows the HSROC curve of fast estimates for age-related fast breathing ranged
breathing at different thresholds. It suggests that none from 0·73 to 0·82 and specificities from 0·54 to 0·89 in
of the fixed thresholds is better than another and that five studies (table 4). For chest indrawing, sensitivity
having an age-related threshold does not improve the estimates ranged from 0·06 to 0·77 and specificity
accuracy of the diagnostic test. estimates from 0·39 to 1·00 (table 4).
In the meta-analysis, when looking at the likelihood
ratios (measures that are more meaningful for clinical Discussion
decisions), the symptoms and signs with the highest To our knowledge, our Article is the first systematic
pooled estimates of positive likelihood ratio were review with meta-analysis of clinical predictors of pneu-
respiratory rate higher than 50 breaths per min, grunting, monia in children. The comprehensive search, un-
lower chest indrawing, and nasal flaring (table 3). The impeded by date, country, or language restrictions,
features with the lowest pooled estimates of negative allowed the consideration of large amounts of data,
likelihood ratio were cough (although very hetero- compared with previous reviews.7,30,34,35 We considered
Number of Total Sensitivity (95% CI) Specificity (95% CI) Positive likelihood Negative likelihood 1/negative likelihood
studies population (n) ratio (95% CI) ratio (95% CI) ratio (95% CI)
Symptoms
History of fever 6 8260 0·94 (0·88–0·97) 0·12 (0·06–0·23) 1·06 (1·00–1·12) 0·53 (0·41–0·69) 1·89 (1·46–2·45)
Cough 5 6421 0·96 (0·91–0·98) 0·14 (0·03–0·46) 1·12 (0·90–1·39) 0·30 (0·09–0·96) 3·37 (1·04–10·89)
Difficult breathing 4 6070 0·60 (0·35–0·81) 0·52 (0·19–0·84) 1·26 (0·84–1·91) 0·76 (0·64–0·90) 1·32 (1·11–1·56)
Rapid breathing 4 4474 0·79 (0·75–0·82) 0·31 (0·17–0·49) 1·14 (0·88–1·46) 0·69 (0·39–1·25) 1·44 (0·80–2·60)
Poor feeding 7 4984 0·64 (0·39–0·83) 0·52 (0·3–0·73) 1·34 (1·17–1·54) 0·69 (0·55–0·86) 1·46 (1·16–1·83)
Vomiting 5 6723 0·36 (0·22–0·52) 0·7 (0·55–0·82) 1·17 (1·06–1·29) 0·93 (0·86–0·99) 1·08 (1·01–1·16)
Signs
Nasal flaring 8 2813 0·47 (0·28–0·66) 0·73 (0·52–0·87) 1·75 (1·20–2·56) 0·73 (0·59–0·89) 1·38 (1·12–1·69)
Grunting 5 1251 0·24 (0·10–0·47) 0·87 (0·65–0·96) 1·78 (1·10–2·88) 0·88 (0·78–0·99) 1·13 (1·01–1·28)
Temperature >38°C* 5 4631 0·56 (0·39–0·71) 0·55 (0·40–0·70) 1·25 (1·14–1·37) 0·80 (0·70–0·91) 1·26 (1·10–1·43)
Respiratory rate >40 breaths per min 4 1058 0·78 (0·54–0·91) 0·51 (0·38–0·63) 1·58 (1·37–1·84) 0·43 (0·23–0·83) 2·30 (1·20–4·41)
Respiratory rate >50 breaths per min 7 1834 0·53 (0·30–0·74) 0·72 (0·58–0·83) 1·90 (1·45–2·48) 0·65 (0·45–0·95) 1·53 (1·05–2·24)
Age-related fast breathing†‡ 6 3320 0·62 (0·26–0·89) 0·59 (0·29–0·84) 1·55 (0·44–5·42) 0·63 (0·16–2·55) 1·59 (0·39–6·42)
Crepitations 7 2510 0·53 (0·37–0·69) 0·58 (0·48–0·67) 1·26 (0·99–1·60) 0·81 (0·61–1·08) 1·23 (0·93–1·63)
Rales 4 1158 0·49 (0·32–0·67) 0·45 (0·22–0·70) 0·90 (0·42–1·90) 1·13 (0·48–2·62) 0·89 (0·38–2·06)
Rhonchi 4 1543 0·19 (0·04–0·57) 0·67 (0·24–0·93) 0·57 (0·36–0·91) 1·21 (0·88–1·67) 0·83 (0·60–1·14)
Decreased breath sounds 5 1364 0·22 (0·12–0·38) 0·76 (0·29–0·96) 0·93 (0·15–5·67) 1·02 (0·58–1·80) 0·98 (0·55–1·72)
Wheezing 6 4825 0·22 (0·18–0·25) 0·75 (0·66–0·82) 0·86 (0·63–1·17) 1·05 (0·95–1·16) 0·95 (0·86–1·06)
Lower chest indrawing‡ 4 1870 0·48 (0·16–0·82) 0·72 (0·47–0·89) 1·76 (0·86–3·58) 0·71 (0·38–1·35) 1·40 (0·74–2·65)
*Rectal temperature >38·0°C or axillary temperature >37·5°C. †Respiratory rate >60 breaths per min in children aged <2 months, >50 breaths per min in children 2–11 months, and >40 breaths per min in
children aged 12–59 months. ‡WHO criteria for pneumonia.
Table 3: Pooled estimates of diagnostic performance measures of each index test assessed in four studies or more
Age range Reference standard True False False True Sensitivity Specificity
positive negative positive negative (95% CI) (95% CI)
Age-related fast breathing*
Shann et al (1984)31 <5 years Crepitations 52 15 36 97 0·78 (0·66–0·87) 0·73 (0·65–0·80)
Cherian et al (1988)32 <5 years Crepitations or chest 204 46 47 385 0·82 (0·76–0·86) 0·89 (0·86–0·92)
radiograph
Harari et al (1991)16 8 weeks to 6 years Chest radiograph 41 15 47 82 0·73 (0·60–0·84) 0·64 (0·55–0·72)
Mulholland et al (1992) Philippines33 2–59 months Paediatrician 81 21 95 111 0·79 (0·70–0·87) 0·54 (0·47–0·61)
Mulholland et al (1992) Swaziland33 2–59 months Paediatrician 20 6 64 201 0·77 (0·56–0·91) 0·76 (0·70–0·81)
Lower chest wall indrawing
Shann et al (1984)31 <5 years Crepitations 4 63 0 133 0·06 (0·02–0·15) 1·00 (0·97–1·00)
Cherian et al (1988)32 <5 years Crepitations or chest 193 57 11 421 0·77 (0·71–0·82) 0·97 (0·95–0·99)
radiograph
Campbell et al (1989)13 0–4 years Chest radiograph 15 10 117 113 0·60 (0·39–0·79) 0·39 (0·32–0·46)
Harari et al (1991)16 8 weeks to 6 years Chest radiograph 18 38 16 113 0·32 (0·20–0·46) 0·88 (0·81–0·93)
*Respiratory rate >60 breaths per min in children aged <2 months, >50 breaths per min in children 2–11 months, and >40 breaths per min in children aged 12–59 months.
Table 4: Performance of age-related fast breathing and chest indrawing in studies that WHO used to decide on criteria for clinical pneumonia
reference standard, whereas in most of the early studies In our Article, chest indrawing, as in the studies done
(table 4), the reference standard was based on the subjective in the 1990s, also produced heterogeneous estimates of
assessment of a physician (this is also why these studies sensitivities, specificities, and likelihood ratios. Chest
were not selected for analysis here). Thus, these early indrawing is probably an early indicator of respiratory
studies probably included lower respiratory tract infections distress that can be due to different disorders, such as
other than pneumonia, such as bronchiolitis. pneumonia, but also bronchiolitis. Even if chest
At the time that these studies were done, giving indrawing is insufficient for diagnosis of radiological
antibiotics to all children with lower respiratory tract pneumonia, then it might still be useful to identify
infections and withholding them only for upper respiratory children that are at risk of hypoxaemia and would benefit
tract infections was perceived to be the best option. Since from oxygen therapy rather than provision of antibiotics.
pneumonia was a major cause of mortality in resource- Our Article has some limitations. First, to assess clinical
poor settings and no simple test was available for diagnosis predictors for the diagnosis of pneumonia in ambulatory
of bacterial pneumonia, WHO decided to use highly care, a study should ideally include all patients presenting
sensitive clinical criteria. The benefits of presumed lives to the health facility without pre-selection criteria. In all
saved through antibiotic treatment were estimated to our included studies only a subgroup of patients at higher
outweigh the risks of unnecessary treatment due to poor risk of pneumonia were chosen based on a constellation
specificity of the diagnostic criteria used. By contrast, in of symptoms and signs, and difficult-to-diagnose cases
our Article, we aimed to assess the clinical predictors for were potentially excluded. This inclusion might have
radiological pneumonia, considered an acceptable biased the diagnostic performance measures. Second, the
surrogate for bacterial infection, to identify children that interobserver agreement among clinicians on symptoms
really need antibiotic treatment. As a result, the pooled and signs, such as auscultation findings, can be very low.
estimates of likelihood ratios for age-related fast breathing This concern about reproducibility is common to all
are worse in our findings (positive likelihood ratio 1·55; diagnostic studies that assess clinical features. Finally,
negative likelihood ratio 0·63; table 3) than in the 1990s’ there was heterogeneity between our chosen studies in
surveys (pooled estimates from the data reported in table 4: terms of inclusion criteria, setting, and chest radiograph
positive likelihood ratio 2·92; negative likelihood ratio interpretation criteria. To do a meta-analysis in this
0·29), and therefore fast breathing might not be useful context, we used the bivariate and the Rutter and Gatsonis
clinically, at least on its own, to identify children in need of HSROC models, which account for the heterogeneity
antibiotics. This was also suggested in a recent study in inherent in diagnostic accuracy studies.11 The small
Pakistan, in which investigators reported that the clinical number of identified studies did not allow investigation of
outcome of children with WHO non-severe pneumonia how the tests accuracies varied between studies with their
(and no chest indrawing) did not differ when treated with methodological characteristics.
antibiotics or placebo.6 Because of the rapid spread of The findings of this Article suggest that no one clinical
antibiotic resistance worldwide, the overuse of antibiotics feature is sufficient on its own for diagnosis of
when prescription is based on cough and fast breathing is radiological pneumonia. Indeed, none of the assessed
a matter of concern and should now be addressed in policy clinical features reached the level commonly accepted for
recommendations. clinical significance (positive likelihood ratio >5 to
include the diagnosis or negative likelihood ratio <0·2 to Tanzania, funded by a grant from the Swiss National Science Foundation
exclude it). The highest pooled positive likelihood ratio (grant number IZ70Z0–124023). We thank Manuel D Bilkis (Hospital de
Niños Ricardo Gutiérrez, Buenos Aires, Argentina) and Homero
observed was 1·9 (respiratory rate >50 breaths per min) Martinez (Hospital Infantil de México Dr Federico Gómez, Mexico City,
and, besides cough, the lowest pooled negative likelihood Mexico) for providing supplementary data and information or answering
ratio was 0·43 (respiratory rate >40 breaths per min). The our queries about their studies. We thank Isabella Locatelli (Institute for
relatively good pooled negative likelihood ratio (0·30) for Social and Preventive Medicine, University of Lausanne, Switzerland)
for her statistical advice on meta-analysis method. We thank Kristina
cough was probably overestimated because cough was Keitel (Swiss Tropical and Public Health Institute, Basel, Switzerland)
part of the inclusion criteria in all selected studies that for her comments on the manuscript and Amena Briet (Swiss Tropical
assessed it as an index test. Respiratory rate, which is the and Public Health Institute, Basel, Switzerland) for her careful editing of
cornerstone of the present WHO criteria to classify the text.
pneumonia, is thus of poor diagnostic value, even if it References
1 Liu L, Johnson HL, Cousens S, et al. Global, regional, and national
was the best individual clinical predictor in our Article. causes of child mortality: an updated systematic analysis for 2010
However, according to our results, a threshold of with time trends since 2000. Lancet 2012; 379: 2151–61.
50 breaths per min for all age groups would be more 2 Van Hemelrijck MJ, Lindblade KA, Kubaje A, et al. Trends observed
appropriate than would the present recommendation of during a decade of paediatric sick visits to peripheral health
facilities in rural western Kenya, 1997–2006. Trop Med Int Health
50 breaths per min in infants (<12 months) and 40 breaths 2009; 14: 62–69.
per min in children older than 1 year. History of fever 3 Cherian T, Mulholland EK, Carlin JB, et al. Standardized
was the second best predictor in terms of negative interpretation of paediatric chest radiographs for the diagnosis of
pneumonia in epidemiological studies. Bull World Health Organ
likelihood ratio, and adding it to the present WHO 2005; 83: 353–59.
criteria could help to increase specificity. 4 Programme for the Control of Acute Respiratory Infections, WHO.
Combination of the clinical features with the best Technical bases for the WHO recommendations on the
management of pneumonia in children at first-level health
likelihood ratios in a decision tree might indeed improve facilities. Geneva, 1991. http://whqlibdoc.who.int/hq/1991/WHO_
the overall diagnostic performance of symptoms and ARI_91.20.pdf (accessed Oct 3, 2013).
signs. Individual data from selected articles would, 5 World Health Organization, UNICEF. Integrated Management of
Childhood Illness. Chart booklet. 2014. http://apps.who.int/iris/
however, have been necessary to appropriately assess bitstream/10665/104772/16/9789241506823_Chartbook_eng.
combination of clinical features. This was out of the pdf?ua=1 (accessed March 25, 2014).
scope of our Article, but it would be relevant to embark 6 Hazir T, Nisar YB, Abbasi S, et al. Comparison of oral amoxicillin
with placebo for the treatment of world health organization-defined
on such meta-analyses prospectively, provided the nonsevere pneumonia in children aged 2–59 months: a multicenter,
heterogeneity in methodological quality of the included double-blind, randomized, placebo-controlled trial in Pakistan.
studies is mitigated. Clin Infect Dis 2011; 52: 293–300.
7 Scott JAG, Wonodi C, Moisi JC, et al. The Definition of Pneumonia,
The development of innovative point-of-care tests for the Assessment of Severity, and Clinical Standardization in the
diagnosis of bacterial pneumonia is crucial to assist Pneumonia Etiology Research for Child Health Study.
clinicians in decision making. The assessment of the Clin Infect Dis 2012; 54: S109–16.
8 Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2: a revised
diagnostic value of combinations of clinical features and tool for the quality assessment of diagnostic accuracy studies.
point-of-care tests to measure host biomarkers or specific Ann Intern Med 2011; 155: 529–36.
pathogens needs appropriately designed prospective 9 Lynch T, Bialy L, Kellner JD, et al. A systematic review on the
studies to propose new evidence-based diagnostic diagnosis of pediatric bacterial pneumonia: when gold is bronze.
PLoS One 2010; 5: e11989.
procedures. Because no gold standard test exists for 10 Harbord RM, Whiting P. metandi: meta-analysis of diagnostic
bacterial pneumonia, investigation is important of the accuracy using hierarchical logistic regression. Stata J 2009; 9: 211.
clinical outcome of children with acute respiratory 11 Macaskill P, Gatsonis C, Deeks J, Harbord R, Takwoingi Y.
Chapter 10: Analysing and Presenting Results. In: Deeks JJ,
infection when treated (or not) with antibiotics33 to Bossuyt PM, Gatsonis C (eds). Cochrane handbook for systematic
accurately identify patients truly in need of antibiotics. reviews of diagnostic test accuracy version 1.0, The Cochrane
Potentially severe forms of acute respiratory infections Collaboration. 2010. http://srdta.cochrane.org/ (accessed Jan 6,
2014).
also include viral pneumonia and bronchiolitis. 12 Wafula EM, Muruka FJ. Chest x-rays in children with acute
Therefore improvements in access to oxygen therapy, respiratory infections or bronchospasm at Kenyatta National
rather than provision of antibiotics, will often be the life- Hospital. East Afr Med J 1984; 61: 900–06.
13 Campbell H, Byass P, Lamont AC, et al. Assessment of clinical
saving treatment. criteria for identification of severe acute lower respiratory tract
Contributors infections in children. Lancet 1989; 1: 297–99.
CR-A, FA, and VD’A conceived the study. CR-A and VD’A did the 14 Wafula EM, Tindyebwa DB, Onyango FE. The diagnostic value of
literature search and analyses. BG and VD’A oversaw the study and various features for acute lower respiratory infection among under
provided important scientific input. All authors contributed to the fives. East Afr Med J 1989; 66: 678–84.
interpretation of the data and the drafting of the Article. All authors 15 Lucero MG, Tupasi TE, Gomez ML, et al. Respiratory rate greater
revised the Article critically and approved the version to be published. than 50 per minute as a clinical indicator of pneumonia in Filipino
children with cough. Rev Infect Dis 1990; 12: S1081–83.
Declaration of interests 16 Harari M, Shann F, Spooner V, Meisner S, Carney M, de Campo J.
We declare no competing interests. Clinical signs of pneumonia in children. Lancet 1991; 338: 928–30.
Acknowledgments 17 Lozano JM, Steinhoff M, Ruiz JG, Mesa ML, Martinez N, Dussan B.
The study was part of a larger project (PeDiAtrick) that aimed to improve Clinical predictors of acute radiological pneumonia and hypoxaemia
the quality of health care and rational use of drugs for children in at high altitude. Arch Dis Child 1994; 71: 323–27.
18 Dai Y, Foy HM, Zhu Z, Chen B, Tong F. Respiratory rate and signs 27 Sigaúque B, Roca A, Bassat Q, et al. Severe pneumonia in
in roentgenographically confirmed pneumonia among children in Mozambican young children: clinical and radiological
China. Pediatr Infect Dis J 1995; 14: 48–50. characteristics and risk factors. J Trop Pediatr 2009; 55: 379–87.
19 Palafox M, Guiscafré H, Reyes H, Munoz O, Martínez H. 28 Bilkis MD, Gorgal N, Carbone M, et al. Validation and development
Diagnostic value of tachypnoea in pneumonia defined of a clinical prediction rule in clinically suspected community-
radiologically. Arch Dis Child 2000; 82: 41–45. acquired pneumonia. Pediatr Emerg Care 2010; 26: 399–405.
20 Rothrock SG, Green SM, Fanelli JM, Cruzen E, Costanzo KA, 29 Wingerter SL, Bachur RG, Monuteaux MC, Neuman MI.
Pagane J. Do published guidelines predict pneumonia in children Application of the world health organization criteria to predict
presenting to an urban ED? Pediatr Emerg Care 2001; 17: 240–43. radiographic pneumonia in a US-based pediatric emergency
21 Shamo’on H, Hawamdah A, Haddadin R, Jmeian S. Detection of department. Pediatr Infect Dis J 2012; 31: 561–64.
pneumonia among children under six years by clinical evaluation. 30 Simoes EAF. Recognizing and diagnosing pneumonia in
East Mediterr Health J 2004; 10: 482–87. developing countries. Curr Opin Infect Dis 1994; 7: 358–63.
22 Mahabee-Gittens EM, Grupp-Phelan J, Brody AS, et al. Identifying 31 Shann F, Hart K, Thomas D. Acute lower respiratory tract infections
children with pneumonia in the emergency department. in children: possible criteria for selection of patients for antibiotic
Clin Pediatr (Phila) 2005; 44: 427–35. therapy and hospital admission. Bull World Health Organ 1984;
23 Hazir T, Nisar YB, Qazi SA, et al. Chest radiography in children 62: 749–53.
aged 2–59 months diagnosed with non-severe pneumonia as 32 Cherian T, John TJ, Simoes E, Steinhoff MC, John M. Evaluation of
defined by World Health Organization: descriptive multicentre simple clinical signs for the diagnosis of acute lower respiratory
study in Pakistan. BMJ 2006; 333: 629. tract infection. Lancet 1988; 2: 125–28.
24 Enwere G, Cheung YB, Zaman SMA, et al. Epidemiology and 33 Mulholland EK, Simoes EA, Costales MO, McGrath EJ,
clinical features of pneumonia according to radiographic findings Manalac EM, Gove S. Standardized diagnosis of pneumonia in
in Gambian children. Trop Med Int Health 2007; 12: 1377–85. developing countries. Pediatr Infect Dis J 1992; 11: 77–81.
25 Puumalainen T, Quiambao B, Abucejo-Ladesma E, et al. Clinical 34 Ayieko P, English M. Case management of childhood pneumonia
case review: a method to improve identification of true clinical and in developing countries. Pediatr Infect Dis J 2007; 26: 432–40.
radiographic pneumonia in children meeting the World Health 35 Pio A. Standard case management of pneumonia in children in
Organization definition for pneumonia. BMC Infect Dis 2008; 8: 95. developing countries: the cornerstone of the acute respiratory
26 Muangchana C. Factors associated with diagnosis of bacterial infection programme. Bull World Health Organ 2003; 81: 298–300.
pneumonia in children of Northern Thailand.
Southeast Asian J Trop Med Public Health 2009; 40: 563–69.