You are on page 1of 11

Descriptive Data Analysis Examining

M .D . Bland, PT, DPT, NCS, MSCI, H ow Standardized Assessments Are


P rogram in Physical T hera py,
D e p a rtm e n t o f
P rogram in
N e u ro lo g y ,
O c c u p a tio n a l
and
T h e r­
Used to Guide Post-Acute Discharge
apy, W a s h in g to n U niversity. M a il­
in g address: P rogram in Physical Recom m endations fo r Rehabilitation
T herapy, W a s h in g to n U niversity,
4444 Forest Park, C am pus Box Services A fter Stroke
8 5 0 2 , St Louis, M O 6 3 1 0 8 (USA).
Address all co rre s p o n d e n c e to D r Marghuretta D. Bland, Michelle Whitson, Hilary Harris, Jeff Edmiaston,
Bland at: b la n d m @ w u s m .w u s tl.
Lisa Tabor Connor, Robert Fucetola, Alexandre Carter, Maurizio Corbetta,
edu.
Catherine E. Lang
M . W h its o n , PT, M HS, M A , MBA,
Barnes Jewish H ospita l R ehabilita­
tio n Services, St Louis, M issouri.
Background. Use of standardized assessments in acute rehabilitation is continu­
H. Harris, MSPT, Barnes Jewish ing to grow, a key objective being to assist clinicians in determining services needed
H ospita l R e h a b ilita tio n Services. postdischarge.
J. E dm iaston, MS, CCC-SLP,
Barnes Jewish H ospital R ehabilita­ O bjective. The purpose of this study was to examine how standardized assess­
tio n Services. ment scores from initial acute care physical therapist and occupational therapist
L.T. C o n n o r, PhD, M SO T, D e p a rt­ evaluations contribute to discharge recommendations for poststroke rehabilitation
m e n t o f O c c u p a tio n a l T herapy, services.
M G H In s titu te o f H ealth Profes-
sions, Boston, M assachusetts.
Design. A descriptive analysis was conducted.
R. Fucetola, PhD, D e p a rtm e n t o f
N e uro log y, W ashing to n University.
M eth o d s. A total of 2,738 records of patients admitted to an acute care hospital
A. C arter, M D , PhD, D e p a rtm e n t with a diagnosis of stroke or transient ischemic attack w ere identified. Participants
of N e u ro lo g y , W a s h in g to n received an initial physical therapist and occupational therapist evaluation with
U niversity.
standardized assessments and a discharge recom m endation of hom e w ith no services,
M . C o rb e tta , M D , D e p a rtm e n t o f hom e with services, inpatient rehabilitation facility (IRF), or skilled nursing facility
N e u ro lo g y and D e p a rtm e n t of (SNF). A K-means clustering algorithm determ ined if it was feasible to categorize
R adiology, W a s h in g to n U niversity.
participants into the 4 groups based on their assessment scores. These results were
C.E. Lang, PT, PhD, P rogram in com pared with the physical therapist and occupational therapist discharge recom­
Physical T hera py, D e p a rtm e n t o f mendations to determ ine if assessment scores guided postacute care
N e u ro lo g y , and P rogram in O c c u ­
recommendations.
p a tio n a l T hera py, W a s h in g to n
U niversity.
Results. Participants could be separated into 4 clusters (A, B, C, and D) based on
[B land M D , W h its o n M , Harris H,
assessment scores. Cluster A was the least impaired, followed by clusters B, C, and D.
e t al. D e scriptive data analysis
e x a m in in g how s ta n dard ized
In cluster A, 50% of the participants w ere recom m ended for discharge to home
assessments are used to g u id e w ithout services, whereas 1% w ere recom m ended for discharge to an SNF. Clusters
p o s t-a c u te discha rge re c o m m e n ­ B, C, and D each had a large proportion of individuals recom m ended for discharge to
da tio n s fo r re h a b ilita tio n services an IRF (74%-80%). There was a difference in percentage of recom m endations across
a fte r stroke. P hys T h e r.
the clusters that was largely driven by the differences betw een cluster A and clusters
2 0 1 5 ;9 5 :7 1 0 -7 1 9 .]
B, C, and D.
© 20 15 A m erican Physical Therapy
Association Lim itations. Additional unknow n factors may have influenced the discharge
Published Ahead o f Print: recommendations.
D ecem ber 11, 2014
A ccepted: N o ve m b e r 26, 2014 Conclusions. Participants poststroke can be classified into meaningful groups
S ub m itted: A ug ust 13, 20 14
based on assessment scores from their initial physical therapist and occupational
therapist evaluations. These assessment scores, in part, guide poststroke acute care
p o s t a R apid R esponse to discharge recommendations.
f0 j th is a rtic le at:
v" • p tjo u rn a l.a p ta .o rg

710 ■ Physical T h e ra p y V o lu m e 95 Num ber 5 M ay 2015


D escrip tive D a ta Analysis E x a m in in g S ta n d a rd iz e d Assessments

n the acute care setting, the those with severe deficits would be and occupational therapist evalua­

I median length of stay for people grouped together and would most
with stroke is 3 days.1 Rehabilita­ likely receive the recommendation
tion clinicians often see a patient for discharge to an SNF. Patients
tions. The recommendations for dis­
charge services from speech-
language pathologists were not
only once for an acute care evalua­ with mild to moderate deficits would included; participants with stroke or
tion, and a key responsibility is to be somewhere between these TIA were referred for speech-
screen for sensorimotor, cognitive, groups and would receive a recom­ language pathology therapy only if
and language deficits. Despite the mendation of home with services or they screened positive for a language
challenges of patient-, clinician-, and IRF. As standardized assessments deficit (by an occupational thera­
facility-specific barriers,2"9 use of become more routinely adminis­ pist), screened positive for a swal­
standardized assessments across the tered, the results of this study will lowing deficit (by nursing staff), or
continuum of care is continuing to provide information on the next met the criteria for further determi­
grow through multiple efforts.10-13 A step: examining how standardized nation of subtle higher-level cogni­
goal of standardized assessment is to assessments shape and guide rehabil­ tive deficits (based on the occupa­
objectively quantify deficits of itation clinical practice. tional therapy screening battery).19
impairment, activity limitations, and Typical initial evaluations at an acute
participation restrictions to assist Method care hospital for patients poststroke
rehabilitation clinicians in determin­ P a r t i c i p a n t s take an average of 20 minutes for
ing patient prognosis, appropriate This study utilized a convenience physical therapy and 39 minutes for
interventions, and the need for addi­ sample of 2,738 patient records occupational therapy.19 Discharge
tional services.4 513"16 It is assumed stored in the Brain Recovery Core recommendations were made by the
that standardized assessments com­ database and additional variables col­ physical therapists and occupational
pleted during the initial evaluation lected in the Cognitive Rehabilita­ therapists during the initial evalua­
will help clinicians in determining tion Research Group database from tion but could be revised at any time.
these factors; however, research has January 2010 through March In our review of the records, <5% of
not shown that this is the case. 2013.1017 All participants had a pri­ the discharge recommendations
mary diagnosis of stroke or transient made from the initial physical thera­
The aim of this study was to examine ischemic attack (TLA).18 Each partic­ pist or occupational therapist evalu­
if standardized assessment scores ipant provided informed consent to ation were changed prior to patient
from initial acute care physical ther­ have his or her stroke rehabilitation discharge; thus, the discharge rec­
apist and occupational therapist eval­ data stored and used for research. ommendation made as part of the
uations systematically contribute to The Washington University Human initial evaluation was used for the
discharge recommendations for Research Protection Office approved analysis. Finally, only patient records
poststroke rehabilitation services. the databases and studies using where the physical therapist and
After initial evaluation of patients in de-identified data. occupational therapist made the
our acute care facility, physical ther­ same discharge recommendation for
apists and occupational therapists Participants averaged 0 days future services were used for the
make one of the following discharge between onset of stroke to admis­ analysis. Arguably, the need for a
recommendations: (1) home with no sion to the acute care hospital. Once specific discharge service has greater
services, (2) home with services, (3) a patient is admitted to the acute credence when both the physical
inpatient rehabilitation facility (IRF), care hospital and is medically stable, therapist and occupational therapist
or (4) skilled nursing facility (SNF). If rehabilitation services for physical make the same recommendation.
the standardized assessments, which therapy and occupational therapy Figure 1 shows a flowchart of all
measure key impairments and activ­ are ordered, usually within 24 hours records screened (N =4,6l3) and
ity limitations, systematically con­ of admission. The acute care physi­ how the final sample (n = 2,738) was
tribute to discharge recommenda­ cal therapist evaluation is com­ achieved.
tions, we would expect patterns or pleted, on average, within 4 days
groupings of patients based on the (median =1 day) of admission, and V a r ia b le s A s s e s s e d
severity of the deficits. For example, the occupational therapist evalua­ At the acute care hospital, clinicians
patients with no deficits to minimal tion is completed, on average, within completed a standardized initial eval­
deficits would likely be grouped 3 days (median = 1 day) of admission. uation on all participants post-
together and would most often The recommendation for discharge stroke.1019 The assessments com­
receive the recommendation to go services for this analysis originated pleted in this evaluation are part of a
home with no services, whereas from the initial physical therapist required standardized battery of tests

May 2015 Volume 95 Number 5 Physical Therapy ■ 711


D e s c rip tiv e D a ta A n a ly s is E x a m in in g S ta n d a r d iz e d A s s ess m en ts

F ig u re 1.
Participant records utilized from the Brain Recovery Core database. Of the initial 4,61 3 patients poststroke w ho consented to
participate, 2,738 participants were included in the analysis. PT=physical therapist, O T=occupational therapist, IRF=inpatient
rehabilitation facility, SNF=skilled nursing facility.

that encompass the sensorimotor, Blessed Test score to screen for therapist or occupational therapist
cognitive, and language domains and dementia or other cognitive impair­ evaluations archived in the Brain
that are com pleted across the contin­ m ent,30 Trail Making Test A and B Recovery Core clinical database. As
uum of care. The assessments w ere scores to assess for visual scanning with most clinical databases, the
chosen to meet the needs of each and attention,31-32 Unstructured majority of variables w ere present
discipline (physical therapy, occupa­ Mesulam total score to assess for most participants, but some data
tional therapy, and speech-language neglect,33’35 15-item Boston Naming w ere missing. Across the 2,738 par­
pathology) and each service (acute, Test score to screen for aphasia,36' 38 ticipants and 15 variables, 32%
inpatient, outpatient). In addition, and scores for Functional Indepen­ (13,230/41,070) of the data were
assessments had to be clinically use­ dence Measure items (gait assist, missing. To limit the introduction of
ful for the entire spectrum of stroke grooming, lower body dressing, and selection bias and loss of information
severities. The following variables toileting) to assess assistance and efficiency, multiple im putation
along with the construct being required for activities of daily liv­ was utilized to account for the miss­
assessed from the initial acute care ing.28-39’41 In addition, data for other ing data.42' 48 Multiple imputation
physical therapist and occupational demographic variables that could allows for missing values to be
therapist evaluations were: upper affect the recom m endation for dis­ replaced through statistical algo­
and lower extremity Motricity Index charge services were collected: age, rithms that capitalize on the case and
scores of the affected limb to assess race, sex, and availability of help at group observed values and variabil­
paresis,20-21 light touch on the palm home. ity.46-47-49’52 Previous analysis of data
of the hand and the dorsum of the from the Brain Recovery Core data­
foot of the affected limb to assess D a ta A n a ly s is base53 has shown that clinical data
somatosensation,22-23 Berg Balance We used IBM SPSS version 21 (IBM were missing at random (ie, missing
Scale score to assess static and Corporation, Armonk, New York) values w ere not systematically differ­
dynamic balance,24-25 10-m walk for all statistical analyses, and the cri­ ent from those w ithout missing val­
speed to assess gait speed for those terion for statistical significance was ues).42’44’46’49’51-54 To account for
participants w ho could walk w ithout set at P<.05. The independent vari­ the uncertainty in missing data, mul­
hands-on assistance,26-29 Short ables came from the initial physical tiple im putation utilized multiple

712 ■ Physical Therapy Volume 95 N um bers May 2015


Descriptive Data Analysis Examining Standardized Assessments

Table 1.
K-Means Cluster Analysis0

V a ria b le C lu s te r A C lu s te r B C lu s te r C C lu s te r D W it h in -im p u t a t io n B e tw e e n -im p u ta tio n


(A ffe c te d Side as A p p lic a b le ) (n = 9 0 1 ) (n = 8 1 4 ) (n = 6 8 6 ) (n = 3 3 7 ) V a ria n c e V a ria n c e

Age (y) 58 (0 ) 66 (0.51) 68 (0.48) 69 (0.69) 0.009 7.73

Race Caucasian Caucasian Caucasian Caucasian 0 0

Sex Male Female Female Female 0 0.08

Help at home Yes Yes Yes Yes 0 0

UE Motricity Index* 84 (0.32) 67 (0.94) 54 (1.62) 38 (2.45) 0.096 128.27

LE Motricity Index* 86 (0.32) 70 (1.07) 58 (1.77) 42 (3.16) 0.143 115.20

Palm light touch sensation1- Normal Normal Normal Impaired 0.002 0.04

Dorsum foot light touch sensation4 Normal Impaired Impaired Impaired 0.002 0.11

Short Blessed Test* 3 (0.42) 9 (0 ) 15 (0.67) 20 (0.47) 0.008 17.49

Trail Making Test A (s) 47 (0.82) 117(3.83) 207 (5.54) 304 (9.36) 1.336 4,137.57

Trail Making Test B (s) 110(1.89) 277 (6.83) 440 (11.14) 632(17.90) 4.946 16,619.82

Unstructured Mesulam total score§ 4 (0 ) 14 (0.63) 28 (0.74) 42 (1.83) 0.042 93.39

Boston Naming Test® 13 (0 ) 10 (0.42) 8 (0.52) 5 (0.53) 0.007 5.69

FIM, walking assist# 5 (0 ) 3 (0.48) 3 (0 ) 2 (0 ) 0.002 0.55

FIM, groom ing# 6 (0 ) 4 (0 ) 3 (0 ) 3 (0.48) 0.002 0.74

FIM, dressing* 5 (0 ) 3 (0 ) 2 (0 ) 2 (0 ) 0 0.66

FIM, toileting* 5 (0.52) 3 (0 ) 2 (0 ) 2 (0.42) 0.004 0.91

Berg Balance Scale** 37 (0.57) 1 3 (0.48) 7 (0.48) 4 (0.48) 0.010 75.44

10-m walking speed (m/s) 1 (0) 0 (0 ) 0 (0 ) 0 (0 ) 0 0.08

“ The K-means cluster analysis produced 4 distinct clusters (A, B, C, and D) for each of the 10 imputations. The cluster center is the overall mean of a
particular cluster. The pooled final cluster centers averaged across the 10 imputations are shown in the table. Values are expressed as means (rounded to
whole numbers) and standard deviations, and additional parameter estimates are included. The value in the parentheses is the standard deviation of the
cluster center (across the 10 imputations), not the standard deviation of the entire cluster. UE=upper extremity, LEHower extremity, FIM = Functional
Independence Measure. Variable scales for reference: * 0 is complete paresis, 100 is normal strength; * normal, impaired, absent; * 0 is normal, 28 is severe
dementia; 5 total score is left plus right omissions, 0 is no omissions, 60 is all symbols o m itte d ;110 is severe aphasia, 15 is normal; * 1 is total assist, 7 is
independent; ** 0 is severe balance deficits, 56 is normal.

imputed data sets as opposed to a tance to the center (overall mean) of based on the assessment and demo­
single data set.52 Ten imputations that particular cluster compared graphic variables analyzed. Once the
w ere run, producing 10 im puted w ith the other clusters.55 The vari­ K-means cluster analysis was run on
data sets of the assessment variables. ables used in the analysis included each of the 10 im puted data sets, the
The decision to run 10 imputations the impairment- and activity-level results w ere combined. Using the
was based on concepts from previ­ assessments listed previously, plus most common cluster assignment
ous studies suggesting that 10 impu­ the demographic variables of age, (mode) across the 10 imputations,
tations can provide sufficient effi­ race, sex, and help at home. Because each participant was partitioned into
ciency of the estimate.42-44'50'51 a K-means cluster analysis expects his or her final cluster. In addition,
the num ber of clusters to be speci­ each im putation produced 4 slightly
The next step was a K-means cluster­ fied prior to the analysis, 2-, 3-, 4-, different clusters; therefore, the clus­
ing algorithm run on each of the 10 and 5-cluster solutions w ere ter center for each of the 4 clusters
im puted data sets to examine if par­ explored. Although each solution was averaged across all 10 imputa­
ticipants could be categorized into was statistically feasible, the tions, creating the final cluster cen­
relatively homogeneous groups 4-cluster solution was ultimately cho­ ters. Both within-imputation and
based on their initial assessment sen to align with clinical constructs between-imputation variance also
scores. The K-means m ethod parti­ (4 discharge recom m endations are w ere calculated to help with the
tioned participants into a cluster if commonly made).43'55"57 Each analy­ interpretation of the analysis.48'50 52
their respective variables (assess­ sis assigned participants to a partic­
ment scores) w ere closest in dis­ ular cluster and defined that cluster

May 2015 Volume 95 Number 5 Physical Therapy ■ 713


D e s c rip tiv e D a ta A n a ly s is E x a m in in g S ta n d a r d iz e d A s s ess m en ts

F ig u re 2.
R e c o m m e n d a tio n fo r fu tu re re h a b ilita tio n services across all 4 clusters. (A) S um m ary o f discharge re c o m m e n d a tio n as a p e rcentage
o f each cluster. (B) S u m m a ry o f discharge re c o m m e n d a tio n as a perce n ta g e o f th e w h o le sam ple. D ischarge re co m m e n d a tio n s
in clu d e : h o m e w ith o u t services, h o m e w ith services, in p a tie n t re h a b ilita tio n fa c ility (IRF), o r skilled nu rsin g fa c ility (SNF).

Finally, the results of the cluster anal­ Results These results are contrasted with
ysis (ie, relatively homogeneous Figure 1 presents a flow chart of how cluster D, which contained the old­
groups based on the independent the 2,738 participants were identi­ est patients (final cluster center of 69
variables) were compared with the fied. Of these, 490 participants (18%) years) and had the greatest amount
therapy discharge recommendations were recommended by both physi­ of impairment, with the center
for future rehabilitation services. cal therapists and occupational ther­ defined as affected upper and lower
The percentage of people assigned apists to discharge home without extremity Motricity Index scores of
to each discharge recommendation services, 261 (10%) to discharge 38 and 42 (out of 100 points),
within each cluster was calculated. home with services (home health or respectively; maximal assist required
Percentages were compared across outpatient), 1,727 (63%) to dis­ on functional tasks; and positive
clusters using a chi-square analysis. charge to an IRF, and 260 (10%) to screens for severe dementia and
We anticipated that the cluster that discharge to an SNF. neglect. Overall, cluster A was least
centered on minimal or no deficits impaired based on assessment
would have a high percentage of par­ The K-means cluster analysis pro­ scores, followed by clusters B, C, and
ticipants referred to home with no duced 4 distinct clusters: A, B, C, and D, which was the most impaired. In
services. In contrast, the cluster that D. Table 1 presents the pooled final addition, the greatest proportion of
centered on the more severe deficits cluster centers (mean and standard the sample was allocated to cluster A
across the sensorimotor, cognition, deviation of cluster center for A, B, (n=901), followed by cluster B
and language domains might have C, and D across the 10 imputations) (n=8l4), cluster C (n=686), and
the highest percentage of partici­ and parameter estimates of the impu­ cluster D (n=337).
pants referred to an SNF. Clusters tations. Cluster A contained the
that centered on participants with youngest participants, with a final Assignment of participants to the 4
mild to moderate deficits might have cluster center for age of 58 years. clusters was compared with the actual
greater percentages of participants Cluster A had those with the least discharge recommendations made by
recommended to go home with ser­ amount of impairment on the stan­ the clinicians (home without services,
vices or to an IRF. dardized assessment battery, with home with services, IRF, or SNF). Fig­
the center defined as affected upper ure 2 shows the discharge recommen­
R o le o f t h e F u n d in g S o u rc e and lower extremity Motricity Index dation percentages across all 4 clus­
Funding was provided by the Barnes scores of 84 and 86 (out of 100 ters, expressed as the percentage per
Jewish Hospital Foundation and the points), respectively; modified inde­ cluster (Fig. 2A) and as a percentage of
Washington University McDonnell pendence or supervision on func­ the whole sample (Fig. 2B). In cluster
Center for Systems Neuroscience. tional activities; and a negative A, 50% of the participants were rec­
screen for dementia and neglect. ommended to go home without ser-

714 ■ Physical Therapy Volum e 95 N um ber 5 May 2015


D e s c rip tiv e D a ta A n a ly s is E x a m in in g S ta n d a r d iz e d A s s e s s m e n ts

Table 2.
C lin ic a l R e p re s e n ta tio n o f P a rtic ip a n ts in Each o f th e 4 C lu s te rs 0

C lu s te r A C lu s te r B C lu s te r C C lu s te r D

Im p a ir m e n t, S e n s o rim o to r Im p a ir m e n t, S e n s o rim o to r Im p a ir m e n t , S e n s o rim o to r Im p a ir m e n t , S e n s o rim o to r


• M o to r : fu ll u p p e r a n d lo w e r • M o to r: fu ll u p p e r a n d lo w e r • M o to r : u p p e r a n d lo w e r • M o to r : lim ite d u p p e r an d
e x tr e m ity m o v e m e n t a g a in s t e x tr e m ity m o v e m e n t a g a in s t e x tr e m ity m o v e m e n t b u t n o t lo w e r e x tr e m ity m o v e m e n t
g r a v ity w ith m o d e ra te to g ra v ity , s o m e a b le to take fu ll ra n g e o f m o tio n • S ensa tion: lig h t to u c h
m a x im a l resistance m o d e ra te resistance • S ensa tion: lig h t to u c h in ta c t im p a ire d
• S en sa tio n : lig h t to u c h in ta c t • S ensa tion: lig h t to u c h in ta c t a n d im p a ire d
a n d im p a ire d

Im p a ir m e n t, C o g n itio n Im p a ir m e n t, C o g n itio n Im p a ir m e n t , C o g n itio n Im p a ir m e n t , C o g n itio n


• D e m e n tia : n o t p re s e n t • D e m e n tia : m in im a l • D e m e n tia : m o d e ra te • D e m e n tia : m a jo r im p a irm e n t
• N e g le c t: n o t p re se n t im p a irm e n t im p a irm e n t • N e g le c t: m a jo r im p a irm e n t
• N e g le c t: m in im a l im p a irm e n t • N e g le c t: m in im a l im p a irm e n t

Im p a ir m e n t, L a n g u a g e Im p a ir m e n t, L a n g u a g e Im p a ir m e n t , L a n g u a g e Im p a ir m e n t , L a n g u a g e
• N o t p re s e n t • M in im a l im p a irm e n t • M o d e ra te im p a irm e n t • M a jo r im p a irm e n t

A c tiv ity A c tiv ity A c tiv ity A c tiv ity


• Basic A D L: m o d ifie d • Basic A D L: m in im a l to • Basic A D L: m o d e ra te to • Basic A D L: m a x im a l assistance
in d e p e n d e n c e o r su p e rv is io n m o d e ra te assistance m a x im a l assistance • B alance: m a jo r im p a irm e n t
• B alance: m in im a l t o m o d e ra te • Balance: m o d e ra te to m a x im a l • B alance: m a jo r im p a irm e n t • W a lk in g : u n a b le to a m b u la te
im p a irm e n t im p a irm e n t • W a lk in g : u n a b le t o a m b u la te in d e p e n d e n tly
• W a lk in g : a m b u la te s a t fu ll • W a lk in g : u n a b le to a m b u la te in d e p e n d e n tly
c o m m u n ity speeds in d e p e n d e n tly

° C lusters are d e sc rib e d in g e n e ra l te rm s o f s o m e o f th e key im p a ir m e n t a n d a c tiv ity lim ita tio n d e fic its . A D L = a c tiv itie s o f d a ily liv in g .

vices, whereas 1% were recom­ Through the use of a K-means clus­ types of participants who were clas­
mended to go to skilled nursing. tering algorithm, standardized assess­ sified in each of the 4 clusters. In this
Clusters B, C, and D each had a large ment scores from initial evaluation figure, the scores from the mean
proportion of individuals recom­ plus demographic variables were cluster centers have been trans­
mended to go to IRF (74%-80%). used to divide participants into 4 formed into descriptors of a partici­
There was a difference in percentage meaningful clusters. These 4 clusters pant in each category. When the par­
of recommendations across the clus­ represent different levels of stroke ticipants were characterized by
ters (y2=1334, PC.001) that was severity characterized by sensorimo­ impairments and activity limitations
largely driven by the differences tor, cognitive, and language deficits. across the sensorimotor, cognitive,
between cluster A and clusters B, C, Physical therapist and occupational and language domains, 4 distinct
and D. The data in Figure 2 indicate therapist recommendations for post­ groups were present. Thus, informa­
that assessment results (severity based stroke rehabilitation services were tion from the standardized assess­
on sensorimotor, cognitive, and lan­ somewhat different across the clus­ ments can quantify participants’ def­
guage deficits) and demographic vari­ ters, suggesting that standardized icits into different levels of severity;
ables were partially steering discharge assessments, in part, are guiding we expected that discharge recom­
recommendations. To check that mul­ poststroke acute care discharge rec­ mendations for additional rehabilita­
tiple imputation did not alter the ommendations for rehabilitation tion services would largely match
results, the analysis was re-run on the services. this pattern.
nonimputed data. The resulting clus­
ters and comparison with discharge Although recovery poststroke is het­ Discharge recommendations varied
recommendations were similar. erogeneous, multiple studies suggest somewhat across clusters, but not as
that general recovery of function can much as expected. There were indi­
D is c u s s io n be reasonably predicted in the first viduals in cluster A who were recom­
This study provides new information few days after stroke.58-64 In the mended to go to an IRF and large,
about the contributions of standard­ majority of these studies, standard­ similar percentages in clusters B, C,
ized assessment scores to the post­ ized assessments were the founda­ and D, who also were recommended
acute discharge rehabilitation ser­ tion of these prediction rules. The to go to an IRF, despite increasing
vice recommendations made by K-means cluster analysis run in this severity and other factors predictive
physical therapists and occupational study supports this concept. Table 2 of poorer outcomes. Several reasons
therapists for people poststroke. is a clinical representation of the may exist as to why clusters from the

M ay 2015 V o lu m e 95 N um ber 5 Physical T h e ra p y ■ 715


Descriptive Data Analysis Examining Standardized Assessments

standardized assessments do not Although the clinicians strive to approach explains the higher per­
more uniformly align with discharge complete 100% of assessments, it is centage of overall IRF recommenda­
recommendations. First, more ther­ not always possible to administer all tions (largest group of participants)
apy has been shown to produce bet­ of measures in a prescribed assess­ but does not explain why 74% to
ter outcomes poststroke.65-67 Of the ment battery in all circumstances in a 80% of individuals were still recom­
possible discharge recommenda­ clinical setting. Use of multiple mended to go to IRF across clusters
tions, an IRF offers the most therapy imputation statistical methods to B, C, and D, which have varying lev­
per day (3 hours). It is possible that limit the loss of data and to decrease els of deficits.
clinicians refer the bulk of patients the introduction of selection bias is
with any amount of impairment or continuing to grow in the litera­ The third limitation is the selection
activity limitation to an IRF to foster ture,69-71 although it is still under­ of 4 clusters as part of the analysis.
the greatest opportunity for recov­ utilized in rehabilitation studies. We selected 4 clusters to match the
ery.68 Second, an IRF may be more Although we saw similar results number of discharge recommenda­
often recommended, anticipating when run on the nonimputed data, tions, although other numbers of
that if a patient is discharged home, we cannot completely rule out the clusters also were statistically feasi­
he or she may not ultimately receive possibility that the imputation biased ble. It is possible that the true num­
necessary services at a later point in our data in some unknown, unpre­ ber of clusters could be different
time. For example, when a patient is dictable way. from 4. Other acute care hospitals
discharged home with orders for ser­ may have different classifications of
vices, it may inherently be harder to A second limitation is the exclusion discharge recommendations (ie,
obtain those services (eg, calling, of 1,196 participants from the study more or less than 4). Our use of 4
scheduling, transportation, availabil­ due to disagreement between physi­ clusters might limit the generalizabil-
ity of an appointment) compared cal therapist and occupational thera­ ity of these results to facilities using
with if the patient was admitted to pist discharge recommendations. different recommendations.
an IRF. Finally, although the stan­ For 385 participants, physical thera­
dardized assessments are adminis­ pists and occupational therapists did The final limitation is that the dis­
tered by clinicians, the score value of not agree on the discharge location charge recommendation may have
the assessment and its relationship to (home, IRF, SNF), and for 811 partic­ been influenced by factors not
predictive models may not be com­ ipants, physical therapists and occu­ included in this analysis. The dis­
pletely understood or utilized by the pational therapists did not agree on charge recommendation is made at
clinician when making discharge whether the participant should the time of the initial evaluation,
recommendations. In addition, clini­ receive services at home. However, when the clinician knows the results
cians practicing in the acute care each discipline assesses somewhat of his or her own assessment, but
environment do not necessarily see different domains, so it is not surpris­ may have varying amounts of infor­
the extent to which their patients ing that differences in discharge rec­ mation about the patient’s history
improve by the end of their rehabil­ ommendation exist. For example, a and availability of family support.
itation, making it more difficult to participant with a score of 45 on the Additional factors such as clinical
see the relationship between assess­ Berg Balance Scale and minimal information from other disciplines,
ment at the acute hospital stay and assist to walk may receive the recom­ medication, medical needs, or insur­
final outcome. Thus, more education mendation from the physical thera­ ance could and should have
about the utility of these measures to pist to discharge home with services. informed the discharge recommen­
the clinicians may be needed. If this participant has significant cog­ dation. It is unlikely, however, that
nitive dysfunction, the occupational across the 2,738 participants, these
Study Limitations therapist may recommend an IRF. As potential confounders would have
Four limitations are important to the recommendation for future ser­ outweighed the clinician’s assess­
consider when interpreting these vices was the same for the majority ment of impairment or activity limi­
results. The first is that the data came of patients, the decision was made to tations so much as to modify or deny
from a clinical database with missing exclude participants where physical needed services.
data. The physical therapists and therapists and occupational thera­
occupational therapists have been pists did not agree. Exclusion was Future Studies
trained in the administration of the done to strengthen the analysis by Rehabilitation poststroke has the
assessments, were monitored for eliminating some of the variability. In potential to save many people from
consistency, and complete annual excluding participants, however, disability,72'73 with the goal of return­
competencies on the assessments.10 bias may have been introduced. This ing people to home and community

716 ■ Physical Therapy Volume 95 Number 5 May 2015


D e s c rip tiv e D a ta A n a ly s is E x a m in in g S ta n d a r d iz e d A s s e s s m e n ts

life with as much independence as across the sensorimotor, cognitive, 6 Stevens JG, Beurskens AJ. Implementation
of measurement instruments in physical
possible.65 For patients to receive and language domains. These results therapist practice: development of a tai­
the maximum benefit from rehabili­ suggest that standardized assessment lored strategy. Phys Ther. 2010;90:953-
961
scores partially guide poststroke
.
tation, the clinician must be able to
acute care discharge recommenda­ 7 Swinkels RA, Van Peppen RP, Wittink H,
determine additional rehabilitation et al. Current use and barriers and facilita­
services that are needed and the best tions for additional poststroke reha­ tors for implementation of standardised
bilitation services. measures in physical therapy in the Neth­
setting for their delivery. As high­ erlands. BMC Musculoskelet Disord. 2011;
lighted in a recent study,68 the pre­ 12 : 106 .
diction of discharge destination is a D r Bland, Ms W h its o n , D r C o n n o r, D r Fuce-
8 Van Peppen RP, Maissan FJ, Van Genderen
fundamental part of the clinician’s FR, et al. Outcome measures in physio­
to la , D r C arter, D r C o rb e tta , and D r Lang therapy management of patients with
role in acute care, and the predicted p ro v id e d c o n c e p t/id e a /re s e a rc h de sig n. D r stroke: a survey into self-reported use, and
discharge recommendation is a cen­ B land, D r C o n n o r, D r C o rb e tta , and D r Lang barriers to and facilitators for use. Phys-
p ro v id e d w ritin g . D r Bland, D r Fucetola, and
iotber Res Int. 2008;13:255-270.
tral driver for all future rehabilita­
D r Lang p ro v id e d data c o lle c tio n . D r Bland 9 Wedge FM, Braswell-Christy J. Brown CJ,
tion care and the quality of that care and D r Lang p ro v id e d da ta analysis. D r Bland et al. Factors influencing the use of out­
that a patient poststroke receives. and D r C o n n o r p ro v id e d p ro je c t m a n a g e ­
come measures in physical therapy prac­
tice. Physiother Theory Pract. 2012;28:
Therefore, our study is an important m e n t. D r C o rb e tta and D r Lang p ro v id e d 119-133.
first step in examining how dis­ fu n d p ro c u re m e n t. M s W h its o n and Ms H ar­
10 Lang CE, Bland MD, Connor LT, et al.The
ris p ro v id e d p a rticip a n ts. Ms W h itso n , Ms
charge recommendations are made brain recovery core: building a system of
Harris, M r E dm iaston, an d D r Lang p ro vid e d organized stroke rehabilitation and out­
and the types of information clini­ fa c ilitie s /e q u ip m e n t. Ms W h itso n , Ms Harris, comes assessment across the continuum
cians are utilizing to make these deci­ an d D r C o n n o r p ro v id e d in s titu tio n a l lia i­ of care. JNPT. 2011;35:194-201.
sions. Future studies are needed to sons. M s Harris, M r E dm iaston, D r C o n n o r, 11 Kinney CL, Eikenberry iMC, Noll SF, et al.
examine additional factors that may D r Fucetola, and D r C a rte r p ro v id e d c o n su l­ Standardization of interdisciplinary clini­
ta tio n (in c lu d in g review of m a n u scrip t
cal practice and assessment in stroke reha­
be contributing to the discharge rec­ bilitation. Int J Phys Med Rehabil. 2013;
before subm issio n). T he a u thors th a n k th e 1:7.
ommendations made as well as to staff, a d m in is tra to rs, and da ta e n try te a m at
further probe the utility of the stan­ Barnes Jewish H ospital, The R e h a bilitatio n
12 Moore JL, Raad J, Ehrlich-Jones L, Heine-
mann AW. Development and use of a
dardized assessments in clinical deci­ In s titu te o f St Louis, and W a sh in g to n U n iver­ knowledge translation tool: the rehabilita­
sion making. sity fo r th e ir e nthusiasm , s u p p o rt, and efforts tion measures database. Arch Phys Med
on this p ro je ct. Rehabil. 2014;95:197-202.
13 Shields RK, Leo KC, Miller B, et al. An
It is also important to determine if F u n d in g w as p ro v id e d b y th e Barnes Jewish acute care physical therapy clinical prac­
the 4 resultant clusters in this analy­ H ospital F o u n d a tio n and th e W a s h in g to n tice database for outcomes research. Phys
U n iversity M c D o n n e ll C e n te r fo r Systems Ther. 1994;74:463-470.
sis could be replicated at other insti­
N euroscience. 14 Garland AF, Kruse M, Aarons GA. Clini­
tutions and if similar patterns exist in cians and outcome measurement: what’s
physical therapist and occupational D O I: 1 0 .2 5 2 2 /p tj.2 0 1 4 0 3 4 7 the use? J Behav Health Serv Res. 2003;
therapist discharge recommenda­ 30:393-405.
tions. This information would fur­ R eferences
15 Vogel AP, Maruff P, Morgan AT. Evaluation
of communication assessment practices
ther increase the generalizability of 1 Go AS, Mozaffarian D, Roger VL, et al; during the acute stages post stroke. J Eval
these results. In addition, this study American Heart Association Statistics Com­ Clin Pract. 2010;16:1183-1188.
analyzed only the recommendation mittee and Stroke Statistics Subcommittee. 16 World Health Organization. International
Heart disease and stroke statistics—2014 Classification o f Functioning, Disability
for future discharge services, not update: a report from the American Heart and Health (ICF). 2002. Available at:
where participants actually went or Association. Circulation. 20l4;129:e28- http ://www. w ho.int/classification/icf/en/.
e292. Accessed June 18, 2014.
long-term outcomes. It would be
2 Bayley MT, Hurdowar A, Richards CL, et al. 17 Harris PA, Taylor R, Thielke R, et al.
important to compare the recom­ Barriers to implementation of stroke reha­ Research electronic data capture (RED-
mendation for services and the types bilitation evidence: findings from a multi- Cap): a metadata-driven methodology and
site pilot project. Disabil Rehabil. 2012; workflow process for providing transla­
of services that the patient actually 34:1633-1638. tional research informatics support.
received. 3 Deyo RA, Patrick DL. Barriers to the use of J B io m e d Inform. 2009;42:377-381.
health status measures in clinical investi­ 18 Bland MD, Sturmoski A, Whitson M, et al.
In conclusion, use of standardized gation, patient care, and policy research. Prediction of discharge walking ability
Med Care. 1989;27(3 suppl):S254-S268. from initial assessment in a stroke inpa­
assessment in clinical rehabilitation tient rehabilitation facility population.
4 Jette DU, Halbert J, Iverson C, et al. Use of
is continuing to grow and is becom­ Arch Phys Med Rehabil. 2012;93:1441-
standardized outcome measures in physi­
1447.
ing a mechanism for prediction of cal therapist practice: perceptions and
applications. Phys Ther. 2009;89:125-135. 19 Bland MD, Sturmoski A, Whitson M, et al.
patient outcomes. These assess­ Clinician adherence to a standardized
ments are quick and efficient and 5 Potter K, Fulk GD, Salem Y, Sullivan J. assessment battery across settings and dis­
Outcome measures in neurological physi­ ciplines in a poststroke rehabilitation pop­
can objectively classify deficits of cal therapy practice, part 1: making sound ulation. Arch Phys Med Rehabil. 2013;94:
impairment and activity limitations decisions. JNPT. 2011;35:57-64. 1048-1053el.

M a y 20 15 V o lu m e 95 Num ber 5 Physical T h e ra p y ■ 717


D e s c rip tiv e D a ta A n a ly s is E x a m in in g S ta n d a r d iz e d A s s ess m en ts

20 Collin C, Wade D. Assessing motor impair­ 36 Calero MD, Arnedo ML, Navarro E, et al. 54 Schafer JL. Analysis o f Incomplete Multi­
ment after stroke: a pilot reliability study. Usefulness of a 15-item version of the Bos­ variate Data. London, United Kingdom:
J Neurol Neurosurg Psychiatry. 1990;53: ton Naming Test in neuropsychological Chapman & Hall/CRC Press; 1997.
576-579. assessment of low-educational elders with
dem entia./ Gerontol B Psychol Sci Soc Sci. 55 Moffroid MT, Haugh LD, Henry SM, Short
21 Veerbeek JM, Van Wegen EE, Harmeling- 2002;57:P187-P191. B. Distinguishable groups of musculoskel­
Van der Wei BC, Kwakkel G; EPOS Inves­ etal low back pain patients and asymptom­
tigators. Is accurate prediction of gait in 37 Goodglass H, Kaplan E, Barresi B. Boston atic control subjects based on physical
nonambulatory stroke patients possible Diagnostic Aphasia Examination. 3rd measures of the NIOSH Low Back Atlas.
within 72 hours poststroke? The EPOS ed. Philadelphia, PA: Lippincott, Williams Spine (Phila Pa 1976). 1994/9:1350-
study. Neurorehabil Neural Repair. 2011; & Wilkins; 2001. 1358.
25:268-274.
38 Lopez MN, Arias GP, Hunter MA, et al. Bos­ 56 Armstrong JJ, Zhu M, Hirdes JP, Stolee P.
22 Sullivan JE, Hedman LD. Sensory dysfunc­ ton Naming Test: problems with adminis­ K-means cluster analysis of rehabilitation
tion following stroke: incidence, signifi­ tration and scoring. Psychol Rep. 2003;92: service users in the Home Health Care Sys­
cance, examination, and intervention. Top 468-472. tem of Ontario: examining the heteroge­
Stroke Rehabil. 2008;15:200-217. neity of a complex geriatric population.
39 Hsueh IP, Lin JH, Jeng JS, Hsieh CL. Com­
23 Winward CE, Halligan PE, Wade DT. Cur­ parison of the psychometric characteris­ Arch Phys Med Rehabil. 2012;93:2198-
rent practice and clinical relevance of tics of the Functional Independence Mea­ 2205.
somatosensory assessment after stroke. sure, 5-item Barthel Index, and 10-item 57 Steinley D. K-means clustering: a half-
Clin Rehabil. 1999;13:48-55. Barthel Index in patients with stroke. century synthesis. B rJ Math Stat Psychol.
J Neurol Neurosurg Psychiatry. 2002;73: 2006;59(pt l):l-3 4 .
24 Berg KO, Wood-Dauphinee S, Williams JI. 188-190.
The Balance Scale: reliability assessment 58 Jongbloed L. Prediction of function after
with elderly residents and patients with an 40 Keith RA, Granger CV, Hamilton BB, Sher-
win FS. The Functional Independence stroke: a critical review. Stroke. 1986;17:
acute stroke. Scand J Rehabil Med. 1995; 765-776.
27:27-36. Measure: a new tool for rehabilitation. Adv
Clin Rehabil. 1987;1:6-18. 59 Jorgensen HS, Nakayama H, Raaschou HO,
25 Berg KO, Wood-Dauphinee S, Williams JI, Olsen TS. Recovery of walking function in
Maki B. Measuring balance in the elderly: 41 Linacre JM, Heinemann AW, Wright BD,
et al. The structure and stability of the stroke patients: the Copenhagen Stroke
validation of an instrument. Can J Public Study. Arch Phys Med Rehabil. 1995;76:
Health. 1992. 83(suppl 2):S7-S11. Functional Independence Measure. Arch
Phys Med Rehabil. 1994;75:127-132. 27-32.
26 Dean CM, Richards CL, Malouin F. Walk­ 60 Kwakkel G, Veerbeek JM, Harmeling-Van
ing speed over 10 metres overestimates 42 Barzi F, Woodward M. Imputations of
missing values in practice: results from der Wei BC, et al; Early Prediction of Func­
locomotor capacity after stroke. Clin tional Outcome After Stroke (EPOS) Inves­
Rehabil. 2001;15:415-421. imputations of serum cholesterol in 28
cohort studies. Am f Epidemiol. 2004; 160: tigators. Diagnostic accuracy of the Bar­
27 Dobkin BEI. Short-distance walking speed 34-45. thel Index for measuring activities of daily
and timed walking distance: redundant living outcome after ischemic hemi­
measures for clinical trials? Neurology. 43 Basagana X, Barrera-Gomez J, Benet M, spheric stroke: does early poststroke tim­
2006;66:584-586. et al. A framework for multiple imputation ing of assessment matter? Stroke. 2011;42:
in cluster analysis. Am J Epidemiol. 2013; 342-346.
28 Finch E, Brooks D, Stratford PW, Mayo NE. 177:718-725.
Physical Rehabilitation Outcome Mea­ 61 Loewen SC, Anderson BA. Predictors of
44 Kneipp SM, McIntosh M. Handling missing stroke outcome using objective measure­
sures: A Guide to Enhanced Clinical Deci­ data in nursing research with multiple
sion Making. 2nd ed. Hamilton, Ontario, ment scales. Stroke. 1990;21:78-81.
imputation. Nurs Res. 2001;50:384-389.
Canada: Lippincott Williams & Wilkins;
62 Veerbeek JM, Kwakkel G, Van Wegen EE,
2002. 45 McCleary L. Using multiple imputation for et al. Early prediction of outcome of activ­
analysis of incomplete data in clinical ities of daily living after stroke: a system­
29 Schmid A, Duncan PW, Studenski D, et al. research. Nurs Res. 2002;51:339-343.
Improvements in speed-based gait classifi­ atic review. Stroke. 2011;42:1482-1488.
cations are meaningful. Stroke. 2007;38: 46 He Y. Missing data analysis using multiple
2096-2100. imputation: getting to the heart of the mat­ 63 Veerbeek JM, Van Wegen EE, Harmeling-
ter. Circ Cardiovasc Qual Outcomes. Van der Wei BC, Kwakkel G; EPOS Inves­
30 Katzman R, Brown T, Fuld P, et al. Valida­ 2010;3:98-105. tigators. Is accurate prediction of gait in
tion of a short Orientation-Memory- nonambulatory stroke patients possible
Concentration Test of cognitive impair­ 47 Meng X. Multiple-imputation inferences within 72 hours poststroke? the EPOS
ment. Am ] Psychiatry. 1983; 140:734- with uncongenial sources of input. Stat study. Neurorehabil Neural Repair. 2011;
739. Sci. 1994;9:538-573. 25:268-274.
31 Seshadri S, Wolf PA, Beiser A, et al. Stroke 48 Rubin DB. Multiple imputation after 18+ 64 Rymer MM, Anderson CS, Harada M, et al.
risk profile, brain volume, and cognitive years .J Am Stat Assoc. 1996;91:16. Stroke service: how can we improve and
function: the Framingham Offspring measure outcomes? Consensus summary
49 Donders AR, van der Heijden DC, Stijnen from a global stroke forum. Acta Neurol
Study. Neurology. 2004;63:1591-1599. T, Moons KG. Review: a gentle introduc­ Scand. 2014;130:73-80.
32 Tombaugh TN. Trail Making Test A and B: tion to imputation of missing values./ Clin
normative data stratified by age and edu­ Epidemiol. 2006;59:1087-1091. 65 Kwakkel G, Kollen B, Lindeman E. Under­
cation. Arch Clin Neuropsychol. 2004; 19: 50 Rubin DB. Multiple Imputation fo r Non­ standing the pattern of functional recov­
203-214. response in Surveys. New York, NY: John ery after stroke: facts and theories. Restor
Wiley & Sons Inc; 1987:258. Neurol Neurosci. 2004;22:281-299.
33 Rengachary J, d’Avossa G, Sapir A, et al. Is
the Posner Reaction Time Test more accu­ 51 Schafer JL, Graham JW. Missing data: our 66 Veerbeek JM, Van Wegen EE, Van Peppen
rate than clinical tests in detecting left view of the state of the art. Psychol Meth­ RP, et al. What is the evidence for physical
neglect in acute and chronic stroke? Arch ods. 2002;7:147-177. therapy poststroke? A systematic review
Phys Med Rehabil. 2009;90:2081-2088. and meta-analysis. PLoS One. 2014;9:
52 Baraldi AN, Enders CK. An introduction to e87987.
34 Mesulam M. Principles o f Behavioral and modern missing data analyses. J Sch Psy­
Cognitive Neurolog)’. 2nd ed. Cambridge, chol. 2010;48:5-37. 67 Lohse KR, Lang CE, Boyd LA. Is more bet­
MA: Oxford University Press; 2000. ter? Using metadata to explore dose-
53 Aufman EL, Bland MD, Barco PP, et al. Pre­ response relationships in stroke rehabilita­
35 Mesulam M. Principles o f Behavioral dictors of return to driving after stroke. tion. Stroke. 2014;45:2053-2058.
Neurology. Philadelphia, PA: FA Davis Co; Am J Phys Med Rehabil. 2013;92:627-
1985. 634.

718 ■ Physical Therapy Volum e 95 Num ber 5 M ay 2015


D e s c rip tiv e D a ta A n a ly s is E x a m in in g S ta n d a r d iz e d A s s e s s m e n ts

68 Luker JA, Bernhardt J, Grimmer KA, 70 Latham NK, Harris BA, Bean JF, et al. Effect 72 Donnan GA, Davis SM, Levi CR. Strategies
Edwards I. A qualitative exploration of dis­ of a home-based exercise program on to improve outcomes after acute stroke.
charge destination as an outcome or a functional recovery following rehabilita­ Med J Aust. 2003;178:309-310.
driver of acute stroke care. BMC Health tion after hip fracture: a randomized clin­
Serv Res. 2014; 14:193. ical trial. JAMA. 2014;311:700-708. 73 Gilligan AK, Thrift AG, Sturm JW, et al.
Stroke units, tissue plasminogen activator,
69 Castillo RC, Wegener ST, Heins SE, et al; 71 Vergouw D, Heymans MW, van der Windt aspirin and neuroprotection: which stroke
LEAP Study Group. Longitudinal relation­ DA, et al. Missing data and imputation: a intervention could provide the greatest
ships between anxiety, depression, and practical illustration in a prognostic study community benefit? Cerebrovasc Dis.
pain: results from a two-year cohort study on low back pain. JM anipulative Physiol 2005;20:239-244.
of lower extremity trauma patients. Pain. Ther. 2012;35:464-471.
2013;154:2860-2866.

May 2015 Volume 95 Number 5 Physical Therapy ■ 719


Copyright of Physical Therapy is the property of American Physical Therapy Association and
its content may not be copied or emailed to multiple sites or posted to a listserv without the
copyright holder's express written permission. However, users may print, download, or email
articles for individual use.

You might also like