Documente Academic
Documente Profesional
Documente Cultură
174 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
and the 6-Minute Walk Test to assess changes in walking distance. Best
REVIEWERS: practice evidence supports the use of the 5 Times Sit-to-Stand to assess
Elizabeth Anderl, PT, DPT; sit to standing transfers. Evidence was insufficient to support use of a
Mary Beveridge; specific OM to assess patient-stated goals across adult neurologic condi-
Maggie Bland, PT, DPT, NCS, MSCI; tions. Physical therapists should discuss the OM results with patients and
Rebecca Craik, PT, PhD, FAPTA; collaboratively decide how the results should inform the plan of care.
Beth Crowner, PT, DPT, MPPA, NCS; Disclaimer: The recommendations included in this CPG are intended
Linda Csiza, PT, DSc, NCS; as a guide for clinicians, patients, educators, and researchers to improve
Vanina Dal Bello-Haas, PT, PhD; rehabilitation care and its impact on adults with neurologic conditions.
The contents of this CPG were developed with support from the APTA
Megan Eikenberry, PT, DPT, NCS;
and the Academy of Neurologic Physical Therapy (ANPT). The Guide-
Edelle Field-Fote, PT, PhD, FAPTA;
line Development Group (GDG) used a rigorous review process and
George Fulk, PT, PhD; was able to freely express its findings and recommendations without
Timothy Hanke, PT, PhD; influence from the APTA or the ANPT. The authors declare no compet-
Carey Holleran, PT, MPT, DHS, NCS; ing interest.
Catherine Lang, PT, PhD; Video Abstract available for more insights from the authors (see Vid-
Arlene McCarthy, PT, DPT, MS, NCS; eo, Supplemental Digital Content 1, available at: http://links.lww.com/
Genevieve Olivier, PT, DPT, NCS; JNPT/A214).
Miriam Rafferty, PT, DPT, PhD, NCS; Key words: gait disorders, human movement system, nervous system
Teresa Rice, PT, MPH, NCS; diseases, neurodegenerative diseases, neurologic, neurologic examina-
Regi Robnett, OTR/L, PhD; tion, neurologic rehabilitation, outcome and process assessment (health
care), outcome assessment (health care), patient care planning, patient
Wendy Romney PT, DPT, NCS;
outcome assessment, postural balance, practice guideline, psychomet-
Amelia Siles, PT, DPT, NCS;
rics, reproducibility of results
Irene Ward, PT, DPT, NCS;
Vanessa Warner, PT, DPT, NCS;
Kelly Westlake, PT, PhD; and
Hallie Zelenik, PT, DPT.
A grant from the American Physical Therapy Associa- not financially supported. Dr Sullivan has presented on
tion supported the development of this clinical practice Outcome Measurement for the ANPT, Neuro Recovery
guideline. Network, and Rock Mountain University of Health Pro-
fessions. All authors reviewed the CPG manuscript.
Work stemming from the CPG has been presented at the
APTA Combined Sections Meetings in 2015, 2016, and Supplemental digital content is available for this article.
2017; the IV STEP conference in 2016; American Col- Direct URL citation appears in the printed text and is
lege of Rehabilitation Medicine Conference in 2016; and provided in the HTML and PDF versions of this article
the Missouri PT Association Conference in 2016. on the journal’s Web site (www.jnpt.org).
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 175
TABLE OF CONTENTS
The Core Set of Outcome Measures for Neurologic Physical Therapy....................... 191
Action Statement 1: Static and Dynamic Sitting and Standing Balance Assessment.... 191
Action Statement 2: Walking Balance Assessment...................................................... 195
Action Statement 3: Balance Confidence Assessment................................................. 197
Action Statement 4: Walking Speed Assessment......................................................... 199
Action Statement 5: Walking Distance Assessment.................................................... 203
Action Statement 6: Transfer Assessment.................................................................... 207
Action Statement 7: Documentation of Patient Goals................................................. 208
Action Statement 8: Use of the Core Set of Outcome Measures................................. 209
Action Statement 9: Discuss Outcome Measure Results and Use
Collaborative/Shared Decision-Making With Patients................................................ 211
Guideline Implementation Recommendations............................................................. 212
Summary of Research Recommendations................................................................... 215
Acknowledgments........................................................................................................ 217
References.................................................................................................................... 217
TABLES
176 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 177
This clinical practice guideline (CPG) is intended to be a statement that meets the Institute of Medicine’s criteria for
guide for rehabilitation management of adults with neu- transparency of the CPG.6 The 9 action statements include
rologic conditions and to inform outcome measurement recommendations for the core set of measures, use of the
research. The CPG applies to all adult patients with neuro- core set, and collaborative decision-making. Research rec-
logic conditions, including those with acute (ie, <6 months ommendations are included in the action statement profiles
since onset/diagnosis), chronic stable (ie, >6 months since and summarized at the end of the CPG.
onset/diagnosis, but not expected to worsen with time), and Each article included in this CPG was appraised by 2
chronic progressive (ie, > 6 months since onset/diagnosis, reviewers, and assigned a level of evidence by the guideline
but with the potential to experience additional symptoms or development group (GDG). The grading criteria to deter-
functional changes). Clinicians and organizations should in- mine the level of evidence that supports the recommenda-
terpret these recommendations in the context of the patient’s tions are described in Table 1. These criteria, recommended
situation, clinical practice, and potential for harm. The meth- by the Academy of Neurologic Physical Therapy (ANPT),
odology used in this CPG, including the critical appraisal were modified to accommodate descriptions of studies of
and assignment of levels of evidence and strength of the psychometric properties. Levels I and II differentiate stron-
recommendations, was derived from the COnsensus-based ger from weaker studies by integrating the quality of the
Standards for the selection of health Measurement INstru- research design and/or reporting of the study,7 as well as
ments (COSMIN) checklist,1-5 recommendations from the the strength of the psychometric data.8,9 The criteria for the
APTA, and is in accordance with internationally accepted grades of recommendation assigned to each action state-
methodologies for evidence-based practice. This CPG is or- ment are provided in Table 2. The grade reflects the over-
ganized to present the level of evidence definitions and the all strength of the evidence available to support the action
grades of recommendations (Tables 1 and 2, respectively), statement. Throughout the CPG, each action statement is
clear and implementable recommendations in the form of preceded by a letter grade indicating the strength of the rec-
9 action statements, an introduction and description of the ommendation, followed by the statement and summary of
need for this CPG, and a standardized profile for each action the supporting evidence.
178 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
A. Action Statement 1: STATIC AND DYNAMIC SIT- • Acute conditions: Evidence quality: V; recommenda-
TING AND STANDING BALANCE ASSESSMENT. tion strength: best practice
Clinicians should use the Berg Balance Scale (BBS) for • Chronic stable conditions: Evidence quality: I; recom-
adults with neurologic conditions who have goals to im- mendation strength: strong
prove static and dynamic sitting and standing balance and • Chronic progressive conditions: Evidence quality: I;
have the capacity to change in this area. The BBS should be recommendation strength: strong
administered under the same test conditions using the proto-
col recommended by the CPG Knowledge Translation (KT) B. Action Statement 5: WALKING DISTANCE AS-
Committee at admission, and discharge, and when feasible, SESSMENT. Clinicians should use the 6-Minute Walk Test
between these periods for patients with: (6MWT) for adults with neurologic conditions who have
• Acute conditions: Evidence quality: I; recommenda- goals to improve walking distance and the capacity to change
tion strength: strong in this area. The 6MWT should be administered (per the
• Chronic stable conditions: Evidence quality: I; recom- Quinn et al protocol,11 as adapted by the CPG KT Committee)
mendation strength: strong under the same test conditions at admission, and discharge,
• Chronic progressive conditions: Evidence quality: I; and when feasible, between these periods for patients with:
recommendation strength: strong • Acute conditions: Evidence quality: V; recommenda-
tion strength: best practice
B. Action Statement 2: WALKING BALANCE ASSESS- • Chronic stable conditions: Evidence quality: I; recom-
MENT. Clinicians should use the Functional Gait Assess- mendation strength: moderate
ment (FGA) for adults with neurologic conditions who have • Chronic progressive conditions: Evidence quality: I;
goals to improve balance while walking and have the capacity recommendation strength: strong
to change in this area. The FGA should be administered un-
der the same test conditions using the protocol recommended P. Action Statement 6: TRANSFER ASSESSMENT. Cli-
by the CPG KT Committee at admission, and discharge, and nicians should document the transfer ability of adults with
when feasible, between these periods for patients with: neurologic conditions who have goals to improve transfers
• Acute conditions: Evidence quality: I; recommenda- and have the capacity to change. Documentation should
tion strength: strong include the type of transfer, level of required assistance,
• Chronic stable conditions: Evidence quality: I; recom- equipment or context adaptations, and time to complete. In
mendation strength: strong patients who have goals and the capacity to improve sit-to-
• Chronic progressive conditions: Evidence quality: I; stand transfers, the 5 Times Sit-to-Stand (5TSTS) may be
recommendation strength: moderate used. The 5TSTS and documentation of other transfers may
be administered under the same test conditions using the
A. Action Statement 3: BALANCE CONFIDENCE AS- protocol recommended by the CPG KT Committee at admis-
SESSMENT. Clinicians should use the Activities-specific sion, and discharge, and when feasible, between these peri-
Balance Confidence (ABC) Scale to assess self-reported ods for adult patients with neurologic conditions (Evidence
changes in balance confidence in adults with neurologic quality: V; recommendation strength: best practice).
conditions who have goals and the capacity to change in this
area. The ABC should be administered under the same test P. Action Statement 7: DOCUMENTATION OF PA-
conditions using the protocol recommended by the CPG KT TIENT GOALS. Clinicians should document patient-stated
Committee at admission, discharge, and, when feasible, be- goals and monitor changes in individuals with neurologic
tween these periods for patients with: conditions, using an outcome measure (OM) such as the
• Acute conditions: Evidence quality: I; recommenda- Goal Attainment Scale (GAS), reporting the task, the per-
tion strength: strong formance conditions, and the time to complete or level of in-
• Chronic stable conditions: Evidence quality: I; recom- dependence desired. Patient goals should be documented at
mendation strength: strong least 2 times, at admission and discharge, and, when feasible,
• Chronic progressive conditions: Evidence quality: I; between these testing periods (Evidence quality: V; recom-
recommendation strength: strong mendation strength: best practice).
B. Action Statement 4: WALKING SPEED ASSESS- B. Action Statement 8: USE OF THE CORE SET OF
MENT. Clinicians should use the 10 meter Walk Test (10mWT) OUTCOME MEASURES. Clinicians should use and doc-
for adults with neurologic conditions who have goals to im- ument the OMs in the core set to assess changes over time.
prove walking speed and have the capacity to change in this The core set includes the BBS, FGA, ABC, 10mWT, 6MWT,
area. The 10mWT should be administered (per the protocol by and 5TSTS, and the recommended patient goal assessment
Steffen and Seney,10 as adapted by the CPG KT Committee) for adults who are undergoing neurologic physical therapy.
under the same test conditions at admission, and discharge, The core set should be administered with patients who have
and when feasible, between these periods for patients with: goals and the capacity to improve transfers, balance, and/or
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 179
gait. In cases when a patient cannot complete one or more undergoing neurologic physical therapy. Collaboratively, the
core set OMs (eg, a patient who is unable to walk; thus, can- clinician and the patient should decide how these data should
not complete the 10mWT or the 6MWT), a score of 0 should inform the plan of care (Evidence quality: V; recommenda-
be documented. The core set should be administered under tion strength: best practice).
the same test conditions at least 2 times, at admission and
discharge, and when feasible between these periods (Evi- These guidelines were issued in 2018 based on the scientific
dence quality: II; recommendation strength: moderate). literature published before March 2016. These guidelines
will be considered for review by 2023, or sooner if new evi-
P. Action Statement 9: DISCUSS OUTCOME MEA- dence becomes available. The ANPT will oversee the pro-
SURE RESULTS AND USE COLLABORATIVE/ cess and methodology for updating the CPG. The GDG will
SHARED DECISION-MAKING WITH PATIENTS. Cli- work collaboratively with the ANPT Evidence-Based Guide-
nicians should discuss the purpose of OMs, OM results, and line Committee. Any updates to the guidelines in the interim
how these results influence treatment options with patients period will be noted on the ANPT Web site.
180 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 181
set should increase standardization of OM selection and ad- Association, and World Confederation of Physical Therapy);
ministration and provide the ability to measure changes in a consumer organizations and associations (eg, the National
patient’s status over time. In addition, greater standardization Stroke Association and the Multiple Sclerosis Society);
of OMs should enhance effective communication among health care administrators, and third-party payers. This CPG
providers and with patients/caregivers, facilitate intervention does not serve as a legal standard of care or mandate. It pro-
effectiveness analysis and programmatic assessment within vides recommendations for the use of a core set of OMs in
and among facilities, and may improve reimbursement. clinical practice, based on a rigorous systematic review and
This CPG focuses on adult patients (older than 18 years), of critical appraisal process. Adherence to these guidelines
either sex, who are undergoing physical therapy services for will not guarantee a positive outcome in care; however, it is
treatment of a neurologic condition (eg, an injury or disease anticipated that the CPG will improve quality of care when
to the central or peripheral nervous system). The CPG action implemented. Furthermore, this CPG does not provide a
statements apply: comprehensive review of all OMs. Rather it focuses exclu-
• When examining balance, gait, transfers, and when set- sively on OMs in the constructs of balance, gait, transfers,
ting patient goals. and patient-stated goals. The appropriate use of the recom-
• In all health care settings or contexts, across the contin- mended OMs in clinical practice is ultimately the decision
uum of care settings, including but not limited to acute of each clinician and patient/significant other. If these OMs
care hospitals, inpatient and outpatient rehabilitation, are not used, the rationale for the use of other OMs should
skilled nursing facilities, and home health care. be documented. We intend for the OM results to be shared
The specific goals of this CPG are to: with patients and significant others during adult neurologic
1. Standardize the use of a core set of OMs to assess rehabilitation. Collaboratively, clinicians and patients should
changes over time in neurologic physical therapy with- decide how the results should guide the plan of care.
in and among facilities.
2. Facilitate comparison of outcomes across interven- METHODS
tions, providers, and patients within and among di-
agnostic groups through the use of a common set of The steps outlining the process of review and determination
measures. of the core set are shown in Table 3. The GDG consisted of 3
3. Facilitate the development of practice-based evidence PTs (J.M., K.P., and J.S.) with expertise in outcome measure-
by standardizing the use of OMs for patients with neu- ment. Two of the team leaders (J.S. and K.P.) served as Chair
rologic conditions to enable the creation and analysis of the ANPT’s EDGE task forces for stroke18 and multiple
of large data sets. sclerosis,17 respectively. The third (J.M.) led the development
4. Improve quality of care by standardizing data elements of the Rehabilitation Measures Database39 and has expertise
to answer important clinical questions (eg, identifica- in knowledge translation. The GDG proposed the CPG on
tion of treatment responders vs nonresponders). the core set of OMs to the ANPT’s Board of Directors, who
5. Ensure systematic and standardized documentation of approved the proposal. The GDG attended the APTA Clini-
OMs to help justify a patient’s need for therapy and to cal Practice Guideline Workshop in July 2013 and received
inform policy. Improved documentation of OMs could funding from the APTA in December 2013 to support the
be used to clarify and improve policies related to reim- CPG’s development.
bursement and access to care. The GDG recruited 2 consultants including a method-
6. Identify gaps in the literature related to OMs in adult ologist (S.K.) to provide advice on conducting the system-
neurologic rehabilitation. This may prompt researchers atic review and writing the CPG, and a psychometrician
to rigorously study the psychometric properties of un- (C.H.C.—see Acknowledgments) to assist with survey
tested OMs or develop new measures to meet clinical development, modifying COSMIN to create a critical ap-
needs. praisal tool, and data analysis. A medical reference librar-
7. Enhance the education of future rehabilitation provid- ian (L.O.) led the literature search process and assisted
ers by informing curricular decisions about the core set with writing the CPG. A doctor of physical therapy student
of OMs to include in entry-level and residency physi- (K.B.) functioned as a graduate assistant who assisted with
cal therapy education. the development and management of article and data stor-
age systems, coordinated communication between the GDG
Statement of Intent and article reviewers, and assisted with data analysis and
Primarily intended for application in adult neurologic reha- writing of the CPG.
bilitation, this CPG may be useful to rehabilitation profes- The GDG also recruited an expert panel consisting of an
sionals including PTs, physical therapist assistants (PTAs), international and diverse group of stakeholders who provid-
occupational therapists, and occupational therapy assistants ed feedback about the scope, process, and final CPG recom-
who select and administer OMs; therapeutic recreation mendations. The expert panel, identified in the Acknowledg-
therapists, physicians, and nurses who are interested in un- ments, included consumers (ie, patients) who had received
derstanding the use of OMs in rehabilitation; educators who neurologic physical therapy; PTs (novice and experienced)
make decisions about academic curricula; researchers who who were members of the ANPT; other rehabilitation pro-
select or study OMs; regulatory bodies and policy mak- fessionals (neurologists, occupational therapists, speech/lan-
ers; professional associations (eg, the APTA, APTA Acad- guage pathologists, neuropsychologists); representatives of
emies of Neurology and Geriatrics, Canadian Physiotherapy professional associations; health care administrators; journal
182 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 183
editors; and experts in OMs, knowledge translation, policy, • perceived importance of improving function in various
and reimbursement. areas (eg, gait and decrease fatigue);
• constructs (eg, balance) examined using tests per-
Methods to Determine the CPG Scope formed by the PT;
To identify the scope and focus of the CPG, the GDG devel- • formats of tests used in clinical settings (eg, question-
oped and administered separate online surveys to consum- naires and performance tests);
ers of neurologic physical therapy services and to ANPT • frequency and duration of testing;
members. Surveys were administered via SurveyMonkey • information provided by the PT regarding the purpose
and focused on the use of OMs during physical therapy ex- and results of tests;
amination and care. Before dissemination, the surveys were • perceived importance of the tests;
approved by the Institutional Review Boards at Northwest- • recommendations for therapy time that should be dedi-
ern University (Chicago, Illinois) and Rockhurst University cated to testing; and
(Kansas City, Missouri). • satisfaction with services and information received
about the tests conducted.
Consumer Survey
An invitation to consumers of neurologic physical therapy Academy of Neurologic Physical Therapy
was distributed through the Clinical Neuroscience Re- Member Survey
search Registry at the Rehabilitation Institute of Chicago Approximately 5000 PT and PTA members of the ANPT
and Northwestern University, Heartland Chapter of the Na- were invited to participate in the survey. Inclusion criteria
tional Parkinson’s Disease Foundation, and the Mid America required that the PT or PTA be licensed, college educated,
Chapter of the National Multiple Sclerosis Society. Par- and have email access. A link to the survey was sent via e-
ticipants included individuals with email access who were mail through the ANPT’s listserv and electronic newsletter.
registered in the research and/or email databases of these Survey participation was optional and the respondent pro-
organizations. Approximately 828 people with stroke, 395 vided informed consent prior to survey initiation.
with spinal cord injury (SCI), 11 635 with multiple sclerosis The ANPT member survey included a maximum of 65
(MS), and 2500 with Parkinson disease (PD) received an in- questions; the number and type of questions answered var-
vitation to participate. The invitation provided a link to the ied by the participant’s responses. Survey logic ensured that
survey, and indicated that participation was optional. To be questions received by each respondent were relevant to the
eligible, consumer participants were required to have a med- individual’s role (eg, clinician or educator/researcher/other).
ically diagnosed neurologic condition, have received physi- The survey consisted of 3 sections: demographic data, a core
cal therapy services, be 18 years or older, English-speaking, set needs assessment, and use of OMs in practice. Demo-
and have email access. Participants confirmed that they met graphic data included primary and professional roles, experi-
these inclusion criteria and provided informed consent on ence (eg, number of years of experience, certifications, and
the first page of the survey. training on OMs), APTA and ANPT membership, education,
The 21-item survey included questions pertaining to primary employment setting, and willingness to use a core set
neurologic physical therapy, including the: of OMs. The core set needs assessment questions captured
• reason for seeking services; the respondent’s understanding of core sets and their use; im-
• frequency, duration, and setting of services; portance of having a core set; types of OMs recommended for
184 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
the core set; representation of the ICF domains and specific Appendix 1 provides a list of measures reviewed for in-
items (eg, aerobic capacity) in the core set; time and money to clusion in the CPG (see Supplemental Digital Content 2,
support use of the core set; and benefits and potential impact Appendix 1, available at: http://links.lww.com/JNPT/A215).
of the core set. Lastly, questions inquired about use of OMs in Details about the literature search are provided in the section
practice. Clinician respondents were asked about current use titled Literature Search.
of OMs in practice, whereas the educators, researchers, and
other respondents (eg, managers) were asked to provide their EDGE-Reviewed Measures
thoughts on what should be measured in practice. Step 1. Identification of Standardized Measures
De-identified aggregate data from both surveys were an- With EDGE Ratings of 2 to 4/4
alyzed using descriptive statistics. Data were used to inform All 243 standardized measures reviewed by the ANPT
the scope and focus of the CPG, particularly to identify the EDGE task forces were considered for inclusion in the CPG.
highest priorities for each sample group. The EDGE task forces used a 1- to 4-point rating scale to
Survey Results make recommendations for measures in categories such
A total of 518 individuals completed the survey (303 PTs and as condition acuity, severity, and site of care.21 A rating of
215 consumers). The PT respondents reported their primary “4” indicated that the measure had excellent psychometric
position as either a clinician (69%) or educator (24%). They properties and clinical utility in the target condition; a “1”
were experienced, with 45% having greater than 15 years rating indicated poor psychometrics (inadequate reliabil-
of experience and 54% holding American Board of Physi- ity or validity) or limited clinical utility (extensive testing
cal Therapy Specialties certification. The majority were em- time, unusual or expensive equipment, costs to administer,
ployed either in an outpatient (46%) or inpatient rehab set- etc).17,18 In step 1, measures that received a “1” rating across
ting (28%). The neurologic conditions experienced by the all categories and EDGE groups were eliminated. A total of
consumers included MS (49%), stroke (34%), or SCI (14%). 222 standardized measures were retained.
Most received outpatient physical therapy (70%), and some
received services in inpatient rehabilitation (21%). Step 2. Identification of Generic/Not Condition-
Survey results showed that 94% of clinicians use OMs Specific Standardized Measures
in clinical practice. The majority reported having 30 to To identify measures that could be used across neurologic
60 minutes to conduct examinations at admission (78%), populations, condition-specific measures (eg, Stroke Impact
interim (53%), and discharge (52%). Almost all (98%) re- Scale) were eliminated. One hundred forty-six of the 222
ported that a core set is either essential (65%) or desirable standardized measures were retained.
(33%), and 91% indicated they were very willing (58%) or
willing (33%) to incorporate a core set of OMs into practice. Step 3. Identification of Standardized Measures
Regarding the maximum amount of time that should be used That Address the CPG Target Constructs
to administer OMs, the greatest number (43%) answered 15 The remaining measures were evaluated relative to the con-
to 29 minutes. All stated the core set should include OMs structs of balance, gait, transfers, and patient-stated goals.
related to the ICF domain of activity, with 98% scoring this A measure was eliminated if fewer than 75% of the items
as essential. Clinicians scored the following constructs as es- or questions assessed these constructs. Fifty-four of the 146
sential to include in the core set: balance (98%), gait (95%), measures were retained.
patient-stated goals (82%), and transfers (81%).
Results from the consumer survey showed that they also Step 4. Identification of Standardized Measures
value the use of tests in their care; 59% scored tests as very Used in 2 or More Neurologic Populations
important and 35% as somewhat important. Of note, con- To identify OMs that were appropriate for use across neu-
sumers identified that they were referred to physical ther- rologic conditions, measures were eliminated that did not
apy due to walking (83%) and balance difficulties (68%), have published psychometric data in at least 2 neurologic
with approximately 90% indicating it was very important to populations. Forty-one of the 54 standardized measures were
improve walking and balance. retained.
Survey results indicated that OMs that assess changes in
balance and gait are important to both clinicians and consum- Step 5. Identification of Standardized Measures
ers and should be included in the core set. In addition, the That Evaluate Change
PT survey indicated OMs related to patient-stated goals and Each measure was evaluated to determine whether it could
transfers were also important for inclusion in the core set. be used to demonstrate changes over time. The availability of
psychometric properties that assess changes (eg, minimum
Selection of Measures to Consider for the CPG detectable change and minimum clinically important differ-
Two sets of measures were evaluated for the inclusion in the ence) for each measure was ascertained. All 41 standardized
CPG—(1) all measures (n = 243) that had been reviewed measures were retained.
by the 6 ANPT EDGE task forces,17-21 and (2) new measures
(n = 67) identified during the literature search—that were Step 6. Identification of Measures With Excellent
not originally reviewed by the EDGE task forces and were Clinical Utility
studied in any adult neurologic population. During each Approximately 85% of PT survey respondents indicated that
step of the review process, the GDG reached consensus on 45 minutes or less should be spent on OM administration,
decisions about measure inclusion. with 63% indicating the maximum time spent on measure
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 185
administration should be less than 30 minutes. In addition, strategies in PubMed, was used.40 A validated version of the
71% indicated the OM should cost $100 or less. Therefore, the filter was also used for the Embase search (developed by E.
GDG decided that, to be included, an OM had to be free, require P. Jansma, Medical Library, VU University, Amsterdam, the
equipment commonly available in a clinic, and take 20 minutes Netherlands). The search strategy is depicted in Appendix 2
or less to administer. Thirty-five of the 41 OMs were retained. (see Supplemental Digital Content 3, available at: http://
links.lww.com/JNPT/A216).
Step 7. Identification of Candidate OMs The initial searches focused on articles pertaining to the
Step 7 followed a literature search of the 35 OMs that met EDGE-reviewed OMs and were performed in April 2015,
the criteria described in steps 1 through 6. Following the lit- October 2015, and December 2015, resulting in a total of
erature search, title/abstract screening, and full-text review, 18 007 articles. All databases were searched back to their in-
each OM was evaluated to determine whether reliability and ception, and no language or date limits were applied. This
data to support interpretation of results (eg, minimal detect- literature review is depicted in Appendix 2. After duplicates
able change [MDC] and minimal clinically important differ- were removed, 12 088 articles remained. To be included, the
ence [MCID]) were available in at least one article that met study was published in English, studied the English lan-
inclusion criteria for the CPG. The remaining 16 measures guage version of the OM, and assessed reliability and or val-
and relevant literature proceeded to a critical appraisal with ues support interpretation of the results (eg, standard error
data extraction via the modified COSMIN checklist5 by the of measurement [SEM], MDC, and MCID). In accordance
trained reviewer pool. with COSMIN, the sample size needed to be a minimum of
30; articles with a sample size less than 30 were acceptable if
New Measures a power analysis was done and the required sample size was
During the initial literature search (including the title/ab- met. Lastly, study participants needed to be adults (18 years
stract and full-text review), the GDG identified 67 additional or older) with a neurologic condition. Table 4 outlines the
measures that were not previously reviewed by EDGE. These inclusion and exclusion criteria.
measures were reviewed using the process described in steps The titles and abstracts of the 12 088 articles were re-
2 through 7 previously. The measures retained during each viewed by 2 of 3 GDG members, and reviewer pairs were
step are described next. rotated within the GDG. The third member played the role
Step 1: Not applicable because these measures were not of tie breaker where disagreement on an article’s inclusion
reviewed by the EDGE task forces. occurred between the 2 initial reviewers. Following the title
Step 2: 65 of the 67 new measures were retained; 2 were and abstract review, 11 548 articles were excluded. Full-text
excluded because they were condition-specific. reviews were conducted on the remaining 540 articles; each
Step 3: 52 of the 65 measures were retained; 13 were exclud- was reviewed by 1 GDG member using the same criteria. A
ed because fewer than 75% of the test items pertained to second GDG member assessed articles if questions or con-
gait, balance, transfers, and patient-stated goals. cerns about an article were identified. Lastly, the graduate
Step 4: 13 of the 52 measures were retained; 39 were ex- assistant reviewed the reference lists in each article to iden-
cluded because there were no published data in 2 or more tify any additional relevant articles. None was identified.
neurologic populations. Follow-up literature searches using the strategies de-
Step 5: 12 of the 13 measures were retained; 1 was excluded scribed previously were performed in March 2016 to identify
because there were no data on psychometric properties any new articles published since April 2015; 403 articles were
that indicated the measure could detect changes over identified after duplicate removal. After title and abstract re-
time. view, 365 articles were excluded, leaving 38 additional arti-
Step 6: 10 of the 12 measures were retained; 2 were excluded cles for review. The PRISMA diagram (Figure) illustrates the
because they did not meet the clinical utility criteria. article search processes used; 64 articles were included for
Step 7: 2 of the 10 measures were retained and relevant lit- full-text review (see Supplemental Digital Content 4, Figure,
erature proceeded to a full-text review and data extraction available at: http://links.lww.com/JNPT/A218).
by the trained reviewer pool using the modified COSMIN
checklist.5 Eight were eliminated because they lacked Critical Appraisal Tool Development
data demonstrating reliability and supporting interpreta- To determine the methodological quality of the articles, the
tion of the results (eg, MDC and MCID). original version of the COSMIN8,9,41,42 was modified (COS-
MIN-M). COSMIN1,3-5 provides a standard for evaluation of
Literature Search the study design and statistical analysis of the psychometric
A medical librarian (L.O.) collaborated with the GDG to properties, including sections representing these psychomet-
develop the search strategies to identify articles related to ric properties: internal consistency, reliability, measurement
each of the OMs of interest. The study types included meta- error, content validity, construct validity, structural validity,
analyses, systematic reviews, and psychometric studies in hypothesis-testing, cross-cultural validity, criterion validity,
the following databases: PubMed MEDLINE, Embase, Co- responsiveness, and interpretability. During an article review
chrane Central Register of Controlled Trials, and CINAHL. using COSMIN-M, only the sections appraising properties
Search strategies for the Embase, CENTRAL, and CINAHL assessed in the study were completed by reviewers, using a
databases were adapted from the PubMed MEDLINE search dichotomous (eg, yes or no) scale. For example, if a study
strategy. A validated search filter, developed by COSMIN only reported on reliability, reviewers only completed COS-
for finding studies on OMs, in conjunction with the search MIN-M sections on reliability and general methodology.
186 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
Although the original COSMIN rating scale has been modi- training and experience was included. Reviewers completed
fied to incorporate a 4-point scale (poor, fair, good, and ex- the COSMIN-M via an online survey Web site (SurveyMon-
cellent), the GDG selected the original version to facilitate key).43 Appendix 4 provides a copy of the COSMIN-M. Two
ease of scoring and higher reliability of the reviewers. members of the GDG reviewed each article to determine and
In consultation with the methodologists, to focus on the document any reported adverse events (see Supplemental
purpose and intent of this CPG, the following modifications Digital Content 6, Appendix 4, available at: http://links.lww.
were made to the COSMIN tool by the GDG. We retained com/JNPT/A219).
COSMIN questions about statistical techniques used and
results, and questions about the presence of potential study Reviewer Selection and Training
flaws. However, the sections on internal consistency, reliabil- Article reviewers were recruited at the 2015 APTA Com-
ity, interpretability, and generalizability were modified to re- bined Sections Meeting and via postings on the ANPT’s e-
duce the number of items and include only those that were newsletter and listserv. All applicants completed an online
of utmost importance to determining the methodological reviewer training course developed by the GDG using Ar-
quality of the study. Questions relevant to the development ticulate Storyline 2™. The training program consisted of
of the core set were also retained. For example, questions an overview of the CPG and the COSMIN-M, followed by
pertaining to psychometric variables that measure changes, a detailed description of the methods for completing each
such as MCID, MDC, and SEM, were retained, as these can section of the COSMIN-M (internal consistency, reliability,
be used to set goals and determine treatment effectiveness. interpretability, generalizability, and general methodology).
Additional questions about specific psychometric values, Lastly, information was provided outlining the CPG process
such as intraclass correlation coefficients (ICCs), and the lo- and reviewer expectations.
cation of that data in the manuscript were added. Appendix The GDG selected one article for reviewer training and
3 provides a list of measurement terms used in the CPG with testing, and 2 GDG members first completed the online
definitions (see Supplemental Digital Content 5, Appendix COSMIN-M for the article. The third GDG member served
3, available at: http://links.lww.com/JNPT/A217). The COS- as a tiebreaker to resolve any conflicts. The GDG’s final rat-
MIN-M generalizability section included questions pertain- ings were used as a basis for the testing score agreement
ing to the neurologic condition of the population studied (eg, with article reviewers. Each potential reviewer completed
stroke and PD), acuity and stability (progressive and non- the COSMIN-M review for 2 measures studied in this arti-
progressive) of the condition, age and sex, and the setting in cle. To successfully complete the training and begin review-
which the study took place. A new section, labeled “general ing articles, a reviewer needed to score 80% or more agree-
methodology,” related to sample size, missing data, and rater ment with the GDG score. If needed, reviewers were allowed
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 187
a second chance to resubmit the review on the same article Recommended Action Statements
(without any feedback on the previous review) and achieve a Using BridgeWiz for APTA 3.0, action statements were
score of 80% or more; 23 individuals successfully completed generated that include clear and implementable recommen-
the training to review articles. dations, consistent with the Institute of Medicine recom-
mendations for transparency.44 The first step was to identify
Scoring of Methodological Quality OMs that demonstrated level I evidence of excellent internal
Two reviewers assessed the methodological quality of consistency and/or reliability and SEM/MDC data in 2 or
each article using the online COSMIN-M (Appendix 4), more populations and 3 condition categories (acute, chronic
for each OM reported in the article. To avoid redundancy, stable, and chronic progressive). If a construct area did not
each reviewer completed the general methodology section have an OM that met this first criterion, other OMs that dem-
only once for each article. The graduate assistant exported onstrated level I evidence of excellent internal consistency
COSMIN-M data into an Excel spreadsheet to compare data and/or reliability and SEM/MDC data in 2 or more popula-
from the 2 reviewers. When inconsistencies were identified, tions and 2 categories were considered. Because the aim of
reviewers were asked to reevaluate the question and confirm this CPG was to recommend a core set of OMs for use in
or change the original response. When inconsistencies con- adult neurologic conditions, when more than one OM in a
tinued, a GDG member resolved the conflict. construct area had substantial supporting evidence, the OM
Once the results were finalized, the score for each sec- with the strongest psychometric properties across diagnos-
tion was calculated using the percentage of “yes” responses tic groups was selected. For the construct of gait, measures
to the questions. Section scores were compared to inform of speed and endurance were considered separately, as these
the overall article quality score, which reflected the score represent 2 different, yet important, aspects of gait perfor-
received by the lowest scoring section. For example, if an mance. Similarly, for balance, both performance-based and
article received 80% for reliability and 60% for measure- patient-reported measures were considered separately. Only
ment error, the article would receive an overall quality score one OM for the construct of transfers met the criteria for
of 60%. If the overall quality score was 50% or more, the consideration in the core set. Because this was a priority
article received a level I rating. If the score was < 50%, the area identified in our surveys, and the OM had some data to
article could not receive higher than a Level II rating. support inclusion in the core set, a best practice recommen-
The strength of the psychometric data was determined dation was made and documentation standards were recom-
in accordance with COSMIN (Table 5). Relevant statisti- mended for other types of transfers.
cal results from each article were evaluated to determine For patient-stated goals, no OMs were identified with
whether they exceeded the threshold established by COS- sufficient literature for recommendation in the core set.
MIN (Table 5). If the article received a level I rating and Instead, general recommendations for documentation stan-
had strong psychometric properties, the article received a dards were developed. To standardize administration of OMs
psychometric property rating of strong (+++). A rating of in clinical practice, recommendations related to the general
strong (−−−) was used for level I studies where the psy- OM use and OM timing were also generated. Lastly, rec-
chometric properties were below the COSMIN threshold. ommendations were made related to the sharing of OM-
Level II articles received a score of moderate (++) if the related information and decisions with patients. Research
psychometric properties met the psychometric threshold and recommendations (designated by R) were generated to iden-
a moderate (−−) if the psychometric properties were below tify missing or conflicting evidence related to using the psy-
the threshold. Ratings of strong (?) or moderate (?) were as- chometric variables studied in the CPG, for OMs that should
signed if specific psychometric properties were not studied be studied across more condition categories, and regarding
(eg, where MDC was calculated, but not minimal important study of recommended administration protocols.
change [MIC]). After this step, each article was assigned a
level of evidence and statistical strength score. Guideline Review
Finally, information from multiple articles on each OM 1. This CPG underwent 4 formal reviews. The first review
was combined, including level of evidence, strength of psy- was conducted by the GDG using 2 tools:
chometric property, the patient population studied, and the • The Appraisal of Guidelines for Research and Evaluation
condition category (acute, chronic stable, and chronic pro- (AGREE II)45 an instrument used to assess CPG quality
gressive) as depicted in Table 6 (step 4). The acute category with 23 items in 6 domains. Each item is rated using a
was defined as participants who had the condition for less than 7-point rating scale that includes specific rating criteria.
6 months; this applied to individuals with new conditions that • The Guideline Implementability Appraisal v 2.0
were expected to improve (eg, peripheral vestibular hypofunc- (GLIA)46 to assess each action statement across 8 di-
tion) or to those with potentially long-lasting, but recently di- mensions of implementability including executability,
agnosed conditions (eg, stroke, SCI, and brain injury). The decidability, validity, flexibility, effect on care processes,
chronic stable category was defined as more than 6-month measurability, novelty/innovation, and computability.
duration, but not expected to progress with time, applying to 2. A second review included completion of the AGREE
participants with conditions such as stroke, SCI, or brain in- II by the ANPT Evidence-Based Documents com-
jury diagnosed more than 6 months ago. The chronic progres- mittee and CPG expert panel. Eight reviewers com-
sive category was defined as more than 6 months in duration, pleted the AGREE II. The aggregate score was 94%.
but with potential to experience additional symptoms or func- The GLIA tool was completed by each member of the
tional decline (eg, amyotrophic lateral sclerosis, MS, or PD). ANPT-appointed Knowledge Translation Task Force
188 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 189
(n = 8). The aggregate score was 88%. Feedback from listserv of PTs who treat individuals with neurologic
the reviewers on the AGREE II and GLIA reviews was conditions. Listserv subscribers included members and
integrated in the final CPG. It is anticipated that a fur- nonmembers of the ANPT. During the public comment
ther review would result in a comparable/higher score. period, reviewers identified the following strengths of
3. A revised draft of the CPG was posted for public com- the CPG: usefulness, value, clarity, comprehensiveness
ment on the ANPT, APTA, and Academy of Geriatric of the literature review, and format. There were some
Physical Therapy Web sites by the ANPT Director of comments for improvement that the GDG determined
Practice. Notices of the public comment period were were beyond the scope of the CPG. Numerous sugges-
distributed via email to CPG reviewers and others who tions for dissemination were forwarded to the CPG KT
inquired about the CPG while it was in development. An Committee.
electronic newsletter and social media posting dissemi- 4. The fourth review was completed by 2 Journal of
nated the public comment notice to ANPT members. Neurologic Physical Therapy peer reviewers prior to
The posting was also made available on a web-based publication.
190 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
JNPT-D-17-00190.indd 192
AUTHOR PRIMARY POPULATION LEVEL OF INTERNAL RELIABILITY STANDARD FLOOR CEILING EFFECTS
AND IMPAIRMENT LEVEL EVIDENCE CONSISTENCY (TYPE, RESULTS) ERROR; MDCs AND EFFECTS
(IF AVAILABLE) MCIDs
Berg Balance Scale, acute samples
Chinsongkram Stroke I NT NT NT 0% 4.3%
et al60
Gustavsen et al47 Stroke; subacute I NT NT NT NT 36% (admission)
rehabilitation
Lemay and SCI; AIS D; 15 paraplegia, I NT NT NT NT 37.5%
Nadeau48 17 tetraplegia
Mao et al49 Stroke I Cronbach α = Interrater NT 14 d 35%; 14 d = 4.9%;
0.92-0.98 ICC = 0.95 (total score); 30 d = 17.3%; 30 d = 11.8%;
weighted k = 0.92 90 d = 6.5%; 90 d = 21.5%;
(individual items) 180 d = 5% 180 d = 28.8%
Pickenbrock Stroke; acute care facility I NT Interrater: NT NT NT
et al57 Mean difference between
raters 0.13; LOA < ±1
point (−0.25, 0.51)
Salter et al59 Stroke; inpatient I NT NT NT 0% 0%
rehabilitation
Stevenson58 Stroke I NT Test-retest MDC 90% = 6; MDC NT NT
ICC = 0.92 95% = 7; SEM = 2.49
Berg Balance Scale, chronic stable samples
63
Hiengkaew et al Stroke; outpatient clinic I NT Test-retest SEM = 1.68 NT NT
ICC = 0.95 MDC = 4.66
Liaw et al64 Stroke I NT Interrater SEM = 2.4; NT NT
ICC = 0.98 MDC = 6.7
Tsang et al51 Stroke I NT NT NT 0% 32.10%
65
Wirz et al SCI I NT Interrater NT NT NT
AIS 4.8% A, 4.8% B, 83.3% ICC = 0.953
C, 7.1% D
(continues )
192 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
JNPT • Volume 42, July 2018
09/06/18 2:22 PM
TABLE 7. Evidence Table, Berg Balance Scale (Continued )
JNPT-D-17-00190.indd 193
AUTHOR PRIMARY POPULATION LEVEL OF INTERNAL RELIABILITY STANDARD FLOOR CEILING EFFECTS
AND IMPAIRMENT LEVEL EVIDENCE CONSISTENCY (TYPE, RESULTS) ERROR; MDCs AND EFFECTS
(IF AVAILABLE) MCIDs
Berg Balance Scale, chronic progressive samples
62
Leddy et al PD; UPDRS/MDS mean I NT Interrater NT NT NT
72.6 (25-135); mean Hoehn
JNPT • Volume 42, July 2018
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
physical therapist; SCI, spinal cord injury; SEM, standard error of measurement; UPDRS, Unified Parkinson’s Disease Rating Scale.
A Core Set of OMs for Adults With Neurologic Conditions Undergoing Rehabilitation
193
09/06/18 2:22 PM
JNPT • Volume 42, July 2018
BBS has been well studied in research and widely used in Five studies reported an MDC for the BBS. In partici-
research and clinical practice. A standardized testing form pants with acute stroke, Stevenson58 reported an MDC95
with administration instructions is available, and commonly of 7. In chronic stroke, the MDC95 varied from 4.6663 to
available equipment (chair, stopwatch, ruler, and step) is 6.7 points.64 In chronic progressive conditions, the MDC95
used during testing. Each of the 14 items requires that the varied based on the condition and severity. In participants
patient perform a specific activity to challenge balance. The with HD, the MDC varied from 1 in individuals with pre-
patient’s ability to complete each item is rated on a 0- to manifest HD to 4 to 5 in individuals with other stages of
4-point scale, with 0 representing the inability to complete HD.11 Similarly, a study of individuals with PD demonstrat-
the task and 4 reflecting independent item completion. ed an MDC95 of 5.10 Only one study reviewed determined
The total score is calculated by summing the scores of the an MIC for the BBS. In participants with MS, the MIC-
14 items, with the maximum score of 56 and the minimum deterioration with clinician and patient anchors was −0.60
score of 0.56 and −1.41, respectively.66
Populations: The BBS can be applied across adult Six level I studies assessed the floor effects of the BBS.
neurologic conditions. This action statement is based on No floor effects were identified in 2 studies of individuals
16 level I studies that reported data in 7 acute samples (6 with acute stroke.59,60 In contrast, Mao et al49 identified the
stroke)47,49,57-60 and 1 SCI,48 4 chronic progressive samples presence of a floor effect that varied by time poststroke, de-
(1 Huntington’s disease [HD]11 and 3 PD),10,52,62 4 chronic pending on the level of acuity as follows: 14 days = 35% (of
stable samples (3 stroke51,63,64 and 1 SCI),65 and 1 study that sample), 30 days = 17.3%, 90 days = 6.5%, and 180 days =
included a mixed acute and chronic stable sample (stroke).50 5%. Studies conducted on individuals with chronic stroke
Psychometric Data: Reliability: Three level I studies and PD (mean Hoehn and Yahr = 2.4) indicated no floor
examined reliability in individuals with acute stroke and effect.51,52 Knorr et al50 did not find a floor effect at 3.3 and
demonstrated excellent interrater reliability. Mao et al49 8.2 months poststroke.
assessed the total score (ICC = 0.95) and individual item Eight level I studies assessed ceiling effects of the BBS.
interrater reliability (weighted κ = 0.92). Using a Bland- In individuals with acute conditions, the presence of a ceiling
Altman plot, Pickenbrock et al57 demonstrated a mean differ- effect varied by study. Ceiling effects of 36%47 and 15%50 of
ence among raters of 0.13. While this demonstrates high in- the sample were identified in subacute stroke, and 37.5%48 in
terrater reliability, the article received a strong (?) reliability the SCI-ASIA Impairment Scale D. However, these results
rating because of the statistics used in the study.57 Excellent conflict with other data that identified 0%59 to 4.3%60 ceiling
test-retest reliability has been demonstrated in individuals effect in a similar stroke population. A finding by Mao et al49
with stroke, with an ICC = 0.92.58 may provide a potential reason for these conflicts, as they
Three level I studies assessed reliability in chronic stable determined the ceiling effect varies by time poststroke, with
conditions. Excellent interrater reliability (ICC = 0.953) 4.9% at 14 days, 11.8% at 30 days, 21.5% at 90 days, and
was demonstrated in individuals with chronic SCI.65 Test-re- 28.8% at 180 days. In individuals with chronic stroke, ceiling
test reliability results were also excellent in individuals with effects of 21%50 and 32.1%51 have been identified. A ceiling
stroke, with ICCs of 0.9563 and 0.98.64 effect of 17.6% was also identified in individuals with PD.52
Four level I studies examined reliability in individu- The strong recommendation for the BBS is based on lev-
als with chronic progressive conditions. Quinn et al11 stud- el I evidence of internal consistency and/or reliability data,
ied test-retest reliability of the BBS in individuals with HD, availability of information to assist in assessing changes, and
which resulted in ICCs of 0.86 to 0.97 across 5 manifestations floor and ceiling effect data across acute, chronic stable, and
of HD from premanifest to late-state HD.11 Three additional chronic progressive conditions.
studies of the BBS in PD suggest excellent interrater reliabil- Related Outcome Measures: While several other bal-
ity (ICCs of 0.9562 to 0.98),52 and good to excellent test-retest ance OMs were assessed in this CPG, the only other OM that
reliability (ICCs of 0.94,10 0.95,52 and 0.79-0.80) in PD.62 assessed static and dynamic sitting balance in acute, chronic
Internal Consistency: Two level I studies demonstrat- stable, and chronic progressive conditions was the Trunk Im-
ed excellent internal consistency of the BBS in acute and pairment Scale (TIS) (see Supplemental Digital Content 8,
chronic progressive conditions, with a Cronbach α of 0.92 Appendix 6, available at: http://links.lww.com/JNPT/A221).
to 0.98 in individuals with acute stroke49 and 0.86 to 0.87 in This 10-item measure requires that a patient perform vari-
individuals with PD.10 ous activities in a sitting position. Two publications, includ-
SEM, MDC, MCID, Ceiling, and Floor Effects: Five ing samples of acute and chronic brain injury67 and MS,68
level I studies assessed SEM or MDC for the BBS; how- demonstrated excellent reliability and established an SEM
ever, none simultaneously reported an MIC or MCID. Thus, in MS. Other psychometric properties were not established.
measurement error was rated as a strong (?) across the 5 Because of the lack of psychometric evidence across catego-
studies. In participants with acute stroke, the SEM was 2.49 ries, the TIS was not included in the core set.
points,58 whereas in chronic stroke the SEM varied from Shorter BBS versions were considered (eg, BBS-3P,
2.464 to 1.68 points.63 In individuals with HD (chronic pro- BBS 9, and BBS-Short form). While decreasing BBS ad-
gressive), the SEM was used to calculate the MDC, but was ministration time is desirable, these versions included dif-
not explicitly stated in the article.11 In participants with PD ferent items and none had sufficient evidence to support use
(chronic progressive), Hoehn and Yahr classification of 1 to across patient populations. The FGA and other OMs that
4 (median = 2), the SEM was used to calculate an MDC, but assess balance while walking were also reviewed, and have
it was not explicitly reported.10 been discussed later in this CPG.
194 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
Supporting Evidence and Clinical Interpretation with practicing PTs (ICC = 0.90). Excellent test-retest reli-
(Table 8) ability (ICC = 0.95) was also demonstrated in a mixed sam-
Administration and Conditions: The FGA is a 10-item ple of individuals with acute or chronic stroke.71
clinician-rated test that assesses balance while walking. The Internal Consistency: Two studies (levels I and II) as-
items are rated on a 0- to 3-point scale, with 0 indicating sessed internal consistency of the FGA. Both studies dem-
severe impairment and 3 indicating normal ambulation. To onstrated excellent internal consistency, with a Cronbach α
score the FGA, the items are summed and a maximum total of 0.86 in acute vestibular dysfunction69 and 0.88 in a mixed
score is 30. A testing form with administration instructions acute and chronic vestibular population.70
is available,70 and commonly available equipment (obstacles, SEM, MDC, MCID, Ceiling, and Floor Effects: Two
stopwatch, and steps) is used during testing. studies of levels I and II evidence assessed the MDC and/
Populations: The majority of the studies reviewed for or MDC% of the FGA, but neither study reported an MCID;
this CPG examined acute and chronic stable conditions, the methodological quality ratings were strong (?)71 and
with only one level I study examining individuals with PD moderate (?),69 respectively. In participants with mixed acute
(chronic progressive).62 Studies reviewed included level I and chronic stable conditions, Lin et al71 calculated an MDC
studies on individuals with acute and chronic stroke,71 acute of 4.2. In individuals with acute vestibular dysfunction, the
and chronic vestibular dysfunction,72 and a level II study on SEM was utilized to determine the MDC of 6; however, the
acute vestibular dysfunction.69 SEM was not explicitly reported.69
Psychometric Data: Reliability: Interrater, intrarater Two studies (one level I and one level II) assessed the
and test-retest reliability were assessed in articles reviewed FGA for ceiling and/or floor effects. In individuals with
for this CPG. Leddy et al62 demonstrated excellent interrater acute vestibular dysfunction, the ceiling effect was 25%.69 A
reliability (ICC = 0.93) in patients with PD with a mean much lower ceiling effect of 0% to 5.7% and a floor effect of
Hoehn and Yahr score of 2.45. A lower, but acceptable, inter- 0% to 2% were found in a mixed sample of individuals with
rater reliability (ICC = 0.73) was demonstrated in a mixed acute or chronic stroke.71 It is important to note that these
sample of individuals with acute or chronic vestibular dys- studies were both completed in outpatient care settings. The
function.72 Excellent intrarater reliability was found in acute presence of floor or ceiling effects in an inpatient setting has
and chronic vestibular dysfunction (ICC = 0.94).72 Leddy not been assessed.
et al62 found that student PTs had a slightly lower, but still The core set recommendation for the FGA was based
excellent interrater reliability, with ICC = 0.80 as compared on levels I and II evidence in acute conditions, and level I
196 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
evidence in chronic stable and chronic progressive condi- or ceiling and floor effects of the TUG. In participants with
tions. Data to assist with measuring change are lacking in acute stroke,50 only floor and ceiling effects of the TUG were
chronic progressive conditions. Therefore, the FGA received established. Furthermore, the TUG includes a sit-to-stand
an aggregate recommendation rating of moderate. transfer, walking speed, and turning, all of which are rep-
Related Outcome Measures: Several OMs that assess resented in other core set measures. Given the lack of reli-
balance while walking were reviewed for this CPG, and 4 had ability data in acute conditions and the overlap with other
sufficient evidence to be considered for the core set. While core set measures, the TUG was not selected for the core set.
the FGA had the highest-quality evidence across patient cat-
egories, the Dynamic Gait Index (DGI), Mini-Balance Eval- R. Research Recommendation 3: Specific information re-
uation Systems Test (Mini-BESTest), and Timed Up and Go garding the functional levels of individuals who may benefit
(TUG) were also considered. The level of evidence for each from the FGA and when to start with or transition to an-
measure is available (see Supplemental Digital Content 7, other OM is needed. Determination of optimal administra-
Appendix 5, available at: http://links.lww.com/JNPT/A220). tion timing would assist clinicians in administering the FGA
The DGI (see Supplemental Digital Content 9, Appendix 7, within a reasonable time frame of when real change can be
available at: http://links.lww.com/JNPT/A222) met the criteria expected. Development and psychometric testing of a FGA
for the core set, but there were conflicting results from reliabil- short-form would decrease administration burden.
ity studies. In a level I study with individuals with acute ves-
tibular deficits, interrater reliability of the DGI was a κ of 0.64, R. Research Recommendation 4: Studies are needed to ex-
with individual items ranging from 0.35 to 1.0,74 whereas stud- amine other OMs, such as the Mini-BESTest and the TUG,
ies on PD75 and stroke71 demonstrated test-retest ICCs of 0.8475 in individuals with acute, chronic progressive, and chronic
and 0.94.71 The FGA was developed as a modification of the stable neurologic conditions. While the FGA had enough
DGI; both OMs include the following items: gait level surfaces, evidence to support its inclusion of the core set, more com-
changes in gait speed, gait with horizontal head turns, gait with prehensive measures of standing and walking balance should
vertical head turns, gait with pivot turn, step over obstacle, and be tested to ensure a complete comparison against the FGA.
stairs. Unlike the DGI, the FGA includes gait with narrow base Properties such as reliability, internal consistency, measure-
of support, gait with eyes closed, and ambulating backward. ment error, floor and ceiling effects, MDCs, and MIC/MC-
The DGI includes step around obstacles, not included in the IDs should be established across neurologic conditions.
FGA. The FGA provides more specific operational definitions
for its items. For example, the DGI indicates that the patient A. Action Statement 3: BALANCE CONFIDENCE AS-
must have “good speed” to achieve a score of 3/3, but the FGA SESSMENT. Clinicians should use the ABC Scale to assess
indicates the item must be completed in less than 5.5 seconds. self-reported changes in balance confidence in adults with
A modified version of the DGI76 was also assessed in this CPG; neurologic conditions who have goals and the capacity to
however, it did not have enough evidence to be considered for change in this area. The ABC should be administered under
the core set. In summary, the FGA was selected instead of the the same test conditions using the protocol recommended by
DGI for inclusion in the core set for the following reasons: bet- the CPG KT Committee at admission, and discharge, and
ter reliability across acute, chronic stable and chronic progres- when feasible, between these periods for patients with:
sive populations; inclusion of clinically relevant balance items • Acute conditions: Evidence quality: I; recommenda-
of gait with narrow base of support, gait with eyes closed, and tion strength: strong
ambulating backward; and improved response categories to fa- • Chronic stable conditions: Evidence quality: I; recom-
cilitate consistency in OM administration. mendation strength: strong
The Mini-BESTest (see Supplemental Digital Content • Chronic progressive conditions: Evidence quality: I;
10, Appendix 8, available at: http://links.lww.com/JNPT/ recommendation strength: strong
A223) was considered for inclusion in the core set of OMs;
however, it did not meet the established criteria. Data existed Aggregate Evidence Quality and Strength: Level
from 1 level I study in acute conditions,60 2 level I studies in I; strong. Based on 3 level I studies (see Supplemen-
chronic progressive conditions,52,77 and 1 level I study in a tal Digital Content 7, Appendix 5, available at: http://
chronic stable condition.51 No data were available on internal links.lww.com/JNPT/A220).
consistency, reliability, and measures of change (eg, MDC Benefits:
and MCID) in participants with acute conditions. Reliability • The ABC demonstrates excellent internal consistency
was studied in chronic progressive conditions, but internal and has data to assist in measuring changes in individu-
consistency and measures of change (eg, MDC and MCID) als with acute, chronic progressive, and chronic stable
were not examined. neurologic conditions. Reliability has been assessed in a
The TUG (see Supplemental Digital Content 11, Appen- chronic progressive condition. Floor and ceiling effects,
dix 9, available at: http://links.lww.com/JNPT/A224) was and information to assist in test result interpretation (eg,
considered for the core set, with a total of 9 level I stud- MDC), are available for individuals with acute, chronic
ies meeting review requirements. Although the majority of progressive, and chronic stable neurologic conditions.
the evidence was from participants with chronic progres- • The ABC has high clinical feasibility, as it is a patient-
sive conditions (HD,11 MS,78 PD,10,75,79 and postpoliomyeli- reported measure, requires only a writing utensil, is
tis),80 the TUG showed excellent reliability. In participants free to administer, and requires minimal time (5-10
with stroke,50,63,81 3 articles described the reliability, MDC, minutes82).
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 197
• The time cost associated with this measure is minimal, In these cases, clinicians should use their judgment to
as patients may be able to independently complete the determine appropriateness of administering this test.
ABC prior to their initial clinical visit. • Patients with hand impairments may require assistance
Risk, Harm, and Cost: with recording their responses to the ABC.
• No adverse events or financial costs were documented Role of Patient Preferences:
in research studies. • Sixty-eight percent of consumers surveyed reported
• There may be a potential burden to patients, as the that balance was a common reason for seeking a PT
ABC is a patient-reported measure. referral.
• The tool is available in English, Turkish, and Spanish, • Clinicians should consider the degree to which im-
so there is a risk of misinterpretation of items for those provements in balance are achievable and important to
who are not fluent in these languages. their individual patients when determining whether to
Benefit-Harm Assessment: Preponderance of benefit. administer the ABC.
Value Judgments: Exclusions:
• The GDG emphasizes the importance of using stan- • Clinicians should use discretion when applying the
dardized administration and scoring procedures for ABC with patients undergoing neurologic rehabilitation
measuring patients in the clinic. While no single pro- who do not have goals to improve balance confidence.
tocol has been used for the ABC, we recommend that Quality Improvement:
each clinical site adopt the testing protocol developed • Use of a single measure across clinical settings will
by the CPG KT Committee (http://www.neuropt.org/ facilitate communication among clinicians and more
professional-resources/anpt-clinical-practice-guide- accurately reflect changes in a patient’s perceived bal-
lines/core-outcome-measures-cpg). We recommend ance confidence over time.
review of the standard procedures and, on an annual • Organizations may use data collected from the ABC
basis, establishing consistency within and among rat- to assess changes in balance confidence in individuals
ers using the ABC. with neurologic conditions receiving rehabilitation.
• Standardization procedures should be reviewed on an • ABC scores may be used to describe the effectiveness of
annual basis. physical therapy services for increasing balance confi-
• Administration of both clinician-rated and patient-re- dence perceptions in adults with neurologic conditions.
ported measures may provide a more comprehensive Implementation and Audit:
assessment of balance confidence than administering • While the ABC did not demonstrate a substantial ceil-
only a clinician rated measure.15 ing effect, if a patient demonstrates a score near 100%,
Intentional Vagueness: the clinician may stop using the OM for the purpose of
• The ABC asks individuals to rate confidence in balance measuring change over time.
while doing several tasks at home and community. Indi-
viduals with a recently diagnosed neurologic condition Supporting Evidence and Clinical Interpretation
may not have experience with these specific tasks since (Table 9)
the onset of the condition. Clinicians should begin admin- Administration and Conditions: The ABC is a patient-re-
istering the ABC when it is appropriate for the patient. ported OM that assesses a person’s perceived confidence in
• Individuals with lack of insight into impairments may performing functional activities without becoming unsteady
have difficulty accurately answering the ABC questions. or falling. The stem, “How confident are you that you will
198 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
not lose your balance or become unsteady when you …?” use of this measure with individuals who have chronic stable
leads to 16 items. Each item is rated on a 0% to 100% scale, conditions, it was not recommended for the core set.
and the total score is calculated by adding item scores and di-
viding by 16 (eg, the number of items). The resulting scores R. Research Recommendation 5: Studies are needed to de-
range from 0% to 100% and reflect overall perceived confi- termine the psychometric properties (eg, reliability) of the
dence. The ABC is a self (patient)-report measure; however, ABC in acute, chronic progressive, and chronic stable neu-
questions can be read to an individual and the responses re- rologic conditions. Furthermore, information to assist clini-
corded. One study used a mailed version of the ABC, but cians in interpreting the results of the ABC, such as MDCs
did not provide any details about instructions related to the and MIC/MCIDs, should be established across neurologic
methods to complete the scale.83 Two studies were conducted conditions. Specific information regarding the characteris-
in a laboratory setting, but did not provide details about the tics of individuals who may benefit from the ABC is needed.
ABC test administration.10,84
Populations: The ABC has been tested in individuals R. Research Recommendation 6: Studies are needed to
with acute, chronic progressive, and chronic stable condi- examine other OMs, such as the Falls Efficacy Scale Inter-
tions. Two level I studies examined individuals with PD,10,83 national, in individuals with acute, chronic progressive, and
and 1 level I study included a mixed sample of individuals chronic stable neurologic conditions. While evidence sup-
with acute and chronic stroke.84 ports the inclusion of the ABC in the core set, other patient-
Psychometric Data: Reliability: Test-retest reliability reported measures of balance should be studied to ensure
was assessed in individuals with PD in 2 level I studies; both a comprehensive comparison to the ABC. Properties such
demonstrated excellent reliability, with ICCs ranging from as reliability, internal consistency, measurement error, floor
0.8683 to 0.94.10 Reliability has not been assessed in acute or and ceiling effects, MDCs, and MIC/MCIDs should be es-
chronic stable conditions. tablished across neurologic conditions.
Internal Consistency: In a sample with acute or chronic
stroke, Salbach et al84 demonstrated excellent internal con- B. Action Statement 4: WALKING SPEED ASSESS-
sistency (Cronbach α = 0.94). In 2 studies on individuals MENT. Clinicians should use the 10 meter Walk Test
with PD of various levels of impairment, the Cronbach α (10mWT) for adults with neurologic conditions who have
ranged from 0.95 to .9680 to 0.98.83 goals to improve walking speed and have the capacity to
SEM, MDC, MCID, Ceiling, and Floor Effects: SEM change in this area. The 10mWT should be administered
was assessed in 3 level I studies, with results stated in 2 (per the protocol by Steffen and Seney10 as adapted by the
studies. In individuals with mixed acute and chronic stable CPG KT Committee) under the same test conditions at ad-
conditions, the SEM was 5.05.84 In PD, Steffen and Seney10 mission, discharge, and, when feasible, between these peri-
identified an SEM of 13% and the smallest detectable differ- ods for patients with:
ence of 30.5%. Jonasson et al83 calculated an MDC of 11%. • Acute conditions: Evidence quality: V; recommenda-
While this MDC was relatively close to the SEMs reported tion strength: best practice
in individuals with PD, Steffen and Seney10 reported a sub- • Chronic stable conditions: Evidence quality: I; recom-
stantially higher MDC of 30% in a similar sample. When mendation strength: strong
applying these data in clinical practice, the patient should be • Chronic progressive conditions: Evidence quality: I;
similar to the sample studied. recommendation strength: strong
Floor and ceiling effects of the ABC have been reported
in individuals with acute and chronic stroke and in PD. In a Aggregate Evidence Quality and Strength: Level I;
mixed sample of individuals with acute or chronic stroke, no strong. Based on 8 level I studies reporting reliability and/
floor or ceiling effects were identified (0%).84 In individu- or data to assist in measuring changes in acute, chronic
als with PD (self-rated severity, mild 25%, moderate 64%, stable, and/or chronic progressive conditions, 2 level I
severe 13%), no floor effects and minimal ceiling effects studies reporting ceiling and floor effect data in acute, and
(4.9%) were identified.83 1 study reporting only MIC data in a chronic progressive
The strong recommendation for the ABC is based on lev- condition (see Supplemental Digital Content 7, Appendix
el I evidence of internal consistency and/or reliability data, 5, available at: http://links.lww.com/JNPT/A220).
and availability of data to assist in measuring change across Benefits:
acute, chronic stable, and chronic progressive conditions. • The 10mWT demonstrates excellent reliability in in-
Related Outcome Measures: No other patient-reported dividuals with chronic progressive and chronic stable
OMs of balance had sufficient literature to be considered neurologic conditions. Data to assist in interpretation
for the core set. The Falls Efficacy Scale-International had and measuring change exists in acute, chronic progres-
evidence to support its use in acute and chronic progressive sive, and chronic stable populations.
conditions (see Supplemental Digital Content 12, Appendix • Floor and ceiling effects have been assessed in indi-
10, available at: http://links.lww.com/JNPT/A225). In 3 sep- viduals with acute neurologic conditions. Information
arate level I studies, reliability, internal consistency, and data to assist in test result interpretation, such as MDC and
to assist in measuring changes were established.83,85,86 Floor MIC, is available for individuals with acute, chronic
and ceiling effects and MDCs have also been published. This stable, and chronic progressive neurologic conditions.
OM has also been translated and tested in many different • The 10mWT requires minimal equipment (eg, stop-
languages. Because of the lack of evidence to support the watch and equipment for measuring walkway distance),
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 199
which is likely available in clinical settings or can be • Standardizing a gait speed measure for patients with
purchased at a low cost. There is a minimal time cost neurologic conditions within and across clinical set-
associated to administer the test (<5 minutes). tings will enable comparative outcomes for quality
Risk, Harm, and Cost: improvement initiatives. Because scores may differ
• No adverse events were documented in research stud- based on testing protocol, it may be difficult to com-
ies. pare data collected in different facilities unless the pro-
• Administering the 10mWT has minimal risks, provid- tocol is also specified. Individual organizations should
ed the patient’s vital signs are monitored and appropri- use the CPG-recommended standardized protocol by
ate guarding is used. Steffen and Seney10 to assess aggregate data for their
Benefit-Harm Assessment: Preponderance of benefit. patients. In cases when the protocol cannot be used,
Value Judgments: the modifications to the OM administration should be
• The GDG emphasizes the importance of using stan- documented.
dardized administration and scoring procedures for Implementation and Audit:
measuring patients in the clinic. While no single pro- • The GDG recommends that clinicians use the protocol
tocol has been used for the 10mWT, Quinn et al11 and by Steffen and Seney,10 which has been adapted by the
Steffen and Seney10 described standardized proce- CPG KT Committee.
dures. The GDG recommends the protocol by Steffen • For patients who are unable to walk at admission but
and Seney because both comfortable and fast speeds have goals and the capacity to improve in this area, a
were tested, providing an assessment of the patient’s score of 0 m/second should be documented to track pa-
ability to alter gait speed. In addition, Steffen and tient change as ambulatory ability improves.
Seney used a shorter walkway (the 10-m as compared • The distance of the 10mWT is short and the use of as-
with the 14m walkway used by Quinn et al), which may sistive devices is permitted, which facilitates its use
be more feasible in smaller spaces. This protocol has across functional levels and environments (eg, home).
also been adapted by the ANPT CPG KT Committee The type of device must be documented.
(http://www.neuropt.org/professional-resources/anpt- • Clinics and organizations should establish administra-
clinical-practice-guidelines/core-outcome-measures- tion consistency within and among clinicians prior to
cpg). We recommend review of the standard proce- using the 10mWT, and this should be repeated annually.
dures and, on an annual basis, establishing consistency
within and among raters using the 10mWT. Supporting Evidence and Clinical Interpretation
• Walking safety may be more of a priority in acute (Table 10)
and subacute rehabilitation to prepare for discharge, Administration and Conditions: The 10mWT involves
whereas walking speed may be a higher priority there- measuring the time it takes for a person to walk the distance,
after. with results typically reported in meters/second (m/s). The
• Community ambulation requires the ability to ambu- patient’s ability to walk at both comfortable and fast speeds
late at various speeds. The 10mWT enables the assess- can be measured, and assistive devices can be used. Quinn et
ment of comfortable and fast walking; therefore, it is al11 and Steffen and Seney10 have described detailed admin-
a useful measure to determine a patient’s ability to re- istration procedures. Both used a walkway length of 10 m,
sume community ambulation. but varied in their measurement of the entire walkway11 ver-
Intentional Vagueness: It is possible that authors of sus the central 6 m.10 Quinn et al11 also measured the number
the studies reviewed used different administration pro- of steps taken during the test. Both Quinn et al11 and Stef-
cedures, resulting in some variability in the 10mWT fen and Seney10 administered 2 trials; Quinn et al11 reported
protocols used among studies. separate time data on each trial whereas Steffen and Seney10
Role of Patient Preferences: Eighty-eight percent of averaged the time from the 2 trials.
consumers surveyed expressed that it was important to The 10mWT protocol by Steffen and Seney10 is recom-
improve walking and 83% reported that difficulty with mended by the GDG. This protocol assesses the time to
walking was a primary reason for seeking physical the nearest 100th of a second to walk the central 6 m of a
therapy. 10-m walkway at the patient’s comfortable and fast walk-
Exclusions: The 10mWT is not appropriate for pa- ing speeds. The time starts when any part of the foot crosses
tients who do not have the capacity to walk. The GDG the plane of the tapeline and ends when any part of the foot
recommends that a score of 0 m/second be documented crosses the plane at the 6-m mark. Two trials are adminis-
for patients who are unable to walk at a given point in tered at the comfortable speed, with the instruction “walk at
time, but who have goals and the capacity to walk in your own comfortable speed and stop when you reach the far
the future. line,” followed by 2 trials at the fast speed, with the instruc-
Quality Improvement: tion “walk as fast as you can safely walk.” The 2 trials, for
• Use of a single measure across clinical settings will fa- each speed, are averaged and the 2 gait speeds are document-
cilitate communication among clinicians and enable as- ed in meters/second. Use of an assistive device is permitted
sessment of changes in a patient’s gait speed over time. and should be documented. CPG KT Committee adaptations
• Identifying a patient’s capacity to return to specific ac- are located online at: http://www.neuropt.org/professional-
tivities requiring various gait speeds may be enhanced resources/anpt-clinical-practice-guidelines/core-outcome-
when using the 10mWT. measures-cpg/core-measures.
200 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
JNPT-D-17-00190.indd 201
IMPAIRMENT LEVEL OF EVI- INTERNAL RELIABILITY STANDARD ERROR; MDCS FLOOR CEILING
AUTHOR (IF AVAILABLE) DENCE CONSISTENCY (TYPE, RESULTS) AND MCIDs EFFECTS EFFECTS
10 meter Walk Test acute samples
Lemay and SCI; AID D I NA NT NT NT 0%
Nadeau48
Perera et al88 Stroke I NA NT “Substantial meaningful NT NT
JNPT • Volume 42, July 2018
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
Steffen and PD; Hoehn and Yahr 1-4 I NA Test-retest MDC comfortable = NT NT
Seney10 (median 2) ICC = 0.96 (comfortable 0.18 m/s; fast = 0.25 m/s
speed) -0.97 (fast speed)
A Core Set of OMs for Adults With Neurologic Conditions Undergoing Rehabilitation
201
(continues )
09/06/18 2:22 PM
JNPT • Volume 42, July 2018
Abbreviations: AIC, Akaike information criterion; AIS, American Spinal Injury Association Impairment Scale; BI, brain injury; EDSS, Expanded Disability Status Scale; HD, Huntington’s disease; ICC, intraclass correlation coefficient;
EFFECTS
CEILING
across all categories were reviewed: 3 acute (1 SCI48 and 2
stroke87,88), 4 chronic progressive (1 MS78, 1 HD11, 1 PD10,
NT
NT
and 1 postpolio80), 2 chronic stable (stroke63 and SCI89), and
MCID, minimal clinically important difference; MDC, minimal detectable change; MS, multiple sclerosis; NA, not applicable; NT, not tested; PD, Parkinson disease; SCI, spinal cord injury; SDC, smallest detectable change.
a mixed sample with acute stable, and chronic progressive
conditions.90 Meaningful change data have been reported in
acute (stroke)88 and chronic progressive (MS66) populations.
Reliability has not been determined in acute neurologic con-
ditions. Floor and ceiling effects have not been studied in
EFFECTS
FLOOR
NT
Psychometric Data: Reliability: Intrarater (ICC = 0.98-
0.99) and interrater (0.95-0.98) reliabilities were reported in
STANDARD ERROR; MDCS
Test-retest
NA
OF EVI-
DENCE
LEVEL
when considering MDC and MIC. These data can assist cli-
Rossier and
measure that examines balance, transfers, and gait. It in- B. Action Statement 5: WALKING DISTANCE AS-
cludes 1 performance-based item and 14 self-report items. SESSMENT. Clinicians should use the 6 Minute Walk Test
Five level I studies on the RMI included 2 in acute stroke, (6MWT) for adults with neurologic conditions who have
reporting on internal consistency (Cronbach α = 0.93)91 and goals to improve walking distance and the capacity to change
interrater reliability (ICC = 0.92).92 In acute stroke, there is in this area. The 6MWT should be administered (per the
a floor effect (30%) at admission to inpatient rehab,91 but Quinn et al11 protocol as adapted by the CPG KT Committee)
not at 5 weeks. Hsueh et al92 reported a floor effect at 14 under the same test conditions at admission, and discharge,
days (40.4%), but not at 30 and 90 days; no ceiling effect and when feasible, between these periods for patients with:
was found. Test-retest reliability has been established in • Acute conditions: Evidence quality: V; recommenda-
chronic stable (stroke; ICC = 0.96),93 chronic progressive tion strength: best practice
(HD; ICC ranged from 0.81 to 0.98 across HD manifesta- • Chronic stable conditions: Evidence quality: I; recom-
tions),11 and a mixed chronic stable and chronic progressive mendation strength: moderate
group (ICC = 0.96).90 A smallest real difference of 2.2 was • Chronic progressive conditions: Evidence quality: I;
reported in stroke (chronic stable)91 and chronic progressive recommendation strength: strong
populations, with MDCs ranging from 1 to 5 across HD
manifestations.11 One level II study established an SEM of Aggregate Evidence Quality and Strength: Level I;
0.49 in MS.94 Although RMI data are available across cat- moderate. Based on 5 level I studies, reporting both
egories, the RMI is composed of 15 items, only 5 of which reliability and/or data to assist in measuring changes
pertain to gait (on level, unlevel, and stair surfaces). Thus, in chronic progressive conditions; 3 level I studies in
the RMI is not solely a measure of gait. Because consumers chronic stable populations that reported reliability, but
reported that gait was of importance, the GDG selected a no data to assist in measuring change; and, in acute pop-
gait-specific measure for the core set. Hence, the RMI was ulations, 1 level I study reporting “substantial meaning-
not included. ful change” and SEM, but no studies that examined reli-
The Timed 25 Foot Walk (see Supplemental Digital Con- ability (see Supplemental Digital Content 7, Appendix
tent 14, Appendix 12, available at: http://links.lww.com/JNPT/ 5, available at: http://links.lww.com/JNPT/A220).
A227) is a measure of gait speed (eg, the time to walk 25 ft). Benefits:
Eight level I studies on persons with MS (chronic progressive) • The 6MWT demonstrates excellent reliability in pa-
establish its reliability in this population, with intrarater and tients with chronic progressive and chronic stable neu-
interrater ICC values of 0.98 and 0.99, respectively.95 Six stud- rologic conditions.
ies96-101 established test-retest ICC values ranging from 0.9296 • Data to assist in measuring change (eg, MIC, SEM,
to 0.991.97 In addition, MIC values (ranging from −0.01 to and MDC) have been assessed in individuals with
−3.55 seconds)102 have been reported, as have SEM, MDC, chronic progressive neurologic conditions, and “sub-
and MDC% (= 1 second, 2.7 seconds, and 36%, respective- stantial meaningful change” and SEM are available for
ly).97 While the Timed 25 Foot Walk could have broad appli- individuals with acute conditions.
cability, there is less evidence overall to support its use across • The 6MWT has high clinical feasibility: it requires
populations as compared with the 10mWT. minimal equipment typically available in most settings
The Walk-12 is a self-report walking measure that as- and can be used for patients who walk with assistive
sesses the impact of a person’s neurologic condition on walk- devices. Only one trial is needed, limiting the time to
ing capability. One level I study reported internal consisten- administer the 6MWT.104 Standardized procedures for
cy (Cronbach α = 0.94), and floor (21.7% at admission and test administration exist, as discussed later.
0.9% at discharge) and ceiling effects (0.9% at admission • Initial costs of purchasing equipment (eg, stopwatches,
and 0% at discharge) in a mixed chronic stable and chronic cones, and distance measuring device) are minimal
progressive sample.103 Further research would be beneficial, and equipment is likely available in most settings. The
as the Walk-12 would complement the performance-based time to instruct the patient and administer the test is
measures of gait included in the CPG. less than 10 minutes, which can be minimized if the lo-
cation and landmarks for conducting the test are stan-
R. Research Recommendation 7: Studies are needed to ex- dardized within each clinical setting.
plore the reliability and clinically important change (eg, MCID) Risk, Harm, and Cost:
of the 10mWT in individuals with acute neurologic conditions. • No adverse events were documented in research stud-
Clinically important change should also be determined in ies reviewed for this CPG.
chronic stable conditions. Studies to determine the presence of • Administering the 6MWT has minimal risks, provided
floor and ceiling effects should be conducted in persons with the patient’s vital signs are monitored and appropriate
chronic progressive and chronic stable conditions. guarding is used.
Benefit-Harm Assessment: Preponderance of benefit.
R. Research Recommendation 8: Studies are needed to Value Judgments:
examine the Walk-12 in individuals with acute, chronic pro- • The GDG emphasizes the importance of measurement
gressive, and chronic stable neurologic conditions. Proper- reliability. Various protocols have been used for the
ties such as reliability, internal consistency, measurement 6MWT. To standardize administration and scoring, the
error, floor and ceiling effects, MDCs, and MIC/MCIDs GDG recommends the protocol described by Quinn
should be established across neurologic conditions. et al.11 This protocol has also been adapted by the
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 203
JNPT-D-17-00190.indd 205
IMPAIRMENT
LEVEL (IF LEVEL OF INTERNAL RELIABILITY FLOOR CEILING
AUTHOR AVAILABLE) EVIDENCE CONSISTENCY (TYPE, RESULTS) STANDARD ERROR; MDCs AND MCIDs EFFECTS EFFECTS
6-min Walk Test acute samples
88
Perera et al Stroke; subacute I NA NT “Substantial meaningful change” = 21 m NT NT
(anchor-stairs); = 54 m (anchor-walk block);
JNPT • Volume 42, July 2018
SEM = 22 m
6-min Walk Test chronic stable samples
104
Liu et al Stroke I NA Test-retest NT NT NT
ICC = 0.98
Ng and Hui-Chan81 Stroke I NA Test-retest NT NT NT
ICC = 0.98
Scivoletto et al89 SCI I NA Intrarater NT NT NT
ICC = 0.99;
Interrater
ICC = 0.99
6-min Walk Test chronic progressive samples
102
Baert et al MS; mild to severe I NA NT MIC improvement (patient anchor): 21.56 m NT NT
(whole group); 26.86 m (EDSS ≤4; 17.39 m
(EDSS 4.5-6.5); SRCindividual 67.22 m (whole
group); 42.86 m (EDSS ≤4; 75.42 m (EDSS
4.5-6.5).
MIC improvement (clinician anchor) = 9.06
m (whole group); 6.90 m (EDSS ≤ 4; 9.87 m
(EDSS 4.5-6.5); SRCindividual = 68.32 m; (whole
group); 56.53 m (EDSS ≤4; 73.98 m (EDSS
4.5-6.5)
Learmonth et al97 MS (79% relaps- I NA Test-retest SEM = 32 m; MDC = 88 m; MDC = 20% NT NT
ing remitting; 12% ICC = 0.959
secondary progres-
sive; 9% primary
progressive); mean
disease duration
11.8 (0.5-32) y;
mean EDSS 3.5
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
(range 0-6.5)
Motl et al98 MS; 82% RR I NA Test-retest NT NT NT
A Core Set of OMs for Adults With Neurologic Conditions Undergoing Rehabilitation
ICC = 0.959
205
(continues )
09/06/18 2:22 PM
JNPT • Volume 42, July 2018
Abbreviations: EDSS, Expanded Disability Status Scale; HD, Huntington’s disease; ICC, intraclass correlation coefficient; MCID, minimal clinically important difference; MDC, minimal detectable change; MIC, minimal important
tients with any neurologic condition. Nine level I studies re-
EFFECTS
CEILING
ported data on the 6MWT, including 5 samples with chronic
progressive conditions (1 HD,11 1 PD,10 and 3 MS97,98,102),
NT
NT
NT
3 samples with chronic stable conditions (1 SCI89 and 2
stroke81,104), and 1 in acute populations.88 One study reported
“substantial meaningful change” and SEM in acute (stroke)
EFFECTS
(MS)66 populations.
NT
NT
NT
Psychometric Data: Reliability: Intrarater and inter-
rater reliability (both ICCs = 0.99) were reported in par-
change; MS, multiple sclerosis; NA, not applicable; NT, not tested; PD, Parkinson disease; RR, risk ratio; SCI, spinal cord injury; SEM, standard error of measurement; SRC, smallest real change.
ticipants with SCI (chronic stable).89 Test-retest reliability
MDC-premanifest HD = 39.22 m; manifest
= −55.06 m; MIC-deterioration patient an-
ICC = 0.86-0.98
Test-retest
with MS. Only one study102 was rated strong, as both SRC
INTERNAL
NA
NA
change (eg, MDC and MIC) can vary across patient popula-
tions, within a given neurologic condition, or depending on
EVIDENCE
(MIC only)
LEVEL OF
the anchor used, as is seen in Table 11. This suggests that cli-
nicians should avoid generalizing the results of one patient
NA
relapsing-remitting
MS; median EDSS
HD from premani-
level I studies provide data on persons with stroke (chronic • The use of OMs of transfers to assess and monitor
stable), including test-retest reliability (ICC = 0.98) and changes in individuals with neurologic conditions re-
MDC (13.4 m).63 In chronic progressive samples, excellent flects best practice and is consistent with the APTA
test-retest reliability (ICC = 0.95) exists in persons with Guide to PT Practice.
postpolio,80 and MIC (6.81 m) and SRC (26.64 m) have been • The GDG emphasizes the importance of using stan-
established in MS.102 Rossier and Wade90 established the test- dardized administration and scoring procedures for
retest reliability (ICC = 0.97) in a mixed chronic stable and measuring patients in the clinic. While there is not a
chronic progressive sample.90 No studies reported data on universally accepted protocol for the 5TSTS, we rec-
the 2MWT in acute populations. The 2MWT has compara- ommend that each clinical site adopt the testing proto-
ble test-retest reliability and the availability of data to inter- col developed by the CPG KT Committee (http://www.
pret change, but there was less evidence overall to support its neuropt.org/professional-resources/anpt-clinical-
use across populations than the 6MWT. practice-guidelines/core-outcome-measures-cpg). We
recommend review of the standard procedures and, on
R. Research Recommendation 9: Studies are needed to de- an annual basis, establishing consistency within and
termine the intrarater and interrater reliability, and clinically among raters using the 5TSTS.
important change (eg, MCID), of the 6MWT in individuals Intentional Vagueness:
with acute neurologic conditions. Data to assist in measuring • No single transfer OM had sufficient literature to support
change (eg, MDC, SEM, and MCID) are needed in individu- a strong or moderate recommendation for the core set;
als with acute and chronic stable neurologic conditions. the 5TSTS received a best practice recommendation.
• Clinicians and organizations need to determine the fea-
P. Action Statement 6: TRANSFER ASSESSMENT. Clini- sibility and utility of using an OM to measure transfers
cians should document the transfer ability of patients who have in view of their patient population, facility-specific re-
goals to improve transfers and have the capacity to change. quirements and resources, and payer requirements.
Documentation should include the type of transfer, level of re- Role of Patient Preferences: Consumers of neurolog-
quired assistance, equipment or context adaptations, and time ic physical therapy surveyed indicated that the use of
to complete. In patients who have goals and the capacity to im- standardized OMs is very important (58%) or impor-
prove sit-to-stand transfers, the 5 Times Sit-to-Stand (5TSTS) tant (35%) to their care.
may be used. The 5TSTS and documentation of other transfers Exclusions: None.
may be administered under the same test conditions using the Quality Improvement: Consistent use of a transfer
protocol recommended by the CPG KT Committee at admis- OM may enable clinicians and administrators to moni-
sion, discharge, and, when feasible, between these periods for tor the patient’s change at an individual, unit, organiza-
adult patients with neurologic conditions. (Evidence quality: tion, or system level.
V; recommendation strength: best practice). Implementation and Audit:
• Procedures for administering the 5TSTS should be stan-
Aggregate Evidence Quality and Strength: Level V; best dardized for use by clinicians in the facility. The GDG
practice. Based on the GDG clinical expertise, informed recommends the standard procedure developed by the
by related evidence and the results of the clinician survey. CPG KT Committee for administration of the 5TSTS.
Benefits: The procedure is located on the ANPT Web site (http://
• Use of the 5TSTS will standardize one aspect of trans- www.neuropt.org/professional-resources/anpt-clinical-
fer skill across patients and may provide information practice-guidelines/core-outcome-measures-cpg).
about the methods a patient uses to complete the sit- • Clinics and organizations should establish administra-
to-stand transfer. tion consistency within and among clinicians prior to
• Initial costs of purchasing equipment (eg, stopwatches) using the 5TSTS, and this should be repeated annually.
are minimal and the required equipment (eg, standard
chair) is commonly available in clinical settings. The Supporting Evidence and Clinical Interpretation
time to administer the test is less than 5 minutes. (Table 12)
Risk, Harm, and Cost: Administration and Conditions: The 5TSTS measures
• No adverse events relative to the use of the 5TSTS the time it takes an individual to transfer from a seated to
were documented in studies reviewed for this CPG. a standing position and back to sitting 5 times. A patient is
• Using an OM of transfers may extend the length of the instructed to sit with arms folded across their chest and with
session. back against the chair. Patients with stroke may have their
Benefit-Harm Assessment: Preponderance of benefit. impaired arm at their side or in a sling. Chair heights of 43
Value Judgments: to 45 cm have been reported in the literature. The patient is
• 77% of clinicians surveyed indicated that transfers are instructed to stand up and return to sitting 5 times as quickly
an important construct to measure. as possible. Timing starts when the therapist says “go” and
• Transfers (ie, moving from one position to another, ends when the patient’s body touches the chair following the
such as sit to stand or wheelchair to mat) are a funda- fifth repetition. Administration procedures for the 5TSTS
mental skill for daily life and an important component are clinically feasible with minimal low-cost equipment re-
of the physical therapy care provided to patients with quired (eg, stopwatch and chair), typically available in most
neurologic conditions. clinical settings.
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 207
Populations: The 5TSTS has been studied in individuals P. Action Statement 7: DOCUMENTATION OF PATIENT
with chronic progressive conditions (PD).79 GOALS. Clinicians should document patient-stated goals and
monitor changes in individuals with neurologic conditions
Psychometric Data: Reliability: One level I study reported using an OM such as the Goal Attainment Scale (GAS), re-
test-retest reliability (ICC = 0.91) in chronic progressive porting the task, the performance conditions, and the time to
conditions (PD).79 Reliability has not been assessed in indi- complete or level of independence desired. Documentation of
viduals with acute or chronic stable populations; therefore, patient goal measures should be administered under the same
the 5TSTS should be used with caution in these groups. test conditions at least 2 times, at admission and discharge,
and, when feasible, between these testing periods. (Evidence
SEM, MDC, MCID, Ceiling, and Floor Effects: SEM was quality: V; recommendation strength: best practice)
reported to be 0.6s in individuals with chronic progressive Aggregate Evidence Quality and Strength: Level
conditions (PD)79; however, data are lacking to assist with V; best practice. Based on the clinical expertise of the
measuring changes in acute or chronic stable neurologic GDG and informed by related evidence and the results
conditions. No studies reported data for floor or ceiling ef- of the clinician survey.
fects in any category. Therefore, the 5TSTS should be used Benefits:
with caution in individuals with acute and chronic stable • Seventy-nine percent of PTs surveyed for this CPG in-
neurologic conditions. dicated that patient-stated goals are an important con-
Related Outcome Measures: The Rivermead Mobility struct to measure.
Index-Modified (RMI-Mod) and the 30-second Chair Stand • Using an OM of patient-stated goals will provide an
Test (30SCST) were reviewed for this CPG. The 30SCST opportunity for patients and clinicians to share their
was excluded because it did not have at least one article beliefs and values.
on reliability and data to interpret changes in neurologic • An OM that assesses a patient’s goals may capture ac-
populations. tivities or constructs not included in other OMs, but are
Three articles supported the RMI-Mod,107-109 and these in- important to the patient.
cluded participants with acute stroke107,109 and a mixed popu- • Use of an OM of patient-stated goals may assist clini-
lation of adults with acute and chronic progressive, but not cians in identifying and addressing discrepancies be-
chronic stable neurologic conditions (see Supplemental Digi- tween perceived and actual performance.
tal Content 16, Appendix 14, available at: http://links.lww. Risk, Harm, and Cost: No adverse events were docu-
com/JNPT/A229).108 All articles examining the RMI-Mod mented in studies reviewed for this CPG.
were level I articles and reported internal consistency values Benefit-Harm Assessment: Preponderance of benefit.
between 0.80 and 0.96 and reliability between 0.93 and 0.99. Value Judgments: The GDG believes that the use of
Data to assist with measuring the change is lacking. While OMs that assess and monitor changes in patient-stated
the RMI-Mod met the initial criteria of at least 75% of the test goals in patients with neurologic conditions:
items matching the constructs of interest, only 50% of the test • Facilitates a patient-centered approach by integrating the
items matched the construct of transfers. For these reasons, patient’s goals, priorities, and values into the plan of care.
the RMI-Mod was not recommended as a transfer OM. • Will encourage patient engagement in the rehabilita-
tion process.
R. Research Recommendation 10: Studies are needed that Intentional Vagueness: No patient-stated goal OM
explore the feasibility and psychometric properties of the had sufficient literature to support use across adults
5TSTS to objectively describe the transfer abilities of adults with neurologic conditions.
with neurologic conditions, especially those other than indi- Role of Patient Preferences: Using an OM of patient-
viduals with PD, across the continuum of care and spectrum stated goals will allow patients to clearly state their
of acuity. Further study of the 30SCST is warranted, particu- preferences for the focus of physical therapy.
larly relative to reliability and data to interpret changes in Exclusions: In some situations, such as patients with im-
individuals with neurologic conditions. paired consciousness, cognition, and/or communication,
208 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
it may be challenging to ascertain the patient’s goals. A R. Research Recommendation 11: Studies should explore
caregiver may be able to provide a proxy response.110-112 the feasibility and psychometric properties, including reli-
Quality Improvement: Consistent use of a patient- ability and data to assist in interpreting change (eg, MDC
stated goal OM may enable clinicians to monitor the and MCID/MIC) of the GAS and other OMs that capture the
patient’s perspective of change, and administrators to individual goals of adults with neurologic conditions across
monitor the degree to which patients perceive change the continuum of care and spectrum of acuity.
at an individual, unit, organization, or system level.
Implementation and Audit: B. Action Statement 8: USE OF THE CORE SET OF
• Because a specific patient-stated goal OM was not rec- OUTCOME MEASURES. Clinicians should use and docu-
ommended, the GDG recommends that each organiza- ment the OMs in the core set to assess change over time. The
tion select an appropriate OM to assess patient-stated core set includes the Berg Balance Scale (BBS), Functional
goals in regard to its patient population, facility-specific Gait Assessment (FGA), Activities-specific Balance Confi-
requirements, and resources. The GAS, a measure that dence Scale (ABC), 10 meter Walk Test (10mWT), 6 Minute
was assessed during the CPG review process, has been Walk Test (6MWT), and 5 Times Sit-to-Stand (5TSTS) and
studied in other populations (eg, pediatric and geri- the recommended patient goal assessment for adults who are
atric) and may be applied to adults with neurologic undergoing neurologic physical therapy. The core set should
conditions. be administered with patients who have goals and the capac-
• Administration procedures (eg, interview structure and ity to improve transfers, balance, and/or gait. In cases when
use of a proxy) for the organization’s chosen patient- a patient cannot complete one or more core set OMs (eg,
stated goal OM could be standardized for use in the a patient who is unable to walk; thus, cannot complete the
facility. Standardization regarding assessment and 10mWT or 6MWT), a score of 0 should be documented. The
documentation of this construct should include report- patient goal assessment should be administered to all adults
ing the task, the performance conditions, and the time undergoing neurologic physical therapy. The core set should
to complete or level of independence desired. Patient be administered under the same test conditions at least 2
goals should be assessed at least 2 times, at admission times, at admission and discharge, and when feasible be-
and discharge, and preferable in between these time pe- tween these periods (Evidence quality: II; recommendation
riods under the same test conditions. strength: moderate).
• When a discrepancy exists between perceived goals Aggregate Evidence Quality and Strength: Level I;
and actual performance or capacity, clinicians should moderate. Based on 41 level I studies for the 6 OMs
provide education for the patient and caregiver and re- collectively (ABC, Berg, FGA, 6MWT, 10mWT, and
view the goal expectations. 5TSTS) and 1 level II moderate study (FGA). Level I
studies provide moderate to strong evidence, supporting
Supporting Evidence and Clinical Interpretation the use of the BBS, FGA, ABC, 10mWT, and 6MWT
General Overview: Patients’ and clinicians’ health beliefs for patients with chronic stable and chronic progressive
frequently lack agreement, affirming the need for discus- conditions. Best practice recommendations support the
sions about goals and shared decision-making with pa- use of the 10mWT (2 level I studies) and the 6MWT (1
tients.113 Many OMs make the theoretical assumption that study reporting MIC) in patients with acute conditions.
all clients have similar goals leading to the challenge of cap- A best practice recommendation was made for the
turing the unique goals of individual clients.114 OMs have 5TSTS based on 1 level I study in patients with chron-
been developed, which allow the clinician and the patient to ic progressive conditions. In addition, a best practice
collaboratively and systematically establish individualized recommendation was made that clinicians document
goals and reach agreement on the scaling of these goals. patient-stated goals and monitor changes using an OM.
Patient-Stated Goals OM Considered in This CPG: In the survey to determine the scope of the core set, the
Three measures of patient-stated goals, the GAS, Canadian PTs indicated that balance (97%), gait (94%), patient-
Occupational Performance Measure, and Patient-Specific stated goals (79%), and transfers (77%) were impor-
Functional Scale, were reviewed for this CPG. The Canadian tant to address, and 94% of PTs indicated they were
Occupational Performance Measure was excluded because willing or very willing to use a core set of OMs.
it is proprietary and requires payment for use. The Patient- The aggregate strength of moderate was given because
Specific Functional Scale was excluded because it did not the core set measures have not been studied collectively.
have at least one citation each to support reliability and as- Benefits:
sessment of change over time. Two citations for the GAS • Consumers of PT and clinicians were in agreement that
were identified. One citation was excluded, as the subject the constructs of gait, balance, transfers, and patient-
population included a mixed geriatric population, rather than stated goals are important to assess. In addition, the
participants exclusively with neurologic conditions.115 A final recovery of balance, gait, and transfers facilitate im-
citation used the GAS with a neurologic population (brain proved independence for adults with neurologic con-
injury and stroke); the standardized response mean (2.2) was ditions. Therefore, a core set of OMs that captures
reported, but data were lacking for reliability.116 One article these constructs addresses the needs of patients and
reported on participants with MS, but failed to meet the sam- practitioners. A comprehensive examination of all con-
ple size required for inclusion in this CPG;117 others did not structs, for which a patient has goals and the capacity
focus on adults with neurologic conditions.118,119 to improve in these goals, reflects best practice.
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 209
• Use of the core set OMs for all patients with neurologic not assessed for other purposes (eg, prediction or im-
conditions and in all settings will facilitate collection pairment classification).
of practice-based evidence to compare interventions • In an acute care setting, in situations where a patient’s
and programs. length of stay is short, or when the patient is abruptly
• Use of the core set OMs across settings will facilitate discharged from a given setting, administration of the
measurement of patient progress over time and across core set at interim and discharge time frames may not
the continuum of care. For example, as a patient moves be feasible.
from acute care to inpatient rehabilitation to outpatient • If a patient does not have goals or a prognosis to im-
services, or as a patient’s neurologic condition changes prove in specific construct areas, OMs should not be
over time due to recovery or its progressive nature, the collected in the specific goal areas. When an OM in the
core set will reflect performance changes for the high- core set cannot be administered (eg, due to a patient’s
est priority domains. current abilities or the patient does not have the capac-
• Results of the core set of OMs can facilitate a compre- ity to improve or goals in the area), the clinician should
hensive examination of balance, gait, and transfers to document that the OM was not administered and pro-
assist with clinical decision-making, including the se- vide a rationale (eg, not applicable due to the patient’s
lection of treatment interventions, modification of the current and expected functional capability or not ap-
plan of care, and discharge decisions. plicable due to a lack of related patient goals).
• Standardization of entry-level DPT and residency edu- Quality Improvement:
cation that includes training on the core set. • The core set will facilitate monitoring of an indi-
Risk, Harm, and Cost: vidual patient’s status across time and settings, and
• No adverse events relative to the use of any of the mea- the degree to which patients change in aggregate. The
sures in the core set were reported in studies reviewed data collected could be used to increase transparency
for this CPG. of outcomes; study clinician performance relative to
• Organizational costs to administer the core set of OMs patient outcomes and internal and external bench-
may include the cost to alter the medical record to in- marks; improve health care processes; and generate
clude data fields, time for staff training and test admin- new knowledge.
istration, and the cost of testing forms and equipment. Implementation and Audit:
Benefit-Harm Assessment: Preponderance of benefit. • The leadership of health care facilities and organiza-
Value Judgments: The GDG believes that the use of a core tions should prioritize use of the core set and actively
set of OMs will enhance patient outcomes because they support implementation.120
will standardize measures across settings. The core set will • Clinical facilities and organizations should standardize
contribute to the advancement of neurologic physical ther- the administration procedures (eg, equipment, instruc-
apy through the development of a learning health system tions, and scoring) of the core set. Efforts should be
and the ability to do comparative effectiveness research. taken to standardize administration procedures and to
Intentional Vagueness: determine the consistency within and among clinicians
• The time frames for administration of the core set (eg, prior to using the core set OMs.
admission, interim, and discharge) may vary depend- • Documentation of the core set should be standard-
ing on facility-specific requirements and length of stay. ized to incorporate the following designated fields into
• The GDG recommends administration of the core set electronic health records: the BBS, FGA, Activities-
and sharing the measurement results with providers at specific Balance Confidence Scale, 10mWT, 6MWT,
the next level of care. This is particularly important and 5TSTS. Fields to document the total score and in-
when it is not feasible to administer the core set more dividual items on the OM should be included. In addi-
than once within a given setting. tion, the following items may be documented when as-
• The measures in the core set were assessed primarily sessing transfers: transfer ability of patients who have
in patients with central nervous system conditions. goals to improve transfers and have the capacity to
Therefore, clinicians should use caution when apply- change, inclusive of type of transfer, level of required
ing these measures to patients with peripheral nervous assistance, equipment or context adaptations, and time
system conditions. to complete. When documenting patient goals, the
• Although evidence supports the use of each measure following items should be included: the task, the per-
in the core set, the use of the measures collectively has formance conditions, and the time to complete and/or
not been studied. level of independence desired.
Role of Patient Preferences: • When a patient continues care at another level of ser-
• Consumers surveyed reported that OMs were very impor- vice, the core set results should be shared between fa-
tant (60%) and somewhat important (36%) to their care. cilities/organizations.
• Selection of the appropriate OMs for an individual • Organizations should audit documentation regularly
patient should be based on a patient’s prognosis and to determine adherence to core set recommendations.
rehabilitation goals. If adherence levels are not acceptable, audit and feed-
Exclusions: back, use of other knowledge translation interventions,
• The OMs in the core set were assessed for reliability or quality improvement initiatives may improve routine
and the ability to measure change over time. They were administration of the core set.
210 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
Supporting Evidence and Clinical Interpretation how these results influence treatment options with patients
The concept of a core set of OMs for use in neurologic re- undergoing neurologic physical therapy. Collaboratively, the
habilitation has been discussed for over 10 years. The APTA clinician and the patient should decide how these data should
EDGE task forces made condition-specific recommenda- inform the plan of care (Evidence quality: V; recommenda-
tions for use of OMs in practice.121 The development, use, tion strength: best practice).
and benefits of core sets, including those organized by con-
dition and construct, have been described.16 Measurement Aggregate Evidence Quality and Strength: Level V;
core sets have been described/developed for clinical and best practice. Based on the GDG clinical expertise and
research use with individuals with stroke,106 MS,122 cerebral informed by the consumer survey results and refer-
palsy,123 vertigo and dizziness,124 and cerebellar ataxia.125 ences in other medical fields.
Other authors have advocated for OM core sets organized by Benefits: Discussing the results of OMs with patients
construct such as balance126 or gait.106 Most published core may result in:
sets have been developed by a consensus approach, such as • Patients being more informed and engaged in rehabili-
a Delphi process.123,126,127 While a modest amount has been tation.
written in support of the development of OM core sets, the • Better alignment of the plan of care with the patient’s
literature on the demonstrated benefits of use in physical goals, preferences, and measurement results.
therapy is extremely limited.128 Therefore, research is needed Risk, Harm, and Cost:
on the impact of the core set on patients, organizations, and • No adverse events relative to the discussion of the re-
the profession. sults OMs were documented in the reviewed studies or
The use of OMs, including a core set of OMs, will cre- in a Cochrane review on the use of decision aids (eg,
ate the foundation for learning health care in adult neuro- interventions that support patients in shared decision-
logic physical therapy, as recommended by the Institute of making) to inform patients about care.129
Medicine.22 The OMs in the core set have value individually • A discussion of the OM results may extend the length
as well as when used collectively in the care of adults with of the session. Decision aid use to support shared
neurologic conditions. All OMs, with the exception of the decision-making has been shown to mildly increase
5TSTS, have documented evidence of strong internal consis- (<3 minutes) the length of a patient’s consultation with
tency/reliability and data to assist in measuring change (eg, a health care provider.113
SEM, MDC, and MCID) from multiple level I articles across • When the results of OMs are not positive and/or pa-
neurologic conditions and categories. Collectively, the core tients have difficulty understanding the results, patients
set OMs capture the client’s status across constructs that may experience stress/discomfort and the discussions
both PTs and consumers indicated to be important or related may add time to the treatment session.
to primary reasons for seeking physical therapy services. Benefit-Harm Assessment: Preponderance of benefit.
Furthermore, the use of patient goal assessment will provide Value Judgments:
standard reporting guidelines for patient goals. The core set • In a Cochrane review on decision aids (eg, interven-
will facilitate a comprehensive examination of important tions that support patients in shared decision-making),
constructs in a patient’s care and support decision-making, some benefits identified include increased participants’
plan of care development, and achievement of outcomes col- knowledge, accuracy of risk perceptions, improved
laboratively set by the patient and the clinician. alignment of values and care choices, and decreased
decisional conflict from feeling uninformed.129
R. Research Recommendation 12: Studies are needed that • The GDG believes discussing the OM results and shar-
explore the impact of using the core set of OMs on rehabili- ing (eg, collaboratively) decision-making would ben-
tation outcomes, including factors related to implementation efit patients undergoing neurologic physical therapy.
(eg, time and cost). Studies should explore the impact of us- Intentional Vagueness: The time frames (eg, admis-
ing the core set of OMs to support clinical decision-making sion, interim, and discharge) for clinicians discuss-
across neurologic conditions and categories. Future mea- ing the results of OMs and sharing decisions with
surement studies should be designed to meet the COSMIN patients who have neurologic conditions may vary
requirements for excellent methodology with regard to sam- depending on facility-specific requirements, patient
ple size, design, and rigor of statistical analysis of psycho- length of stay, etc.
metric properties.8,9,40,42 Role of Patient Preferences: The majority of the con-
sumers surveyed reported that test results were very
R. Research Recommendation 13: The CPG KT Committee important (60%) or important (35%) to them.
is developing standardized administration procedures for all 6 Exclusions: In some situations (eg, a patient with an im-
OMs in the core set. Studies are needed to determine the psy- paired level of consciousness, cognition, or communica-
chometric properties of these protocols across acute, chronic tion impairment), it may be challenging to discuss the
progressive, and chronic conditions in clinical practice. results of OMs with a patient. A caregiver may be able to
participate in these discussions and decisions as a proxy.
P. Action Statement 9: DISCUSS OUTCOME MEA- Quality Improvement:
SURE RESULTS AND USE COLLABORATIVE/ • Mechanisms (eg, time and space for conversation)
SHARED DECISION-MAKING WITH PATIENTS. should be developed to enable clinicians to share OM-
Clinicians should discuss the purpose of OMs, results, and related information with patients and caregivers.
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 211
• Sharing OM results and their impact on the plan of care values with care decisions (low-quality evidence). Although
may help to: this review focused on decision aids for medical interven-
• Engage and motivate a patient in his/her physical therapy. tions, it may have relevance for rehabilitation practice. Similar
• Facilitate shared decision-making regarding goals and outcomes (eg, enhanced patient involvement and knowledge)
the plan of care. may be achieved by providing patients with explicit informa-
Implementation and Audit: tion about their OM results and collaboratively making deci-
• Organizations should develop procedures and docu- sions about their care.
mentation for the discussion of OM between the cli-
nician and the patient. Articles are available to guide R. Research Recommendation 14: Research is needed on
implementation of shared decision-making in clinical the impact of discussing OM results and shared decision-
practice, and may be applied to rehabilitation clinics.130 making with patients receiving neurologic physical therapy,
• Education and training on methods to discuss OM re- including the development and impact of OM-related infor-
sults and share decision-making may be required. mation (eg, OM-related decision aids) on the understand-
• A routine audit and feedback of documentation should ing and involvement of a patient in his/her care and on the
be performed to ensure adherence to the recommenda- achievement of patient goals. Furthermore, studies should
tions of sharing OM results and decision-making with develop and test the use of decision aids that incorporate the
the patient. core set.
Recommendations for Health Care Organizations and and strive to achieve an agreement of more than 0.90 reli-
Clinicians: The GDG recommends that organizations adopt ability.140-142 OMs with a test-retest or interrater reliability of
specific standardized practices related to use of this core less than 0.70 should not be used for individual patients.140,141
set of OMs and documentation of patient goals in clinical Establishing the reliability of clinicians in a clinical setting
practice. should facilitate consistent measurement of a patient’s per-
• First, the core set should be used when a person under- formance (eg, when more than one clinician conducts a giv-
going neurologic physical therapy has goals and poten- en test on an individual patient) or when measures are taken
tial to improve balance, gait, or transfers. over time (eg, at admission and discharge), and enhance a
• Patient goal documentation should adhere to the CPG clinician’s and organization’s confidence in the OM results.
recommendations. The OMs should be administered to In addition, increased reliability when using OMs may im-
a patient when evaluated in any setting. If a patient is prove the clinician’s ability to identify changes in function,
unable to perform a test, but will likely be able to per- reduce measurement error, and improve the development
form some or all of the OM at some point in the future, and modification of the plan of care. Training to ensure stan-
the patient should receive a zero on the initial test. This dardization of OM administration and skills assessment may
provides an opportunity to capture data at a later point enhance reliability.
in time, reflecting change that occurred. To promote adoption of the core set, organizations should
• Follow-up measures should be administered at least consider the use of KT interventions.143 A copy of the CPG
twice, with ideal administration time being the mid- action statements should be kept in a location that is easy to
dle of treatment and at discharge. While it is recom- reference. Equipment and space to administer the core set
mended to collect the core set at least once between should be kept in an easily accessible location. Examination
the admission and discharge assessment, the decision forms should be adapted to include facility-specific informa-
to use the OMs for interim measurements is left to the tion, such as the location of equipment and local adaptation
discretion of the clinician and the organization. Factors to testing paths, and electronic and printed versions should
such as length of stay, facility requirements, and re- be made available. Initial training on administration of the
imbursement may impact the ability to administer the core set, how to use data to guide decision-making, and
core set at times other than admission and discharge. methods to use core set data to collaboratively determine a
However, an interim assessment will provide impor- plan of care with patients (eg, shared decision-making) may
tant information about whether the patient’s status is be required. This content should also be provided during new
changing during the episode of care and may inform hire orientation. Audit and feedback144 may facilitate adher-
intervention modifications. In cases when administra- ence to the recommendation that OM administration occurs
tion of the OMs multiple times is not feasible (eg, in at admission and discharge, and preferably, at least once in
acute care), the GDG recommends that the clinician between. Audit criteria should include adherence to recom-
administers the OM once and provide the measurement mended administration timing and documentation of OM in-
results to the next level of care. terpretation and shared decision-making. Tools to assist with
• In health systems with several levels of care, the core auditing will be developed by the CPG KT Committee, and
set should be used throughout a patient’s episode of added to the ANPT Web site. Incorporating a requirement
care and measurement results should be provided to to adhere to use of the core set into performance appraisals
the next level of care. will promote the use of the core set as a clinical and pro-
• Clinicians should utilize data from the core OM set fessional expectation. Whenever possible, core set reminder
to describe progress to other health professionals (eg, systems and decision-support tools should be integrated into
letters to insurance companies, physicians, and team the electronic health system. These and other KT strategies
conference reporting). may be used to promote adoption throughout a health care
• Documentation of the OMs should be standardized organization.
within the facility based on the recommended methods Integration With EDGE Recommendations: Six ANPT
and incorporated into designated fields in the electron- EDGE task forces predated the development of this CPG. The
ic health record. OM recommendations from those groups were focused on in-
• Information, such as SEMs, MDCs, and MCIDs, dividuals with a specific neurologic condition (eg, stroke). It
should be used to support decisions to alter the course is the intent of the GDG that, when caring for an individual
of treatment and discharge from care. with a specific condition, clinicians integrate the core set with
• Implementation of this core set may require time for the recommendations from the relevant EDGE task force.
learning about the CPG and the recommended prac- The core set may be viewed as a “starting point” for measure
tices, comparing current practice with recommended selection, with additional condition-specific measures as rec-
actions, and creating a plan for CPG implementation ommended by the EDGE task force used to provide insight
within the organization.138,139 Specific protocols for into issues specific to their patient’s health condition.
administering the core set have been recommended by ANPT KT Taskforce Will Support CPG Implementation:
the GDG and CPG KT Committee (http://www.neu- In collaboration with the GDG, the ANPT has developed a
ropt.org/professional-resources/anpt-clinical-practice- KT task force made up of PTs practicing in different levels
guidelines/core-outcome-measures-cpg). of care: experts, early career PTs, supervisors, researchers,
Organizations and clinicians should determine interrater patients, and educators. Their role is to support clinicians
and intrarater reliability of each core set measure annually and organizations in the dissemination and implementation
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 213
of CPGs. The primary objective of the core set KT task force Practice Committee Chair, and GDG reviewed applications
is to develop implementation packages that will include KT and selected members. Two task force cochairs and 7 mem-
processes, products, and tools for organizations, clinicians, bers agreed to participate.
and educators to use to implement the core set. The process of collaboration between the task force and
The GDG and the Practice Committee of the ANPT joint- the GDG has begun and is anticipated to continue through
ly developed and disseminated the previous objectives with 2019. As this process evolves, the KT task force, in conjunc-
an invitation to apply for membership on the task force. In- tion with the GDG and the leadership of the ANPT, will fi-
terested stakeholders were asked to submit a statement of in- nalize plans and develop multiple and diverse implementa-
terest and a curriculum vita. The ANPT Director of Practice, tion recommendations and strategies.
214 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
R. Research Recommendation 1: Researchers should fur- patient-reported measures of balance should be studied to
ther examine the BBS, to determine its psychometric proper- ensure a comprehensive comparison to the ABC. Properties
ties in neurologic conditions other than stroke, SCI, PD, HD, such as reliability, internal consistency, measurement error,
and MS. Properties such as SEMs, MDCs, and MCID/MICs floor and ceiling effects, MDCs, and MIC/MCIDs should be
should be established for individuals with scores through- established across neurologic conditions.
out the range of the scale in all adult neurologic conditions.
Specific information regarding the functional levels of in- R. Research Recommendation 7: Studies are needed to
dividuals who may benefit from the BBS, and when to start explore the reliability and clinically important change (eg,
with or transition to another OM, is needed. Determination MCID) of the 10mWT in individuals with acute neurologic
of optimal administration timing would assist clinicians in conditions. Clinically important change should also be de-
administering the BBS within a reasonable time frame when termined in chronic stable conditions. Studies to determine
“real change” would be expected. Development and compre- the presence of floor and ceiling effects should be conduct-
hensive testing of a BBS short-form would decrease admin- ed in persons with chronic progressive and chronic stable
istration burden. conditions.
R. Research Recommendation 2: Studies on OMs that pro- R. Research Recommendation 8: Studies are needed to
vide a comprehensive assessment of sitting balance across examine the Walk-12 in individuals with acute, chronic
acute, chronic progressive, and chronic conditions are need- progressive, and chronic stable neurologic conditions. Psy-
ed. These should aim to determine the psychometric proper- chometric properties such as reliability, internal consis-
ties, including reliability, and to identify information to as- tency, measurement error, floor and ceiling effects, MDCs,
sist in interpretation, such as MDCs and MIC/MCIDs. and MIC/MCIDs should be established across neurologic
conditions.
R. Research Recommendation 3: Specific information re-
garding the functional levels of individuals who may benefit R. Research Recommendation 9: Studies are needed to de-
from the FGA and when to start with or transition to another termine the intrarater and interrater reliability, and clinically
OM is needed. Determination of optimal administration tim- important change (eg, MCID), of the 6MWT in individuals
ing would assist clinicians in administering the FGA within with acute neurologic conditions. Data to assist in measuring
a reasonable time frame when real change can be expected. change (eg, MDC, SEM, and MCID) are needed in individu-
Development and psychometric testing of an FGA short- als with acute and chronic stable neurologic conditions.
form would decrease administration burden.
R. Research Recommendation 10: Studies are needed that
R. Research Recommendation 4: Studies are needed to ex- explore the feasibility and psychometric properties of the
amine other OMs, such as the Mini-BESTest and the TUG, 5TSTS to objectively describe the transfer abilities of adults
in individuals with acute, chronic progressive, and chronic with neurologic conditions, especially those other than indi-
stable neurologic conditions. While the FGA had enough viduals with PD, across the continuum of care and spectrum
evidence to support its inclusion of the core set, more com- of acuity. Further study of the 30SCST is warranted, particu-
prehensive measures of standing and walking balance should larly relative to reliability and data to interpret changes in
be tested to ensure a complete comparison against the FGA. individuals with neurologic conditions.
Properties such as reliability, internal consistency, measure-
ment error, floor and ceiling effects, MDCs, and MIC/MCIDs R. Research Recommendation 11: Studies should explore
should be established across neurologic conditions. the feasibility and psychometric properties, including reli-
ability and data to assist in interpreting change (eg, MDC
R. Research Recommendation 5: Studies are needed to de- and MCID/MIC) of the GAS and other OMs that capture the
termine the psychometric properties (eg, reliability) of the individual goals of adults with neurologic conditions across
ABC in acute, chronic progressive, and chronic stable neu- the continuum of care and spectrum of acuity.
rologic conditions. Furthermore, information to assist clini-
cians in interpreting the results of the ABC, such as MDCs R. Research Recommendation 12: Studies are needed that
and MIC/MCIDs, should be established across neurologic explore the impact of using the core set of OMs on rehabili-
conditions. Specific information regarding the characteris- tation outcomes, including factors related to implementation
tics of individuals who may benefit from the ABC is needed. (eg, time and cost). Studies should explore the impact of us-
ing the core set of OMs to support clinical decision-making
R. Research Recommendation 6: Studies are needed to across neurologic conditions and categories. Future measure-
examine other OMs, such as the Falls Efficacy Scale In- ment studies should be designed to meet the COSMIN re-
ternational, in individuals with acute, chronic progressive, quirements for excellent methodology with regard to sample
and chronic stable neurologic conditions. While evidence size, design, and rigor of statistical analysis of psychometric
supports the inclusion of the ABC in the core set, other properties.8,9,40,42
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 215
R. Research Recommendation 13: The CPG KT Committee decision-making with patients receiving neurologic physi-
is developing standardized administration procedures for all 6 cal therapy, including the development and impact of OM-
OMs in the core set. Studies are needed to determine the psy- related information (eg, OM-related decision aids) on the
chometric properties of these protocols across acute, chronic understanding and involvement of a patient in his/her care
progressive, and chronic conditions in clinical practice. and on the achievement of patient goals. Furthermore, re-
search should develop and test the use of decision aids that
R. Research Recommendation 14: Research is needed incorporate the core set.
on the impact of discussing OM results and shared
216 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
ACKNOWLEDGMENTS REFERENCES
The GDG has substantially benefitted from the contributions 1. Mokkink LB, Terwee CB, Knol DL, et al. Protocol of the COS-
and support provided by many, including patients, clinicians, MIN study: COnsensus-based Standards for the selection of health
Measurement INstruments. BMC Med Res Methodol. 2006;6:2.
researchers, and methodologists throughout the development
2. Mokkink LB, Terwee CB, Gibbons E, et al. Inter-rater agreement
of this CPG, from ideation to publication. and reliability of the COSMIN (COnsensus-based Standards for
We would like to thank Chi-Hung Chang, PhD, who pro- the selection of health status Measurement Instruments) checklist.
vided the GDG with invaluable methodological support in BMC Med Res Methodol. 2010;10:82.
the development of the clinician and consumer surveys and 3. Mokkink LB, Terwee CB, Knol DL, et al. The COSMIN checklist
the COSMIN-M. We would like to formally acknowledge for evaluating the methodological quality of studies on measure-
ment properties: a clarification of its content. BMC Med Res Meth-
the support of the APTA for grant funding that supported
odol. 2010;10:22.
this CPG and specifically thank Matthew Elrod, PT, DPT, 4. Mokkink LB, Terwee CB, Patrick DL, et al. The COSMIN study
MEd, NCS, and Anita Bemis-Dougherty, PT, DPT, MAS. reached international consensus on taxonomy, terminology, and
We are grateful for the ongoing guidance and support definitions of measurement properties for health-related patient-
provided by the ANPT, specifically Beth Crowner, PT, DPT, reported outcomes. J Clin Epidemiol. 2010;63(7):737-745.
NCS, MPPA, Director of Practice, the Evidence-Based Doc- 5. Mokkink LB, Terwee CB, Patrick DL, et al. The COSMIN check-
uments Advisory Committee, and our liaison, Miriam Raf- list for assessing the methodological quality of studies on mea-
surement properties of health status measurement instruments: an
ferty, PT, DPT, PhD. international Delphi study. Qual Life Res. 2010;19(4):539-549.
We thank the Clinical Neuroscience Research Registry 6. Institute of Medicine. Clinical Practice Guidelines We Can Trust.
at the Rehabilitation Institute of Chicago and Northwestern Washington, DC: The National Academies Press; 2011.
University, Heartland Chapter of the National Parkinson’s 7. Fetters L, Tilson J. Evidence Based Physical Therapy. Philadelphia,
Disease Foundation, and the Mid America Chapter of the PA: FA Davis; 2012.
National Multiple Sclerosis Society for their support and as- 8. Terwee CB. Protocol for Systematic Reviews of Measurement
Properties. Amsterdam, the Netherlands: Knowledge Center Mea-
sistance with distributing our survey to consumers of physi-
surement Instruments; 2011. http://www.cosmin.nl/images/up-
cal therapy. load/files/Protocol%20klinimetrische%20review%20version%20
We are grateful to our expert panel members whose di- nov%202011.pdf
verse perspectives and expertise helped guide our work. Our 9. Terwee CB, Bot SD, de Boer MR, et al. Quality criteria were pro-
expert panelists included: Mary Beveridge; Kristen Bode, posed for measurement properties of health status questionnaires.
PT; Rhea Cohn, PT, DPT; Rebecca Craik, PT, PhD, FAPTA; J Clin Epidemiol. 2007;60(1):34-42.
10. Steffen T, Seney M. Test-retest reliability and minimal detectable
Anna De Joya, PT, DSc, NCS; Judith Deutsch, PT, PhD,
change on balance and ambulation tests, the 36-item short-form
FAPTA; Jan Douglas, OTR/L; Edelle Field-Fote, PT, PhD, health survey, and the unified Parkinson disease rating scale in
FAPTA; Timothy Hanke, PT, PhD; Allen Heinemann, PhD; people with parkinsonism. Phys Ther. 2008;88(6):733-746.
Ann Jeppesen, PT, MPT; Jacob Kean, SLP, PhD; Catherine 11. Quinn L, Khalil H, Dawes H, et al. Reliability and minimal de-
Lang, PT, PhD; Deborah Larsen, PT, PhD; Nancy Mayo, tectable change of physical performance measures in individuals
PT, BSc, MSc, PhD; Lorna Paul, PT, PhD; Jeff Rizner; Regi with pre-manifest and manifest Huntington disease. Phys Ther.
Robnett, PhD, OTR/L; Mark Stephan; Keiko Thomas, OT, 2013;93(7):942-956.
12. American Physical Therapy Association. Clinical Practice Guide-
PhD; David Tirschwell, MD, MSc; Mary Van de Kamp, lines. http://www.apta.org/EvidenceResearch/EBPTools/CPGs/.
CCC-SLP; and Vanessa Warner, PT, DPT, NCS. Accessed October 10, 2017.
We are grateful to members of the ANPT who vol- 13. American Physical Therapy Association. Guide to Physical Therapist
unteered to review the literature. The critical appraisal Practice 3.0. http://guidetoptpractice.apta.org/. Accessed June 24,
team included: Kathryn Brown, PT; Melissa DiLorenzo, 2017.
PT, DPT; Lisa Dutton, PT, PhD; Laura Dylus, PT, MSPT, 14. International Classification of Functioning, Disability, and health:
ICF [computer program]. Version 1.0. Geneva, Switzerland: World
NCS; Heather Hayes, DPT, PhD, NCS; Kaitlin Hays, PT,
Health Organization; 2001.
DPT, NCS; Kristen M. Johnson, PT, EdD, MS, NCS; Sarah 15. Potter K, Fulk GD, Salem Y, Sullivan J. Outcome measures in
Keller, PT, DPT, NCS; Thomas Longbottom, PT, DPT, NCS; neurological physical therapy practice: part I. Making sound deci-
Jackie Madsen, PT, DPT, NCS, GCS; Kathryn D. Mitch- sions. J Neurol Phys Ther. 2011;35(2):57-64.
ell, PT, DPT, NCS, MSCS; Holly Roberts, PT, DPT, GCS, 16. Sullivan JE, Andrews AW, Lanzino D, Perron AE, Potter KA. Out-
NCS; Jennifer Schwartz, PT, DPT, NCS; Elizabeth Scott, come measures in neurological physical therapy practice: part II.
A patient-centered process. J Neurol Phys Ther. 2011;35(2):65-74.
PT, DPT, NCS, MSCS; Ted J. Stevenson, PT, MSc; Suzanne
17. Potter K, Cohen ET, Allen DD, et al. Outcome measures for indi-
Trojanowski, PT, DPT, NCS; Diana Veneri, PT, EdD, NCS, viduals with multiple sclerosis: recommendations from the Ameri-
RYT; Amanda Wu, PT, DPT, NCS; Katherine Winborn, PT, can Physical Therapy Association Neurology Section task force.
DPT, MS, NCS; Elizabeth Yates Horton, PT, DPT, NCS; Rie Phys Ther. 2014;94(5):593-608.
Yoshida, PT, DPT, NCS; and Hallie Zeleznik, PT, DPT, NCS. 18. Sullivan JE, Crowner BE, Kluding PM, et al. Outcome measures
We are very grateful for the ongoing work and the col- for individuals with stroke: process and recommendations from
laboration of the CPG KT Committee. This committee in- the American Physical Therapy Association neurology section task
force. Phys Ther. 2013;93(10):1383-1396.
cludes: Maggie Bland (Co-Chair), PT, DPT, NCS, MSCI; 19. Kahn JH, Tappan R, Newman CP, et al. Outcome measure recom-
Amelia Siles (Co-Chair), PT, DPT, NCS; Teresa Rice, PT, mendations from the spinal cord injury EDGE task force. Phys
MPH, NCS; Genevieve Olivier, PT, DPT, NCS; Hallie Zele- Ther. 2016;96(11):1832-1842.
nik, PT, DPT; Megan Eikenberry, PT, DPT, NCS; Arlene 20. McCulloch KL, de Joya AL, Hays K, et al. Outcome measures
McCarthy, PT, MS, DPT, NCS; Wendy Romney, PT, DPT, for persons with moderate to severe traumatic brain injury: rec-
NCS; and Elizabeth “Libby” Anderl, PT, DPT. ommendations from the American Physical Therapy Association
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 217
Academy of Neurologic Physical Therapy TBI EDGE Task Force. 42. Terwee CB, Mokkink LB, Knol DL, Ostelo RW, Bouter LM, de
J Neurol Phys Ther. 2016;40(4):269-280. Vet HC. Rating the methodological quality in systematic reviews
21. Academy of Neurologic Physical Therapy. Academy of Neurologic of studies on measurement properties: a scoring system for the
PT Outcome Measures Recommendations. http://www.neuropt. COSMIN checklist. Qual Life Res. 2012;21(4):651-657.
org/professional-resources/neurology-section-outcome-measures- 43. SurveyMonkey home page. https://www.surveymonkey.com/. Ac-
recommendations. Accessed June 25, 2017. cessed June 25, 2017.
22. Institute of Medicine. Best Care at Lower Cost: The Path to 44. Guideline Elements Model. BridgeWiz for APTA 3.0. http://gem.
Continuously Learning Health Care in America. Washington, DC: med.yale.edu/BRIDGE-Wiz/. Published 2011. Accessed June 25,
Institute of Medicine; 2013. 2017.
23. Haigh R, Tennant A, Biering-Sorensen F. The use of outcome mea- 45. Brouwers MC, Kho ME, Browman GP, et al. AGREE II: advanc-
sures in physical medicine and rehabilitation in Europe. Eur J Re- ing guideline development, reporting and evaluation in health care.
habil Med. 2001;33:273-278. CMAJ. 2010;182(18):E839-E842.
24. Jette DU, Halbert J, Iverson C, Miceli E, Shah P. Use of standard- 46. Shiffman RN, Dixon J, Brandt C, et al. The GuideLine Imple-
ized outcome measures in physical therapist practice: perceptions mentability Appraisal (GLIA): development of an instrument to
and applications. Phys Ther. 2009;89(2):125-135. identify obstacles to guideline implementation. BMC Med Inform
25. Andrews AW, Folger SE, Norbet SE, Swift LC. Tests and measures Decis Mak. 2005;5:23.
used by specialist physical therapists when examining patients 47. Gustavsen M, Aamodt G, Mengshoel AM. Measuring balance in
with stroke. J Neurol Phys Ther. 2008;32(3):122-128. sub-acute stroke rehabilitation. Adv Physiother. 2006;8(1):15-22.
26. Thier SO. Forces motivating the use of health status assessment 48. Lemay JF, Nadeau S. Standing balance assessment in ASIA D
measures in clinical settings and related clinical research. Med paraplegic and tetraplegic participants: concurrent validity of the
Care. 1992;30(5 suppl):MS15-MS22. Berg Balance Scale. Spinal Cord. 2010;48(3):245-250.
27. Lansky D, Butler JB, Waller FT. Using health status measures in 49. Mao HF, Hsueh IP, Tang PF, Sheu CF, Hsieh CL. Analysis and
the hospital setting: from acute care to “outcomes management.” comparison of the psychometric properties of three balance mea-
Med Care. 1992;30(5 suppl):MS57-MS73. sures for stroke patients. Stroke. 2002;33(4):1022-1027.
28. Cano SJ, Hobart JC. Watch out, watch out, the FDA are about. Dev 50. Knorr S, Brouwer B, Garland SJ. Validity of the Community Bal-
Med Child Neurol. 2008;50(6):408-409. ance and Mobility Scale in community-dwelling persons after
29. Fulk G, Field-Fote EC. Measures of evidence in evidence-based stroke. Arch Phys Med Rehabil. 2010;91(6):890-896.
practice. J Neurol Phys Ther. 2011;35(2):55-56. 51. Tsang CS, Liao LR, Chung RC, Pang MY. Psychometric proper-
30. Horn SD, Gassaway J, Pentz L, James R. Practice-based evi- ties of the Mini-Balance Evaluation Systems Test (Mini-BESTest)
dence for clinical practice improvement: an alternative study de- in community-dwelling individuals with chronic stroke. Phys
sign for evidence-based medicine. Stud Health Technol Inform. Ther. 2013;93(8):1102-1115.
2010;151:446-460. 52. Schlenstedt C, Brombacher S, Hartwigsen G, Weisser B, Moller
31. Salter KL, Teasell RW, Foley NC, Jutai JW. Outcome assessment B, Deuschl G. Comparing the Fullerton Advanced Balance Scale
in randomized controlled trials of stroke rehabilitation. Am J Phys with the Mini-BESTest and Berg Balance Scale to assess postural
Med Rehabil. 2007;86(12):1007-1012. control in patients with Parkinson disease. Arch Phys Med Rehabil.
32. Van Peppen RP, Maissan FJ, Van Genderen FR, Van Dolder R, Van 2015;96(2):218-225.
Meeteren NL. Outcome measures in physiotherapy management 53. Donoghue D, Stokes EK. How much change is true change? The
of patients with stroke: a survey into self-reported use, and barriers minimum detectable change of the Berg Balance Scale in elderly
to and facilitators for use. Physiother Res Int. 2008;13(4):255-270. people. J Rehabil Med. 2009;41(5):343-346.
33. Wedge FM, Braswell-Christy J, Brown CJ, Foley KT, Graham C, 54. Downs S, Marquez J, Chiarelli P. The Berg Balance Scale has high
Shaw S. Factors influencing the use of outcome measures in physi- intra- and inter-rater reliability but absolute reliability varies across
cal therapy practice. Physiother Theory Pract. 2012;28(2):119- the scale: a systematic review. J Physiother. 2013;59(2):93-99.
133. 55. Berg K, Wood-Dauphinee S, Williams JI, Gayton D. Measuring
34. Stevens JG, Beurskens AJ. Implementation of measurement in- balance in the elderly: preliminary development of an instrument.
struments in physical therapist practice: development of a tailored Physiother Can. 1989;41(6):304-311.
strategy. Phys Ther. 2010;90(6):953-961. 56. Blum L, Korner-Bitensky N. Usefulness of the Berg Balance
35. Abrams D, Davidson M, Harrick J, Harcourt P, Zylinski M, Clancy Scale in stroke rehabilitation: a systematic review. Phys Ther.
J. Monitoring the change: current trends in outcome measure us- 2008;88(5):559-566.
age in physiotherapy. Man Ther. 2006;11(1):46-53. 57. Pickenbrock HM, Diel A, Zapf A. A comparison between the Stat-
36. Beattie P, Maher C. The role of functional status questionnaires for ic Balance Test and the Berg Balance Scale: validity, reliability,
low back pain. Aust J Physiother. 1997;43(1):29-38. and comparative resource use. Clin Rehabil. 2016;30(3):288-293.
37. Centers for Medicare & Medicaid Services. Functional Reporting: 58. Stevenson TJ. Detecting change in patients with stroke using the
PT, OT, and SLP Services Frequently Asked Questions Document Berg Balance Scale. Aust J Physiother. 2001;47(1):29-38.
Now Available. https://www.cms.gov/Medicare/Billing/Therapy- 59. Salter K, Jutai J, Foley N, Teasell R. Clinical Outcome Variables
Services/Functional-Reporting.html. Published 2014. Accessed Scale: a retrospective validation study in patients after stroke. J
June 25, 2017. Rehabil Med. 2010;42(7):609-613.
38. American Physical Therapy Association. Functional Limitation 60. Chinsongkram B, Chaikeeree N, Saengsirisuwan V, Viriyatharakij
Reporting (FLR) Under Medicare: Tests and Measures for High- N, Horak FB, Boonsinsukh R. Reliability and validity of the Bal-
Volume Conditions. http://www.ptnow.org/FunctionalLimitation- ance Evaluation Systems Test (BESTest) in people with subacute
Reporting/TestsMeasures/. Accessed June 25, 2017. stroke. Phys Ther. 2014;94(11):1632-1643.
39. Moore JL, Raad J, Ehrlich-Jones L, Heinemann AW. Development 61. Delbaere K, Close JC, Mikolaizak AS, Sachdev PS, Brodaty
and use of a knowledge translation tool: the rehabilitation mea- H, Lord SR. The Falls Efficacy Scale International (FES-I).
sures database. Arch Phys Med Rehabil. 2014;95(1):197-202. A comprehensive longitudinal validation study. Age Ageing.
40. Terwee CB, Jansma EP, Riphagen II, de Vet HC. Development of 2010;39(2):210-216.
a methodological PubMed search filter for finding studies on mea- 62. Leddy AL, Crowner BE, Earhart GM. Functional gait assessment
surement properties of measurement instruments. Qual Life Res. and balance evaluation system test: reliability, validity, sensitivity,
2009;18(8):1115-1123. and specificity for identifying individuals with Parkinson disease
41. COnsensus-based Standards for the selection of health Measure- who fall. Phys Ther. 2011;91(1):102-113.
ment Instruments home page. http://www.cosmin.nl/. Accessed 63. Hiengkaew V, Jitaree K, Chaiyawat P. Minimal detectable changes
June 25, 2017. of the Berg Balance Scale, Fugl-Meyer Assessment Scale, Timed
218 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA
“Up & Go” Test, gait speeds, and 2-minute walk test in individuals 83. Jonasson SB, Nilsson MH, Lexell J. Psychometric properties of
with chronic stroke with different degrees of ankle plantarflexor four fear of falling rating scales in people with Parkinson’s disease.
tone. Arch Phys Med Rehabil. 2012;93(7):1201-1208. BMC Geriatr. 2014;14:66.
64. Liaw LJ, Hsieh CL, Lo SK, Chen HM, Lee S, Lin JH. The relative 84. Salbach NM, Mayo NE, Hanley JA, Richards CL, Wood-
and absolute reliability of two balance performance measures in Dauphinee S. Psychometric evaluation of the original and Canadian
chronic stroke patients. Disabil Rehabil. 2008;30(9):656-661. French version of the activities-specific balance confidence scale
65. Wirz M, Muller R, Bastiaenen C. Falls in persons with spinal cord among people with stroke. Arch Phys Med Rehabil. 2006;87(12):
injury: validity and reliability of the Berg Balance Scale. Neurore- 1597-1604.
habil Neural Repair. 2010;24(1):70-77. 85. Morgan MT, Friscia LA, Whitney SL, Furman JM, Sparto PJ. Reli-
66. Paltamaa J, Sarasoja T, Leskinen E, Wikstrom J, Malkia E. Mea- ability and validity of the Falls Efficacy Scale-International (FES-
suring deterioration in international classification of functioning I) in individuals with dizziness and imbalance. Otol Neurotol.
domains of people with multiple sclerosis who are ambulatory. 2013;34(6):1104-1108.
Phys Ther. 2008;88(2):176-190. 86. van Vliet R, Hoang P, Lord S, Gandevia S, Delbaere K. Falls ef-
67. Verheyden G, Vereeck L, Truijen S, et al. Trunk performance after ficacy scale-international: a cross-sectional validation in people
stroke and the relationship with balance, gait and functional abil- with multiple sclerosis. Arch Phys Med Rehabil. 2013;94(5):883-
ity. Clin Rehabil. 2006;20(5):451-458. 889.
68. Verheyden G, Nuyens G, Nieuwboer A, Van Asch P, Ketelaer P, De 87. Scrivener K, Schurr K, Sherrington C. Responsiveness of the ten-
Weerdt W. Reliability and validity of trunk assessment for people metre walk test, Step Test and Motor Assessment Scale in inpatient
with multiple sclerosis. Phys Ther. 2006;86(1):66-76. care after stroke. BMC Neurol. 2014;14:129.
69. Marchetti GF, Lin CC, Alghadir A, Whitney SL. Responsiveness 88. Perera S, Mody SH, Woodman RC, Studenski SA. Meaning-
and minimal detectable change of the dynamic gait index and ful change and responsiveness in common physical performance
functional gait index in persons with balance and vestibular disor- measures in older adults. J Am Geriatr Soc. 2006;54(5):743-749.
ders. J Neurol Phys Ther. 2014;38(2):119-124. 89. Scivoletto G, Tamburella F, Laurenza L, Foti C, Ditunno JF,
70. Wrisley DM, Marchetti GF, Kuharsky DK, Whitney SL. Reli- Molinari M. Validity and reliability of the 10-m walk test and
ability, internal consistency, and validity of data obtained with the the 6-min walk test in spinal cord injury patients. Spinal Cord.
functional gait assessment. Phys Ther. 2004;84(10):906-918. 2011;49(6):736-740.
71. Lin JH, Hsu MJ, Hsu HW, Wu HC, Hsieh CL. Psychometric com- 90. Rossier P, Wade DT. Validity and reliability comparison of 4 mo-
parisons of 3 functional ambulation measures for patients with bility measures in patients presenting with neurologic impairment.
stroke. Stroke. 2010;41(9):2021-2025. Arch Phys Med Rehabil. 2001;82(1):9-13.
72. Nilsagård Y, Kollén L, Axelsson H, Bjerlemo B, Forsberg A. Func- 91. Franchignoni F, Tesio L, Benevolo E, Ottonello M. Psychometric
tional Gait Assessment: reliability and validity in people with pe- properties of the Rivermead Mobility Index in Italian stroke reha-
ripheral vestibular disorders. Int J Ther Rehabil. 2014;21(8):367- bilitation inpatients. Clin Rehabil. 2003;17(3):273-282.
373. 92. Hsueh IP, Wang CH, Sheu CF, Hsieh CL. Comparison of psy-
73. Marchetti GF, Whitney SL. Construction and validation of the chometric properties of three mobility measures for patients with
4-item dynamic gait index. Phys Ther. 2006;86(12):1651-1660. stroke. Stroke. 2003;34(7):1741-1745.
74. Wrisley DM, Walker ML, Echternach JL, Strasnick B. Reliability 93. Chen HM, Hsieh CL, Sing Kai L, Liaw LJ, Chen SM, Lin JH. The
of the dynamic gait index in people with vestibular disorders. Arch test-retest reliability of 2 mobility performance tests in patients
Phys Med Rehabil. 2003;84(10):1528-1533. with chronic stroke. Neurorehabil Neural Repair. 2007;21(4):347-
75. Huang SL, Hsieh CL, Wu RM, Tai CH, Lin CH, Lu WS. Mini- 352.
mal detectable change of the timed “up & go” test and the dy- 94. Freeman J, Walters R, Ingram W, Slade A, Hobart J, Zajicek J.
namic gait index in people with Parkinson disease. Phys Ther. Evaluating change in mobility in people with multiple sclerosis:
2011;91(1):114-121. relative responsiveness of four clinical measures. Mult Scler.
76. Matsuda PN, Taylor CS, Shumway-Cook A. Evidence for the va- 2013;19(12):1632-1639.
lidity of the modified dynamic gait index across diagnostic groups. 95. Solari A, Radice D, Manneschi L, Motti L, Montanari E. The mul-
Phys Ther. 2014;94(7):996-1004. tiple sclerosis functional composite: different practice effects in
77. Leddy AL, Crowner BE, Earhart GM. Utility of the Mini-BESTest, the three test components. J Neurol Sci. 2005;228(1):71-74.
BESTest, and BESTest sections for balance assessments in 96. Larson RD, Larson DJ, Baumgartner TB, White LJ. Repeatability
individuals with Parkinson disease. J Neurol Phys Ther. 2011;35(2): of the timed 25-foot walk test for individuals with multiple sclero-
90-97. sis. Clin Rehabil. 2013;27(8):719-723.
78. Nilsagård Y, Lundholm C, Gunnarsson LG, Dcnison E. Clini- 97. Learmonth YC, Dlugonski DD, Pilutti LA, Sandroff BM,
cal relevance using timed walk tests and “timed up and go” Motl RW. The reliability, precision and clinically meaningful
testing in persons with multiple sclerosis. Physiother Res Int. change of walking assessments in multiple sclerosis. Mult Scler.
2007;12(2):105-114. 2013;19(13):1784-1791.
79. Paul SS, Canning CG, Sherrington C, Fung VS. Reproducibility 98. Motl RW, Learmonth YC, Pilutti LA, Dlugonski D, Klaren R. Va-
of measures of leg muscle power, leg muscle strength, postural lidity of minimal clinically important difference values for the mul-
sway and mobility in people with Parkinson’s disease. Gait Pos- tiple sclerosis walking scale-12? Eur Neurol. 2014;71(3/4):196-
ture. 2012;36(3):639-642. 202.
80. Stolwijk-Swuste JM, Beelen A, Lankhorst GJ, Nollet F; CARPA 99. Nieuwenhuis MM, Van Tongeren H, Sorensen PS, Ravnborg M.
Study Group. SF36 physical functioning scale and 2-minute walk The six spot step test: a new measurement for walking ability in
test advocated as core qualifiers to evaluate physical functioning in multiple sclerosis. Mult Scler. 2006;12(4):495-500.
patients with late-onset sequelae of poliomyelitis. J Rehabil Med. 100. Phan-Ba R, Pace A, Calay P, et al. Comparison of the timed 25-foot
2008;40(5):387-394. and the 100-meter walk as performance measures in multiple scle-
81. Ng SS, Hui-Chan CW. The timed up & go test: its reliability rosis. Neurorehabil Neural Repair. 2011;25(7):672-679.
and association with lower-limb impairments and locomotor ca- 101. Stellmann JP, Vettorazzi E, Poettgen J, Heesen C. A 3meter
pacities in people with chronic stroke. Arch Phys Med Rehabil. Timed Tandem Walk is an early marker of motor and cerebel-
2005;86(8):1641-1647. lar impairment in fully ambulatory MS patients. J Neurol Sci.
82. Powell LE, Myers AM. The Activities-specific Balance Confidence 2014;346(1/2):99-106.
(ABC) Scale. J Gerontol A Biol Sci Med Sci. 1995;50A(1):M28- 102. Baert I, Freeman J, Smedal T, et al. Responsiveness and clini-
M34. cally meaningful improvement, according to disability level,
©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA 219
of five walking measures after rehabilitation in multiple sclero- a multidisciplinary consensus meeting. Mult Scler. 2014;20(12):
sis: a European multicenter study. Neurorehabil Neural Repair. 1641-1650.
2014;28(7):621-631. 123. Verschuren O, Ketelaar M, Keefer D, et al. Identification of a core
103. Holland A, O’Connor RJ, Thompson AJ, Playford ED, Hobart JC. set of exercise tests for children and adolescents with cerebral pal-
Talking the talk on walking the walk: a 12-item generic walking sy: a Delphi survey of researchers and clinicians. Dev Med Child
scale suitable for neurological conditions? J Neurol. 2006;253(12): Neurol. 2011;53(5):449-456.
1594-1602. 124. Grill E, Bronstein A, Furman J, Zee DS, Muller M. International
104. Liu J, Drutz C, Kumar R, et al. Use of the six-minute walk test Classification of Functioning, Disability and Health (ICF) Core
poststroke: is there a practice effect? Arch Phys Med Rehabil. Set for patients with vertigo, dizziness and balance disorders. J
2008;89(9):1686-1692. Vestib Res. 2012;22(5/6):261-271.
105. ATS Committee on Proficiency Standards for Clinical Pulmo- 125. Winser SJ, Smith C, Hale LA, Claydon LS, Whitney SL. Balance
nary Function Laboratories. ATS statement: guidelines for the outcome measures in cerebellar ataxia: a Delphi survey. Disabil
six-minute walk test. Am J Respir Crit Care Med. 2002;166(1): Rehabil. 2015;37(2):165-170.
111-117. 126. Sibley KM, Howe T, Lamb SE, et al. Recommendations for a core
106. Salbach NM, O’Brien KK, Brooks D, et al. Considerations for the outcome set for measuring standing balance in adult populations:
selection of time-limited walk tests poststroke: a systematic review a consensus-based approach. PLoS One. 2015;10(3):e0120568.
of test protocols and measurement properties. J Neurol Phys Ther. 127. Herrmann KH, Kirchberger I, Stucki G, Cieza A. The comprehen-
2017;41(1):3-17. sive ICF core sets for spinal cord injury from the perspective of
107. Lennon S, Johnson L. The modified Rivermead mobility index: physical therapists: a worldwide validation study using the Delphi
validity and reliability. Disabil Rehabil. 2000;22(18):833-839. technique. Spinal Cord. 2011;49(4):502-514.
108. Walsh JM, Barrett A, Murray D, Ryan J, Moroney J, Shannon M. 128. Lennon S. Physiotherapy practice in stroke rehabilitation: a sur-
The Modified Rivermead Mobility Index: reliability and conver- vey. Disabil Rehabil. 2003;25(9):455-461.
gent validity in a mixed neurological population. Disabil Rehabil. 129. Stacey D, Legare F, Lewis K, et al. Decision aids for people facing
2010;32(14):1133-1139. health treatment or screening decisions. Cochrane Database Syst
109. Radman L, Forsberg A, Nilsagard Y. Modified Rivermead Mobil- Rev. 2017;4:CD001431.
ity Index: a reliable measure in people within 14 days post-stroke. 130. Elwyn G, Frosch D, Thomson R, et al. Shared decision making: a mod-
Physiother Theory Pract. 2015;31(2):126-129. el for clinical practice. J Gen Intern Med. 2012;27(10):1361-1367.
110. Duncan PW, Lai SM, Tyler D, Perera S, Reker DM, Studenski S. 131. Elwyn G, Laitner S, Coulter A, Walker E, Watson P, Thomson
Evaluation of proxy responses to the Stroke Impact Scale. Stroke. R. Implementing shared decision making in the NHS. BMJ.
2002;33(11):2593-2599. 2010;341:c5146.
111. Hilari K, Owen S, Farrelly SJ. Proxy and self-report agreement on 132. Government of Canada. Canadian Institutes of Health Research
the Stroke and Aphasia Quality of Life Scale-39. J Neurol Neuro- Act. http://laws.justice.gc.ca/eng/acts/c-18.1/page-1.html. Ac-
surg Psychiatry. 2007;78(10):1072-1075. cessed July 27, 2017.
112. Oczkowski C, O’Donnell M. Reliability of proxy respondents for 133. Nilsen P. Making sense of implementation theories, models and
patients with stroke: a systematic review. J Stroke Cerebrovasc frameworks. Implement Sci. 2015;10:53.
Dis. 2010;19(5):410-416. 134. Hudon A, Gervais MJ, Hunt M. The contribution of conceptual
113. Elder NC, Imhoff R, Chubinski J, et al. Congruence of patient self- frameworks to knowledge translation interventions in physical
rating of health with family physician ratings. J Am Board Fam therapy. Phys Ther. 2015;95(4):630-639.
Med. 2017;30(2):196-204. 135. Levac D, Glegg SMN, Camden C, Rivard LM, Missiuna C. Best
114. Ruble L, McGrew JH, Toland MD. Goal attainment scaling as an practice recommendations for the development, implementation,
outcome measure in randomized controlled trials of psychosocial and evaluation of online knowledge translation resources in reha-
interventions in autism. J Autism Dev Disord. 2012;42(9):1974- bilitation. Phys Ther. 2015;95(4):648-662.
1983. 136. Zidarov D, Thomas A, Poissant L. Knowledge translation in
115. Stolee P, Rockwood K, Fox RA, Streiner DL. The use of goal physical therapy: from theory to practice. Disabil Rehabil.
attainment scaling in a geriatric care setting. J Am Geriatr Soc. 2013;35(18):1571-1577.
1992;40(6):574-578. 137. Field B, Booth A, Ilott I, Gerrish K. Using the Knowledge to Ac-
116. Turner-Stokes L, Williams H, Johnson J. Goal attainment scaling: tion Framework in practice: a citation analysis and systematic re-
does it provide added value as a person-centred measure for evalu- view. Implement Sci. 2014;9:172.
ation of outcome in neurorehabilitation following acquired brain 138. Moulding NT, Silagy CA, Weller DP. A framework for effective
injury? J Rehabil Med. 2009;41(7):528-535. management of change in clinical practice: dissemination and
117. Khan F, Pallant JF, Turner-Stokes L. Use of goal attainment scaling implementation of clinical practice guidelines. Qual Health Care.
in inpatient rehabilitation for persons with multiple sclerosis. Arch 1999;8(3):177-183.
Phys Med Rehabil. 2008;89(4):652-659. 139. Straus SE, Tetroe J, Graham ID. Knowledge Translation in Health
118. Cusick A, McIntyre S, Novak I, Lannin N, Lowe K. A comparison Care. West Sussex, UK: John Wiley & Sons; 2013.
of goal attainment scaling and the Canadian Occupational Perfor- 140. Andresen EM. Criteria for assessing the tools of disability out-
mance Measure for paediatric rehabilitation research. Pediatr Re- comes research. Arch Phys Med Rehabil. 2000;81(12, suppl
habil. 2006;9(2):149-157. 2):S15-S20.
119. Hurn J, Kneebone I, Cropley M. Goal setting as an outcome mea- 141. Post MW. What to do with “moderate” reliability and validity coef-
sure: a systematic review. Clin Rehabil. 2006;20(9):756-772. ficients? Arch Phys Med Rehabil. 2016;97(7):1051-1052.
120. Harlos K, Tetroe J, Graham ID, Bird M, Robinson N. Mining the 142. Fitzpatrick R, Davey C, Buxton MJ, Jones DR. Evaluating patient-
management literature for insights into implementing evidence- based outcome measures for use in clinical trials. Health Technol
based change in healthcare. Healthc Policy. 2012;8(1):33-48. Assess. 1998;2(14):i-iv, 1-74.
121. Field-Fote E. Towards Optimal Practice. What can we gain from 143. Colquhoun HL, Lamontagne ME, Duncan EA, Fiander M,
assessment of patient progress with standardized outcome mea- Champagne C, Grimshaw JM. A systematic review of interven-
sures? http://www.ptresearch.org/article/104/resources/research- tions to increase the use of standardized outcome measures by re-
ers/edge-task-force-evaluation-database-to-guide-effectiveness. habilitation professionals. Clin Rehabil. 2017;31(3):299-309.
Accessed July 26, 2017. 144. Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: effects
122. Paul L, Coote S, Crosbie J, et al. Core outcome measures for exercise on professional practice and healthcare outcomes. Cochrane Data-
studies in people with multiple sclerosis: recommendations from base Syst Rev. 2012;(6):CD000259.
220 ©2018 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of Academy of Neurologic Physical Therapy, APTA