Sunteți pe pagina 1din 19

Research

Effectiveness of the Picture Exchange


Communication System (PECS) on
Communication and Speech for Children With
Autism Spectrum Disorders: A Meta-Analysis
Michelle Flippin
Stephanie Reszka
Linda R. Watson
University of North Carolina at Chapel Hill

Purpose: The Picture Exchange Communication


System (PECS) is a popular communicationtraining program for young children with autism
spectrum disorders (ASD). This meta-analysis
reviews the current empirical evidence for PECS
in affecting communication and speech outcomes for children with ASD.
Method: A systematic review of the literature on
PECS written between 1994 and June 2009 was
conducted. Quality of scientific rigor was assessed
and used as an inclusion criterion in computation of
effect sizes. Effect sizes were aggregated separately for single-subject and group studies for
communication and speech outcomes.
Results: Eight single-subject experiments
(18 participants) and 3 group studies (95 PECS
participants, 65 in other intervention/control) were
included. Results indicated that PECS is a promising but not yet established evidence-based

elayed development of language is an early and persistent marker of autism (Lord, Risi, & Pickles, 2004).
Although estimates vary, approximately 25% of children with autism do not develop functional speech (Volkmar,
Lord, Bailey, Schultz, & Klin, 2004). Thus, the need for early
and effective communication training for children with autism
is clear. However, given the myriad communication-training
strategies available, it is difficult for clinicians to choose the
most effective intervention for an individual child with autism
spectrum disorders (ASD). Variability in language outcomes
for children with ASD makes it difficult to predict which
children will go on to develop speech and which children will
require augmentative and alternative communication. In addition, differential response to intervention for individual
children with ASD makes it difficult for clinicians to identify
the best method of communication training for any one particular child. Given the heterogeneous nature of ASD, variability

178

intervention for facilitating communication in


children with ASD ages 111 years. Small to
moderate gains in communication were demonstrated following training. Gains in speech were
small to negative.
Conclusions: This meta-analysis synthesizes
gains in communication and relative lack of gains
made in speech across the PECS literature for
children with ASD. Concerns about maintenance
and generalization are identified. Emerging
evidence of potential preintervention child characteristics is discussed. Phase IV was identified
as a possibly influential program characteristic
for speech outcomes.
Key Words: autism, Picture Exchange
Communication System, communication
intervention, speech

in treatment outcomes is likely to be a function of individual,


pretreatment characteristics (Lord et al., 2005). To date, there
are no clear guidelines for clinicians in determining which
communication strategy is likely to be effective for an individual child with ASD. The purpose of this meta-analysis is
to review the current empirical evidence for one communication strategy, the Picture Exchange Communication System
(PECS). PECS is a manualized program for teaching children
to use an exchange-based communication system that has
been a common intervention choice for nonverbal children
with ASD in clinical and school settings. In this meta-analysis,
the quality of the current research evidence for the PECS
method is assessed. Additionally, pretreatment characteristics of children who responded to PECS training are identified
across studies to generate a profile of a young child with
ASD for whom PECS may be an appropriate and effective
communication intervention, and program characteristics

American Journal of Speech-Language Pathology Vol. 19 178195 May 2010 A American Speech-Language-Hearing Association

that may support the development of speech in children


through the PECS program are discussed.

TABLE 1. Six phases of Picture Exchange Communication


System (PECS) training.
Phase

Brief Overview of PECS


PECS is a behaviorally based pictorial communication
system designed for children with social-communicative deficits. Using PECS, expressive communication skills are targeted through the training of requests and, later, comments.
As Bondy and Frost (1994, p. 3) describe, Children using
PECS are taught to approach and give a picture of a desired
item to a communicative partner in exchange for that item. By
doing so, the child initiates a communicative act for a concrete item within a social context. It is important to note that
the term PECS does not refer generally to all exchange-based
pictorial communication interventions (i.e., exchanging a
photograph or line drawing for a corresponding real item);
rather, PECS is a specific, manualized intervention protocol.
In the PECS program, a childs expressive communication
abilities are shaped via the use of reinforcement, delay, and
generalization across trainers and settings. PECS training
consists of six phases (see Table 1). In Phase I: The Physical
Exchange, two trainers physically prompt the child to exchange
a single picture for a preferred item, without distractor pictures. In Phase II: Expanding Spontaneity, a communication
book is introduced, and increased distance is placed between
the child and communicative partner. The child is required
to get a picture symbol from his or her communication book
and travel to the communicative partner to request an item.
Placement of picture symbols is varied in the book, and generalization is targeted across a variety of trainers and contexts.
In Phase III: Picture Discrimination, the child discriminates
between two picture symbols (first between a highly desired
and a nondesired item and then between two desired items). In
Phase IV: Sentence Structure, the child makes a request by
building and exchanging a two-picture-sequence sentence
strip with an I want symbol plus the picture symbol for the
preferred item. In Phase IV, after the child has requested by
giving the sentence strip, the communication partner provides
the verbal model I wantI and uses a time delay before
labeling the requested item and handing the sentence strip and
requested item back to the child. In Phase V: Responding to
What Do You Want? the communicative partner introduces
the verbal prompt What do you want? As Phase V intervention continues, a time delay is inserted between the verbal
prompt and an additional gestural prompt toward the I want
picture symbol. Eventually, the child begins answering the
question before his or her communicative partner uses the
gestural prompt. Finally, in Phase VI: Responsive and Spontaneous Commenting, comments are trained via the exchange
of a sentence strip in response to the communicative partners
questions (i.e., What do you see? and What do you have?
contrasted with the request cue What do you want?).
Ease of implementation for both children and interventionists is one of the features that helped PECS to become a
widely popular social-communication-training system for children with ASD. For example, children do not need to master
prerequisite skills (e.g., eye contact, gestures, and verbal imitation) prior to beginning PECS training. Rather, children with
relatively limited skills begin exchanging picture symbols to

II

III

IV

VI

Description
Training begins on a single picture of highly desired item.
Student picks up picture of desired item and releases into
communicative partners hand in exchange for desired
item. Communicative partner gives the item to the child
while naming the item (e.g., car ). Two adults (i.e., the
communicative partner and a physical prompter) are used
during this phase.
A communication book is introduced, and increased distance
is placed between the child and communicative partner.
Child is required to get picture from her communication
book and travel to communicative partner to request item.
To increase spontaneity and persistence, placement of
picture symbol is varied in the book. Also, generalization
across a variety of trainers, contexts, and reinforcers is
introduced at this phase.
Child is required to discriminate between two picture
symbols (highly desired vs. nondesired item to gradually
multiple desired items). Correspondence checks are
done to ensure that child is truly requesting preferred
item.
Child uses a sentence starter (I want) to make a request by
building and exchanging a 2-picture-sequence sentence
strip with I want symbol plus picture symbol for preferred
item. Communicative partner provides verbal model I
wantI and pauses before labeling the requested item
and handing sentence strip and requested item back to
child. Communicative partner differentially reinforces
any vocal attempt.
Communicative partner introduces the verbal prompt What
do you want? Over time, a delay is inserted between
the verbal prompt and an additional gesture prompt
toward the I want picture symbol. The child begins
answering the question before her communicative
partner uses the gestural prompt.
Comments are trained as child exchanges sentence strips
to respond to partners communicative questions (i.e.,
What do you see? What do you want? What do
you have?).

Note. From PECS Training Manual (Frost & Bondy, 2002). Adapted
with permission.

request preferred items immediately upon starting the first


phase of PECS. Also, because PECS is a behavioral approach
that shapes communication via the use of reinforcers, it is
motivating for children. Finally, there is little initial training
required for trainers to implement PECS (i.e., usually a 2-day
workshop).
Limitations of PECS include the restricted range of communicative functions targeted in the approach. The communicative repertoire trained in PECS consists primarily of requests
(Phases IV). A response form that the PECS developers
label comments is trained in the final phase (Phase VI).
However, comments as defined in the program are not true,
self-initiated comments. Rather, the comments are responses
to adult prompts, learned via shaping and rewards. PECS
does not include steps in the program to specifically guide the
child to initiate with picture communication symbols to share
interests with others (i.e., the type of communicative acts
generally considered as commenting). In addition, other
communicative functions that develop early among typically
developing children, such as protests and refusals, are not
Flippin et al.: Effectiveness of PECS

179

directly targeted in PECS. For example, although PECS trains


discrimination between preferred and nonpreferred items, the
standard PECS protocol does not provide a built-in method for
directly indicating that an item is not wanted. Finally, as PECS is
an aided communication technique, preparation of picture
symbols can be labor intensive for clinicians, and the need to
carry a communication book with limited vocabulary choices
can be restrictive for children using the PECS approach.
In the 14 years since its inception, PECS has been widely
adopted in special education settings for children with ASD.
Descriptive reports have suggested that the PECS method
leads to increased functional communication in a relatively
short time period and, sometimes, speech development in
children with ASD. For example, in a retrospective report on
longitudinal data for children with autism who were 5 years of
age and younger, Bondy and Frost (1994) documented that
more than half of the 66 participating children were able to
use speech without pictures to communicate within a year of
starting PECS. Similar gains in the use of PECS symbols to
communicate and in the development of spontaneous speech
have been documented across other case studies and quasiexperimental reports (e.g., Magiati & Howlin, 2003; Schwartz,
Garfinkle, & Bauer, 1998; Webb, 2000). Further, these increases in communication and speech were documented to
occur over a relatively short time period, within 6 to 14 months
of starting PECS (Schwartz et al., 1998; Webb, 2000). Although these reports offer anecdotal support for the effectiveness of PECS, the quality of evidence is limited due
to lack of experimental control. Empirical studies on the
acquisition and impact of PECS strengthen the quality of
evidence related to the effectiveness of PECS and have
added to the evidence base for this approach.

Previous Reviews of PECS


Several recent reviews have employed varying scopes and
methodologies to examine the efficacy of PECS for communication and/or speech outcomes for children and adults with
various disabilities. For instance, Lancioni and colleagues
(2007) reviewed the literature on the effectiveness of pictorial
exchange communication interventions (including PECS)
and voice output communication aids in promoting requesting
among children with developmental disabilities. In that review,
the authors concluded that 170 out of 173 children who participated in studies of PECS or other pictorial exchange communication interventions showed improvement in their ability
to make requests. The independent variables in that review,
however, were not limited to PECS, and participant inclusion
criteria were not specific to autism.
In a more narrowly focused synthesis of 13 studies of PECS,
Tien (2008) reached similar conclusions that PECS appears to
be an effective intervention for improving functional communication skills for participants with ASD. In a broad review of
all of the empirical articles published on the PECS approach,
Sulzer-Azaroff, Hoffman, Horton, Bondy, and Frost (2009)
synthesized data from 34 peer-reviewed studies to conclude
that PECS is an effective means of training functional communication for individuals with impaired or no speech. That
review was not limited to specific participant ages, diagnoses,
or outcome variables. While these reviews provide important

syntheses of the evidence for PECS, they do not provide assessments of the quality of the studies included, or quantitative analyses of results.
In contrast, Schlosser and Wendt (2008) employed both
quality assessment and quantitative analyses in their systematic review of the effects of augmentative and alternative
communication intervention on communication and speech
production for children with autism. Although the independent
variables examined in that review were not limited to PECS,
articles that met criteria for review included seven studies (six
single-subject experiments and one group design) in which
PECS was the independent variable. The authors proposed that
PECS was highly effective for teaching requesting to children
with autism. In contrast, the authors reported mixed results
for speech outcomes, with two studies yielding percentage of
nonoverlapping data (PND) considered highly effective for
promoting speech, one study ineffective, and one study mixed
(highly effective for one participant and ineffective for another);
however, effect sizes (ESs) were not aggregated. Furthermore, since the publication of that review, several additional
group and single-subject experiments have been published
that add to the evidence base for the PECS approach. Most
recently, Preston and Carter (2009), in their examination of
the efficacy of PECS in 10 single-subject and three group designs, reached similar conclusions to Schlosser and Wendt
(2008) that PECS is effective in providing a means of communication for individuals with little or no speech but that the
data are not as clear for speech outcomes following PECS
training. Assessment of quality and calculation of ESs were
completed for individual studies in that review; however, participant criteria were not limited to children with a diagnosis
of autism, and independent variables were not limited to
standard PECS protocol. Rather, the review included studies
with participants ranging in age from early childhood to adulthood, studies of participants with comorbid diagnoses (e.g.,
autism and attention deficit/hyperactivity disorder [ADHD],
blindness, and deafness), and studies that involved modifications of the PECS approach. Thus, despite the contributions
of these systematic reviews of literature, to date no metaanalysis has examined the effectiveness of the standard PECS
protocol on communication and speech outcome variables
for children with ASD.

Research Questions and Method


The evidence base for PECS includes both single-subject
designs and group research. To thoroughly evaluate the evidence for this intervention, both types of studies must be
considered in the meta-analysis. Calculation and aggregation
of ESs for meta-analysis is well established for group designs
and is becoming increasingly accepted practice in singlesubject experiments (Schlosser & Sigafoos, 2008). Although
there is not a standard metric, the calculation of ESs in singlesubject designs allows for the comparison of treatment outcomes within and between individuals as well as comparison
of the relative strength of treatments (Beeson & Robey, 2006).
In the autism literature, specifically, meta-analysis of singlesubject studies has contributed to the evidence base for several
popular interventions, including social skills training (Bellini,

180 American Journal of Speech-Language Pathology Vol. 19 178195 May 2010

Peters, Benner, & Hopf, 2007; Schneider, Goldstein, &


Parker, 2008), video modeling (Bellini & Akullian, 2007),
and self-management (Suk-Hyang, Simpson, & Shogren,
2007). Although there is not a way to aggregate ESs across
single-subject and group designs, including single-subject
research in a meta-analysis allows for a more comprehensive
understanding of the effect of an intervention (Kavale, Mathur,
Forness, Quinn, & Rutherford, 2000). In fact, several studies
have employed meta-analytic techniques for both singlesubject and group designs to determine the effectiveness of
interventions for children with externalizing behaviors and
disruptive behavior disorders (Maughan, Christiansen, Jenson,
Olympia, & Clark, 2005), ADHD (Fabiano et al., 2009), and
autism (Schlosser & Wendt, 2008). Given the volume of
single-subject publications, the current meta-analysis includes
both single-subject and group studies of the PECS approach.
This meta-analysis provides an evaluation of the quality of
empirical evidence, using appropriate quality indicators for
single-subject or group designs. In addition, ESs are aggregated within each type of design to examine the effectiveness
of PECS for both speech and communicative outcomes specifically for young children with ASD. This study addressed
two research questions:
1. What are the effects of PECS on communication outcomes
for children with ASD?

2. What are the effects of PECS on speech outcomes for


children with ASD?

Search Strategy
Studies were identified for inclusion in this meta-analysis
through a three-step process. First, searches were conducted
to identify conceptual and empirical articles related to PECS
published between 1994 and June 2009 that included at least
one child participant (18 years or younger) with ASD, in
the following databases: PsycInfo, ERIC, Academic Search
Premier, and Cumulative Index to Nursing and Allied Health
Literature (CINAHL). Table 2 describes the search terms and
yields. Search terms used were Picture Exchange Communication System, autism, PECS, and Bondy and Frost. Reverse
searches were then conducted to identify articles that cited the
seminal article on PECS (Bondy & Frost, 1994). Second, results were cross-referenced with articles listed on the research
page of the official PECS Web site (www.pecs.com/research.
htm). Finally, reference lists were examined from three relevant literature reviews (Preston & Carter, 2009; Schlosser &
Wendt, 2008; Sulzer-Azaroff et al., 2009) to identify additional
studies that were not captured through previous searches. The
systematic search returned 54 articles. Of the 54 articles identified, only empirical studies (single-subject experiments or

TABLE 2. Search strategies across general-purpose databases.


Database
PsycInfo

Academic Search
Premier

ERIC

CINAHL

Search strategy
(DE Picture Exchange Communication System)
(DE Picture Exchange Communication System AND DE autism)
(DE Picture Exchange Communication System OR DE PECS)
(DE Picture Exchange Communication System OR DE PECS
AND DE autism)
(DE PECS)
(DE PECS AND DE autism)
(Reverse search for articles citing Bondy & Frost, 1994)
(DE Picture Exchange Communication System)
(DE Picture Exchange Communication System AND DE autism)
(DE Picture Exchange Communication System OR DE PECS)
(DE Picture Exchange Communication System OR DE PECS
AND DE autism)
(DE PECS)
(DE PECS AND DE autism)
(Reverse search for articles citing Bondy & Frost, 1994)

Yield (references)
48
45
154
51
150
45
98
36
24
3,295
71
3,141
28
32

Revised search
added AND autism
added OR PECS
added AND autism
added AND autism

added OR PECS
added AND autism
added AND autism
added AND autism

(DE Picture Exchange Communication System)


(DE Picture Exchange Communication System AND DE autism)
(DE Picture Exchange Communication System OR DE PECS)
(DE Picture Exchange Communication System OR DE PECS
AND DE autism)
(DE PECS)
(DE PECS AND DE autism)

33
24
82
81

added AND autism


added OR PECS
added AND autism

76
23

added AND autism

(DE Picture Exchange Communication System)


(DE Picture Exchange Communication System AND DE autism)
(DE Picture Exchange Communication System OR DE PECS)
(DE Picture Exchange Communication System OR DE PECS
AND DE autism)
(DE PECS)
(DE PECS AND DE autism)
(Reverse search for articles citing Bondy & Frost, 1994)

52
48
192
56

added AND autism


added OR PECS
added AND autism

188
49
13

added AND autism

Note. DE = descriptor; ERIC= Education Resources Information Center; CINAHL= Cumulative Index to Nursing and Allied Health Literature.

Flippin et al.: Effectiveness of PECS

181

group design) published in English in a peer-reviewed journal


were considered for inclusion in this synthesis. The remaining
30 studies were reviewed for inclusion criteria by at least two
of the authors. Interrater reliability for inclusion of studies
was 93.3%. In the rare instances of disagreement, the decision to
include or exclude an article was reached by consensus. Studies
included in this meta-analysis met the following criteria:
Participants. This meta-analysis included children younger
than 18 with a diagnosis of autism, ASD, or pervasive developmental disorder-not otherwise specified (PDD-NOS).
Five studies on the use of PECS with adults (Chambers &
Rehfeldt, 2003; Rehfeldt & Root, 2005; Rosales & Rehfeldt,
2007; Stoner et al., 2006; Ziomek & Rehfeldt, 2008) were
not included. In addition, five studies of participants diagnosed with neurological or developmental disorders other
than autism (Bock, Stoner, Beck, Hanley, & Prochnow, 2005;
Kern, Gallagher, Staosta, Hickman, & George, 2006) or with
both autism and a comorbid physical or neurological diagnosis such as ADHD (Adkins & Axelrod, 2002), blindness
(Lund & Troha, 2008), and deafness (Malandraki & Okalidou,
2007) were not included.
PECS implementation. The independent variable in this
meta-analysis was one or more of the six manualized PECS
phases. Five studies with independent variables that were
components or modifications of the manualized PECS methodology (Cummings & Williams, 2000; Dooley, Wilczenski,
& Torem, 2001; Ganz, Cook, Corbin-Newsome, Bourgeois,
& Flores, 2005; Ganz, Sigafoos, Simpson, & Cook, 2008;
Yokoyama, Naoi, & Yamamoto, 2006) were not included.
For the alternating treatment single-subject study conducted
by Angermeier and colleagues (Angermeier, Schlosser, Luiselli,
Harrington, & Carter, 2008), which compared the effectiveness of PECS in two conditions (PECS with Picture Communication Symbols and PECS using Blissymbols), only data
from PECS trials using Picture Communication Symbols
(as recommended in the PECS manual) were included. For
the study by Tincani, Crozier, and Alazetta (2006), data were
included for Study I, which used the standard PECS protocol.
Outcome variables. The dependent variables for the metaanalysis were (a) communicative behaviors (e.g., requests
and initiations) and (b) speech or vocalization. Two studies
with outcomes that were nonlanguage behaviorsthat is,
aggressive behavior (Frea, Arnold, & Vittimberga, 2001) and
problem solving (Marckel, Neef, & Ferreri, 2006)were not
included in this meta-analysis. Finally, one study of PECS
in which symbols were modified with braille for use with a
visually impaired therapist was excluded because the graphed
data of communication outcomes in that study were provided
for the therapist and not the child participants (Charlop,
Malmberg, & Berquist, 2008).
Articles selected for review. A total of 11 studies (eight
single-subject experiments and three group designs) met
criteria for inclusion. For the purpose of this meta-analysis,
findings from articles that analyzed data from the same participants (i.e., Carr & Felce, 2007a, 2007b; Yoder & Stone,
2006a, 2006b) were collapsed into a single study.
Data extraction and decisions. Data extracted from published studies of PECS included participant diagnoses and
ages, experimental design, outcome variables, phases of
PECS trained, and reported results. For group studies, ESs

were extracted if reported; if not, reported statistics from which


ESs could be calculated were extracted. For single-subject
studies, data points on communication and speech outcome
variables were extracted from plotted graphs to calculate ESs.
In the study by Angermeier and colleagues (2008), in which
baseline data were reported separately for each of the
trained PECS phases, ESs calculated for communicative
outcomes were averaged across the trained phases of PECS
for each participant. For the study by Charlop-Christy,
Carpenter, Le, LeBlanc, and Kellet (2002), which employed
a multiple-baseline-across-settings design, ES was averaged
across the two contexts (academic and play sessions) in
which speech outcomes were measured. Finally, to satisfy
the independence assumption of meta-analysis, for four
studies in which multiple outcome variables were reported
for speech (Charlop-Christy et al., 2002; Ganz, Simpson, &
Corbin-Newsome, 2008; Yoder & Stone, 2006a, 2006b)
and communication (Howlin, Gordon, Pasco, Wade, &
Charman, 2007), variables were averaged so that only one
ES per construct (i.e., speech or communication) was included
for each study in calculation of the composite ES (Hedges
& Olkin, 1985). Included outcome variables and summaries
of the data for group and single-subject designs included are
presented in Tables 36.

Quality of Evidence
The quality of evidence for the PECS approach was evaluated via the use of rating scales adapted from guidelines by
Horner et al. (2005) and Wolf (1978) for single-subject designs (see Appendix A) and by Gersten et al. (2005) for group
designs (see Appendix B). Quality indicator items were assigned a rating of adequate, partially adequate, or inadequate/
unknown and a score of 2, 1, or 0 points, respectively. Each
article was independently coded for quality assessment by
the first two authors. Interrater reliability was calculated via
point-to-point agreement on the 11 included articles and
ranged from 84.2% to 100%. Composite scores were tallied
as a percentage of points assigned out of total possible points
for each article. Scores at 90% and above were considered
to be strong quality of evidence. Scores ranging from 75% to
90% were considered to be adequate quality of evidence, and
scores of 74% and below were considered to be inadequate
quality of evidence.
Overall, the quality of evidence for PECS was considered
to be adequate (see Tables 36). Quality assessment ratings
of group studies ranged from strong to inadequate levels of
evidence (one study of strong quality and two of inadequate
quality) for the effectiveness of PECS on communicative and
speech abilities of children with autism. For group designs,
the quality of evidence for PECS would be strengthened by
improved measurement and reporting of treatment fidelity.
For example, in two of the three group studies in this metaanalysis, treatment fidelity was not reported. Without measures
of treatment fidelity, it is difficult to know whether PECS was
delivered in the appropriate manner and dosage; thus, it is
difficult to demonstrate a functional relationship between the
intervention and the communication and speech outcomes.
Quality assessment ratings of the single-subject experiments ranged from strong to adequate (three studies of strong

182 American Journal of Speech-Language Pathology Vol. 19 178195 May 2010

Flippin et al.: Effectiveness of PECS

183

Multiple baselines across


participants

IIV

IIII

IIII

IIV

IIV

IIII

IIII

PECS
phases

Treatment
fidelity (Y/N)

% independent mands

Spontaneous language
(icons and
verbalizations)
% independent mands

% independent PECS
exchanges
% independent PECS
exchanges

% accuracy PECS
exchanges

% independent PECS
exchanges

Dependent variables

Gains in PECS exchanges


for all 3 participants
with autism
Gains in PECS exchanges
for all 3 participants
Mastery for 2/3 participants
in independent PECS
exchanges
Increases in spontaneous
language (icons and
some verbal)
Gains in mands for both
participants; greater
gains with signs for
1 participant
Gains in mands for both
participants

Gains in PECS exchanges


for all 4 participants

Results reported

S (93)

S (93)

A (76)

A (82)

A (83)

A (78)

S (90)

Quality rating
(% scores)

98.4

100

64.8

0.34

0.30

0.16

0.71

64.4

1.04

ES

93.7

PND (%)

NR

NR

NR

G/M

24 PECS,
17 control

26 immediate,
28 delayed,
29 control
17 PECS,
19 RPMT

Carr & Felce


(2007a, 2007b)

Howlin et al. (2007)

3;98;9
5;29;5
5;110;0
3;07;0

3;07;0

Ages
( years;months)

RCT

Group
(nonrandom;
nonmatched)
RCT

Design

IVI

NR

IIII

PECS
phases

Treatment
fidelity (Y/N)

Requesting

Initiations;
PECS usage

Initiations

Dependent
variables

Significant increase in frequency of


initiations and PECS usage; gains not
maintained on follow-up
No main effects for PECS on requesting;
PECS more effective than RPMT on
requesting for children with low JA

Initiations increased for children in PECS


group but not for control

Results reported

S (100)

I (45)

I (50)

Quality rating
(% scores)

NR

G/M

0.65

0.95

ES

Note. I = inadequate quality of evidence; RCT = randomized controlled trial; RPMT = Responsive Education and Prelinguistic Milieu Teaching; JA = joint attention. Dash indicates incalculable
from data presented.

Yoder & Stone


(2006a, 2006b)

Participants

Reference

TABLE 4. Summary of communication outcomes and quality ratings for group designs.

Note. PND = percentage of nonoverlapping data points; ES = effect size; G/M = generalization or maintenance measures included; S = strong quality of evidence; NR = not reported;
A = adequate quality of evidence. Dash indicates incalculable due to absence of baseline phase.

10;2, 11;9

Tincani et al.
(2006; Study I)

Multiple baselines across


settings (home,
centers, journal)
Alternating treatments

6;0

5;10, 6;8

Multiple baselines across


participants

4;5, 3;1, 4;1

Tincani (2004)

Changing criterion

Alternating treatments
and multiple baselines
across participants
Alternating treatments

Design

5;8, 7;2, 3;9

NR
(3 preschoolers)

Beck et al. (2008)

Ganz & Simpson


(2004)
Ganz, Simpson, &
Corbin-Newsome
(2008)
Kravitz et al. (2002)

9;0, 7;0, 6;0, 8;0

Ages
( years;months)

Angermeier et al.
(2008)

Reference

TABLE 3. Summary of communication outcomes and quality ratings for single-subject designs.

184 American Journal of Speech-Language Pathology Vol. 19 178195 May 2010


Design

IIV

IIII

IIV

IIV

IIII

IIII

PECS
Treatment
phases fidelity (Y/N)
Results reported

Vocal approximations

Word vocalizations

Word approximations and


intelligible words

Average spoken words


per trial

Gains in average spoken


words for all
3 participants
No gains in word
approximations or
intelligible words
Gains in words for both
participants, although
greater gains with
sign for 1 participant
Gains in vocal
approximations for
1 participant during
Phase IV

Total utterances; % intelligible Gains in speech outcomes


utterances; % spontaneous
for 1/3 participants with
intelligible utterances;
autism
different words
Spontaneous speech; MLU
Gains in spontaneous
speech, MLU for all
3 participants

Dependent variables

Note. Dash indicates incalculable due to absence of baseline phase. MLU = mean length of utterance.

Multiple baselines
across participants

5;10, 6;8

10;2

Alternating treatments

4;5, 3;1, 4;1

Ganz, Simpson, &


Corbin-Newsome
(2008)
Tincani (2004)

Tincani et al.
(2006; Study I)

Multiple baselines
across participants

5;8, 7;2, 3;9

Ganz & Simpson


(2004)

Multiple baselines
across participants;
multiple baselines
across settings
(home, centers,
journal)
Changing criterion

3;8, 5;9, 12;0

NR
Alternating treatments
(3 preschoolers)

Ages
(years;months)

Charlop-Christy
et al. (2002)

Beck et al. (2008)

Reference

TABLE 5. Summary of speech outcomes and quality ratings for single-subject designs.

S (93)

S (93)

A (80)

A (82)

A (83)

A (78)

12

100

6.5

NR

NR

1.45

NR
0.26

0.01

NR

0.05
59.4

G/M
NR

ES

Quality rating
(% scores) PND (%)

Flippin et al.: Effectiveness of PECS

185

26 immediate,
28 delayed,
29 control
17 PECS,
19 RPMT

Howlin et al. (2007)

Yoder & Stone


(2006a, 2006b)

Participants

Reference
3;98;9
5;29;5
5;110;0
3;07;0

Ages
(years;months)

RCT

RCT

Design

IVI

NR

PECS
phases

TABLE 6. Summary of speech outcomes and quality ratings for group designs.

Treatment
fidelity (Y/N)

Nonimitative
words;
nonimitative
spoken acts

Frequency
of speech

Dependent
variables

Overall, PECS more


effective than RPMT
in facilitating words
and spoken acts;
PECS especially
effective for children
with low JA and high
object exploration;
advantages for PECS
group at Time 1 not
maintained at Time 2

No significant change in
frequency of words

Results reported

S (100)

I (45)

Quality rating
(% scores)

0.57

0.05

ES

G/M

quality and five of adequate quality). Quality of the singlesubject experiments would be strengthened by inclusion of
measures of maintenance, generalization, and social validity.
Follow-up measures to assess maintenance and generalization were reported in only 50% of the single-subject studies,
and social validity was measured in only two of the eight
single-subject designs. Failure to measure maintenance, generalization, and social validity in the PECS single-subject
literature is consistent with other single-subject investigations
in the autism literature. For example, Odom and colleagues
(2003) reported that only 35% of single-subject intervention
experiments with individuals with ASD measured maintenance and only 41% reported generalization measures. Knowing whether speech and communication gains made during the
PECS program are maintained after stopping PECS intervention is important for clinicians in deciding on a communicationtraining approach for children with autism.

Analysis Procedures
For group designs, ESs for posttest group differences were
reported as given or calculated from published data. For one
study that reported results using the nonparametric Mann
Whitney U statistic (Carr & Felce, 2007a, 2007b), an equivalent of Cohens d was calculated as outlined by Rosnow
and Rosenthal (2008). The dequivalent metric represents the
value of d analogous to the result for an exactly normally
distributed outcome with N/2 units in each group (Rosnow
& Rosenthal, 2008, p. 382). For another study (Howlin et al.,
2007), Cohens d was calculated from the published odds
ratios as outlined by Chinn (2000). Standard interpretation
of Cohens d (Cohen, 1988) was used to consider the strength
of evidence for group design studies (i.e., <0.2 = trivial;
0.20.5 = small; 0.50.8 = moderate; >0.8 = strong).
For single-subject experiments, two methods of calculating
ES were used, as there is not currently an established metric
for ES in single-subject experiments (Beretvas & Chung, 2008).
In the first analysis, data from published graphs were entered
and analyzed using the software program ITSACORR (Crosbie,
1993). ITSACORR conducts an analysis of the single-subject
data by fitting least-squares trend lines to baseline and treatment phases while controlling for autocorrelation and short
data sets (Maughan et al., 2005). ITSACORR was chosen
over other methods of ES calculation (e.g., standardized difference approach) because of the validity of this approach
for graphs with zero slope in the baseline phase (Huitema,
2004) and undefined standard deviations (i.e., less than two
data points in baseline or all baseline data points equal to zero;
Beeson & Robey, 2006; Kratochwill, Stoiber, & Gutkin,
2000). ITSACORR provides an F statistic as well as tests of
change in intercept and change in slope. The y-intercept
t statistic given by ITSACORR and the number of data points
per phase were used to calculate ESs as Glasss delta, as
outlined by Maughan et al. (2005).
In addition to the ITSACORR method of data analysis for
single-subject designs, the studies were also analyzed using
the PND method, in which the highest data point in baseline
phase was identified and the percentage of data points during
intervention exceeding this level was calculated (Scruggs,
Mastropieri, & Castro, 1987). PND could not be calculated

for three studies that used alternating treatment (Angermeier


et al., 2008; Beck, Stoner, Bock, & Parton, 2008) or changing
criterion designs (Ganz & Simpson, 2004) without a baseline phase. Interpretation of PND scores as outlined by Scruggs
and colleagues (Scruggs, Mastropieri, Cook, & Escobar, 1986)
is as follows: <50% = unreliable treatment; 50%70% =
questionable effectiveness; 70%90% = fairly effective;
>90% = highly effective.
After individual ESs were calculated, composite ESs for
the speech and communication outcome variables were computed independently for single-subject and group designs.
For single-subject multiple-baseline designs across participants, ESs are reported as the mean ES for all participants. As
study quality is a focus of this meta-analysis, a threshold of
at least adequate quality was set for inclusion of a study in
the computation of aggregate ESs (Pettiti, 2000). All eight of
the single-subject experiments met criteria of at least adequate
quality. For group designs, however, only one of the three
group experiments met quality criteria. Thus, for the group
studies, individual ESs are described here, and aggregate ESs
were not calculated.

Synthesized Results
Findings were synthesized to evaluate the effectiveness of
the PECS approach on communication and speech outcomes
for children with autism. Results are reported separately for
single-subject studies and group designs, as ESs from singlesubject experiments tend to be inflated when compared with
those of group designs (Swanson & Sachse-Lee, 2000), and
there is no method to combine ESs from different experimental
designs (Kavale et al., 2000).

Communication Outcomes
Communication outcomes examined in the PECS literature include the frequency of PECS exchanges, requests
(Angermeier et al., 2008; Beck et al., 2008; Ganz & Simpson,
2004; Ganz, Simpson, & Corbin-Newsome, 2008; Howlin
et al., 2007; Kravits, Kamps, Kemmerer, & Potucek, 2002;
Tincani, 2004; Tincani et al., 2006), and initiations (Carr &
Felce, 2007a, 2007b; Howlin et al., 2007). Increases in communication outcomes following PECS training were demonstrated across both single-subject and group studies. Overall,
for the single-subject experiments, the mean weighted ES
was 0.51. The confidence interval did not include zero, 95% CI
[0.04, 0.67]; therefore, the assumption can be made that
PECS treatment had a significant impact on communication
outcomes. The mean PND of 84.3%, 95% CI [68.4%, 100.1%],
indicates that PECS is a fairly effective treatment for improving communication for young children with autism. However, evidence of the maintenance and generalization of
communication gains made through PECS intervention is
limited in the single-subject literature. In fact, maintenance
of communication gains was measured in only one of the
seven single-subject studies that examined communication
outcomes. In that study, Angermeier and colleagues (2008)
reported that all three participants maintained mastery level
of communicative exchanges at the Phase II level of PECS
immediately after completing Phase II training. Furthermore,

186 American Journal of Speech-Language Pathology Vol. 19 178195 May 2010

generalization of communication gains achieved through


PECS was measured in only three single-subject studies.
Beck et al. (2008) measured generalization across settings
for two of the four participants in their study comparing the
effectiveness of PECS and VOCA. Probes conducted in the
childrens homes demonstrated limited generalization of
communication gains made through PECS 1 week after
school-based training. One participant used PECS to request
only once during the sessions, while the other participant
demonstrated only three requests using PECS (vs. 17 requests when using a voice output device).
In contrast, Tincani (2004) measured generalization across
trainers in an alternating treatment design. In that study, PECS
was more effective than sign language in promoting communication for one child; this child demonstrated picture
exchanges at levels similar to those achieved in training (93%
on average) during generalization sessions conducted with
a new communication partner. Similar results were reported
by Tincani and colleagues (2006), in that both participants
produced levels of independent mands during four generalization probes with a new communication partner (i.e., the childs
teacher) that were similar to those achieved during Phase IV
training. All generalization probes were higher than levels of
communication achieved during baseline phase.
For the group designs, the mean weighted ES could not
be aggregated, as ES was not calculable for communication
outcomes for the PECS intervention in one of the three group
studies (Yoder & Stone, 2006a, 2006b) examining communication outcomes, and the two group studies reporting calculable ES data did not meet quality inclusion criteria. With
regard to maintenance of communicative gains, concerns were
raised by one group study. Howlin and colleagues (2007)
reported that the increases in rate of initiations and PECS usage that made up immediate treatment effects were not maintained over time, and upon follow-up, ESs were negligible,
0.04, 95% CI [0.61, 0.1], and 0.24, 95% CI [0.42, 0.92],
respectively. Maintenance of communication gains for the
PECS intervention group was not reported in the study by
Carr and Felce (2007a, 2007b) and not calculable from presented data for Yoder and Stone (2006a, 2006b). In addition,
generalization of communicative gains was not reported for
any of the three group studies of PECS. Thus, overall, small to
moderate effects were demonstrated for the short-term efficacy
of PECS in improving communicative outcomes for young
children with autism across the single-subject experiments
and group studies of PECS. Evidence for maintenance and
generalization of communicative gains achieved through
PECS training, however, is limited and mixed.

Speech Outcomes
Although the developers of the program describe PECS as
an augmentative communication system and are careful not
to claim that PECS improves speech for children with ASD,
speech is a frequently measured outcome variable in the
PECS literature. Clinicians and parents alike desire information regarding the effectiveness of PECS in influencing speech
outcomes for young children with autism. Speech outcomes
were measured broadly across the PECS studies and included
the general measures of spontaneous speech (Charlop-Christy

et al., 2002; Howlin et al., 2007) as well as more specific


measures of the frequency of nonimitative spoken acts and
words (Yoder & Stone, 2006a, 2006b), word vocalizations
(Tincani, 2004), word approximations (Ganz, Simpson, &
Corbin-Newsome, 2008), vocal approximations (Tincani
et al., 2006), and average number of words spoken per trial
(Ganz & Simpson, 2004). In the five single-subject experiments examining speech, outcomes varied widely across
the 12 participating children (ES ranged from 1.45 to 1.37).
It is interesting to note that several single-subject studies
reported overall gains in speech based on visual inspection
and interpretation of the data. However, as a group, the mean
weighted ES for speech outcome variables across singlesubject studies was negligible (0.17), and the CI included
zero, 95% CI [0.01, 0.36]. The mean PND was 44.7%, [1.8%,
87.6%], indicating questionable effectiveness of the PECS
approach for increasing speech for young children with autism
across the single-subject literature.
Furthermore, maintenance of speech gains was measured
in only one of the five single-subject studies examining speech
outcomes. Charlop-Christy and colleagues (2002) reported
1-year follow-up data for one participant who demonstrated
maintenance of speech gains made through PECS at levels
similar to those achieved during PECS training.
Finally, generalization of speech gains made through PECS
was also measured in only one of the five single-subject studies
examining speech outcomes. Tincani and colleagues (2006)
reported that for one participant who made gains in speech
through PECS, four generalization probes implemented by the
childs teacher demonstrated levels of vocalization similar to
those achieved in training. However, only two of the four
generalization probes were above the childs baseline levels
of vocalization prior to starting PECS training.
Results of speech outcomes following PECS training were
also variable across the group experiments. In a follow-up
analysis of their study, Carr and Felce (2007b) noted that five
of 17 children in PECS group showed increases in speech;
however, ESs for speech outcomes in this study were not
calculable from the published data. Children in the Howlin
et al. (2007) study achieved a negligible ES for speech (0.05).
In contrast, moderate effects for speech outcome variables
(i.e., frequency of nonimitative spoken acts, ES = 0.63, and
number of different nonimitative words, ES = 0.50) were
reported by Yoder and Stone (2006a, 2006b) at posttest in
their randomized controlled trial comparing PECS with
Responsive Education and Prelinguistic Milieu Teaching
(RPMT). In that study, PECS was found overall to be the
more effective treatment for increasing number of nonimitative spoken communication acts, t(34) = 2.30, p = .03,
and the number of different nonimitative words used, t(34) =
2.10, p = .04. However, posttest advantages in speech realized by the PECS group were not maintained at follow-up
6 months after intervention. In fact, ES for all speech outcome measures at 6 months after intervention was negligible
(ES = 0). Thus, the variable effects in speech outcomes following PECS illustrate that the program is not equally effective
in improving speech outcomes for all children with autism.
Variability in response to PECS may be due to preintervention characteristics of individual children. Available evidence
related to this possibility is examined in the following section.
Flippin et al.: Effectiveness of PECS

187

Child Characteristics: Moderating Variables


and Preintervention Characteristics
Given the heterogeneous nature of the population of children with ASD, it is important for both clinical intervention
and research to determine which characteristics make individual children more likely to benefit from PECS, as well as
to identify which components of the PECS program are most
effective. Therefore, in addition to determining the overall
effectiveness of the PECS communication approach, further
analysis was conducted across group studies and single-subject
experiments to identify modifying variables and preintervention characteristics of children who responded to PECS
training. For group studies, examination of variables that
moderate the effectiveness of PECS provides a strong statistical tool which allows us to identify particular child characteristics that have a measurable and direct influence on
speech and communication outcomes. For single-subject
experiments, examination of preintervention participant characteristics allows us to describe which children gained the
most from PECS, at the level of individual participant, although a direct relationship between preintervention characteristics and speech and language outcomes is not identifiable.
Three child characteristics emerged as potential pretreatment
identifiers of a child with autism who is likely to respond to
PECS intervention: (a) limited joint attention, (b) relatively
stronger object exploration, and (c) limited motor imitation.

Joint Attention
Joint attention refers to three-point, systematic sharing
of attention between (a) an individual, (b) an object or event,
and (c) another individual (Tomasello, 1995). Evidence from
one group design study suggests that PECS may be a more
effective communication intervention than RPMT for children with initially low rates of joint attention. In Yoder and
Stones study (2006a, 2006b), exploratory analysis of pretreatment variables revealed that initial rates of joint attention were a strong predictor of whether a child made greater
communication (i.e., requesting) gains from either PECS or
RPMT. Initiating joint attention was operationally defined
as an intentional communication act about an object that
attempts to get the adults to comment, laugh, smile, show attention, or give a label (Yoder & Stone, 2006b, p. 430). For
children who began an intervention with initially lower frequencies of joint attention (i.e., one instance or less of initiating joint attention across two assessment procedures), PECS
was the more successful approach in targeting communication outcomes. Joint attention also emerged as a potentially
influential preintervention characteristic in a single-subject
experiment by Charlop-Christy and colleagues (2002), which
documented that the largest overall gains in both speech
and communication were made by the youngest participant,
who began the study with no spontaneous speech, and relatively weaker social communicative behaviors (i.e., joint attention, eye contact, and toy play). Thus, joint attention may
be one child characteristic to be explored as a moderating
variable of main effects in group designs and as a preintervention characteristic to describe for participants in single-subject
experiments.

Object Exploration
A second potential preintervention variable that may moderate the effects of PECS on speech outcomes is object exploration. Differential response to treatment based on a childs
initial levels of object exploration was documented by Yoder
and Stone (2006a, 2006b). In their study, Yoder and Stone defined
object exploration as the number of different toys a child
touched during a play assessment. For children with initially
higher levels of object exploration (+1 SD above the group
mean), PECS was shown to be a more effective treatment than
RPMT in increasing the frequency of nonimitative speech at
posttest. Initial levels of object exploration were also shown to
be important in maintaining gains in speech made through PECS.
In fact, only children with high object exploration maintained
speech gains at the 6-month follow-up, relative to the alternate
treatment group. Thus, object exploration may be a variable
that moderates speech outcomes achieved by children with
autism through the use of PECS, but this finding has not yet
been replicated across studies or by independent researchers.

Imitation
Imitation is a third potential preintervention characteristic
that may influence both speech and communication outcomes
for children participating in PECS intervention. Motor imitation
was examined as a preintervention characteristic that influenced
the acquisition and effectiveness of PECS in a single-subject
study comparing the effectiveness of sign language and PECS
on the training of requests. In that study, Tincani (2004) examined the pretreatment ability of two participants to imitate
27 hand, arm, and finger movements, similar to those required
to communicate via sign language. As was predicted by the
author, sign language was more effective than PECS in facilitating independent requests for a participant with relatively
higher motor imitative ability. In contrast, PECS was the more
effective treatment for improving communication for a participant with relatively lower motor imitative ability. With regard to speech outcomes, however, sign language was the
more effective intervention for both participants, regardless
of initial levels of motor imitation.
Verbal imitation has also emerged as a potentially influential preintervention child characteristic. Charlop-Christy
and colleagues (2002) described the three participants in their
study, who each made gains in both communication and
speech through PECS, as having some ability to verbally imitate before beginning PECS training. The authors postulate
that participants baseline level of verbal imitation may have
accounted for the ability to produce spontaneous speech during and after training. Assessment measures of preintervention verbal imitation were not described, however. It is important
to emphasize that results from these two single-subject experiments may not generalize to the overall population of
children with ASD. Nevertheless, motor and verbal imitation
may be a variable of interest in future studies of the effectiveness of PECS on communication and speech outcomes
for children with autism. In fact, given that early imitation
skills have been shown to be a strong predictor of later speech
development in children with autism (Charman et al., 2003;
Toth, Munson, Meltzoff, & Dawson, 2006), it is interesting

188 American Journal of Speech-Language Pathology Vol. 19 178195 May 2010

that imitation has not been more frequently examined as a


pretreatment characteristic across the autism communication
intervention literature.
Thus, the current evidence base for the effects of moderators and preintervention characteristics is limited, but the
measurement and analysis of preintervention variables in future
studies would be invaluable in informing clinical decisions
about the selection of effective communication interventions
for individual children with ASD. For future group designs,
examination of the potential moderating impact of preintervention variables such as joint attention, object exploration,
and motor/verbal imitation on the effects of PECS on communicative and speech outcomes is warranted. In future singlesubject experiments, although statistical examination of
moderators is not possible given the constraints of the research design, reporting preintervention assessment results
for these and other participant characteristics would allow for
systematic replication of studies and provide pilot data for
larger group studies to help identify the profile of a child with
ASD who is likely to make communication and/or speech
gains through PECS.

Program Characteristics: Phase IV Intervention


and Speech Outcomes
Another interesting and potentially clinically useful finding of this analysis is the impact of training PECS Phase IV
on spontaneous speech for those children who went on to
develop speech through PECS. In their seminal report, Bondy
and Frost (1994) documented that although speech development was not a specific aim of their approach, vocalizations
generally developed in the later phases of PECS training
(IV to VI). Phase IV of PECS is unique in that it introduces
both verbal modeling and time delay strategies. In Phase IV,
the trainer models the phrase I wantI and briefly pauses
before handing the requested object to the child. Evidence
from several single-subject studies lends empirical support
to Bondy and Frosts (1994) initial reports of increased speech
during later PECS phases (Charlop-Christy et al., 2002; Ganz
& Simpson, 2004; Tincani, 2004).
Because single-subject experiments document the participants changes in speech across each phase of PECS, it was
possible to compare the magnitude of gains in speech between
Phases III and IV for those single-subject experiments that
reported speech outcomes through Phase IVof PECS (Ganz &
Simpson, 2004; Ganz, Simpson, & Corbin-Newsome, 2008;
Tincani, 2004). This analysis resulted in a composite ES for
speech outcomes across Phase IVof the single-subject studies
of 0.73. This lends support to evidence that for children who
go on to develop speech, Phase IV is important. In contrast,
for those same children, communication gains between
Phases III and IV were found to be negative (ES = 0.37).
Large ESs for speech development and negative effects for
communication outcomes between Phases III and IV suggest
that as these children become increasingly more verbal, speech
begins to replace the picture-based exchanges of PECS.
Thus, it serves to highlight that Phase IV may be particularly
important for development of speech.
However, questions remain as to whether speech gains
realized in Phase IV were due to the introduction of verbal

models, the use of time delay, or some combination of strategies that may contribute to an increase in speech production
during PECS Phase IV. Alternatively, it may be that those
children who reach the criterion of 80% mastery in Phases IIII
are the same children who are likely to go on to develop
speech. There is some support in the PECS literature for the
impact of time delay on increased speech production (CharlopChristy et al., 2002; Tincani, 2004; Tincani et al., 2006). For
example, after the introduction of a 4-s delay of reinforcement,
one child in Tincanis study (2004) increased percentage of
word vocalizations from a low of 30.1% during PECS Phase III
training to an average of 90%. Tincani and colleagues (2006)
further documented the effectiveness of using a 35-s delay
in an alternating treatment design, with one participant who
demonstrated greater use of speech during those phases that
employed a delay versus baseline phases. Thus, there is some
limited evidence that the verbal modeling, time delay, or some
combination introduced during Phase IV of PECS may play
a role in the acquisition of spontaneous speech for those children who go on to develop speech through the PECS program,
but few studies have addressed these questions, limiting the
evidence available. Further research to determine whether including verbal models and time delay strategies earlier in the
PECS program results in an earlier speech gains would have
important clinical implications.

Summary, Limitations, and Future Directions


This meta-analysis synthesized findings from both group
and single-subject experiments to evaluate the quality of the
research evidence and the effectiveness of the PECS approach
on speech and communicative abilities for children with autism. With one group design of strong quality and seven singlesubject experiments of at least adequate quality documenting
gains in communication following PECS training, the body
of evidence for the PECS approach demonstrates that PECS is
a promising, although not yet established, evidence-based
practice for promoting communication in children with autism. In contrast, the evidence for gains in speech achieved
through PECS is not as strong. Fewer studies have examined
speech outcomes (one group study of strong quality and four
single-subject studies of at least adequate quality), and ESs
have varied widely across studies. Given the nine controlled,
empirical studies of at least adequate quality that were identified in this meta-analysis, PECS is relatively well-researched
as compared with other popular communication interventions for children with autism. Considering that there are only
nine such studies, however, our results on the effectiveness of
the PECS approach should be viewed with caution.
Overall, the data do provide evidence that PECS has small
to moderate effects in improving communication skills for
children with autism. In addition, PECS may improve speech
ability for some children with autism relative to speech prior
to intervention or gains made as a function of other intervention approaches, but further research is needed related to speech
development as an outcome of PECS intervention. The finding of a negligible aggregated ES for speech outcomes across
the single-subject experiments and small to negative ESs for
group studies is an important outcome of this meta-analysis
and demonstrates the value of using synthesized results to
Flippin et al.: Effectiveness of PECS

189

uncover trends in the composite data that are not readily apparent by visual inspection and narrative review. These results
also provide information on some preintervention child characteristics and program characteristics that may be influencing speech and communicative outcomes for children with
autism undergoing PECS training, but studies addressing
these questions are currently few in number.
Despite the overall adequate quality of evidence for the
effectiveness of the PECS approach and the potentially clinically useful identification of child and intervention characteristics for examining which children are most likely to have
favorable speech and/or communication outcomes through
PECS, several concerns and questions remain. One important concern is the lack of measurement and reporting of
treatment fidelity for two of the three group studies of PECS
and four of the eight single-subject experiments. Without
clear documentation of how PECS was implemented, including descriptions of personnel training and measurement of
adherence to the manualized PECS protocol, the functional
relationship between the intervention and communication
and speech outcomes at both posttest and during generalization is unclear. In addition, there is insufficient evidence to
determine whether PECS results in generalization and longterm maintenance of communication and speech gains for
children with ASD. Two group studies raised concerns regarding the maintenance of communication and speech gains
made through PECS, and only a few single-subject studies
reported maintenance or generalization measures. Clinically,
this is a concern, as it is important for interventionists to know
whether gains made in PECS can be maintained without continued support, across varying contexts. Furthermore, given
that there is only one published group design comparing
PECS with a specific alternative treatment, it is still unknown
whether the PECS approach results in better communication
and speech outcomes than other available autism interventions. Thus, several concerns and questions remain about the
overall effectiveness of PECS for communication and speech
outcomes for children with ASD.
Questions also remain regarding the influence of moderators on the effectiveness of PECS and the identification of
pretreatment characteristics of children who are more likely to
respond to PECS. Given the small number of studies providing
the relevant pretreatment data on participants, the evidence
is inconclusive regarding which of the currently identified
factors (i.e., joint attention, motor and verbal imitation, and
object exploration) contribute the most to the relative effectiveness of PECS on speech and communication outcomes.
In addition, the three preintervention characteristics described
in this synthesis likely do not exhaust the possible initial characteristics of children with ASD influencing response to PECS.
Finally, Phase IV of PECS and two strategies introduced
in that phase (i.e., verbal modeling and time delay) were
discussed as possible influences on speech acquisition for
those children who went on to develop speech through PECS
training. It is still unclear, however, as to whether the documented increases in spontaneous speech in Phase IV are
related to the introduction of verbal modeling, time delay, or
some combination, or whether those children who are able to
achieve success in Phases IIII are simply more likely to go
on to develop speech. Also unclear is whether introducing

verbal modeling and time delay components earlier in the


program than Phase IV would result in earlier gains in spontaneous speech or whether it is necessary to master Phases IIII
as a foundation to developing speech in those children who
do go on to develop speech.
In summary, the overall effectiveness of the PECS approach
for communication outcomes with children with ASD is promising although not yet established. Evidence for the effectiveness of the approach on speech outcomes is not as strong.
PECS may be more beneficial for promoting speech in children with a specific developmental profile (i.e., low joint
attention, low motor imitation, and high object exploration)
than some alternative approaches, at least as a short-term
effect. Further empirical research is now needed to directly
examine the generalizablity of speech and communication
gains following PECS and to examine and identify child
characteristics that may account for the variance in outcomes.
Based on this meta-analysis, we recommend that researchers
include measures of treatment fidelity, maintenance, and generalization in future studies of PECS. We also support the
need for additional studies examining the effectiveness of
PECS on speech and communication outcomes for children
with ASD as compared to other interventions. In addition, the
evidence base for PECS will be enhanced if researchers examine the potential influence of moderators and preintervention characteristics described in this synthesis (i.e., joint
attention, object exploration, and motor and verbal imitation)
and other relevant pretreatment variables. Implementing these
recommendations will strengthen the evidence base of this
approach and aid clinicians in making informed treatment decisions for individual children with ASD.

Acknowledgment
The authors thank Necdet Karasu for his advice on calculating
effect sizes in single-subject research.

References
References marked with an asterisk indicate studies included in
the meta-analysis.
Adkins, T., & Axelrod, S. (2002). Topography versus selectionbased responding: Comparison of mand acquisition in each
modality. The Behavior Analyst Today, 2, 259266.
*Angermeier, K., Schlosser, R. W., Luiselli, J. K., Harrington, C.,
& Carter, B. (2008). Effects of iconicity on requesting with
the Picture Exchange Communication System in children with
autism spectrum disorder. Research in Autism Spectrum Disorders, 2, 430446.
*Beck, A. R., Stoner, J. B., Bock, S. J., & Parton, T. (2008).
Comparison of PECS and the use of VOCA: A replication. Education and Training in Developmental Disabilities, 43, 198216.
Beeson, P. L. M., & Robey, R. R. (2006). Evaluating singlesubject treatment research: Lessons learned from the aphasia
literature. Neuropsychology Review, 16, 161169.
Bellini, S., & Akullian, J. (2007). A meta-analysis of video modeling and video self-modeling interventions for children and
adolescents with autism spectrum disorders. Exceptional Children, 73, 264287.
Bellini, S., Peters, J. K., Benner, L., & Hopf, A. (2007). A metaanalysis of school-based social skills interventions for children
with autism spectrum disorders. Remedial & Special Education,
28, 153162.

190 American Journal of Speech-Language Pathology Vol. 19 178195 May 2010

Beretvas, S. N., & Chung, H. (2008). A review of meta-analyses


of single-subject experimental designs: Methodological issues
and practice. Evidence-Based Communication Assessment and
Intervention, 2, 129141.
Bock, S. J., Stoner, J. B., Beck, A. R., Hanley, L., & Prochnow, J.
(2005). Increasing functional communication in non-speaking
preschool children: Comparison of PECS and VOCA. Education and Training in Developmental Disabilities, 40, 264278.
Bondy, A. S., & Frost, L. A. (1994). The Picture Exchange Communication System. Focus on Autistic Behavior, 9, 119.
*Carr, D., & Felce, J. (2007a). Brief report: Increase in production
of spoken words in some children with autism after PECS training to Phase III. Journal of Autism and Developmental Disorders, 37, 780787.
*Carr, D., & Felce, J. (2007b). The effects of PECS teaching to
Phase III on the communicative interactions between children with
autism and their teachers. Journal of Autism and Developmental
Disorders, 37, 724737.
Chambers, M., & Rehfeldt, R. (2003). Assessing the acquisition
and generalization of two mand forms with adults with severe
developmental disabilities. Research in Developmental Disabilities, 24, 265280.
Charlop, M. H., Malmberg, D. B., & Berquist, K. L. (2008). An
application of the Picture Exchange Communication System
(PECS) with children with autism and a visually impaired therapist.
Journal of Developmental and Physical Disabilities, 20, 509525.
*Charlop-Christy, M. H., Carpenter, M., Le, L., LeBlanc, L. A.,
& Kellet, K. (2002). Using the Picture Exchange Communication
System (PECS) with children with autism: Assessment of PECS
acquisition, speech, social-communicative behavior, and problem
behavior. Journal of Applied Behavior Analysis, 35, 213231.
Charman, T., Baron-Cohen, S., Swettenham, J., Baird, G.,
Drew, A., & Cox, A. (2003). Predicting language outcome in
infants with autism and pervasive developmental disorders. The
International Journal of Language and Communication Disorders, 38, 265285.
Chinn, S. (2000). A simple method for converting an odds ratio to
effect size for use in meta-analysis. Statistics in Medicine, 19,
31273131.
Cohen, J. (1988). Statistical power analysis for the behavioral
sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
Crosbie, J. (1993). Interrupted time-series analysis with brief
single-subject data. Journal of Consulting & Clinical Psychology, 61, 966974.
Cummings, A. R., & Williams, W. (2000). Visual identity matching
and vocal imitation training with children with autism: A surprising
finding. Journal on Developmental Disabilities, 7, 109122.
Dooley, P., Wilczenski, F. L., & Torem, C. (2001). Using an activity schedule to smooth school transitions. Journal of Positive
Behavior Interventions, 3, 5761.
Fabiano, G. A., Pelham, W. E., Coles, E. K., Gnagy, E. M.,
Chronis-Tuscano, A., & OConnor, B. C. (2009). A metaanalysis of behavioral treatments for attention-deficit /
hyperactivity disorder. Clinical Psychology Review, 29, 129140.
Frea, W., Arnold, C., & Vittimberga, G. (2001). A demonstration of
the effects of augmentative communication on the extreme aggressive behavior of a child with autism within an integrated preschool
setting. Journal of Positive Behavior Intervention, 3, 194198.
Frost, L., & Bondy, A. (2002). PECS training manual. Newark,
DE: Pyramid Educational Consultants.
Ganz, J. B., Cook, K. E., Corbin-Newsome, J., Bourgeois, B., &
Flores, M. (2005). Variations on the use of a pictorial alternative
communication system with a child with autism and developmental delays. Teaching Exceptional Children Plus, 1(6).
Retrieved from http://escholarship.bc.edu /education /tecplus/
vol1/iss6/3.

Ganz, J. B., Sigafoos, J., Simpson, R. L., & Cook, K. E. (2008).


Generalization of a pictorial alternative communication system
across instructors and distance. AAC: Augmentative & Alternative Communication, 24, 8999.
*Ganz, J., & Simpson, R. (2004). Effects on communicative requesting and speech development of the picture exchange communication system in children with characteristics of autism.
Journal of Autism and Developmental Disorders, 34, 395409.
*Ganz, J., Simpson, R. L., & Corbin-Newsome, J. (2008). The
impact of the Picture Exchange Communication System on
requesting and speech development in preschoolers with autism
spectrum disorders and similar characteristics. Research in
Autism Spectrum Disorders, 2, 157169.
Gersten, R., Fuchs, L. S., Compton, D., Coyne, M., Greenwood,
C., & Innocenti, M. S. (2005). Quality indicators for group
experimental and quasi-experimental research in special education. Exceptional Children, 71, 149164.
Hedges, L. V., & Olkin, I. (1985). Statistical methods for metaanalysis. Orlando, FL: Academic Press.
Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., &
Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional
Children, 71, 165179.
*Howlin, P., Gordon, R. K., Pasco, G., Wade, A., & Charman, T.
(2007). The effectiveness of Picture Exchange Communication
System (PECS) training for teachers of children with autism:
A pragmatic, group randomised controlled trial. Journal of
Child Psychology and Psychiatry, 48, 473481.
Huitema, B. E. (2004). Analysis of interrupted time-series experiments using ITSE: A critique. Understanding Statistics, 3,
2746.
Kavale, K. A., Mathur, S. R., Forness, S. R., Quinn, M. M., &
Rutherford, R. B. (2000). Right reason in the integration of
group and single subject research in behavioral disorders.
Behavioral Disorders, 25, 142157.
Kern, L., Gallagher, P., Staosta, K., Hickman, W., & George,
M. (2006). Longitudinal outcomes of functional behavioral
assessment-based intervention. Journal of Positive Behavioral
Interventions, 8, 6778.
Kratochwill, T. R., Stoiber, K. C., & Gutkin, T. B. (2000). Empirically supported interventions in school psychology: The
role of negative results in outcome research. Psychology in the
Schools, 37, 399413.
*Kravits, T. R., Kamps, D. M., Kemmerer, K., & Potucek, J.
(2002). Brief report: Increasing communication skills for an
elementary-aged student with autism using the Picture Exchange
Communication System. Journal of Autism and Developmental
Disorders, 32, 225230.
Lancioni, G. E., OReilly, M. F., Cuvo, A. J., Singh, N. N.,
Sigafoos, J., & Didden, R. (2007). PECS and VOCAs to enable
students with developmental disabilities to make requests: An
overview of the literature. Research in Developmental Disabilities, 28, 468488.
Lord, C., Risi, S., & Pickles, A. (2004). Trajectory of language
development in autistic spectrum disorders. In M. L. Rice &
S. F. Warren (Eds.), Developmental language disorders: From
phenotypes to etiologies (pp. 138). Mahwah, NJ: Erlbaum.
Lord, C., Wagner, A., Rogers, S., Szatmari, P., Aman, M.,
Charman, T., . . . Yoder, P. (2005). Challenges in evaluating
psychosocial interventions for autistic spectrum disorders.
Journal of Autism and Developmental Disorders, 35, 695708.
Lund, S. K., & Troha, J. M. (2008). Teaching young people who
are blind and have autism to make requests using a variation
on the Picture Exchange Communication System with tactile
symbols: A preliminary investigation. Journal of Autism and
Developmental Disorders, 38, 719730.
Flippin et al.: Effectiveness of PECS

191

Magiati, I., & Howlin, P. (2003). A pilot evaluation study of the


Picture Exchange Communication System (PECS) for children
with autistic spectrum disorders. Autism: The International
Journal of Research & Practice, 7, 297320.
Malandraki, G. A., & Okalidou, A. (2007). The application of
PECS in a deaf child with autism: A case study. Focus on Autism
and Other Developmental Disabilities, 22, 2332.
Marckel, J. M., Neef, N. A., & Ferreri, S. J. (2006). A preliminary
analysis of teaching improvisation with the Picture Exchange
Communication System to children with autism. Journal of
Applied Behavior Analysis, 39, 109115.
Maughan, D. R., Christiansen, E., Jenson, W. R., Olympia, D.,
& Clark, E. (2005). Behavioral parent training as a treatment
for externalizing behaviors and disruptive behavior disorders:
A meta-analysis. School Psychology Review, 34, 267286.
Odom, S. L., Brown, W. H., Frey, T., Karasu, N., Smith-Canter,
L. L., & Strain, P. S. (2003). Evidence-based practices for young
children with autism: Contributions for single-subject design research. Focus on Autism and Other Developmental Disabilities,
18, 166175.
Pettiti, D. B. (2000). Meta-analysis, decision analysis, and costeffectiveness analysis: Methods for quantitative synthesis in
medicine. New York, NY: Oxford University Press.
Preston, D., & Carter, M. (2009). A review of the efficacy of the
Picture Exchange Communication System intervention. Journal
of Autism and Developmental Disorders, 39, 14711486.
Rehfeldt, R., & Root, S. (2005). Establishing derived requesting
skills in adults with severe developmental disabilities. Journal of
Applied Behavior Analysis, 38, 101105.
Rosales, R., & Rehfeldt, R. A. (2007). Contriving transitive conditioned establishing operations to establish derived manding skills
in adults with severe developmental disabilities. Journal of
Applied Behavior Analysis, 38, 101105.
Rosnow, R., & Rosenthal, R. (2008). Assessing the effect size of
outcome research. In A. M. Nezu & C. M. Nezu (Eds.), Evidencebased outcome research: A practical guide to conducting randomized controlled trials for psychosocial interventions
(pp. 379401). New York, NY: Oxford University Press.
Schlosser, R. W., & Sigafoos, J. (2008). Meta-analysis of singlesubject experimental designs: Why now? Evidence-Based Communication Assessment & Intervention, 2, 117119.
Schlosser, R. W., & Wendt, O. (2008). Effects of augmentative
and alternative communication intervention on speech production in children with autism: A systematic review. American
Journal of Speech-Language Pathology, 17, 212230.
Schneider, N., Goldstein, H., & Parker, R. (2008). Social skills
interventions for children with autism: A meta-analytic application of percentage of all non-overlapping data (PAND).
Evidence-Based Communication Assessment and Intervention,
2, 152162.
*Schwartz, I. S., Garfinkle, A. N., & Bauer, J. (1998). The Picture Exchange Communication System: Communicative outcomes for young children with disabilities. Topics in Early
Childhood Special Education, 18, 144159.
Scruggs, T. E., Mastropieri, M. A., & Castro, G. (1987). The
quantitative synthesis of single subject research: Methodology
and validation. Remedial & Special Education, 8, 2433.
Scruggs, T. E., Mastropieri, M. A., Cook, S. B., & Escobar, C.
(1986). Early intervention for children with conduct disorders:
A quantitative synthesis of single-subject research. Behavioral
Disorders, 11, 260271.
Stoner, J. B., Beck, A. R., Bock, S. J., Hickey, K., Kosuwan, K.,
& Thompson, J. R. (2006). The effectiveness of the Picture
Exchange Communication System with nonspeaking adults.
Remedial & Special Education, 27, 154165.

Suk-Hyang, L., Simpson, R. L., & Shogren, K. A. (2007). Effects


and implications of self-management for students with autism:
A meta-analysis. Focus on Autism and Other Developmental
Disabilities, 22, 213.
Sulzer-Azaroff, B., Hoffman, A., Horton, C., Bondy, A., &
Frost, L. (2009). The Picture Exchange System (PECS): What
do the data say? Focus on Autism and Other Developmental
Disabilities, 24, 89103.
Swanson, H. L., & Sachse-Lee, C. (2000). A meta-analysis of
single-subject-design intervention research for students with
LD. Journal of Learning Disabilities, 33, 114136.
Tien, K. C. (2008). Effectiveness of the Picture Exchange Communication System as a functional communication intervention for
individuals with autism spectrum disorders: A practice-based
research synthesis. Education and Training in Developmental
Disabilities, 43, 6776.
*Tincani, M. (2004). Comparing the Picture Exchange Communication System and sign language for children with autism.
Focus on Autism and Other Developmental Disabilities, 19,
152163.
*Tincani, M., Crozier, S., & Alazetta, L. (2006). The Picture Exchange Communication System: Effects on manding and speech
development for school-aged children with autism. Education
and Training in Developmental Disabilities, 41, 177184.
Tomasello, M. (1995). Joint attention as social cognition. In
C. Moore & P. J. Dunham (Eds.), Joint attention and its origins
and role in development (pp. 103130). Hillsdale, NJ: Erlbaum.
Toth, K., Munson, J., Meltzoff, A. N., & Dawson, G. (2006).
Early predictors of communication development in young children with autism spectrum disorder: Joint attention, imitation,
and toy play. Journal of Autism and Developmental Disorders,
36, 9931005.
Volkmar, F. R., Lord, C., Bailey, A., Schultz, R. T., & Klin, A.
(2004). Autism and pervasive developmental disorders.
Journal of Child Psychology and Psychiatry, 45, 135170.
Webb, T. (2000). The talking goes onthe Picture Exchange
Communication System. Special Children, 130, 3034.
Wolf, M. (1978). Social validity: The case for subjective measurement or how applied behavior analysis is finding its heart.
Journal of Applied Behavioral Analysis, 11, 203214.
*Yoder, P., & Stone, W. L. (2006a). A randomized comparison of the
effect of two prelinguistic communication interventions on the
acquisition of spoken communication in preschoolers, with ASD.
Journal of Speech, Language, and Hearing Research, 49, 698711.
*Yoder, P., & Stone, W. L. (2006b). Randomized comparison
of two communication interventions for preschoolers with autism
spectrum disorders. Journal of Consulting and Clinical Psychology, 74, 426435.
Yokoyama, K., Naoi, N., & Yamamoto, J. (2006). Teaching verbal
behavior using the Picture Exchange Communication System
(PECS) with children with autism spectrum disorder. Japanese
Journal of Special Education, 43, 485503.
Ziomek, M. M., & Rehfeldt, R. A. (2008). Investigating the acquisition, generalization, and emergence of untrained verbal
operants for mands acquired using the Picture Exchange Communication System in adults with severe developmental disabilities. Analysis of Verbal Behavior, 24, 1530.
Received March 19, 2009
Revision received June 30, 2009
Accepted January 25, 2010
DOI: 10.1044/1058-0360(2010/09-0022)
Contact author: Michelle Flippin, UNCChapel Hill Division
of Speech & Hearing Sciences, Bondurant Hall, CB 7190,
Chapel Hill, NC 27599. E-mail: mflippin@unc.edu.

192 American Journal of Speech-Language Pathology Vol. 19 178195 May 2010

Appendix A (p. 1 of 2)
Quality Indicators for Single-Subject Research

Flippin et al.: Effectiveness of PECS

193

Appendix A (p. 2 of 2)
Quality Indicators for Single-Subject Research

194 American Journal of Speech-Language Pathology Vol. 19 178195 May 2010

Appendix B
Quality Indicators for Group Research

Flippin et al.: Effectiveness of PECS

195

Copyright of American Journal of Speech-Language Pathology is the property of American Speech-LanguageHearing Association and its content may not be copied or emailed to multiple sites or posted to a listserv
without the copyright holder's express written permission. However, users may print, download, or email
articles for individual use.

S-ar putea să vă placă și