Sunteți pe pagina 1din 26

Journal of Child Psychology and Psychiatry 45:1 (2004), pp 109–134

Assessment of young children’s social-emotional


development and psychopathology: recent advances
and recommendations for practice
Alice S. Carter,1 Margaret J. Briggs-Gowan2 and Naomi Ornstein Davis1
1
University of Massachusetts Boston, USA; 2Yale University, USA

In the past 10 years tremendous progress has been 1994, in press), as well as work that is focused on
made in the conceptualization and measurement of examining the prevalence and patterns of problems
young children’s social-emotional problems and and competencies in very young children that are
competencies and psychopathology. It is now clear assessed dimensionally across the continuum of typ-
that a significant number of very young children ical and pathological functioning (e.g., Achenbach &
exhibit psychopathological conditions and that the Rescorla, 2001; Briggs-Gowan, Carter, Skuban, &
problems that emerge in this developmental period Horwitz, 2001; Carter, Briggs-Gowan, Jones, & Lit-
often persist. Simply stated, early emerging psycho- tle, 2003; Mathiesen & Sanson, 2000). Moreover, a
pathology warrants identification and intervention. number of new questionnaire and interview assess-
New measures that assess social-emotional prob- ment tools have been developed that focus specifi-
lems and competencies and psychopathology are cally on assessing social-emotional functioning in
available to screen in pediatric practices and child- infants, toddlers, and preschoolers (cf., Del Carmen
care settings, as well as for use in more compre- & Carter, in press). Along with advances in con-
hensive evaluations that can be conducted in clinical ceptual knowledge and measurement approaches, a
and research settings. In this paper, factors that deeper understanding and appreciation of some in-
have contributed to the neglect of young children’s herent challenges facing clinicians and researchers
social-emotional and behavior problems and psy- who conduct social-emotional or mental health
chopathology, such as an emphasis on cognitive and evaluations of very young children has emerged.
linguistic development and concern regarding stig- Following a bio-ecological, transactional, develop-
matizing young children and their families, are re- mental framework (Bronfenbrenner, 1986; Lerner,
viewed briefly. Next, some of the inherent challenges 1991; Sameroff, 1995; Sameroff & Chandler, 1975),
of young child assessment are discussed, including we discuss the importance of integrating knowledge
the rapid developmental changes that characterize about the individual child’s social-emotional func-
the early childhood period, more limited opportun- tioning and psychopathological symptoms within the
ities that may present for evaluating behavior across contexts of the child’s cognitive and developmental
settings, and the importance of understanding functioning, family relationships, cultural values
young children’s behavior within relevant develop- and beliefs, and broader family and community risk
mental, relational and cultural contexts. Finally, factors. Within this framework, we present not only
some of the most promising measures developed those promising assessment tools that address very
over the past decade are reviewed to highlight young children’s social-emotional problems and
advances in a range of assessment methods, includ- competencies and psychopathology, but also review
ing parent-report questionnaires, diagnostic inter- commonly employed instruments that assess cognit-
views and observational assessments that are ive and developmental functioning, recognizing the
designed to elicit disorder-specific behavior. In con- importance of anchoring social-emotional problems
cluding, recommendations for enhancing identifica- within the context of the child’s developmental level.
tion and intervention services are offered. In addition, assessment instruments for character-
Over the past 10 to 15 years, dramatic progress izing the parent–child or caregiver–child relationship
has been made in the conceptualization and meas- are described to highlight several approaches for
urement of very young children’s social-emotional examining the caregiving context. Finally, we sum-
problems and competencies and psychopathology marize recent approaches to advance understanding
(cf., Del Carmen-Wiggins & Carter, 2001, in press; of cultural diversity and competence. A very import-
Zeanah, 2000; Zeanah, Boris, & Larrieu, 1997). This ant context that is beyond the scope of this paper is
work builds on research efforts that have begun to that of the evaluation setting, which may be a pedi-
address the manifestation of specific disorders atric clinic, day care center or Head Start program,
among very young children (e.g., Keenan & Waks- mental health clinic, private practice, or research
chlag, 2000, 2002; Luby, in press; Luby & Morgan, setting. For further discussion of these issues see
1997; Schereenga, in press; Schereenga & Zeanah, Huffman and Nichols (in press). In concluding our
 Association for Child Psychology and Psychiatry, 2004.
Published by Blackwell Publishing, 9600 Garsington Road, Oxford OX4 2DQ, UK and 350 Main Street, Malden, MA 02148, USA
110 Alice S. Carter, Margaret J. Briggs-Gowan, and Naomi Ornstein Davis

review of specific instruments, we offer recommen- problems, and empirical studies document that in-
dations to encourage applied early detection and fants and toddlers suffer from emotional problems
intervention efforts and continued research. including dysregulated mood states, such as pro-
found sadness, disruptive anger, and debilitating
fears (Carter, 2002; Radke-Yarrow, Nottelmann,
Resistance to acknowledging psychopathology
Martinez, Fox, & Belmont, 1992; Sameroff & Emde,
in young children
1989; Zeanah, 2000; Zeanah et al., 1997; Zero to
Although empirical evidence documents that infants, Three, 1994).
toddlers, and young preschoolers suffer from mental
health disturbances that impair their daily activities,
Prevalence and continuity in early emerging
there is still considerable resistance to the notion
problem behaviors and psychopathology
that infants and toddlers can exhibit serious and
persistent psychopathology that disrupts develop- Prevalence estimates of parent-reported social-emo-
mental adaptation (Emde, 1999, 2001). This neglect tional and behavioral problems in 2- and 3-year-old
of young children’s mental health has multiple children have ranged from approximately 7% to 24%,
determinants (McLearn, Knitzer, & Carter, in press). with the majority falling between 10% and 15%
First, relative to the mental and social-emotional (Briggs-Gowan et al., 2001; Cornely & Bromet, 1986;
health of young children, greater emphasis has been Earls, 1980; Koot & Verhulst, 1991; Larson, Pless, &
paid to the impact of cognitive and linguistic com- Miettinen, 1988; Lavigne et al., 1996; Newth & Cor-
petence on children’s later adaptive functioning. In bett, 1993; Richman, Stevenson, & Graham, 1975;
addition, the contributions of children’s early emo- Stallard, 1993; Thompson et al., 1996). With respect
tional experiences to their capacity to build rela- to the infant–toddler period, Jenkins and colleagues
tionships (e.g., family, peers, teachers) and as a (Jenkins, Bax, & Hart, 1980) documented that ap-
foundation for learning (Shonkoff & Phillips, 2000; proximately 10% of 1- and 2-year-olds receiving
Emde, Bingham, & Harmon, 1993) are only recently developmental screening had emotional/behavioral
being recognized. Additional barriers to focusing problems based on parent and pediatrician reports.
adequate attention on young children’s mental In addition, in a preschool-pediatric sample, Lavigne
health include general societal stigma associated and his colleagues (1996) reported a prevalence of
with child mental health (Jellinek, Patel, & Froehle, approximately 7% for clinician-determined psychi-
2003; US Public Health Service, 2000), parental fear atric diagnoses with impairment and 9% for parent–
of blame for the child’s difficulties (McLearn et al., in child problems. Recently, in a healthy birth cohort
press), and cultural differences in belief systems living in urban and suburban towns in the Northeast
regarding both children’s development and mental region of the United States, Briggs-Gowan and col-
health service utilization (cf., Jellinek et al., 2003). leagues (2001) reported a weighted prevalence of
A final issue that deserves mention is our societal approximately 12% for parent ratings of subclinical
nurturance of the myth that childhood, and especi- and clinical problems on the Child Behavior Check-
ally early childhood, is a ‘sacred,’ happy time. Thus, list 2/3 and 6% for clinical level ratings on the Par-
parents, day care providers, teachers, pediatricians, enting Stress Index Difficult Child domain.
and mental health care providers often avoid dis- Moreover, consistent with the suggestion that early
cussion of children’s mental health needs. Indeed, emerging behavior problems are associated with
when a parent shares concern about his or her child- and family-level impairments, parents who
child’s social-emotional or behavioral disturbance, reported elevated child problem behavior scores were
family members and health professionals often more likely to report delays in child social-emotional
minimize or dismiss the parent’s concerns. Parents competence, express worry about their child’s be-
commonly report that when they first shared their havior, and rate their child’s behaviors as interfering
worries, they were told that the problem was likely in family activities (Briggs-Gowan et al., 2001).
transient (i.e., ‘only a stage’) and/or that the parent There is also evidence that parents can describe their
was overly anxious. Even when children are suffer- young children’s social-emotional and behavioral
ing from autism and show marked impairment in problems and competencies in a differentiated
socialization and communication it is not uncom- manner, distinguishing between problems in
mon for there to be a long delay until referral to a aggression and overactivity as compared with prob-
specialist or receipt of a diagnosis (De Giacomo & lems related to anxiety, depression, and social
Fombonne, 1998; Siegel, Pliner, Eschler, & Elliot, withdrawal (Carter et al., 2003).
1988) and for parents to feel that their concerns were Recent empirical evidence counters the notion that
discounted. This is unfortunate, as failure to identify these early emerging problems are transient in nat-
and address early emerging social-emotional prob- ure. Indeed, there is a growing body of work that
lems likely leads to the exacerbation of problems confirms the persistent nature of infant–toddler so-
and may diminish parents’ sense of efficacy in the cial-emotional and behavioral problems. For exam-
parenting role. Clinical case review, studies of chil- ple, Mathiesen and Sanson (2000) reported that 37%
dren at high risk for social-emotional and behavior of 18-month-olds with extreme behavioral/emotional
Infant–toddler assessment 111

problems continued to have extreme difficulties at the presence of behaviors that emerge during the
30 months of age. Similarly, in their pediatric sam- typical course of normal development, but that are
ple, Lavigne and colleagues (1998) noted that over exhibited with heightened or reduced frequency,
half of 2- and 3-year-olds with a psychiatric disorder intensity and/or duration. Alternatively, some so-
continued to have disorder one and two years later. cial-emotional and behavior problems and psycho-
Other studies have similarly presented moderate pathology are characterized by developmental
longitudinal stability in parent reports of infant– deviance, or the presence of unusual behaviors that
toddler emotional/behavioral symptoms (Briggs- are not typical at any age or that are expressed in a
Gowan & Carter, 1998; Keenan, Shaw, Delliquadri, manner that is qualitatively distinct from that seen
Giovannelli, & Walsh, 1998; Rose, Rose, & Feldman, among typically developing children. It is relatively
1989). Thus, there is an increasing body of empirical easy to identify deviant behaviors because their
literature indicating that young children evidence presence at any point in development is cause for
significant social-emotional and behavior problems concern. In contrast, when problems are character-
and psychopathology and that these early emerging ized by degree of intensity, frequency, or duration of
problems are likely to persist over time. typically occurring behaviors, it can be much more
difficult to establish the boundary between typical
development and psychopathology.
Challenges to the assessment of young
Discriminating typical from atypical development is
children’s social-emotional development
facilitated by focusing on clusters of behaviors or a
and psychopathology
related set of relevant symptoms. Given the rapid
Defining and assessing social-emotional problems shifts in development in the earliest years of life, it is
and psychopathology that emerge in infancy, tod- important both to ensure that behaviors assessed are
dlerhood, and preschool is a challenging process (Del developmentally appropriate and to test whether
Carmen-Wiggins & Carter, 2001; Zeanah et al., clusters of behaviors demonstrate age invariance or
1997). Four factors that complicate the task of are similarly associated across the age span of inter-
developing age-appropriate assessment strategies est. Generally, the developers of dimensional assess-
are: (1) the rapid pace of developmental transitions ment tools attempt to identify coherent clusters of
and growth in early childhood; (2) a lack of guide- problem and/or competence behaviors that are be-
lines for integrating data that are gathered from dif- lieved to reflect a shared construct, rather than rely on
ferent sources and methods; (3) limited information single indicators of disturbance. Utilizing both nor-
for determining levels of impairment both within the mative data about the cluster of behaviors and data
child and within the family system; and (4) difficulty about children with known psychopathology, test
assessing child functioning within the relevant rela- developers also establish cut-points within dimen-
tional and cultural contexts. sional scales that can be used to assign caseness (e.g.,
clinical or at-risk status). Generally, dimensional
scales inquire about how often a behavior occurs or
Rapid developmental shifts and the
how representative a given behavior is of the target
normative context
child. In contrast, diagnostic decision making is
The rapidly shifting nature of very young children’s informed by the quality of behavioral presentation,
development poses problems for young child historical information about the onset, offset, fre-
assessment (cf., Zeanah et al., 1997). Specifically, quency, duration, and course of behavior and the
many behaviors that are considered ‘clinically relev- sensitivity of the behavior to contextual cues, as well
ant’ at older ages may be manifestations of normal as whether or not the behavior is causing distress or
development when they appear in early childhood. impairment to the child or family. Thus, although
For example, a normative increase in oppositional temper tantrums may be normative at specific ages,
behaviors and tantrums typically accompanies an the child whose tantrums occur across settings and
emerging sense of self and pursuit of autonomy in caregivers and who evidences extreme or qualitatively
the second year of life, the period commonly referred unusual behaviors during tantrums (e.g., tries to hurt
to as the ‘terrible twos.’ Indeed, an absence of temper others or destroys toys) may be suffering from a clin-
tantrums in toddlerhood may be cause for concern, ical disorder, even if the frequency of tantrums is
as tantrums are one way that very young children appropriate for the child’s age (Egger, 2003a).
assert their newfound sense of autonomy and indi- Ideally, given the developmental shifts that occur
viduality. Unless the frequency of these behaviors is in early childhood, measures designed to assess
unusually high or the intensity and quality of the young children’s development will rely on narrow age
behaviors are markedly distinct from the normative bands for comparison. This principle is evident
patterns, these behaviors typically do not reflect the in the normative tables of the Vineland Adaptive
emergence of psychopathology (Campbell, 1990). Behavior Scales (Sparrow, Balla, & Cicchetti, 1984).
As illustrated by the example of temper tantrums, In infancy and early toddlerhood, age-bands of
some social-emotional and behavioral problems and comparison begin at 1-month intervals. After age
psychopathological conditions are characterized by 2 years, age-bands increase to 2 months. By the
112 Alice S. Carter, Margaret J. Briggs-Gowan, and Naomi Ornstein Davis

time a child is 6 years of age the age band for com- data must by informed by knowledge of the strengths
parison is 3 months. The broadest age band em- and limitations of different approaches. Dimensional
ployed, for older children, is 4 months. The need for measures have the following advantages when nor-
narrow comparison groups is particularly salient for mative data are available: (1) allow comparisons of
social-emotional behaviors, such as competencies, an individual child’s behavior to a normative refer-
which change at a more dramatic rate through the ence group; (2) provide a means to quantify change
infancy, toddler, and preschool period, when com- in behavior over time and/or pre- and post-inter-
pared to problem behaviors (Carter et al., 2003). vention; (3) offer an efficient and inexpensive means
Given the dearth of epidemiological or national to gather information across multiple domains of
standardization data regarding very young children’s social-emotional functioning; and (4) permit profiling
expression of social-emotional/behavioral problems, of children’s relative strengths and weaknesses
determining the boundary between typical develop- across domains of social-emotional and behavior
ment and diagnosable psychopathology can present problem areas and competence (Carter, 2002; Eisert,
challenges, particularly when symptom presentation Sturner, & Mabe, 1991; Glascoe, 2000; Jellinek &
is not extreme. Indeed, it is quite likely that the ab- Murphy, 1988). Diagnostic interviews are valuable in
sence of sufficient normative data contributes to the providing systematic and comprehensive assess-
under-identification of psychopathology in young ments of symptom presence, duration, onset, and
children. Fortunately, with the development of new diagnostic status, but are less appropriate for scree-
assessment tools, researchers are now poised to ning (Jellinek & Murphy, 1988). Moreover, assigning
conduct large-scale epidemiological studies to gather a diagnosis may be necessary to receive appropriate
data on individual behaviors, symptom clusters, and mental health services (McLearn et al., in press).
disorders. Of note, all parent report measures may be subject
to a variety of reporting biases, including possible
distortions associated with parental affective symp-
Challenge of integrating data from multiple
toms (e.g., Briggs-Gowan, Carter, & Schwab-Stone,
sources and informants
1996; Fergusson, Horwood, & Lynskey, 1995; cf;
A major challenge that persists for clinicians and re- Richters, 1992), as well as negative distortion that is
searchers is determining appropriate methods for aimed toward receipt of services. Parents also may
integrating data across different methods and sour- under-report for fear of stigma or of involvement by
ces. Existing assessment tools vary with respect to outside agencies, for example when there is suspi-
who provides information about the child, the method cion of child abuse or neglect. Evaluations of young
of assessment employed (e.g., questionnaire, inter- children also can be complicated by the lack of
view or observation), and the timeframe that is multiple informants or contexts in which data about
covered (e.g., last two weeks, last year, lifetime). the child can be gathered. A significant number of
Questionnaires and interviews also vary in terms of young children live in single parent households or
the type of information that is gathered about indi- are cared for in-home by a single primary caregiver.
vidual symptoms or social-emotional behaviors. For Due to the potential biases inherent in parent rep-
example, problem behavior checklists (e.g., the CBCL orts (cf., Briggs-Gowan et al., 1996; Richters, 1992),
(Child Behavior Checklist; Achenbach & Rescorla, relying on a single informant is not ideal. Families
2000) and ITSEA (Infant-Toddler Social and Emo- construct meanings of young children’s behavior
tional Assessment; Carter et al., 2003)) often have based on the history of interactions between the
response formats that cross a rating of the frequency parents and child, the caregivers’ prior relational
of the behavior with a rating of whether the behavior is history and cultural values and beliefs (Clark, Tluc-
typical of the child. Although this is sufficient for zek, & Gallagher, in press). The interpretation or
identifying children at elevated risk for psychopa- meaning attributed to the child’s behavior influences
thology, it does not yield information that is sufficient the parents’ level of concern about and responses
for determining clinical diagnostic status. Rather, to the child. Thus, the same set of child behaviors
structured or semi-structured interviews that include may evoke widely disparate reactions from different
specific questions about the onset, offset, frequency, parents. This poses some problems in distinguishing
intensity, quality, and context of occurrence are children who have social-emotional/behavioral prob-
necessary to determine clinical caseness or to assign lems from those whose parents interpret typically
a diagnosis. It is also noteworthy that problem be- developing behaviors as evidence of a problem.
havior checklists often exclude behaviors that are To avoid over-reliance on parent report, evaluators
rare in the population or that have very low base rates can gather information from other caregivers (e.g.,
of occurrence because their inclusion compromises daycare providers) and include observational
psychometric sufficiency (i.e., reduces internal con- assessments of the child with the parent(s), as well
sistency) (Carter et al., 2003). as in interaction with non-parental figures. Obser-
Until methods are developed for integrating infor- vations are often believed to be less biased than
mation across assessment sources and methods, the parent reports. However, children may be reactive to
interpretation of multi-method, multi-informant a novel setting, compromising the ecological validity
Infant–toddler assessment 113

of the observation, and significant low-base rate be- recognized that level of impairment also may have
haviors may be unlikely to emerge in a novel setting. very important implications for studies of dimen-
For this reason, some observational approaches, sional aspects of social-emotional and behavioral
such as the ADOS (Autism Diagnostic Observation problems and competencies. For example, impair-
Schedule; Lord, Risi, & Lambrecht, 2000) and DB- ment may be a better predictor of long-term pro-
DOS (Disruptive Behavior Disorder Observational gnosis than symptom severity or type.
Schedule; Wakschlag & Danis, in press), include For infants and young children, determining
presses which are designed to elicit particular types impairment solely within the individual child may
of problem behaviors or the absence of age-appro- not be appropriate. Given that young children’s
priate competencies. development is embedded within their caregiving
When two informants are available to report on a relationships, it may be more appropriate to consider
young child’s behavior or when parent report and both child and family impairments that are secon-
behavior observations are compared, discrepancies dary to the child’s symptoms. It is possible to develop
are often found. These discrepancies between the a list of specific activities and settings in which lim-
parent’s report and a second informant’s report or itations due to the child’s psychopathology should be
observational data have been studied in an effort documented. Aspects of child functioning that
to describe response biases, which are typically should be addressed include the following: (1)
construed as contributing to measurement error adaptation to developmentally appropriate demands
1 (Briggs-Gowan et al., 1996; cf., Richters, 1992). and/or specific contexts (e.g., a child is expelled from
Conceiving of differences in reports solely as errors in several day care centers because his or her behavior
measurement may not be accurate, however, be- is too challenging and is seen as atypical within the
cause a parent’s negative appraisal of a child (i.e., the daycare context); (2) the acquisition of new develop-
parent’s internal working model of the child) likely mental capacities and skills (e.g., a child’s tactile
influences parenting practices and subsequently sensitivities or fears interfere with his or her explo-
child behavior (cf., Fonagy, Target, Steele, & Gerber, ration of toys and fine motor skills begin to lag); (3)
1995; Zeanah, Keener, Anders, & Thomas, 1986). relationship and interpersonal functioning (e.g., a
Therefore, whether or not the caregiver’s report of child’s impulsivity and attentional problems lead to
elevated social-emotional and behavior problems is difficulties with peers); or (4) health (e.g., a child’s
consistent with the child’s actual behavior, the child inability to regulate arousal during feeding leads to
whose parent holds a negative appraisal and negative significant weight loss or failure to thrive).
expectations of him or her is likely at elevated risk for Quite often, however, there may not be clear
future problems in social-emotional functioning markers of impaired functioning despite the pres-
(Carter, Garrity-Rokous, Little, & Briggs-Gowan, ence of either risk or disorder. This is more likely to
2001). Differences in parent and other caregiver occur with young children because caregivers play a
reports also may occur when a family is not from the more active role in regulating the child’s behavior
dominant culture. In this case, it is critical to eval- and emotions (Sameroff & Emde, 1989). To minimize
uate the cultural sensitivity of collateral informants the impact of psychopathology on children’s day-to-
(e.g., child care providers) reporting on children’s day functioning, caregivers can provide scaffolding
behaviors as well as their knowledge about the family to maximize the child’s developmental skills and
and cultural frame. Only by examining the cultural capacity to adapt within a given environment. For
awareness of collateral informants can the evaluator example, parents may actively avoid settings that
actively guard against over- or under-pathologizing a trigger problematic behavior, structure environ-
family due to cultural differences that are not ments to restrict exposure to overwhelming events,
understood by a collateral informant. set limits that minimize the escalation of the child’s
negative behaviors, and provide regulatory strategies
or supports that minimize the child’s expression of
Challenge of assessing impairment
distress. This kind of scaffolding may support com-
Another major challenge in the field of young child petence by aiding the child to develop self-regulatory
mental health assessment is that of determining and strategies but also may compromise competence by
quantifying impairment. This is particularly critical denying children age-appropriate experiences and
when assigning psychopathological diagnoses. For opportunities to acquire new skills (Briggs-Gowan
older children and adults, impairment is child-spe- et al., 2001).
cific and hence individual functioning is assessed Given the embedded nature of the young child’s
(Carter & Del Carmen, in press). The diagnostician emotions and behaviors within the child’s caregiving
must determine that the individual meets the rel- relationships, an alternative conceptualization of
evant symptom criteria for a particular disorder and the degree of impairment is to explore whether the
must document the individual’s inability to perform child’s psychopathology is impacting not only the
and adapt to expectable work, school, relational, child, but also the family system. Evidence of family
and/or self-care activities and demands. While impact would include parental distress or indicators
clearly central to the diagnostic process, it should be that the child’s behavior interferes with the parent’s
114 Alice S. Carter, Margaret J. Briggs-Gowan, and Naomi Ornstein Davis

ability to maintain family routines (e.g., eating consensus among researchers and clinicians who
together as a family in a restaurant), household assess early emerging social-emotional and behavi-
activities (e.g., making a phone call to family mem- oral problems that children must be evaluated
bers or friends), or employment (e.g., stopping or within their caregiving contexts (Clark et al., in
changing work settings because of difficulty obtain- press). However, in addition to considering specific
ing appropriate child care) (Carter & Del Carmen, in caregivers, it is also crucial to consider child-level
press). From a developmental-contextual perspec- influences, broader family factors, cultural contri-
tive, it is therefore important to evaluate the func- butions, and community factors. Both Urie Bron-
tioning of both the child and the family in fenbrenner’s (1986) bio-ecological model and
determining level of impairment. Sameroff and Chandler’s (1975) transactional
Given the difficulties in determining impairment in framework provide useful heuristic models for
young children, few instruments exist to assess the understanding these influences on children’s devel-
impact of psychopathology on children’s functioning. opment and their implications for the assessment
However, one measure that has been used to quan- process. The developmental contextual framework
tify impairment in very young children is the Vine- posited by each of these models argues for a multi-
land Adaptive Behavior Scales (Sparrow et al., level assessment strategy.
1984). For example, Luby, Heffelfinger, and
Mrakotsky (2003) employed the Vineland for this
The caregiving context
purpose in their effort to validate clinical depressive
disorders in preschool-aged children. Although de- Defining the caregiving context. There is general
signed to assess adaptive behavior skills, which re- consensus that understanding the caregiving con-
flect the child’s personal and social sufficiency, this text is crucial when examining young children’s
measure provides a quantitative assessment of the developmental trajectories (Sameroff & Emde, 1989).
child’s day-to-day functioning across the following As young children are highly dependent on external
4 domains: Communication, Daily Living Skills, regulatory supports and therefore are strongly in-
Socialization and Motor Skills. The Vineland has fluenced by caregiving contexts, it is not unusual for
excellent psychometric properties (Sparrow et al., problem behaviors to be specific to context and/or
1984). The Vineland Expanded Form is recommen- caregiver. In addition, problem behaviors may reflect
ded for use with very young children given that it has a mismatch between a child’s developmental level
more sufficient item density in this age range. and the situational demands and supports in the
The Social-Emotional Early Childhood Scales environment. Alternatively, a child who has signific-
(SEEC; Sparrow, Balla, & Cicchetti, 2001) present ant problem behaviors in many settings may appear
additional normative data for the Vineland Adaptive well-regulated with a particular caregiver due to the
Behavior Scales Socialization scale, Expanded Form, unique accommodations and affordances that a
for use with children under 7 years of age. Consis- particular caregiver can provide. Problem behaviors
tent with the expanded form, this instrument pro- that occur across relational contexts are generally
vides standard scores for the socialization domain. viewed as of greater concern and suggest that the
In addition, standard scores can be computed for child has internalized or learned a style of respond-
each of the subdomains of Interpersonal Relation- ing that has generalized beyond a particular care-
ships, Playtime and Leisure Time, and Coping Skills. giver or caregiving context.
Although the Vineland does an excellent job of cap- A first step in understanding the caregiving con-
turing the child’s current functioning, one limitation text is to identify the child’s primary caregivers, the
is that it does not determine whether lower than patterns of current caregiving relationships (e.g.,
age-expected performance is due to the child’s psy- how often the child transitions between caregivers),
chopathological condition(s). Lower scores on the and the history of the caregiving relationships (e.g.,
Vineland may have been evident prior to the onset of multiple transitions, abrupt losses). Parents are of-
psychopathology, may be associated with develop- ten unaware of the potential impact of caregiving
mental delay, and/or may arise because parents do transitions on very young children. For example, a
not expect age-adequate self skills and social suffi- child may demonstrate an increase in aggressive
ciency (e.g., the child achieves a low Daily Living behaviors or social withdrawal subsequent to a
Skills score because he or she is not expected to or staffing change in his or her day care setting. How-
asked to participate in household chores). ever, parents may not make a connection between
the child’s behavior and the loss of contact with a
favorite teacher until they are asked about this se-
The centrality of understanding early emerging
quence of events during an interview about caregiv-
psychopathology in context
ing contexts.
Winnicott’s statement that ‘A baby alone does not A second feature of the caregiving context that
exist’ was intended to convey that children cannot be should be explored is the parents’ definition of family
considered apart from the caregiver and the context and who they include in their family constellation.
in which they live (Winnicott, 1965). There is a strong The diversity of our current society includes a
Infant–toddler assessment 115

multitude of family constellations (cf., Carter & ment), the level of inference required for making
Murdock, 2001). Moreover, family constellations are ratings, and the number of behaviors or qualities
dynamic units of social organization that change that are coded. Some of the most widely used
across history, setting, culture, circumstance, and measures are described below.
stage of the life cycle. Thus, the task of identifying The Nursing Child Assessment Satellite Training
the members who should be counted within a given (NCAST) Teaching Scale (newborn to 36 months) and
family can be extremely complicated, with family Feeding Scales (newborn to 12 months) include
members employing different rules for inclusion and structured interactions that are coded for 149 dis-
exclusion. Family membership may be defined on tinct behaviors (Barnard, 1979). Behaviors are coded
the basis of biological relationships or perceptions of reliably in a presence/absence format observing an
psychological relationship and may include the nu- interaction live or coding from videotape with the
clear family, larger extended kinship networks, or opportunity to replay interactions.
the community (Carter & Murdock, 2001; Sue & The Clinical Problem-Solving Procedure, developed
Sue, 2003). Clarifying the parents’ definition of ‘the by Crowell and Feldman (1988), is based on the ‘tool-
family’ also is critical for identifying sources of sup- use task’ (Matas, Arend, & Sroufe, 1978). The ex-
port and stress within the family system. Moreover, aminer selects tasks that he/she believes the child is
the evaluator’s awareness and openness to diverse not capable of completing independently. The parent
definitions of ‘the family’ is essential for building a is then provided with a varied set of common toys
positive working alliance with the family. Although a and activities and instructed to play with her child.
thorough evaluation of the caregiving context would The activities assigned are increasingly difficult, and
include assessments that target multiple dimensions the last two are technically beyond the child’s
of family system functioning, a review of family developmental capacities. This coding scheme has
functioning measures is beyond the scope of this been used in clinical and research applications
paper. (Crowell & Fleischmann, 1993).
The Emotional Availability Scale (EAS) 3rd edition
The reciprocal nature of parent–child interac- (Biringen, Robinson, & Emde, 1998) involves global
tions. Both experimental and correlational studies ratings of parental sensitivity, structuring, intru-
demonstrate the inter-relatedness of child behavior siveness, and hostility and child responsiveness and
and the parenting context. For example, Acker and involvement with the parent that are based on
O’Leary’s (1996) experimental manipulation of the watching a parent–child interaction. Dyadic emo-
behavior of mothers of typically developing toddlers tional availability emphasizes both caregiver and
reveals how variations in parenting strategies can child emotional openness and communication within
amplify negative behaviors, such as negative affect dyadic interactions. Emotional availability is a
and demanding maternal attention. This study dimensional construct that captures the quality of the
demonstrated increases in child negativity and mother–infant interaction by focusing on both
demanding behavior when mothers responded maternal and infant characteristics in a relational
inconsistently to child negative behavior, alternating context. Maternal sensitivity, structuring, non-
between positive feedback and reprimands. Consis- intrusiveness and lack of hostility facilitate the in-
tent with this finding, Shaw and his colleagues fant’s ability to regulate emotion and behavior, and to
reported that boys whose mothers were both reject- respond to the mother and others in a responsive and
ing and ‘responsive’ evidenced higher externalizing involving manner (Biringen, 2000; Biringen &
scores than boys whose mothers were rejecting and Robinson, 1991; Robinson, Emde, & Korfmacher,
unresponsive (Shaw et al., 1998). The transactional 1997).
or reciprocal nature of patterns in parent–child The Parent–Child Early Relational Assessment
relationships extends over time and also must be (PCERA) focuses on the parent and child’s experience
acknowledged in considering child social-emotional of the relationship, the affective and behavioral
behaviors in context (Sameroff, 2000). It is quite characteristics that each brings to the interaction,
likely that ‘goodness of fit’ plays an important role, and the quality or tone of the relationship (Clark,
with child characteristics, such as infant tempera- 1985; Farran, Clark, & Ray, 1990). Twenty-nine
ment, combining with parental perceptions and parent-focused constructs, 30 child-focused con-
parenting styles to minimize or increase risk for later structs, and 8 dyadic constructs are rated during
psychopathology (Seifer, 2000). four 5-minute segments that include feeding, a
structured situation in which the mother shows the
Methods for assessing the parent–child relation- child how to accomplish a challenging task, free play,
ship. A number of procedures and coding schemes and a brief separation. The PCERA identifies areas of
have been developed to assess different aspects of strength and areas of concern in the parent, the child,
the parent–child relationship. Coding schemes vary and the dyad. Internal consistency of factors, inter-
with respect to the number of different types of rater reliability and predictive and discriminant va-
contexts that are assessed (e.g., feeding interaction, lidity are adequate (Clark, 1999; Clark, Hyde, Essex,
free play, teaching, laboratory or in-home environ- & Klein, 1997; Clark, Paulson, & Conlin, 1993).
116 Alice S. Carter, Margaret J. Briggs-Gowan, and Naomi Ornstein Davis

Organizational Change (http://www.apa.org/pi/


The contexts of race, ethnicity and culture
multiculturalguidelines).
When evaluating the caregiving context, it is im-
portant to distinguish between culture, race, and DSM-IV Outline for Cultural Formulation. Relevant
ethnicity. Culture is the term used to describe to work with young children, Christensen and col-
shared values, beliefs, and practices that are trans- leagues (in press) offer recommendations for adapt-
mitted across generations within a group (cf., Pin- ing the DSM-IV Outline for Cultural Formulation for
2 derhughes, 1989; Tomlinson-Clarke, 1999). From a young child assessment. These recommendations are
population genetics perspective, there are no dis- relevant for diagnostic evaluations, as well as in
crete boundaries between racial groups (Marshall, planning screening and more comprehensive
1998; Rosenberg et al., 2002). While there are small dimensional assessments of young children’s social-
differences between populations, most of the vari- emotional development and problem behaviors. For
ability across all humans comes from within popu- example, when the individual being assessed is an
lation differences (Marshall, 1998; Rosenberg et al., infant or toddler, Christensen et al. (in press) place
2002). Consistent with this, Suyemoto and Dimas the focus on the parents’ cultural reference group
(2003) argue that ‘race is a socially constructed (e.g., ethnic or cultural reference group, identification
concept of categorization and distinction within so- with culture of origin and dominant culture, language
cial relationships based on physical characteristics.’ ability, use, and preference) and highlight the ‘par-
Ethnicity is used to denote a particular kind of cul- ents’ intentions for raising the child with respect to
ture, which is usually associated with a common the culture of origin and the dominant culture.’
geographic region, or national origin (Atkinson, Concerns raised with respect to cultural identity may
Morton, & Sue, 1998; Pinderhughes, 1989; Sue & include issues of multi-cultural identification and the
Sue, 2003). Increasingly, families are multi-ethnic, possible inter-generational pressures and conflicts
cultural, and racial. The number of multi-ethnic that can arise when families are multi-cultural.
children has steadily increased in the United States The DSM-IV Cultural Formulation also considers
over the past 30 years (US Bureau of the Census, whether cultural explanations of the individual’s ill-
2000). When evaluating a multi-ethnic child, it is ness differ from the dominant culture. For infants
important to recognize that the parents of multi- and toddlers, behaviors considered problematic
ethnic children are often criticized by others for within the dominant culture may not generate con-
engaging in cross-cultural relationships and face a cern within the family. Christensen et al. (in press)
distinct set of parenting challenges (Gibbs, 1987; recommend talking with families about the following:
Root, 1990; Rosenblatt, 1999). (1) perceptions of the child’s difficulties or distress;
Scholars who study cultural influences on devel- (2) how the child’s behavior is viewed relative to other
opment advocate that cultural beliefs, values, and child behavior in their cultural group; (3) cultural
practices should be a central focus of assessments explanations for the child’s difficulties or distress;
of young children (Betancourt & Lopez, 1993; and (4) parental experiences with and preferences for
Christensen, Emde, & Fleming, in press; Garcia- treatment.
Coll & Magnuson, 2000). Moreover, it is critical to Another area outlined by the DSM-IV Cultural
recognize that culture is not a static entity, but is Formulation addresses cultural elements of the
dynamic and responsive to the settings and condi- relationship between the individual (or parents/
tions to which the family must adapt (Christensen caregivers) and the clinician. Also relevant to the
et al., in press). Thus, the day-to-day routines and assessment context, cultural differences between the
household practices through which culture is evaluator and the child’s parents may interfere with
maintained within the family and transmitted to the gathering reliable and valid data about child and
child are influenced by factors such as immigration, family functioning. Communication barriers that
economic conditions, and exposure to other cultural stem from differences in language or contextual
groups. In advocating that researchers and clini- understanding of behaviors and emotions must be
cians attend to the influence of culture, race, and examined and efforts made to minimize miscom-
ethnicity, we recognize that this often involves munication.
acquiring training in culturally competent practices. Of interest, neither the DSM-IV Cultural Formu-
In addition to openness to diversity and awareness lation nor the Christensen and colleagues adapta-
of varying cultural practices, researchers and cli- tion address distinctions between culture and race.
nicians must engage in a process of self-awareness Yet, families of color face unique challenges associ-
to avoid biases that could lead to over- or under- ated with societal racism and stereotyping. Thus, the
pathologizing the child or family practices. Cultural caregiving context may be influenced by race, inde-
proficiency is central to gathering reliable and valid pendent of the contribution of culture and ethnicity
information. For an extensive discussion of cultural (Suyemoto, personal communication, June 10,
competence see the American Psychological 2003). For this reason, to fully understand the
Association (2002) Guidelines on Multicultural caregiving context it may at times be necessary to
Education, Training, Research, Practice and assess parents’ perceptions of racism.
Infant–toddler assessment 117

Cultural issues in measurement/assessment education level. Nonetheless, this interesting finding


tools. Although the DSM-IV Cultural Formulation underscores the importance of taking race/ethnicity
emphasizes barriers to developing a clinical rela- into consideration.
tionship that facilitates diagnosis and treatment,
these issues also must be considered with respect to
The context of risk – cumulative risk factors
assessment tools. It is not sufficient to employ a
measure that has been translated into the target In addition to examining the child’s developmental
population or client’s native language, because the and caregiving context, broader contextual features
translation may not be appropriate for the popula- that may support or impede the child’s adaptive
tion under study or the family seeking treatment. For development (e.g., poverty, exposure to community
example, in our experience in developing the Span- violence, recent traumatic events, low parental edu-
ish translation of the ITSEA, a sample item, ‘uses a cation, limited social support) should be examined.
pacifier,’ was initially translated by a Spanish spea- It is now clear that an accumulation of environ-
ker of Puerto Rican descent. When researchers on mental risk factors within and beyond the family
the West Coast prepared to employ the measure with system has a deleterious impact on young children’s
a predominantly Mexican American population, this development (cf., Sameroff, Seifer, & McDonough, in
item was deemed to have a sexualized meaning that press). Beginning with Rutter’s pioneering research
was clearly inappropriate for this population. on the Isle of Wight (Rutter, Tizard, Yule, Graham, &
Although translation and back-translation has Whitmore, 1976; Rutter, 1989), a large number of
traditionally been held as a standard, it may not be a studies have described both the unique and cumu-
sufficient practice (cf., van de Vijver & Leung, 1997). lative impact of ecological risks, often including
Instead, using focus groups and/or pilot testing with family poverty as one of a number of such risks, on
the target population is highly recommended to children’s development (e.g., Sameroff, Bartko, &
avoid miscommunication. In addition, because it is Baldwin, 1998; Sameroff & Chandler, 1975). Gen-
rare to obtain appropriate within ethnic group re- erally, this research has employed cumulative risk
liability and validity data, investigators who are models, indicating that as the number of risk factors
working with minority populations are encouraged to increases, child outcomes worsen (Hooper, Burch-
report internal consistency statistics when present- inal, Roberts, Zeisel, & Neebe, 1998; Liaw & Brooks-
ing findings. It is not appropriate to assume that the Gunn, 1994; Sameroff, Seifer, Baldwin, & Baldwin,
internal consistency or factor structure obtained in a 1993; Shaw & Emery, 1988). Risk factors can be
dominant culture population will be comparable aggregated across the child, family, and community
when a scale is employed with ethnic/racial minority levels of the Bronfenbrenner (1986) bio-ecological
groups. In clinical settings, individual problem and model. In contrast to assessments of developmental
competence items that parents endorse should be level and parent–child relationships, which reflect
reviewed in order to understand the threshold that dynamic developmental processes, cumulative risk
parents are using to determine whether or not a indices include both static characteristics of family
behavior is ‘Somewhat True’ or ‘Often True.’ In members (e.g., minority status) and factors that may
addition, the affective valence that is attributed be amenable to intervention (e.g., elevated depres-
to the behavior and the cultural meaning of the sive symptoms, limited social support).
behavior, if any, must be part of the initial dialogue
with the family. Depending on the outcome of such
Developmental context
discussions, the clinician must be prepared to
determine and report whether a particular measure Children’s social-emotional development and psy-
is culturally invalid. chopathology should be evaluated within the context
A study by McCain, Kelley, and Fishbein (1999) of cognitive and linguistic development, as well as
highlights the importance of attending to possible with attention to any physical or health conditions
response differences across ethnic/racial groups. that may be present (Sparrow, Carter, Racusin, &
They explored response patterns by Black/African Morris, 1995). Anna Freud (1966) wrote eloquently
Americans and Whites on the Toddler Behavior about the need to evaluate multiple lines of devel-
Symptom Inventory, a parent-report measure of opment and to attempt to understand the manner in
problem behaviors. Of interest, although there were which development along one line may set con-
no differences in the reported frequencies of problem straints on growth in other developmental domains.
behaviors, Black/African American parents were As highlighted by Cicchetti and Sroufe’s (1976) work
more likely to be concerned about their children’s on the development of young children’s humor,
problem behaviors than White parents. Unfortu- expectations for social-emotional development must
nately, given the lack of multivariate examination of be based within the context of the child’s overall
this finding, it is not possible to attribute this finding cognitive development or mental age. Although all
to ethnicity/race. It is equally plausible that the developmental domains (e.g., cognition, language,
observed difference between Black/African Amer- gross and fine motor functions, sensory capacities)
ican and White parents was a function of class or deserve attention, language delay is the most typical
118 Alice S. Carter, Margaret J. Briggs-Gowan, and Naomi Ornstein Davis

reason for parents to raise concern about their chil- inexpensive screener can then be referred for a sec-
dren’s development (Horwitz, Gary, Briggs-Gowan, & ond, more comprehensive screening. Moreover, first
Carter, in press). Young children with language delay stage screening need not be a single snapshot or
are at very high risk for social-emotional and beha- static assessment. Indeed, an ideal screening strat-
vior problems (Beitchman, Wilson, Brownlie, Wal- egy would be dynamic (Squires, Bricker, & Potter,
ters, & Lancee, 1996; Horwitz et al., 2003; Irwin, 1997), with children screened at multiple well-child
Carter & Briggs-Gowan, 2002; Rescorla, 2000) and visits over time. In this dynamic scenario, referrals
all young child mental health evaluations should, at for a second or third stage screening can occur after
a minimum, include screening for cognitive and an initial positive screen or after it is clear that the
language delay. When results of screening indicate problematic behaviors persist over time. The second
the possible presence of social-emotional/behavioral stage of screening might involve a longer parent-
problems and/or cognitive/language delays it is report instrument accompanied by questions regar-
important to conduct more comprehensive stan- ding (1) the parent’s degree of concern about the
dardized assessments of developmental level. child’s behaviors and (2) presence of any impairment
or interference in daily activities as a function of the
child’s social-emotional behaviors, temperament,
or special needs (Briggs-Gowan et al., 2001). The
Screening for early problems
meaning of the child’s behavior and cultural con-
In recent years, there has been growing recognition siderations are central foci of the comprehensive
of the importance of early detection of not only second-stage assessment. Depending on available
developmental delays, but also social-emotional resources, the third stage of screening would involve
and/or behavioral problems (American Academy of observations, collateral informants, and/or referral
Pediatrics, 2001; US Public Health Service, 2000). for more intensive diagnostic evaluation. Ideally, this
Indeed, the American Academy of Pediatrics (2001) third stage evaluation would be conducted at a site
recently recommended routine screening by pediat- that can also provide intervention services. Of note,
ricians to enhance efforts to identify early social- the decision to proceed to the second or third stage of
emotional problems. Of note, there is evidence that screening could be based on a number of parent
screening in pediatrics is both feasible (Baird et al., report indices, including parent’s indication of con-
2000; Jellinek et al., 1999) and effective in improv- cern, the profile of scores obtained from a longer
ing rates of referral for mental health services (Mur- second-stage parent report instrument, a high score
phy et al., 1996). Early detection efforts have been on a cumulative risk factor score, and/or the pres-
advanced by public policies that facilitate early ence of developmental or family disruption.
intervention efforts, most notably Part C of The Screeners used for widespread detection efforts
Individuals with Disabilities Education Act Amend- should have certain characteristics. For example,
ments of 1997 (IDEA; Public Law No. 105-17), which they should be brief, easy to administer, score and
mandates intervention services for children from interpret, and should demonstrate acceptable reli-
birth to age 3 years who have delays in cognitive, ability and validity (Eisert et al., 1991; Jellinek &
language, motor, and social development. Part C also Murphy, 1988). Ideally, screeners should be simple
provides discretionary services for young children enough that most parents can complete them in-
with emotional/behavioral problems that may place dependently (Glascoe, 2000), thus reducing expenses
them at risk for later developmental problems. De- associated with staff time (Carter, 2002). Further,
spite such policy advances, many early-emerging with advances in technology, parents may be able
social-emotional problems go undetected and, to complete screeners on hand-held computers to
therefore, unaddressed by service systems. High- facilitate ease of both administration and scoring
lighting the need for enhanced screening efforts, re- (Carter, 2002). Finally, it is crucial that screeners
cent research in a representative healthy birth provide information that is both developmentally
cohort of an urban and suburban sample revealed appropriate (Glascoe, 2000; Rescorla & Achenbach,
that only 8% of 1- and 2-year-olds with parent- 2002) and clinically useful (Carter, 2002).
reported social-emotional/behavioral problems were Another important feature of a screener, related to
receiving services (Horwitz et al., in press). its validity, is its ability to maintain a balance
We advocate the use of multi-gating, or multi-stage whereby a sufficient proportion of children with
screening procedures as a cost-effective means for problems are detected while maintaining an accep-
screening large groups of children (Loeber, 1990; table rate of false positives. In developing maximally
Lochman and the Conduct Problems Prevention Re- useful and cost-effective screening tools, there is
search Group, 1995). The first step in such a process inherent tension about where to set the scoring
involves utilizing a brief and relatively inexpensive threshold for identifying a child as a screen positive
screening assessment tool to identify children at (versus negative). If the threshold is too high, then
elevated risk. This first step can ideally occur in pe- too few true ‘cases’ (with ‘case’ defined, for example,
diatric offices at the time of well-child visits. Children on the basis of meeting criteria for a psychiatric
who are identified as at elevated risk based on an disorder or having significant functional impair-
Infant–toddler assessment 119

ment) will screen positive (i.e., the screen will have that the needs of young children with early-emerging
low sensitivity). Yet, the screener will likely have high difficulties are addressed.
‘specificity,’ meaning it will identify a low proportion
of ‘non-cases’ as screen positives. In contrast, if the
threshold is set too low, sensitivity will be high, but
Measurement of developmental issues
specificity will be low, potentially flooding the service
system with unnecessary costs for assessing false To aid in the selection of tools for assessing devel-
positives. Thus, it is important to achieve a balance opmental level and language functioning, several
between identifying a sufficient proportion of ‘cases’ commonly used tools that have adequate psycho-
to effectively improve early detection, while minim- metric properties are discussed in the following
izing false positives. To meet these competing con- section. Both brief screening tools, parent report
straints, Meisels (1989) has suggested that measures, and comprehensive, standardized
screening tools should have sensitivity and specific- assessments that are administered directly to the
ity of 80% or higher. child are reviewed (see Tables 1 and 2).
Moreover, consistent with longer dimensional
assessment instruments, screeners should have
Screening tools for assessing developmental issues
adequate psychometric properties with respect to
reliability and validity. In evaluating the level of Three screeners for measuring possible develop-
acceptability of reliability and validity statistics, mental problems are reviewed. As evident in the
several criteria, recommended by Cicchetti, are em- descriptions below, these measures vary signific-
ployed. Sensitivity and specificity statistics and lev- antly in terms of length (from 30 items to 100
els of agreement may be judged by the following items), method of administration (from parent report
criteria: 90% to 100% ¼ excellent; 80% to 90% ¼ to administered by a paraprofessional), domains
good; 70% to 79% ¼ fair; and less than 70% ¼ poor covered, and item density within a particular
(Cicchetti, Volkmar, Klin, & Showalter, 1995). In domain.
measuring internal consistency of scales, Cron- The Ages and Stages Questionnaires (ASQ): A
bach’s alpha may be evaluated as follows: .90 to Parent-Completed, Child Monitoring System (Bricker
1.0 ¼ excellent, .80 to .89 ¼ good, .70 to .79 ¼ fair, & Squires, 1999) is a widely used, first stage
and less than .70 ¼ poor (Cicchetti, 1994). For screening measure for children 4 to 60 months of
Kappa, Weighted Kappa, and Intraclass Correlation age, with different forms dependent on the age of the
Coefficients, 1.0 to .75 ¼ excellent, .60 to .74 ¼ child (Table 1). The 30 question ASQ addresses five
good, .40 to .59 ¼ fair, and less than .40 ¼ poor. domains of development (Communication, Gross
Pediatric settings are well suited to the task of Motor, Fine Motor, Problem Solving, and Personal-
detecting social-emotional and behavior problems Social). To aid parents in completing the screener,
(American Academy of Pediatrics, 2001; Regier, some questions have pictures depicting the child
Goldberg, & Taube, 1978). For example, given stan- demonstrating a particular skill. The ASQ can be
dard immunization schedules in early childhood, completed in 10 to 20 minutes. Two-week test–retest
pediatricians have frequent and routine contact with reliability of screening status is adequate, with 94%
many young children and their families. In addition, agreement. Validity relative to standardized assess-
families with children who have social-emotional/ ments of developmental level is acceptable (84%
behavioral problems tend to utilize pediatric services agreement overall, 72% sensitivity overall, specificity
more than other families (Zuckerman, Moore, & Glei, from 81% to 92%).
1996) and are therefore particularly likely to be in- The MacArthur Communicative Development
cluded in routine screening. Furthermore, one study Inventory Short Form (CDI) (Fenson et al., 1993;
indicated that parents who discussed their chil- Fenson et al., 2000a, b) is a parent-report vocabu-
dren’s social-emotional/behavioral problems with lary checklist that is designed as a screener for
their pediatrician were three times more likely to assessing productive vocabulary in 12- to 36-
obtain mental health services for their children than month-old children (Table 1). There are two ver-
those who did not discuss these issues with their sions, depending on the age of the child. The Infant
pediatrician (Briggs-Gowan, Horwitz, Schwab-Stone, form is intended for 8 to 18 months, whereas the
Leventhal, & Leaf, 2000). Further, including routine Toddler form spans from 16 to 30 months of age.
screening of social-emotional/behavior problems is Each form contains a list of vocabulary words. To
one way to inform parents that these behaviors are complete the Infant form, the informant indicates
an appropriate topic of conversation in the pediatric whether the child (1) understands each word or (2)
office. Given the vital role that the pediatrician can says each word. On the Toddler form, the inform-
play in children’s mental health and evidence that ant indicates simply whether the child says each
screening in pediatrics is both feasible (Baird et al., word. Scores are calculated as sums. The Mac-
2000; Jellinek et al., 1999) and effective in improv- Arthur CDI has demonstrated high internal consis-
ing referral rates (Murphy et al., 1996), routine tency and good test–retest reliability in measuring
screening may play an important role in ensuring productive vocabulary in toddlers. In addition,
120
Alice S. Carter, Margaret J. Briggs-Gowan, and Naomi Ornstein Davis
Table 1 Selected cognitive and language screening instruments

Ages and Stages Questionnaires MacArthur Communicative Brigance Screens – Infant


(ASQ) (Bricker & Squires, Development Inventories–Short Form and Toddler Screen (Brigance & Language Development
1989, 1999) (Fenson et al., 2000b) Glascoe, 2002) Survey (Rescorla, 1989)

Age range 4 months to 5 years (questionnaires 8–18 months (infant form) Birth–11 months (infant form) 18–35 months
for 2–6-month age groupings) 16–30 months (toddler form) 12–23 months (toddler form)
Respondent Parent or caregiver Parent or caregiver N/A (administered) Parent or caregiver
Number of items 30 items 89 words (infants) 85 items (infant form) 310 words
100 words (toddlers) 83 items (toddler form) Parent report of child’s
5 longest phrases/sentences
Administration time 10–20 minutes 10 minutes 10 minutes 10 minutes
Skills/Domains assessed Communication Language Fine Motor Expressive Language skills
Gross Motor and communication skills Gross-Motor
Fine Motor Receptive language
Problem Solving Expressive language
Personal-Social Self-help skills
Social-emotional skills
How items are scored Items are rated as to whether Infant form: check if child Skills are directly observed One point for each word that
the child demonstrates ‘understands word’ and elicited by assessor the child says. The child’s
the behavior: Yes, sometimes, or ‘says word’ and parent. mean length of phrases
or not yet Toddler form: check Points are given for skills is also calculated.
if child ‘says word’ that are demonstrated.
Scoring/Cut-points Cut-points indicate low risk Cut-points set at lowest 10th Yields a nonverbal score For children 24-months
and high risk (high risk suggests percentile based on standardization and a communication score or older, the cut-point
need for referral) sample by age and sex groupings is fewer than 50 words
or no word combinations
Language and cultural Available in Spanish, French, Available in Spanish Available in Spanish Available in Spanish/English
validity and Korean versions
Level of difficulty 4th to 6th grade reading level Reading level not reported, N/A 5th grade reading level
to complete with illustrations but simple in format
to assist in clarifying item content
Level of training Staff or paraprofessionals Professionals score Paraprofessionals conduct Nonprofessional staff may
to administer can score in 1 to 5 minutes observations administer
Infant–toddler assessment 121

Table 2 Selected cognitive and language assessments

Mullen Scales Bayley Scales of Infant Preschool Language Scale,


of Early Learning Development (BSID-II) 4th edition (PLS-4) (Zimmerman,
(MSEL) (Mullen, 1995) (Bayley, 1993) Steiner, & Pond, 2002)

Age range Birth to 68 months 1–42 months Birth to 71 months


Description Individually administered; Individually administered; Assesses expressive
Identifies strengths and Assists in diagnosing and receptive language;
weaknesses across domains; developmental delay; Caregiver Questionnaire
Assesses school readiness Useful for planning allows integration of results
interventions with report of child’s typical
communication at home
Administration time 15 min. (l year) 1 hour 20–45 minutes
25–35 min. (3 years)
40–60 min. (5 years)
Skills/Domains Gross Motor Mental scales Auditory Comprehension
assessed Visual Reception Motor scale Expressive Language
Fine Motor Behavior rating scale
Expressive Language
Receptive Language
Scoring 5 Scales: T-scores, percentile Standard scores: Standard scores, percentile
ranks, age equivalents Mental Development Index ranks, and language age
Early Learning Composite: Psychomotor Development Index equivalents for: Total Language;
standard scores, percentile Auditory Comprehension;
ranks Expressive Communication
Language and cultural The standardization was Renorming sample was stratified A Spanish version of the PLS-4
validity based on census data on age and sex and on region, normed on Spanish-speaking
in 1987–1989, and race/ethnicity, and parental children living in the USA.
controlled for race, education. Test items and art are
SES/parent occupation, considered appropriate
gender, community size, for children from different
age, geographic region. SES and cultural/regional
groups.
Level of training Graduate training and PhD-level training and relevant Master’s-level training and
to administer experience in infant training in assessment relevant training in assessment
assessment

statistical cut-points reflecting the lowest 10th session. This measure has demonstrated adequate
percentile on the MacArthur CDI (for a child’s age reliability and validity.
and sex) have been established in a national The Language Development Survey (LDS) (Rescorla,
standardization sample. As the standardization 1989) is a parent-report vocabulary checklist that
sample was predominantly white and most was developed as a simple, inexpensive screening tool
respondents had completed high school, results to identify language delay in toddlers. The measure is
should be interpreted cautiously if used with fam- designed for use with children ages 18–35 months,
ilies with limited education or from ethnic minority but the cut-points for determining language delay are
backgrounds. best validated for children 24-months and older. A
The Brigance Infant and Toddler Screen (Brigance parent or caregiver indicates which words their child
& Glascoe, 2002) is a recent downward extension of says on the 310-word checklist. If the child uses
the Brigance screens that have been in used with phrases or sentences, the parent is asked to offer 5
older children (Table 1). This screening tool is examples of the child’s longest or best phrase or
administered by a paraprofessional. There are sep- sentence. A total vocabulary score is calculated based
arate Infant and Toddler versions, with different on the number of words that the parent endorses.
items depending on child age. The infant screen, In addition, a mean phrase length score is calculated
designed for children from birth to 11 months, con- by dividing the total number of words in the valid
tains 85 items. The toddler screen, developed for 12- phrases by the number of valid phrases reported. The
to 23-month-olds, contains 83 items. Both versions measure takes 10 minutes to complete and does not
include items for assessing fine and gross motor require professional training for administration or
skills, receptive and expressive language skills, self- scoring. The LDS has excellent reliability of the
help skills, and social-emotional skills. The screen- vocabulary section and good reliability for the mean
ing is conducted by a paraprofessional who works length of phrases. In addition, the measure has
with both the child and the parent to determine demonstrated good sensitivity and specificity in
whether skills are present. The screening score is predicting children with expressive language delay
based on skills observed during the assessment (Rescorla & Achenbach, 2002).
122 Alice S. Carter, Margaret J. Briggs-Gowan, and Naomi Ornstein Davis

communication style in other settings. Standard


Standardized developmental assessments
scores, percentile rank, and age equivalents all
In this section, two commonly used standardized facilitate comparison of children’s performance to
assessments that address the full range of develop- their age matched peers. The authors report that the
ment and one standardized assessment of language test content is considered appropriate for children
level are reviewed. In-depth details about the psy- from different cultural, regional, and socioeconomic
chometrics of these tools are available in published groups. In addition, a Spanish version of the PLS-4
manuals. has been created and normed on almost 1,200
The Mullen Scales of Early Learning (MSEL; Mul- Spanish-speaking children living in the United
len, 1995) is an individually administered assess- States.
ment that can be used with children from birth
through 68 months of age. The Mullen identifies
children’s strengths and weaknesses in 5 domains of
Measurement of social-emotional and behavioral
functioning (expressive language, receptive lan-
problems, competencies, and psychopathology
guage, visual reception, fine motor, and gross mo-
tor). T-scores are generated along with percentile In this section, widely used and newly developed,
ranks and age equivalents to facilitate comparison of promising measures of social-emotional/behavioral
children’s developmental level to their age-matched problems, social-emotional competence, and psy-
peers. In addition, an Early Learning Composite chopathology are discussed. In general, social-
standard score is calculated based on the four cog- emotional development has received little attention
nitive scales. For older children, Mullen scores can in developmental assessments, as evidenced by the
be helpful in assessing school readiness. The Mullen fact that traditional developmental tests such as the
Scales were standardized on a nationally represen- Mullen and the Bayley do not assess this construct.
tative sample that includes more than 1,800 chil- Similarly, most past research/clinical work/
dren from 4 geographic regions in the United States. assessment tools have focused on assessments of
The normative sample contained equal numbers of problem behaviors. Nonetheless, it is also useful to
boys and girls and closely matched US population gather information about children’s social-emo-
estimates for race/ethnicity, community size, and tional and behavioral competencies. In infancy and
socioeconomic status. The Mullen has adequate toddlerhood, a wide array of self- and social com-
reliability and validity. petencies can be assessed through parent report
A second commonly used cognitive assessment and direct observations (Briggs-Gowan & Carter,
tool for infants and toddlers is the Bayley Scales of 1998; Carter et al., 2003; Houck, 1999; Sroufe,
Infant Development (BSID-II; Bayley, 1993). This 1990; Stipek, Recchia, & McClintic, 1992). Gather-
test can be used with children ages 1 to 42 months ing information about social-emotional and beha-
and is useful in assessing developmental delays vioral competencies can serve several purposes.
across a range of mental and motor functioning First, the presence of a delay in this domain is a
including cognitive, language, personal-social, fine risk factor for the emergence of behavior problems
motor, and gross motor skills. Two standard scores and psychopathology (e.g., Carter, 2002; Cicchetti
are computed: a Mental Development Index and a & Cohen, 1995; Denham & Holt, 1993). Compet-
PsychoMotor Development Index. A behavior rating ence in stage-salient tasks increases the likelihood
scale that assesses children’s behavior during the of later competence (Houck, 1999; Sameroff et al.,
assessment process is also useful for interpreting 1998) and minimizes the emergence of new and
the Mental Development and Psychomotor Devel- maintenance of existing maladaptive patterns of
opment Indices calculated based on test perform- behavior (Carter, 2002; Keenan & Shaw, 1997;
ance. The Bayley II was normed on a sample of Masten & Coatsworth, 1995, 1998). Second, as-
1,700 children who were grouped by age, sex, US sessing social-emotional and behavioral compe-
geographic region, race/ethnicity, and parental tence provides one avenue for evaluating the
education. relative degree of impairment associated with extant
Whereas the Mullen and the Bayley are designed problem behaviors (Briggs-Gowan et al., 2001). To
to assess children’s development more broadly in the extent that problem behaviors co-occur with
terms of cognitive, motor, and language functioning, delays in the acquisition of stage-salient compet-
the Preschool Language Scale, 4th edition (PLS-4; encies, concern for the child’s overall development
Zimmerman, Steiner, & Pond, 2002) specifically is raised. Third, including questions about both
measures children’s expressive and receptive lan- positive and negative aspects of the child may
guage capabilities. Used with children from birth to minimize parental response biases (Briggs-Gowan &
71 months, the PLS-4 is an individually adminis- Carter, 1998; Carter, 2002). Finally, in clinical
tered test of comprehension and spoken language. evaluations of young children, assessing social-
An additional Caregiver Questionnaire allows the emotional and behavioral competencies may facilit-
examiner to integrate results of the formal assess- ate the design of interventions that capitalize on
ment with the caregiver’s report of the child’s typical children’s strengths.
Infant–toddler assessment 123

simple and yields cut-point scores indicating poss-


Screening tools for assessing social-emotional and
ible problems in the social-emotional domain.
behavioral problems and competencies
The Brief-Infant-Toddler Social-Emotional Assess-
In recent years, the number of screening tools ment (BITSEA; Briggs-Gowan, 2000; Briggs-Gowan,
available for assessing social-emotional functioning Carter, Irwin, Wachtel, & Cicchetti, in press) is a 42-
in the infant–toddler period has grown (see Table 3). item measure for identifying social-emotional/be-
However, many screeners now available focus on a havioral problems and delays in competence in 1- to
specific area of social-emotional adjustment (e.g., 3-year-old children. The BITSEA has both social-
behavior problems) and do not provide comprehen- emotional/behavioral problem and competence in-
sive coverage of both problems and competencies. dices. It has demonstrated acceptable test–retest
For example, the 36-item Eyberg Child Behavior reliability and inter-rater reliability. In addition,
Inventory (Colvin & Eyberg, 1999; Eyberg, 1980; concurrent validity has been shown between BITSEA
Eyberg & Pincus, 1999), developed for 2 1/2- to 11- Problems and CBCL Internalizing and Externalizing
year-olds, focuses on conduct problems, aggression Scores, as well as evaluator ratings of child problem
and attention and has demonstrated acceptable re- behaviors during a testing situation. Further, BIT-
liability and validity. Similarly, the 40-item Toddler SEA Competence has shown low to modest correla-
Behavior Screening Inventory (TBSI) (Mouton- tions with evaluator ratings of competence. The
Simien, McCain, & Kelley, 1997) measures behavior BITSEA cut-points have demonstrated high sensi-
problems in 1- to 3-year-olds. The TBSI has shown tivity (80–95%) in detecting children with social-
acceptable sensitivity in detecting children referred emotional/behavioral problems according to the
for psychological services by their pediatrician longer CBCL/1.5-5, as well as children with high
(McCain et al., 1999). problem scores and/or low competence scores on the
Early Childhood Assessment (DECA; LeBuffe & more comprehensive ITSEA (80% sensitivity), while
Naglieri, 2003) takes a strength-based approach to maintaining acceptable specificity. In addition, re-
screening. The 37-item DECA, developed for 2- to cent work indicates that the BITSEA is highly sen-
5-year-olds, includes three protective factor scales sitive to autism spectrum disorders (Carter, Irwin,
(Initiative, Self-control, and Attachment) and a Skuban, & Briggs-Gowan, 2001). Finally, pre-
behavioral concerns scale. Parent and childcare liminary results from a longitudinal birth cohort
provider versions are available. In addition, a com- suggest that children who screen positive on the
panion guide that provides strategies for intervening BITSEA during toddlerhood are at moderate to high
based on the results of the DECA is available for risk for persistent language/learning and/or social-
helping children in early intervention settings. The emotional problems according to Kindergarten
DECA has acceptable test-retest and inter-rater teacher reports (Briggs-Gowan & Carter, 2003).
reliability. In a study that compared 95 preschool- It is important to note that in the infant–toddler
aged children with emotional and behavior problems period, it may be premature to recommend imple-
to 86 socio-demographically matched community menting routine screening. Although screening tools
children with no emotional or behavioral concerns, such as the BITSEA and ASQ-SE show promise,
the two groups were significantly different, in ex- their clinical validity has yet to be established. It is
pected directions, on each of the scales that com- therefore important to document that these tools are
prise the DECA. In the same study, the protective sufficiently sensitive to clinically significant social-
factor scale and the behavioral concerns scale emotional/behavioral problems (detecting a min-
achieved sensitivity of 67% and 78% in the problem imum 80% of cases), yet maintain false positive rates
group and 71% and 65% specificity, respectively that are low enough (20% or lower) that service sys-
(LeBuffe & Naglieri, 2003). As neither measure tems are not overwhelmed unnecessarily. To address
meets recommended guidelines, it may be premature this need, current research undertaken by Briggs-
to use the DECA as a screener for social-emotional/ Gowan and her colleagues is examining the clinical
behavior problems. However, the DECA may be a validity of both the ITSEA and the BITSEA, in
useful brief measure of children’s strengths and relation to consensus psychiatric diagnoses and
problems. parent–child relational disturbances in a sample of
The Ages & Stages Questionnaire–Social-Emotional clinic-referred and comparison children.
Version (ASQ-SE; Squires, Bricker, & Twombly,
2002a) is a promising screener for measuring social-
Tools for comprehensive assessment
emotional and behavioral problems from birth to
of social-emotional/behavioral problems
5 years of age. This measure was developed as a
companion to the ASQ developmental screeners More comprehensive assessments are required for
(described in Table 1). It has demonstrated accept- clinical evaluations and for research studies that
able test–retest reliability, as well as sensitivity in focus on clinical populations or that aim to utilize
detecting children with developmental delay and/or profiles of problems and competencies (see examples
social-emotional diagnoses (Squires, Bricker, & in Table 4). Recently, there has been an increase in
Twombly, 2002b). Scoring of the ASQ-SE is fairly the number of checklist measures available for
124
Alice S. Carter, Margaret J. Briggs-Gowan, and Naomi Ornstein Davis
Table 3 Selected social emotional screening instruments

Ages and Stages


Brief Infant–Toddler Social Questionnaires– Toddler Behavior Screening Devereux Early EybergChild Behavior
Emotional Assessment Social-Emotional (ASQ-SE) Inventory (TBSI) Childhood Assessment Inventory (Colvin &
(BITSEA) (Briggs-Gowan (Squires, Bricker, & (Mouton-Simien, McCain, (DECA) (LeBuffe & Eyberg, 1999; Eyberg,
& Carter, 2001) Twombly, 2002) & Kelley, 1997) Naglieri, 2003) 1980)

Age range 12–36 months 6–60 months 12–42 months 2- to 5-year-olds 2 1/2 to 11 years
Respondent Parent or caregiver Parent or caregiver Parent or caregiver Parent or caregiver Parent
Number of items 42 items 19–33 items 40 items 37 items 36 items
Admin. Time 5–7 minutes 10–15 minutes Not reported. 5–10 minutes 5 minutes
Skills/Domains assessed Problem behaviors Social-emotional problems Problem behaviors Initiative Conduct problems
Competencies Behavioral problems Self control Aggression
Social competencies Attachment Inattention
How items are scored 3 point rating scale: 3 point rating scale: 3 point rating scale: 5 point rating scale: Items are rated
Not true/rarely Most of the time Not true Never for intensity on a 7-point
Somewhat true/ Sometimes Somewhat/sometimes true Rarely frequency scale from
sometimes Never or rarely; Very/often true Occasionally Never to Always.
Very true/often Rating of whether Rating of whether the Frequently Parents also rate whether
the behavior is concerning respondent considers the Very frequently each item is a
to the respondent. behavior to be a problem. problem (yes or no).
Scoring/Cut-points Problem and competence High score suggests Cut-points are offered. Three ranges for Cut-points are offered
index totals as well as need for further evaluation. Authors suggest Protective factors, reflecting need for
cut-points based on Low score suggests the follow-up with family reflecting concern, referral or no need
child age and sex. respondent considers on any behavior typical or strength. for referral.
Combined cut-point social-emotional behaviors that is reported to be For Behavioral Concerns
(presence of problems to be competent. problematic. cut-points indicate
and/or low competence). concern and no concern.
Language Available in Spanish, Available in Spanish. Scales were examined Available in Spanish. Examination of
and cultural validity French, Dutch, Hebrew. Authors suggest for SES and ethnicity Scales were examined Caucasian and African
excluding any items effects (McCain et al., 1999). for racial bias with American families
that are not culturally small effect sizes indicated no effects of
appropriate. reported. race on the scales
(Colvin & Eyberg, 1999).
Reading level 4th to 6th grade 5th to 6th grade Not reported 6th grade Not reported.
Infant–toddler assessment 125

Table 4 Selected social-emotional assessment instruments

Infant-Toddler Social Child Behavior Checklist Preschool Age Psychiatric


and Emotional Assessment (ITSEA) ages 1.5–5 (CBCL) (Achenbach Assessment (PAPA) (Egger,
(Carter & Briggs-Gowan, 2000) & Rescorla, 2000) Ascher, & Angold, 1999)

Age range 12–36 months 18–60 months 2–5 years


Format Questionnaire Checklist/questionnaire Structured interview
(can be administered
as an interview)
Respondent Parent or caregiver Parent or caregiver Parent or caregiver
Number of items 139 in scales 99 items 15 diagnostic modules
27 in indices
Administration time Approximately 30 minutes 15 to 20 minutes 1½–2hours
Skills/Domains Externalizing Externalizing Modified DSM-IV and ICD-10 criteria
assessed Internalizing Internalizing DC:0–3 symptoms and diagnoses;
Dysregulation Total Problem Brief developmental assessment;
Competencies DSM Oriented scales Family structure and functioning;
Maladaptive behavior Incapacities
Atypical behavior
Social relatedness
Scoring of items 3-point rating scale: 3-point rating scale: Yields diagnosis
not truly/rarely not true and incapacity scores
somewhat true/sometimes somewhat/sometimes true
very true/often very true/often true
No opportunity
Scoring of problem Cut-points are available Cut-points are available. Scoring is accomplished through
areas by child age and sex computerized algorithms.
Language and Use with low SES Available in Spanish Spanish language translation
cultural validity Available in Spanish, French, is currently under way
Dutch, Hebrew
Level of difficulty 4th to 6th grade reading level. 5th grade reading level Lay interviewer trained to reliability
to complete Can be administered orally
if family prefers
Level of training Interpretation requires Interpretation requires 1–2 weeks classroom training;
to administer knowledge of standardized knowledge of standardized Individuals from a range
assessment and supervised assessment and supervised of professions can be trained
training in working with training in working with the to administer.
the relevant kinds of clients. relevant kinds of clients.

assessing social-emotional/behavioral adjustment and Competence), as well as three indices (Social


in young children. The Infant-Toddler Social and Relatedness, Atypical Behaviors, and Maladaptive)
Emotional Assessment (ITSEA) (Carter & Briggs- that consist of low base rate, clinically significant
Gowan, 2000; Carter et al., 2003), developed for 1- behaviors. Reliability and validity have been evalu-
to 3-year-olds, and the downward extension of the ated in three studies (Briggs-Gowan & Carter, 1998;
Child Behavior Checklist, now available for 18- Carter, Little, Briggs-Gowan, & Kogan, 1999; Carter
months to 5 years of age (CBCL/1.5-5, Achenbach & et al., 2003). Of note, early work with the ITSEA
Rescorla, 2000), reflect this growth in checklist documented validity relative to independent obser-
measures. One of the advantages of longer dimen- vational ratings of child behavior in a sample of
sional assessments, as compared to screening tools, toddlers (Carter et al., 1999). Most recently, the
is that profiles of problems and competencies can be psychometrics of the ITSEA were examined in a large
examined for areas of relative strength and concern representative healthy birth cohort of urban and
or for identifying clusters of children who vary across suburban families (Carter et al., 2003). Results
score profiles. indicated acceptable internal consistency and test–
retest reliability. In addition, criterion-related valid-
Infant-Toddler Social and Emotional Assessment ity was supported by moderate correlations between
(ITSEA). The ITSEA (Briggs-Gowan & Carter, 1998; ITSEA problem scales and parent reports on the
Carter & Briggs-Gowan, 2000; Carter et al., 2003) is CBCL/1.5–5, as well as by small to modest correla-
a 169-item questionnaire about social-emotional/ tions with independent evaluator’s ratings of prob-
behavioral problems and competencies in 1- to 3- lem behaviors. Further, consistent with the
year-old children. The ITSEA was developed as a developmental nature of ITSEA Competence, chil-
comprehensive tool that would be appropriate for dren’s scores in this domain increased with child
profiling children’s strengths and weaknesses in the age. ITSEA Competence was also positively and
social-emotional domain. There are four broad do- moderately associated with the results of standard-
mains (Internalizing, Externalizing, Dysregulation, ized developmental tests (r ¼ .39 to .58). Scale scores
126 Alice S. Carter, Margaret J. Briggs-Gowan, and Naomi Ornstein Davis

and cut-point status, reflecting the extreme 10th disorders, regulatory disorders (addressing, for
percentile, are derived from the subscales and example, sleep, feeding, and emotion regulation),
domains of ITSEA. In addition, t-scores have been Post-Traumatic Stress Disorder, and Reactive
developed at the domain level. Attachment Disorder (Egger & Angold, in press). The
PAPA interview also includes a section for de-
Child Behavior Checklist for 1.5-5 (CBCL/1.5-5) termining the level of impairment, or ‘incapacity,’
(Achenbach & Rescorla, 2000). This 99-item that is associated with symptoms of each diagnostic
checklist measure is a downward extension of the area. Preliminary findings from a recent study indi-
CBCL, originally developed for older children, and is cate that the PAPA achieves test–retest reliability
designed for children from 18 months through comparable to that of other diagnostic tools of older
5 years. The CBCL/1.5-5 addresses social-emo- children (Egger, 2003).
tional/behavioral problems in three domains (Inter-
nalizing, Externalizing and Total Problems) and Advances in conceptualization of disorder in early
includes new DSM-Oriented scales, designed to childhood. Building on the emerging body of
parallel symptoms in DSM diagnostic areas. Indi- empirical diagnostic work with young children, an
vidual social-emotional competencies are not rated in interdisciplinary task force of independent invest-
the CBCL/1.5-5. Scoring yields both t-scores and igators gathered recently to make recommendations
cut-point status scores. The cut-points fall in two regarding clearly specified diagnostic criteria that
ranges: ‘Sub-clinical’ (t-score ‡60) and ‘clinical’ can be used in systematic research on psychiatric
(t-scores ‡63). The CBCL/1.5-5 has demonstrated disorders in infants and preschool children (Task
very good 8-day test–retest reliability and cross- Force on Research Diagnostic Criteria: Infancy and
informant agreement. There is evidence that the Preschool, in press). This group developed the Re-
CBCL/1.5-5 discriminates children referred to men- search Diagnostic Criteria – Preschool Age (RDC-PA)
tal health and special education facilities from in a process analogous to that which led to the
matched subjects from a normative sample, with 74% development of research diagnostic criteria for use in
of referred children correctly classified by the Inter- general psychiatry (Spitzer, Endicott, & Robins,
nalizing and Externalizing scales. Furthermore, 1978). After considerable discussion of the status of
results reported by Achenbach and Rescorla (2000) the extant diagnostic nosologies (i.e., DSM-IV, DC:
indicate that children with high CBCL/1.5-5 domain Zero to Three, ICD-10), a focus was placed on gen-
scores were 5 to 6 times more likely to be clinically erating testable and developmentally sensitive cri-
referred than children with scores below the cut- teria consistent with the DSM-IV approach to
points. conceptualizing psychopathology. The work was in-
formed by a review of over 40 empirical articles that
focused on psychopathology in children younger
Diagnosis in early childhood
than 5 years of age.
Recent advances in screening and assessments of The guidelines for developing the criteria were as
social-emotional and behavior problems and com- follows: (1) Wherever possible, adhere to the DSM-
petencies have been paralleled by major progress in IV; (2) Modifications to criteria should be based on
conceptualizing the early emergence of psychopa- empirical evidence; (3) Criteria that require infer-
thology with respect to psychiatric diagnosis. This ence of internal states should not be included (e.g.,
progress is reflected in empirical work by several if a pre-verbal child wakes up crying in the night, it
groups of clinical researchers that addresses specific is not legitimate to assume the child is awakening
aspects of psychopathology such as Post Traumatic from a nightmare); (4) Maintain a focus on the
Stress Disorder (PTSD), Depression, Disruptive child’s symptomatology, such that parental behav-
Behavior Disorders, and Attachment Disorders. In iors are not included as criteria for child disorders;
addition, progress is evident in the revisions of exist- and (5) Maintain a clear distinction between symp-
ing measures (e.g., K-SADS and C-DISC) for use with toms and disability or impairment. For some dis-
younger children and the design of new measures. orders, such as disruptive behavior disorders, the
group concluded that minimal changes in dia-
Diagnostic assessment measures. The Preschool gnostic criteria were necessary for young children.
Age Psychiatric Assessment (PAPA; Egger, Ascher, & In contrast, for PTSD, many revisions to wording
Angold, 1999) was recently developed to provide were required to make symptoms developmentally
comprehensive and developmentally sensitive cov- appropriate. Moreover, many symptoms that are
erage of the symptom, frequency, duration and onset applicable for older children and adults are not
criteria necessary to generate diagnoses for children relevant for very young children. When clinical- or
ages 2 to 5 using the DSM-IV, ICD-10, and DC: 0–3 research-based evidence indicated that the existing
diagnostic classification systems. Reviews of the in- nosological criteria did not adequately capture the
fant mental health literature and input from many phenomenology of a particular disorder in young
infant mental health experts were used to design children or were developmentally inadequate (e.g.,
sections on internalizing disorders, externalizing as in Reactive Attachment Disorder), new criteria
Infant–toddler assessment 127

were created or existing criteria modified to be disorders (Luby et al., 2002, 2003). Their work
developmentally-sensitive. addresses the complicated developmental question
Several disorders were minimally modified (e.g., of whether the young child’s emotional repertoire is
Attention-Deficit/Hyperactivity Disorder, Opposi- itself sufficiently differentiated to encompass true
tional Defiant Disorder), others were moderately ‘depressive’ and/or ‘elated’ affect and how to dif-
modified (e.g., Conduct Disorder, Posttraumatic ferentiate atypical from normative developmental
Stress Disorder), while others required conceptual manifestations. Clinicians and researchers are lim-
alterations (e.g., Reactive Attachment Disorder, ited by the fact that the current DSM nosology does
Sleep Onset Protodyssomnia, several feeding disor- not describe the developmentally specific manifes-
ders). Of the 87 symptoms that were reviewed across tations of affective symptoms for young children.
13 DSM-IV disorders, 51% were not altered, 34% Their work indicates that given the greater variab-
were developmentally modified, and 15% were con- ility in mood states observed in young children, it is
sidered developmentally inappropriate. Twenty-two not clear that the duration criteria should be com-
new symptom categories were created and 10 parable to older manifestations (Luby, in press).
experimental symptoms were offered for further Luby and colleagues utilized a multi-method, multi-
study. The RDC-PA are available on-line at http:// informant approach that included: (1) an age
www.infant.institute.org. appropriate diagnostic interview; (2) observation of
Although a review of each area addressed by the the young child’s affective range using a laboratory-
RDC-PA is beyond the scope of this paper, a brief based temperament assessment; (3) a developmen-
review of some of the recent work conducted by tally appropriate direct interview for preschoolers;
Schereenga and Zeanah (1994, in press) in PTSD, (4) an examination of thematic play; (5) parental
Luby and colleagues (Luby, Heffelfinger, & Mra- dimensional ratings scales; (6) an observation of the
kotsky, 2002; Luby et al., 2003) in Depression, and parent–child interaction across structured and
Keenan and Wakschlag (2000, 2002; Wakschlag & unstructured conditions; and (7) cognitive and
Danis, in press) in Disruptive Disorders is included neurocognitive assessment of the child. By
to highlight the importance of the conceptual and employing these techniques, they were able to
methodological strategies employed to validate dis- identify a group of young preschool children who
orders in very young children. met the modified depression criteria developed for
young children.
Posttruamatic Stress Disorder (PTSD). The work of It is important to note that Luby and colleagues’
Michael Schereenga and colleagues (Scheeringa, in empirical data indicate that young children with
press; Scheeringa & Gaensbauer, 2000; Scheeringa, Major Depressive Disorder (MDD) are less withdrawn
Peebles, Cook, & Zeanah, 2001; Scheeringa, Zeanah, and have less consistent vegetative symptoms than
Drell, & Larrieu, 1995) documents that infants older do older children (Luby, in press). However, the
than 9 months of age and toddlers can and do suffer children were consistently described as ‘less happy’
from PTSD. It also highlights the importance of and showed less pleasure in play activities, consis-
understanding the child’s developmental capacities tent with an anhedonic depressive presentation. In
when determining the appropriateness of criteria addition, changes in activity, appetite and sleep were
employed for older children and illuminates the noted. Anhedonia appears to be a very specific
utility of adopting a multi-informant, multi-method marker of depression in young children, with 57% of
approach to assessment. Moreover, by systematic- children with depression evidencing this symptom,
ally evaluating young children exposed to significant in contrast to none of the children in the psychiatric
stress and reviewing the basic research on memory or typically developing control groups (Luby et al.,
processing in infancy and toddlerhood, Schereenga 2002). Moreover, Luby et al.’s (2003) work is notable
and colleagues have made a very strong case that for addressing the relation of biological correlates,
many of the DSM-IV criteria for PTSD are not such as cortisol reactivity, and family genetic risk to
applicable to very young children due to their more disorder status among preschoolers.
limited cognitive, verbal, and memory capacities.
They also suggest that young children evidence un- Disruptive Behavior Disorders (DBD). The study of
ique behaviors that may need to be incorporated into disruptive behavior disorders highlights the com-
modified diagnostic criteria. They further have plexity of distinguishing normative from clinically
documented the central role that parental reactions problematic behavior during early childhood when
play in the emergence, promotion, and/or mainten- some disruptive behaviors are increasing in a nor-
ance of symptoms in young children and propose a mative frame. Indeed, some have questioned
variety of mechanisms that can account for these whether disruptive behavior problems can be reli-
associations (Scheeringa & Zeanah, in press). ably assessed during this period (Campbell, 1990)
and whether it may be premature to diagnose a child
Depression. Luby and colleagues have been ex- whose developmental trajectory may include dimi-
amining the early manifestations of clinically sig- nution of symptoms without intervention. At the
nificant signs and symptoms of depressive same time, disruptive behavior is the most common
128 Alice S. Carter, Margaret J. Briggs-Gowan, and Naomi Ornstein Davis

reason for referral of young children to mental health contexts. Screening large representative samples
clinics (Keenan & Wakschlag, 2000; Luby & Mogan, affords the opportunity to ascertain unbiased clin-
1997; Thomas & Guskin, 2001) and there is in- ically informative sub-samples for methodologically
creasing evidence from research endeavors that be- intensive sub-studies. These sub-studies can ad-
havior disorders can be validly diagnosed in dress the child’s cognitive and linguistic develop-
preschoolers (Keenan & Wakschlag, 2002). Although mental capacities as well as utilize observational
still in a very early stage of development, Wakschlag methods to examine the relational context. This
and colleagues (Wakschlag & Danis, in press) have approach provides an opportunity to merge dimen-
an exciting new observational measure of Disruptive sional and diagnostic assessments and will yield
Behavior Disorders, the Disruptive Behavior Dia- critical information for disentangling continuities
gnostic Observational Schedule (DB-DOS), which is and discontinuities in normative and atypical
modeled on the Autism Diagnostic Observational development.
Schedule (Lord et al., 2000). The DB-DOS presents The assessment methodology currently exists to
multiple opportunities to elicit behaviors relevant to routinely screen very young children for social-emo-
diagnosing disruptive behavior disorders. The DB- tional and behavior problems as well as delays in the
DOS includes structured observations of the child acquisition of competencies in pediatric settings as
with the parent and with an examiner who is either well as in early intervention programs. Yet, despite
involved with the child or disengaged (Wakschlag & the likely long-term benefits and cost-saving poten-
Danis, in press). tial of early identification and intervention services,
As our understanding of specific early-emerging short-term cost and knowledge barriers currently
disorders evolves, it is quite likely that additional limit widespread implementation. Discussions with
diagnosis-specific instruments will be developed al- pediatricians suggest that one of the greatest barriers
lowing clinicians and researchers to elicit targeted to screening is the limited availability of mental
information about behaviors that assist in making health referral sources. Indeed, very few children who
differential diagnoses (i.e., are specific to diagnostic are rated by parents as having elevated social-emo-
conditions). Clearly, multi-method, multi-informant tional and behavior problems are receiving any be-
assessment is integral to understanding young havioral health services (Horwitz et al., in press).
children’s development. Moreover, observations of Unmet mental health needs exist among non-referred
the parent–child or caregiver–child interactions children in the community as well as among children
across several contexts must be considered a critical receiving early intervention services for developmen-
component of any young child assessment of social- tal concerns. Documenting the mental health needs
emotional problems or psychopathology. It has also of young children may promote training of profes-
been argued that for very young children, repeated sionals who have the competence to treat young
assessments on more than one day are necessary to children and their families. Moreover, the availability
capture the child and family’s range of functioning of social-emotional and behavior problem assess-
adequately (Weston et al., 2003). ment tools should increase studies that focus on the
clinical efficacy and effectiveness of prevention and
early intervention programs designed to promote
positive mental health.
Summary and conclusions
Finally, although significant progress is occurring
In this paper we have tried to document some of the in the arena of young child diagnosis, a strong case
recent advances in the conceptualization and can be made for intervening when young children are
assessment of early-emerging social-emotional and exhibiting elevations in problem behaviors or delays
behavior problems, competencies, and psychopa- in the acquisition of competence. This is particularly
thology. Considerable evidence documents that true when children are also experiencing exposure to
young children evidence significant psychopathol- multiple contextual risk factors. It is therefore
ogy (cf., Del Carmen & Carter, in press; Emde, important to advocate for changes to systems that
1999; Zeanah, 2001; Zeanah et al., 1997). Given require child diagnosis as a gateway to intervention.
the range of new assessment measures that have As we learn more about the precursors or prodromal
become available over the past 10 years, the field of manifestations of clinical psychopathology we will be
young child mental health is poised for dramatic able to examine the efficacy of earlier targeted pre-
gains in knowledge. It is critical to conduct large- ventive intervention approaches.
scale, longitudinal, epidemiological studies to in-
form our understanding of the course of psycho-
pathological conditions within the context of a
Correspondence to
normative developmental framework. Multi-method,
multi-informant assessment approaches are more Alice S. Carter, Department of Psychology,
essential in early childhood due to young children’s University of Massachusetts Boston, 100 Morrissey
inability to provide self-reports and the embedded Boulevard, Boston, MA 02125, USA; Email: alice.
nature of children’s development in their caregiving carter@umb.edu
Infant–toddler assessment 129

References Briggs-Gowan, M.J., & Carter, A.S. (2002). Brief-Infant-


Toddler Social and Emotional Assessment (BITSEA):
Achenbach, T., & Rescorla, L. (2000). Manual for the Manual. Version 2.0. New Haven, CT: Yale University.
ASEBA preschool forms and profiles. Burlington, VT: Briggs-Gowan, M.J., & Carter, A.S. (May, 2003). The
University of Vermont. Infant-Toddler Social & Emotional Assessment (ITSEA)
Acker, M.M., & O’Leary, S.G. (1996). Inconsistency of and Brief Infant-Toddler Social & Emotional Assess-
mothers’ feedback and toddlers’ misbehavior and ment (BITSEA). Invited presentation at the ‘Young
negative affect. Journal of Abnormal Child Psychology, Child Assessment Roundtable: Approaches and Fu-
24, 703–714. ture Directions In Mental Health’, National Institute
American Academy of Pediatrics. (2001). Committee on of Mental Health. Washington, DC.
children with disabilities. Developmental surveillance Briggs-Gowan, M.J., Carter, A.S., Irwin, J., Wachtel, K.,
and screening of infants and young children. Pediat- & Cicchetti, D. (in press). The Brief Infant-Toddler
rics, 108, 192–196. Social and Emotional Assessment: Screening for
American Psychological Association. (2002). Guidelines social-emotional problems and delays in competence.
on multicultural education, training, research, practice Journal of Pediatric Psychology.
and organizational change. http:/www.apa.org/ Briggs-Gowan, M., Carter, A., & Schwab-Stone, M.
divisions/div45/resources.html. (1996). Discrepancies among mother, child and
Atkinson, D.R., Morton, G., & Sue, D.W. (1998). Coun- teacher reports: Examining the contributions of
seling American minorities (5th edn). Boston, MA: maternal depression and anxiety. Journal of Abnor-
McGraw Hill. mal Child Psychology, 24, 749–765.
Baird, G., Charman, T., Baron-Cohen, S., Cox, A., Briggs-Gowan M.J., Carter, A.S., Skuban, E.M., &
Swettenham, J., Wheelwright, B.A., & Drew, A. (2000). Horwitz, S.M. (2001). Prevalence of social-emotional
A screening instrument for autism at 19 months and behavioral problems in a community sample of 1-
of age: A 6-year follow-up study. Journal of Abnormal and 2-year-old children. Journal of the American
Child and Adolescent Psychiatry, 39, 94–702. Academy of Child and Adolescent Psychiatry, 40,
Barnard, K.E. (1979). Instructor’s learning resource 811–819.
manual. Seattle: NCAST Publications, University of Briggs-Gowan, M.J., Horwitz, S.M., Schwab-Stone,
Washington. M.E., Leventhal, J.M., & Leaf, P.J. (2000). Mental
Bayley, N. (1993). The Bayley Scales of Infant Develop- health in pediatric settings: distribution of disorders
ment, second edition. San Antonio, TX: The Psycho- and factors related to service use. Journal of the
logical Corporation. American Academy of Child and Adolescent Psychi-
Beitchman, J.H., Wilson, B., Brownlie, E.B., Walters, atry, 39, 841–849.
H., & Lancee, W. (1996). Long-term consistency in Bronfenbrenner, U. (1986). Ecology of the family as a
speech/language profiles: I. Developmental and aca- context for human development: Research perspec-
demic outcomes. Journal of the American Academy of tives. Developmental Psychology, 22, 723–742.
Child and Adolescent Psychiatry, 35, 804–814. Campbell, S.B. (1990). Behavior problems in preschool
Betancourt, H., & Lopez, S.R. (1993). The study of children: Clinical and developmental issues. New
culture, ethnicity, and race in American psychology. York: Guilford Publications.
American Psychologist, 48, 629–637. Carter, A.S. (2002). Assessing social-emotional and
Biringen, Z. (2000). Emotional availability: Conceptu- behavior problems and competencies in infancy and
alization and research findings. American Journal of toddlerhood: Available instruments and directions for
Orthopsychiatry, 70, 104–114. application. In B. Zuckerman, A. Lieberman, & N. Fox
Biringen, Z., & Robinson, J.L. (1991). Emotional (Eds.), Emotion regulation and developmental health:
availability in mother–child interactions: A reconcep- Infancy and early childhood (pp. 277–299). New York:
tualization for research. American Journal of Ortho- Johnson & Johnson Pediatric Institute.
psychiatry, 61, 258–271. Carter, A.S., & Briggs-Gowan, M.J. (1999). Infant-
Biringen, Z., Robinson, J., & Emde, R.N. (1998). The Toddler Social and Emotional Assessment (ITSEA).
Emotional Availability Scales (3rd edn). Unpublished New Haven, CT: Yale University (alice.carter@
manual, Colorado State University. umb.edu or itsea@yale.edu).
Bricker, D., & Squires, J. (1989). The effectiveness of Carter, A.S., & Briggs-Gowan, M.J. (2000). Manual of
screening at-risk infants: Infant Monitoring Ques- the Infant-Toddler Social-Emotional Assessment. New
tionnaire. Topics in Early Special Childhood Educa- Haven, CT: Yale University.
tion, 3, 67–85. Carter, A.S., Briggs-Gowan, M.J., Jones, S.M., & Little,
Bricker, D., & Squires, J. (1999). The Ages & Stages T.D. (2003). The Infant-Toddler Social and Emotional
Questionnaires: A parent-completed, child monitoring Assessment: Factor structure, reliability, and valid-
system, second edition. Baltimore, MD: Paul H. ity. Journal of Abnormal Child Psychology, 31, 495–
Brooks Publishing. 514.
Brigance, A.H., & Glascoe, F.P. (2002). Brigance Infant Carter, A.S., & Del Carmen, R. (in press). Epilogue. In R.
and Toddler Screen. North Billerica, MA: Curriculum Del Carmen & A.S. Carter (Eds.), Handbook of infant,
Associates, Inc. toddler, and preschool mental health assessment.
Briggs-Gowan, M.J., & Carter, A.S. (1998). Preliminary New York, NY: Oxford University Press.
acceptability and psychometrics of the Infant-Toddler Carter, A.S., Garrity-Rokous, F.E., Chazan-Cohen, R.,
Social and Emotional Assessment (ITSEA): A new Little, C., & Briggs-Gowan, M. (2001). Maternal
adult-report questionnaire. Infant Mental Health, 19, depression and comorbidity: Predicting early parent-
422–445. ing, attachment security, and toddler social-emotional
130 Alice S. Carter, Margaret J. Briggs-Gowan, and Naomi Ornstein Davis

problems and competencies. Journal of the American Colvin, A., & Eyberg, S.A. (1999). Restandardization of
Academy of Child and Adolescent Psychiatry, 40, the Eyberg Child Behavior Inventory: Professional
18–26. Manual. Odessa, FL: Psychological Assessment Re-
Carter, A.S., Irwin, J.R., Skuban, E.M., & Briggs- sources.
Gowan, M.J. (October, 2001). Toward early detection Crowell, A., & Feldman, S. (1988). The effects of mother’
of autism: Profiling social emotional/behavioral prob- internal working models of relationships and chil-
lems and competence in typically developing, autistic, dren’s behavioral and developmental status on
and developmentally delayed toddlers. Paper presen- mother–child interaction. Child Development, 59,
ted at the International Meeting for Autism Research, 1273–1285.
San Diego, CA. Crowell, J., & Fleischmann, M.A. (1993). Use of
Carter, A.S., Little, C., Briggs-Gown, M., & Kogan, N. structured research procedure in clinical assess-
(1999). The Infant-Toddler Social and Emotional ments of infants. In C.H. Zeanah, Jr. (Ed.), Handbook
Assessment (ITSEA): Parent ratings and observations of infant mental health (pp. 210–221). New York:
of attachment, mastery motivation, emotion regula- Guilford Press.
tion and coping behaviors. Infant Mental Health Cornely, P., & Bromet, E. (1986). Prevalence of behavior
Journal, 20, 1–18. problems in three-year-old children living near Three
Carter, A.S., & Murdock, K.K. (2001). The family as a Mile Island: A comparative analysis. Journal of Child
context of psychological functioning. In E.L. Grigor- Psychology and Psychiatry, 27, 489–498.
enko & R.J. Sternberg (Eds.), Family environment De Giacomo, A., & Fombonne, E. (1998). Parental
and intellectual functioning: A lifespan perspective recognition of developmental abnormalities in aut-
(pp. 1–22). New York: Lawrence Erlbaum Associates. ism. European Child and Adolescent Psychiatry, 7,
Christensen, M., Emde, R., & Fleming, C. (in press). 131–136.
Cultural perspectives for assessing infants and young Del Carmen-Wiggins, R., & Carter, A.S. (2001). Intro-
children. In R. Delcarmen-Wiggins & A. Carter (Eds.). duction – Special Section: Assessment of infant and
Handbook of infant, toddler, and preschool mental toddler mental health: Advances and challenges.
health assessment. New York, NY: Oxford University Journal of the American Academy of Child and Ado-
Press. lescent Psychiatry, 40, 8–10.
Cicchetti, D., & Cohen, D.J. (1995). Perspectives on Del Carmen, R., & Carter, A.S. (Eds). (in press).
developmental psychopathology. In D. Cicchetti & Handbook of infant, toddler, and preschool mental
D.J. Cohen (Eds.), Developmental psychopathology, health assessment. New York, NY: Oxford University
Vol. 1: Theory and methods (pp. 3–20). New York: Press.
John Wiley & Sons, Inc. Denham, S.A., & Holt, R.W. (1993). Preschoolers’
Cicchetti, D., & Sroufe, L.A. (1976). The relationship likability as cause or consequence of their social
between affective and cognitive development in behavior. Developmental Psychology, 29, 271–275.
Down’s syndrome infants. Child Development, 47, Earls, F. (1980). Prevalence of behavior problems in
920–929. 3-year-old children: A cross-national replication.
Cicchetti, D.V. (1994). Guidelines, criteria, and rules of Archives of General Psychiatry, 37, 1153–1157.
thumb for evaluating normed and standardized Egger, H.L. (May, 2003). The Preschool Age Psychiatric
assessment instruments in psychology. Psychological Assessment (PAPA). Invited presentation at the
Assessment, 6, 284–290. ‘Young Child Assessment Roundtable: Approaches
Cicchetti, D.V., Volkmar, F., Klin, A., & Showalter, D. and Future Directions In Mental Health’, National
(1995). Diagnosing autism using ICD-10 criteria: A Institute of Mental Health, Washington, DC.
comparison of neural networks and standard multi- Egger, H.L. (2003). Temper Tantrums and Preschool
variate procedures. Child Neuropsychology, 1, 26–37. Psychopathology. Presented at the American Acad-
Clark, R. (1985). The parent–child early relational emy of Child and Adolescent Psychiatry 50th Anni-
assessment. Instrument and manual. Department of versary Meeting, Miami, Florida.
Psychiatry, University of Wisconsin Medical School, Egger, H.L., & Angold, A. (in press). The Preschool Age
Madison, WI. Psychiatric Assessment (PAPA): A structured parent
Clark, R. (1999). The parent–child early relational interview for diagnosing psychiatric disorders in
assessment: A factorial validity study. Educational preschool children. In R. Del Carmen & A.S. Carter
and Psychological Measurement, 59, 821–846. (Eds.), Handbook of infant, toddler, and preschool
Clark, R., Hyde, J.S., Essex, M.J., & Klein, M.H. (1997). mental health assessment. New York, NY: Oxford
Length of maternity leave and quality of mother– University Press.
infant interactions. Child Development, 68, 364–383. Egger, H.L., Ascher, B.H., & Angold, A. (1999). The
Clark, R., Paulson, A., & Conlin, S. (1993). Assessment Preschool Age Psychiatric Assessment: Version 1.1.
of developmental status and parent–infant relation- (Unpublished Interview Schedule). Center for Devel-
ships. In C. Zeanah (Ed.), The handbook of infant opmental Epidemiology, Department of Psychiatry
mental health (pp. 191–209). New York: Guilford and Behavioral Sciences, Duke University Medical
Press. Center.
Clark, R., Tluczek, A., & Gallagher, K.C. (in press). Eisert, D.C., Sturner, R.A., & Mabe, P.A. (1991).
Assessment of parent–child early relational distur- Questionnaires in behavioral pediatrics: Guidelines
bances. In R. Delcarmen-Wiggins & A. Carter (Eds.). for selection and use. Journal of Developmental and
Handbook of infant, toddler, and preschool mental Behavioral Pediatrics, 12, 42–50.
health assessment.New York, NY: Oxford University Emde, R.N. (1999). Early intervention and mental
Press. health: Implications for research in Head Start. NHSA
Infant–toddler assessment 131

Dialog: A Research-to-Practice Journal for the Early the cumulative risk model. Journal of Applied Devel-
Intervention Field, 2, 286–296. opmental Psychology, 19, 85–96.
Emde, R.N. (2001). A developmental psychiatrist looks Horwitz, S.H., Gary, L.A., Briggs-Gowan, M.J., & Carter
at infant mental health challenges for Early Head A.S. (in press). Do needs drive services or do services
Start. Zero to Three, 22, 21–24. drive needs? Pediatrics.
Emde, R.N., Bingham, R.D., & Harmon, R.J. (1993). Horwitz, S.H., Irwin, J.R., Briggs-Gowan, M.J., Heenan,
Classification and the diagnostic process in infancy. J.M.B., Mendoza, J., & Carter, A.S. (2003). Language
In C.H. Zeanah, Jr. (Ed.), Handbook of infant mental delay in a community cohort of young children.
health (pp. 225–235). New York: Guilford Publica- Journal of the American Academy of Child and
tions. Adolescent Psychiatry, 42, 932–940.
Eyberg, S. (1980). The Eyberg Child Behavior Inventory. Houck, G.M. (1999). The measurement of child char-
Journal of Clinical Child Psychology, 9, 22–28. acteristics from infancy to toddlerhood: Tempera-
Eyberg, S., & Pincus, D. (1999). Eyberg Child Behavior ment, developmental competence, self-concept, and
Inventory & Sutter-Eyberg Student Behavior Inventory social competence. Issues in Comprehensive Pediatric
– Revised. Odessa, FL: Psychological Assessment Nursing, 22, 101–127.
Resources. Huffman, L.C., & Nichols, M. (in press). Mental health
Farran, D., Clark, K., & Ray, A. (1990). Measures of screening of young children in a pediatric primary
parent–child interaction. In E. Gibbs & D. Teti (Eds.), care setting. In R. Del Carmen & A. Carter (Eds.),
Interdisciplinary assessment of infants: A guide for Assessment of infant and toddler mental health.
early intervention professionals (pp. 227–247). Balti- Oxford University Press.
more: Paul H. Brooks Publishing Co. Individuals with Disabilities Education Act Amend-
Fenson, L., Bates, E., Dale, P., Goodman, J., Reznick, ments of 1997(Pub L No. 105–17).
J.S., & Thal, D. (2000a). Measuring variability in Irwin, J.R., Carter, A.S., & Briggs-Gowan, M.J. (2002).
early child language: Don’t shoot the messenger. The social-emotional development of ‘late-talking’
Child Development, 71, 323–328. toddlers. Journal of the American Academy of Child
Fenson, L., Dale, P.S., Reznick, J.S., Thal, D., Bates, E., and Adolescent Psychiatry, 41, 1324–1332.
Hartung, J.P., Pethick, S., & Reilly, J.S. (1993). Jellinek, M.S., & Murphy, J.M. (1988). Screening for
Macarthur Communicative Development Inventories: psychosocial disorders in pediatric practice. American
The user’s guide and technical manual. San Diego, Journal of Diseases in Children, 142, 1153–1157.
CA: Singular Publishing Group, Inc. Jellinek, M.S., Murphy, J.M., Little, M., Pagano, M.E.,
Fenson, L., Pethick, S., Renda, C., Cox, J.L., Dale, P.S., Comer, D.M., & Kelleher, K.J. (1999). Use of the
& Reznick, J.S. (2000b). Short form versions of the pediatric symptom checklist to screen for psychoso-
MacArthur Communicative Development Inventories. cial problems in pediatric primary care: A national
Applied Psycholinguistics, 21, 95–115. feasibility study. Archives of Pediatrics and Adoles-
Fergusson, D.M., Horwood, L.J., & Lynskey, M.T. cent Medicine, 153, 254–260.
(1995). The stability of disruptive childhood beha- Jellinek, M., Patel, B.P., & Froehle, M.C. (2003). Bright
viors. Journal of Abnormal Child Psychology, 23, futures in practice: Mental health, volume 1, practice
379–96. guide and volume 2, tool kit. Journal of the American
Fonagy, P., Target, M., Steele, M., & Gerber, A. (1995). Academy of Child and Adolescent Psychiatry, 42,
Psychoanalytic perspectives on developmental psy- 507–508.
chopathology. In D. Cicchetti & D.J. Cohen (Eds.), Jenkins, S., Bax, M., & Hart, H. (1980). Behavior
Developmental psychopathology, Vol. 1: Theory and problems in pre-school children. Journal of Child
methods (pp. 504–554). New York: John Wiley & Sons Psychology and Psychiatry, 21, 5–17.
Inc. Keenan, K., & Shaw, D. (1997). Developmental and
Freud, A. (1966). A short history of child analysis. social influences on young girls’ early problem
Psychoanalytic Study of the Child, 21, 7–14. behavior. Psychological Bulletin, 121, 95–113.
Garcia Coll, C., & Magnuson, K. (2000). Cultural Keenan, K., Shaw, D., Delliquadri, E., Giovannelli, J., &
differences as sources of developmental vulnerabil- Walsh, B. (1998). Evidence for the continuity of early
ities and resources. In J.P. Shonkoff & S.J. Meisels problem behaviors: Application of a developmental
(Eds), Handbook of early childhood intervention (2nd model. Journal of Abnormal Child Psychology, 26,
edn, pp. 94–114). New York: Cambridge University 441–445.
Press. Keenan, K., & Wakschlag, L. (2000). More than the
Gibbs, J.T. (1987). Identity and marginality: Issues in terrible twos: The nature and severity of behavior
the treatment of biracial adolescents. American Jour- problems in clinic-referred preschool children. Jour-
nal of Orthopsychiatry, 57, 265–278. nal of Abnormal Child Psychology, 28, 33–46.
Glascoe, F.P. (2000). Early detection of developmental Keenan, K., & Wakschlag, L. (2002). Can a valid
and behavioral problems. Pediatric Review, 21, 272– diagnosis of disruptive behavior disorder be made in
280. preschool children?. American Journal of Psychiatry,
Glascoe, F.P. (2002). The Brigance Infant and Toddler 159, 351–358.
Screen: Standardization and validation. Developmen- Koot, H.M., & Verhulst, F.C. (1991). Prevalence of
tal and Behavioral Pediatrics, 23, 145–150. problem behavior in Dutch children aged 2–3. Acta
Hooper, S.R., Burchinal, M.R., Roberts, J.E., Zeisel, S., Psychiatrica Scandinavica, 83, 1–37.
& Neebe, E.C. (1998). Social and family risk factors Larson, C.P., Pless, I.B., & Miettinen, O. (1988).
for infant development at one year: An application of Preschool behavior disorders: Their prevalence in
132 Alice S. Carter, Margaret J. Briggs-Gowan, and Naomi Ornstein Davis

relation to determinants. Journal of Pediatrics, 113, Masten, A.S., & Coatsworth, J.D. (1998). The develop-
278–285. ment of competence in favorable and unfavorable
Lavigne, J.V., Arend, R., Rosenbaum, R., Binns, H.J., environments: Lessons from research on successful
Christoffel, K.K., & Gibbons, R.D. (1998). Psychiatric children. American Psychologist, 53, 205–220.
disorders with onset in the preschool years: I. Matas, L., Arend, R.A., & Sroufe, L.A. (1978). Continuity
Stability of diagnoses. Journal of the American of adaptation in the second year: The relationship
Academy of Child and Adolescent Psychiatry, 37, between quality of attachment and later competence.
1246–1254. Child Development, 49, 547–556.
Lavigne, J.V., Gibbons, R.D., Christoffel, K.K., Arend, Mathiesen, K.S., & Sanson, A. (2000). Dimensions of
R., Rosenbaum, D., Binns, H., Dawson, N., Sobel, H., early childhood behavior problems: Stability and
& Isaacs, C. (1996). Prevalence rates and correlates of predictors of change from 18 to 30 months. Journal
psychiatric disorders among preschool children. of Abnormal Child Psychology, 28, 15–31.
Journal of the American Academy of Child and McCain, A.P., Kelley, M.L., & Fishbein, J. (1999).
Adolescent Psychiatry, 35, 204–214. Behavioral screening in well-child care: Validation of
LeBuffe, P.A., & Naglieri, J.A. (2003). The Devereux the Toddler Behavior Screening Inventory. Journal of
Early Childhood Assessment (DECA): A measure of Pediatric Psychology, 24, 415–422.
within-child protective factors in preschool children. McLearn, K.T., Knitzer, J., & Carter, A.S. (in press).
Devereux: Institute of Clinical Training and Res- Mental health: A neglected partner in the healthy
earch. Retrieved June 10, 2003, from http://www. development of young children. In E. Festschrift (Ed.),
devereuxearlychildhood Child development and social policy: Knowledge for
Lerner, R.M. (1991). Changing organism-context action. American Psychological Association.
relations as the basic process of development: A Meisels, S.J. (1989). Meeting the mandate of Public Law
developmental context perspective. Developmental 99-457: Early childhood intervention in the nineties.
Psychology, 27, 27–32. American Journal of Orthopsychiatry, 59, 451–460.
Liaw, F., & Brooks-Gunn, J. (1994). Cumulative Mouton-Simien, P., McCain, A.P., & Kelley, M.L. (1997).
familiar risks and low-birthweight children’s cognit- The development of the toddler behavior screening
ive and behavioral development. Journal of Clinical inventory. Journal of Abnormal Child Psychology, 25,
Child Psychology, 23, 360–372. 59–64.
Lochman, J. & Conduct Problems Prevention Research Mullen, E. (1995). The Mullen Scales of Early Learning.
Group. (1995). Screening of child behavior problems Circle Pines, MN: American Guidance Service.
for prevention programs at school entry. Journal of Murphy, J.M., Ichinose, C., Hicks, R.C., Kingdon, D.,
Consulting & Clinical Psychology, 63, 549–559. Crist-Whitzel, J., Jordan, P., Feldman, G., & Jellinek,
Loeber, R. (1990). Development and risk factors of M.S. (1996). Utility of the Pediatric Symptom Check-
juvenile antisocial behavior and delinquency. Clinical list as a psychosocial screen to meet the federal Early
Psychology Review, 10, 1–41. and Periodic Screening, Diagnosis, and Treatment
Lord, C., Risi, S., & Lambrecht, L. (2000). The Autism (EPSDT) standards: A pilot study. Journal of Pediat-
Diagnostic Observation Schedule – Generic: A stand- rics, 129, 864–869.
ard measures of social and communication deficits Newth, S.J., & Corbett, J. (1993). Behaviour and
associated with the spectrum of autism. Journal of emotional problems in three-year-old children of
Autism and Developmental Disorders, 30, 205–223. Asian parentage. Journal of Child Psychology and
Luby, J.L. (in press). Affective disorders. In R. Del Psychiatry, 34, 333–352.
Carmen & A. Carter (Eds.), Handbook of infant, Pinderhughes, E. (1989). Understanding race, ethnicity
toddler, and preschool mental health assessment. and power: The key to efficacy in clinical practice. New
New York: Oxford University Press. York: The Free Press.
Luby, J.L., Heffelfinger, A.K., & Mrakotsky, C. (2002). Radke-Yarrow, M., Nottelmann, E., Martinez, P., Fox,
Preschool major depressive disorder: Preliminary M.B., & Belmont, B. (1992). Young children of
validation for developmentally modified DSM-V cri- affectively ill parents: A longitudinal study of psycho-
teria. Journal of the American Academy of Child and social development. Journal of the American Academy
Adolescent Psychiatry, 41, 928–937. of Child and Adolescent Psychiatry, 31, 68–77.
Luby, J.L., Heffelfinger, A.K., & Mrakotsky, C. (2003). Regier, D.A., Goldberg, I.D., & Taube, C.A. (1978). The
The clinical picture of depression in preschool de facto US mental health services system: A public
children. Journal of the American Academy of Child health perspective. Archives of General Psychiatry,
and Adolescent Psychiatry, 42, 340–348. 35, 685–693.
Luby, J.L., & Morgan, K. (1997). Characteristics of an Rescorla, L. (1989). The Language Development Survey:
infant/preschool psychiatric clinic sample: Implica- A screening tool for delayed language in toddlers.
tions for clinical assessment and nosology. Infant Journal of Speech and Hearing Disorders, 54, 587–
Mental Health Journal, 18, 209–220. 599.
Marshall, E. (1998). Cultural anthropology: DNA stud- Rescorla, L. (2000). Do late-talking toddlers turn out to
ies challenge the meaning of race. Science, 282, 654– have reading difficulties a decade later? Annals of
655. Dyslexia, 50, 87–102.
Masten, A.S., & Coatsworth, J.D. (1995). Competence, Rescorla, L., & Achenbach, T.M. (2002). Use of the
resilience, and developmental psychopathology. In D. Language Development Survey (LDS) in a national
Cicchetti & D.J. Cohen (Eds.), Developmental psycho- probability sample of children 18 to 35 months of age.
pathology: Volume 2, Theory and methods (pp. 715– Journal of Speech, Language, and Hearing Research,
752). New York: John Wiley & Sons Inc. 45, 733–743.
Infant–toddler assessment 133

Richman, N., Stevenson, J.E., & Graham, P.J. (1975). Seifer, R. (2000). Temperament and goodness of fit:
Prevalence of behavior problems in 3-year-old chil- Implications for developmental psychopathology. In
dren: An epidemiological study in a London borough. A.J. Sameroff, M. Lewis, & S.M. Miller (Eds.), Hand-
Journal of Child Psychology and Psychiatry, 16, 277– book of developmental psychopathology (2nd edn,
287. pp. 257–276). New York: Kluwer Academic.
Richters, J.E. (1992). Depressed mothers as inform- Scheeringa, M.S. (in press). Posttraumatic stress disor-
ants about their children: A critical review of the der. In R. Del Carmen & A. Carter (Eds.), Handbook of
evidence for distortion. Psychological Bulletin, 112, infant, toddler, and preschool mental health assess-
485–499. ment. New York: Oxford University Press.
Robinson, J.L., Emde, R.N., & Korfmacher, J. (1997). Scheeringa, M.S., & Gaensbauer, T.J. (2000). Posttrau-
Integrating an emotional regulation perspective in a matic stress disorder. In C.H. Zeanah, Jr. (Ed.),
program of prenatal and early childhood home Handbook of infant mental health (pp. 369–381).
visitation. Journal of Community Psychology, 25, New York: Guilford Press.
59–75. Scheeringa, M.S., Peebles, C.D., Cook, C.A., & Zeanah,
Root, P.P.M. (1990). Resolving other status: Identity C.H. (2001). Toward establishing procedural, criter-
development of biracial individuals. Women and ion, and discriminant validity for PTSD in early
Therapy, 9, 185–205. childhood. Journal of the American Academy of Child
Rose, S.L., Rose, S.A., & Feldman, J.F. (1989). Stability and Adolescent Psychiatry, 40, 52–60.
of behavior problems in very young children. Devel- Scheeringa, M.S., & Zeanah, C.H. (1994). Posttraumatic
opment and Psychopathology, 1, 5–19. stress disorder semi-structured interview and obser-
Rosenberg, N.A., Pritchard, J.K., Weber, J.L., Cann, vational record for infants and young children (0–
H.M., Kidd, K.K., Zhivotovsky, L.A., & Feldman, M.W. 48 months). New Orleans, LA: Tulane University
(2002). Science, 298, 2381–2385. Health Sciences Center.
Rosenblatt, P. (1999). Multiracial families. In M. Lamb Scheeringa, M.S., & Zeanah, C.H. (in press). A rela-
(Ed.), Child development in nontraditional families tional perspective on PTSD in young children. Journal
(pp. 263–278). Mahwah, NJ: Lawrence Erlbaum. of Traumatic Stress.
Rutter, M. (1989). Isle of Wight revisited: Twenty-five Scheeringa, M.S., Zeanah, C.H., Drell, M.J., & Larrieu,
years of child psychiatric epidemiology. Journal of the J.A. (1995). Two approaches to the diagnosis of
American Academy of Child and Adolescent Psychi- posttraumatic stress disorder in infancy and early
atry, 28, 633–653. childhood. Journal of the American Academy of Child
Rutter, M., Tizard, J., Yule, W., Graham, P., & and Adolescent Psychiatry, 34, 191–200.
Whitmore, K. (1976). Research report: Isle of Wight Shaw, D.S., & Emery, R.E. (1988). Chronic family
Studies, 1964–1974. Psychology and Medicine, 6, adversity and school-age children’s adjustment. Jour-
313–332. nal of the American Academy of Child and Adolescent
Sameroff, A., & Chandler (1975). Transactional models Psychiatry, 27, 200–206.
in early social relations. Human Development, 18, Shaw, D.S., Winslow, E.B., Owens, E.B., Vondra, J.I.,
65–79. Cohn, J.F., & Bell, R.Q. (1998). The development of
Sameroff, A.J., Bartko, W.T., & Baldwin, A. (1998). early externalizing problems among children
Family and social influences on the development of from low-income families: A transformational per-
child competence. In M. Lewis & C. Feiring (Eds.), spective. Journal of Abnormal Child Psychology, 26,
Families, risk, and competence (pp. 161–185). Mah- 95–107.
wah, NJ: Lawrence Erlbaum. Shonkoff, J.P., & Phillips, D.A. (2000). From neurons to
Sameroff, A.J. (1995). General systems theories and neighborhoods: The science of early childhood devel-
developmental psychopathology. In Cicchetti, D., & opment. Washington, DC: National Academy Press.
Cohen, D.J. (Eds.), Developmental psychopathology, Siegel, B., Pliner, C., Eschler, J., & Elliott, G. (1988).
Vol. 1: Theory and methods (pp. 659–695). New York: How children with autism are diagnosed: Difficulties
John Wiley & Sons, Inc. in identification of children with multiple develop-
Sameroff, A.J. (2000). Dialectical processes in develop- mental delays. Journal of Developmental and Beha-
mental psychopathology. In A.J. Sameroff, M. Lewis, vioral Pediatrics, 9, 199–204.
& S.M. Miller (Eds.), Handbook of developmental Sparrow, S., Balla, D., & Cicchetti, D. (2001). Social
psychopathology (2nd edn, pp. 23–40). New York: Emotional Early Childhood Scales (SEEC) manual.
Kluwer Academic. Circle Pines, MN: American Guidance Service.
Sameroff, A.J., & Emde, R.N. (1989). Relationship Sparrow, S., Balla, D., & Cicchetti, D. (1984). Vineland
disturbances in early childhood: A developmental Adaptive Behavior Scales: Expanded form manual.
approach. New York: Basic Books. Circle Pines, MN: American Guidance Service.
Sameroff, A.J., Seifer, R., Baldwin, A., & Baldwin, C. Sparrow, S., Carter, A.S., Racusin, G.R., & Morris, R.
(1993). Stability of intelligence from preschool to (1995). Comprehensive psychological assessment
adolescence: The influence of social and family risk through the life span: A developmental approach. In
factors. Child Development, 64, 80–97. D. Cicchetti & D.J. Cohen (Eds.), Developmental
Sameroff, A.J., Seifer, R., & McDonough, S.C. (in press). psychopathology, Vol. 1: Theory and methods (pp.
Contextual contributors to the assessment of infant 81–105). New York: John Wiley & Sons, Inc.
mental health. In R. Del Carmen & A. Carter (Eds.), Spitzer, R.L., Endicott, J., & Robins, E. (1978).
Handbook of infant, toddler, and preschool mental Research diagnostic criteria. Archives of General
health assessment. Oxford University Press. Psychiatry, 35, 773–782.
134 Alice S. Carter, Margaret J. Briggs-Gowan, and Naomi Ornstein Davis

Squires, J., Bricker, D., & Potter, L. (1997). Revision of (Eds.), Key words in multicultural interventions: A
a parent-completed developmental screening tool: dictionary (pp. 82–83). Westport, CT: Greenwood.
Ages and Stages Questionnaires. Journal of Pediatric US Public Health Service. (2000). Report of the Surgeon
Psychology, 22, 313–328. General’s Conference on Children’s Mental Health: A
Squires, J., Bricker, D., & Twombly, E. (2002a). Ages & National Action Agenda. Washington, DC: Depart-
Stages Questionnaires: Social-Emotional, A parent ment of Health and Human Services.
completed, child-monitoring system for social-emo- van de Vijver, F., & Leung, K. (1997). Methods and data
tional behaviors. Baltimore, MD: Paul H. Brookes analysis for cross-cultural research. Thousand Oaks,
Publishing Co., Inc. CA: Sage Publications.
Squires, J., Bricker, D., & Twombly, E. (2002b). The Wakschlag, L.S., & Danis, B. (in press). Assessment of
ASQ:SE user’s guide. Baltimore, MD: Paul H. Brookes disruptive behavior in young children: A clinical-
Publishing Co., Inc. developmental framework. In R. Del Carmen & A.
Sroufe, A.L. (1990). An organizational perspective on Carter (Eds.), Handbook of infant, toddler, and
the self. In D. Cicchetti & M. Beeghly (Eds.), The self preschool mental health assessment. Oxford Univer-
in transition: Infancy to childhood (pp. 281–307). sity Press.
Chicago: University of Chicago Press. Weston, D.R., Thomas, J.M., Barnard, K.E., Wieder, S.,
Stallard, P. (1993). The behaviour of 3-year-old chil- Clark, R., Carter, A.S., & Fenichel, E. (2003). DC:0–3
dren: Prevalence and parental perception of problem Assessment Protocol Project: Defining a comprehen-
behaviour: A research note. Journal of Child Psycho- sive information set to support DC:0–3 diagnostic
logy and Psychiatry, 34, 413–421. formulation. Infant Mental Health Journal, 24, 410–
Stipek, D., Recchia, S., & McClintic, S. (1992). Self- 427.
evaluation in young children. Monographs of the Winnicott, D.W. (1965). The maturational process and
Society for Research in Child Development, 57, Mono the facilitating environment. New York: International
226. Universities Press.
Sue, D.W., & Sue, D. (2003). Counseling the culturally Zeanah, C.H. (2000). (Ed.). Handbook of infant mental
diverse: Theory and practice (4th edn). New York: health (2nd edn). New York, Guilford Publications.
Wiley. Zeanah, C.H., Boris, N.W., & Larrieu, J.A. (1997). Infant
Suyemoto, K.L., & Dimas, J.M. (2003). Check one box development and developmental risk: A review of the
only. In J.S. Mio & G.Y. Iwamasa (Eds.), Culturally past 10 years. Journal of the American Academy of
diverse mental health: The challenges of research and Child and Adolescent Psychiatry, 36, 165–78.
resistance (pp. 55–81). New York: Brunner-Routledge. Zeanah, C.H., Keener, M.A., & Anders, T.F. (1986).
Task Force on Research Diagnostic Criteria: Infancy Developing perceptions of temperament and their
and Preschool (in press). Research diagnostic criteria relation to mother and infant behavior. Journal of
for infants and preschool children: The process and Child Psychology and Psychiatry, 27, 499–512.
empirical support. Journal of the American Academy Zero to Three. (1994). Diagnostic classification: 0–3:
of Child and Adolescent Psychiatry. Diagnostic classification of mental health and devel-
Thomas, J.M., & Guskin, K.A. (2001). Disruptive opmental disorders in infancy and early childhood.
behavior in young children: What does it mean? Washington, DC: Zero to Three.
Journal of the American Academy of Child and Zimmerman, I.L, Steiner, V.G., & Pond, R.E. (2002).
Adolescent Psychiatry, 40, 44–51. Preschool Language Scale, fourth edition (PLS-4) Eng-
Thompson, M.J.J., Stevenson, J., Sonuga-Barke, E., lish edition. San Antonio, TX: The Psychological
Nott, P., Bhatti, Z., Price, A., & Hudswell, M. (1996). Corporation.
Mental health of preschool children and their mothers Zuckerman, B., Moore, K.A., & Glei, D. (1996). Associa-
in a mixed urban/rural population. I. Prevalence and tion between child behavior problems and frequent
ecological factors. British Journal of Psychiatry, 168, physician visits. Archives of Pediatric and Adolescent
16–20. Medicine, 150, 146–153.
Tomlinson-Clarke, S. (1999). Culture. In J.S. Mio, J.E.
Trimble, P. Arredondo, H.E. Cheatham, & D. Sue Manuscript accepted 10 September 2003

S-ar putea să vă placă și