Sunteți pe pagina 1din 17

Archives of Clinical Neuropsychology 25 (2010) 157–173

Impairment in Occupational Functioning and Adult ADHD: The


Predictive Utility of Executive Function (EF) Ratings Versus EF Tests
Russell A. Barkley 1,*, Kevin R. Murphy 2

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


1
Department of Psychiatry, Medical University of South Carolina and SUNY Upstate Medical University, Mt Pleasant, SC, USA
2
Adult ADHD Clinic of Central Massachusetts, Northborough, MA, USA
*Corresponding author at: Department of Psychiatry, Medical University of South Carolina, 1752 Greenspoint Ct., Mt Pleasant, SC 29466, USA.
Tel./fax: þ1-843-971-8323.
E-mail address: drbarkley@russellbarkley.org (R.A. Barkley).
Accepted 2 February 2010

Abstract
Attention deficit hyperactivity disorder (ADHD) is associated with deficits in executive functioning (EF). ADHD in adults is also associ-
ated with impairments in major life activities, particularly occupational functioning. We investigated the extent to which EF deficits assessed
by both tests and self-ratings contributed to the degree of impairment in 11 measures involving self-reported occupational problems,
employer reported workplace adjustment, and clinician rated occupational adjustment. Three groups of adults were recruited as a function
of their severity of ADHD: ADHD diagnosis (n ¼ 146), clinical controls self-referring for ADHD but not diagnosed with it (n ¼ 97), and
community controls (n ¼ 109). Groups were combined and regression analyses revealed that self-ratings of EF were significantly predictive
of impairments in all 11 measures of occupational adjustment. Although several tests of EF also did so, they contributed substantially less
than did the EF ratings, particularly when analyzed jointly with the ratings. We conclude that EF deficits contribute to the impairments in
occupational functioning that occur in conjunction with adult ADHD. Ratings of EF in daily life contribute more to such impairments than do
EF tests, perhaps because, as we hypothesize, each assesses a different level in the hierarchical organization of EF as a meta-construct.

Keywords: Adult ADHD; Executive functioning (EF); EF ratings; EF tests; Occupational impairment

Introduction

A growing body of evidence suggests that attention deficit hyperactivity disorder (ADHD) consists of more than just its
primary diagnostic symptoms of inattention, impulsiveness, and often hyperactivity (American Psychiatric Association,
2001). Theorists now argue that symptoms of deficient executive functioning (EF) may also be involved in the disorder
(Barkley, 1997, 1997/2001; Castellanos, Sonuga-Barke, Milham, & Tannock, 2006). Meta-analyses of EF tests in ADHD
also find significant deficits on most of the tests used to assess traditional EF constructs at the group level of analysis (com-
parisons of means), particularly in tasks involving response inhibition and working memory, especially in manipulative rather
than merely storage and recall aspects of working memory (Boonstra, Oosterlaan, Sergeant, & Buitelaar, 2005; Frazier,
Demareem, & Youngstrom, 2004; Hervey, Epstein, & Curry, 2004; Martinussen, Hayden, Hogg-Johnson, & Tannock,
2005). Greater deficits are found in tests of nonverbal than verbal working memory (Martinussen et al., 2005).
Research on EF deficits in ADHD routinely relies upon tests of EF as the primary source for determining the existence of EF
deficits (Biederman et al., 2006; Boonstra et al., 2005; Hervey et al., 2004; Jonsdottir, Bouma, Sergeant, & Scherder, 2006;
Wilcutt, Doyle, Nigg, Faraone, & Pennington, 2005). In the case of adult ADHD, such research often finds these deficits in
group comparisons of mean scores, suggesting that ADHD is in fact a disorder of EF. But research examining these deficits
at the individual level of analysis (such as percent impaired or abnormal on the test) reports that EF deficits exist in just a min-
ority (30% – 50%) of cases (Biederman et al., 2006; Nigg, Wilcutt, Doyle, & Sonuga-Barke, 2005). Moreover, such deficits on
EF tests are usually only weakly related to severity of ADHD symptoms, if at all (Barkley, Murphy, & Fischer, 2008; Jonsdottir

# The Author 2010. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oxfordjournals.org.
doi:10.1093/arclin/acq014 Advance Access publication on 2 March 2010
158 R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173

et al., 2006). On the basis of such evidence some researchers have concluded that ADHD involves only a minority of cases that
may have EF deficits (Nigg et al., 2005; Wilcutt et al., 2005). Some cases or types of ADHD may be associated with non-EF
neuropsychological deficits, such as problems with motivation or an energetic pool of arousal (Sergeant, 2005; Wilcutt et al.,
2005). Others go further and assert that ADHD is not a disorder of EF at all (Boonstra et al., 2005; Jonsdottir et al., 2006;
Marchetta, Hurks, Krabbendam, & Jolles, 2008). Either of these conclusions may be correct. However, both of these assertions
hinge on an unquestioned premise—that EF tests are the gold standard or most valid indicators of the presence of EF deficits.
This presumption is problematic for various reasons, not the least of which is that the definition of EF is quite ambiguous
with little or no consensus among researchers (Castellanos et al., 2006). Some assert that the essence of the construct of EF is
the cross-temporal organization of behavior to achieve future goals (Fuster, 1997) or the maintenance of problem-solving sets
toward those goals (Welsh & Pennington, 1988). If that is so, then it is not clear how EF tests are sampling this conceptual
domain. Those tests involve an exceptionally limited time window over which testing occurs (5– 30 min each) and their

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


content is not directly indicative of cross-temporal organization or maintenance of problem-solving toward goals. A further
problem is that most EF tasks are complex, involving multiple cognitive processes, only some of which are supposedly reflect-
ing the EF intended (Anderson, 2002; Castellanos et al., 2006). Such tests are often found to be significantly influenced by the
level of intelligence as well (Mahone et al., 2002) making their results difficult to interpret as reflecting pure measures of a
particular EF construct.
Most troubling from a clinical perspective is that EF tests have low or no ecological validity when judged against ratings of
EF in daily life or direct observations of EF performance in natural settings. Past studies found EF tests to have low-order cor-
relations that are often nonsignificant with patient self-ratings and those of significant others of the dysexecutive symptoms
they observe in patients with frontal lobe injuries (Burgess, Alderman, Evans, Emslie, & Wilson, 1998; Chaytor,
Schmitter-Edgecombe, & Burr, 2006; Wood & Liossi, 2006). Research using parent and teacher ratings of EF in children
with frontal lobe lesions, traumatic brain injuries (TBI), or other neurological or developmental disorders also find low or
no significant relationships between EF ratings and EF tests (Anderson, Anderson, Northam, Jacobs, & Milkiewicz, 2002;
Mangeot, Armstrong, Colvin, Yeates, & Taylor, 2002; Vriezen & Pigott, 2002). These studies typically find that the variance
shared between any single EF test and EF ratings ranges from just 0% to 10%. Combinations of EF tests do not fair much better,
sharing just 12% – 20% of the variance with EF ratings. When IQ is covaried out of these results, even those significant relation-
ships between EF tests and EF ratings may become nonsignificant (Mangeot et al., 2002) in keeping with studies suggesting
that non-EF cognitive processes permeate EF tests. Likewise, when researchers directly observe the performance of frontal lobe
injured patients in tasks in daily life, they find no relationship between impaired EF test performance and impairment in daily
life activities presumed to involve EF (Mitchell & Miller, 2008). In contrast, studies of both autistic children and children with
TBI have found moderate and significant relationships of EF ratings to measures of daily adaptive functioning (Gilotty,
Kenworthy, Sirian, Black, & Wagner, 2002; Mangeot et al., 2002). The constructs evaluated by EF tests are apparently not
those assessed by EF ratings or by direct evaluations of EF in daily life (Alderman, Burgess, Knight, & Henman, 2003;
Shallice & Burgess, 1991).
Of all the domains of major life activities expected to be influenced by EF, adult occupational functioning would be
expected to be one of those given its heavy emphasis on the need for the cross-temporal organization and maintenance of be-
havior and problem-solving toward goals across days, weeks, or even months. Effective performance at work requires the
capacity for self-management relative to time (time management), self-organization planning and problem-solving, self-
activation, and self-motivation to sustain the pursuit of larger delayed consequences over smaller more immediate ones
(deferred gratification), among other activities, that are presumed to be facilitated by the EFs.
Increasing evidence indicates that adult ADHD is associated with various problems in occupational functioning. ADHD
(hyperactive) children followed to adulthood are found to rank significantly lower than control groups in occupational
status, to have significantly worse job performance ratings from employers, and to be more likely fired from employment
and to be so more often (Barkley et al., 2008). Clinic-referred adults diagnosed with ADHD have been found to be more
likely to be unemployed, to have been fired from employment, to have impulsively quit a job, to use more sick leave, to
have applied for or be on disability pensions, to have changed jobs impulsively more often, and to have more chronic employ-
ment problems (De Quiros & Kinsbourne, 2001; Halmoy, Fasmer, Gillberg, & Haavik, 2009; Murphy & Barkley, 1996).
Adults with ADHD also appear to have more dysfunctional career beliefs, more decision-making confusion, and greater work-
related anxiety and external conflict regarding their careers (Painter, Prevatt, & Welles, 2008). Epidemiological studies
(de Graaf et al., 2008) likewise found that adults with ADHD had significantly more days “out of role” or under-productive,
had more than twice the risk of absence due to sickness, and more than twice the risk of workplace accidents than other working
adults. They estimated the increased cost per ADHD worker to be $4,336 per year, not including the cost of the accidents. It is
clear that ADHD in adults is associated with myriad problems in occupational history and current functioning. Yet, no research
to date to our knowledge has examined the degree to which the EF deficits associated with ADHD in adults might contribute to
R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173 159

their occupational problems. This paper attempted to do so using both EF tests and EF ratings in view of the evidence discussed
above that each approach may be measuring quite different aspects of EF and so may contribute quite differently to those occu-
pational difficulties.
Our EF tests were selected to assess the most commonly listed constructs involved in EF, as noted above, yet in a reasonable
amount of time given the extensive battery of other measures being collected in the project (see Barkley et al., 2008). The
battery included measures of response inhibition, maintenance of attention, resistance to distraction, set shifting and rule devel-
opment, nonverbal working memory, and verbal working memory. This battery does not provide a comprehensive or exhaus-
tive coverage of all constructs that have been attributed to EF, such as planning and problem-solving and
emotional-motivational self-regulation. But it does provide some coverage of most of the EF constructs previously found to
be deficient in reviews of EF tests in ADHD.
In summary, this paper examined the contribution of EF deficits to occupational functioning in adults who ranged in severity

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


of ADHD symptoms, from those meeting full diagnostic criteria, to those referred for the disorder but falling short of such
criteria, and to those in a general community control group. The second aim of this paper was to evaluate the relative
merits of EF ratings and EF tests in predicting impairment in occupational functioning. In view of the problems with the eco-
logical validity of EF tests noted above, we hypothesized that EF ratings would be more predictive of occupational problems
than EF tests.

Materials and Methods

Participants

Three groups of participants were combined in this paper: (1) ADHD: 146 adults clinically diagnosed with ADHD;
(2) clinical control group: 97 adults evaluated at the same clinic but not diagnosed with ADHD; and (3) community control
group: 109 adult volunteers from the local community. These samples have been described in considerably greater
detail elsewhere (Barkley et al., 2008). Both the ADHD and clinical control adults were obtained from consecutive referrals
to an adult ADHD Clinic in a Department of Psychiatry at a major medical school. The community control adults were
obtained from advertisements posted throughout the medical school lobbies and from periodic newspaper ads in the regional
newspaper.
To be eligible, all subjects had to have an IQ of 80 or higher on the Shipley Institute of Living Scale. They also had to have
no evidence of: Deafness, blindness, or other significant sensory impairment; significant and obvious brain damage or neuro-
logical injury, or epilepsy; significant language disorders that would interfere with comprehension of verbal instructions in the
protocol; a chronic and serious medical condition, such as diabetes, thyroid disease, cancer, heart disease; a childhood history
of mental retardation, autism, or psychosis. To be placed in the ADHD group, clinic-referred participants had to meet the
DSM-IV criteria for ADHD, excepting the age of onset criterion, as judged by an experienced clinical psychologist using a
structured interview for ADHD (see below). Participants in the clinical control group were those evaluated at this same
clinic who did not receive a clinical diagnosis of ADHD.
No precise age of onset of symptoms producing impairment was required for placement within the ADHD group as one
purpose of this grant funded project was to examine the value of specifying various age ranges of onset for the diagnosis
of ADHD in adults. Also, the results of prior studies do not support the validity of the age of onset of 7 years currently included
in the DSM-IV diagnostic criteria for ADHD, especially when applied to adults (Barkley & Biederman, 1997; Barkley et al.,
2008). All had the onset of their symptoms prior to age 21 and the mean age of onset was 7 years (median ¼ 6 years).
Typically, we require corroboration of ADHD symptoms and impairment from someone else who knows the person well,
such as parents, siblings, or spouses/partners, as part of making a clinical diagnosis of ADHD. We did not do so here
though we did collect such information for most participants. This permitted us to specifically examine the degree of agreement
between those sources and the participants concerning their ADHD symptoms and EF. Of the 146 adults assigned to the ADHD
group, 30 were inattentive types (20%), 6 were residual (4%), and 110 were combined types (76%) by clinician diagnosis.
The clinical control group comprised patients referred to this same adult ADHD clinic but not clinically diagnosed as having
ADHD. The primary diagnoses given by the clinician to members of this group were varied but comprised the following: 43%
anxiety disorders, 15% drug use disorders, 12% mood disorders, 4% learning disorders, 4% partner relationship problems, 4%
adjustment disorders, 1% personality disorders, 1% ODD, and 17% no diagnosis.
The community control group consisted of relatively normal adults drawn from the local region via advertisements. To be
eligible for this group, they must have met the criteria noted earlier for all participants. In addition, they had to have a score on
the Adult ADHD Rating Scale (see below) based on current symptoms (by self-report) “below” the 84th percentile (within
þ1 SD of mean) for their age (using norms reported in Barkley & Murphy, 2006). They also had to be free of any ongoing
160 R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173

medication for treatment of a medical condition or psychiatric disorder that could be judged to interfere with the measures to be
collected here.
As we previously reported (reference withheld for blind review), the selection criteria were successful in selecting groups of
patients that differed significantly from each other in severity of their ADHD symptoms for the interview-based assessment of
symptoms, for both self- and other rated current ADHD symptoms and impairments, and for both self- and other rated child-
hood symptoms of ADHD and impairments (see Rating Scales and ADHD Interview below for these instruments). In all
instances, the ADHD group was significantly more severe than the clinical control group, which was significantly more
severe than the community control group.
The age of our ADHD group (M ¼ 32.4, SD ¼ 10.9) was significantly younger than the other two groups, by an average of 4
years from the community control group (M ¼ 36.4, SD ¼ 12.0) and 5 years from the clinical control group (M ¼ 37.8, SD ¼
13.2), F ¼ 6.78; p ¼ .001. The ADHD group had significantly less education (M ¼ 14.2 years, SD ¼ 2.2) than the two control

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


groups (clinical control M ¼ 16.3, SD ¼ 2.8; community M ¼ 15.4, SD ¼ 2.7), F ¼ 15.05, p , .001; the community group
also had significantly less education than the clinical control group (p , .05). The lower education of the ADHD group is con-
sistent with prior research on the impact of ADHD on the educational outcomes of adults diagnosed with ADHD and of chil-
dren with ADHD followed to adulthood (Barkley et al., 2008, chapter 9). The groups did not differ in their IQ scores (Shipley
Institute of Living Scale; ADHD: M ¼ 106, SD ¼ 8.8; clinical: M ¼ 109, SD ¼ 8.8; community: M ¼ 108, SD ¼ 7.9), F ¼
2.79, p ¼ NS. But the clinical group (M ¼ 54.1, SD ¼ 31.3) had a significantly higher occupational index than the other
two groups (ADHD: M ¼ 38.2, SD ¼ 26.8; community: M ¼ 42.3, SD ¼ 26.7), F ¼ 64.93, p , .001, who did not differ
from each other on the Hollingshead Index of Social Position (Hollingshead, 1975). The groups did not differ in the
percent who were currently employed (ADHD ¼ 73%, clinical control ¼ 71%, and community control ¼ 77%). The sex com-
position of the groups was: ADHD ¼ 68% men and 32% women; clinical control ¼ 56% men and 44% women; and commu-
nity control ¼ 47% men and 53% women. The groups differed significantly in this composition (x 2 ¼ 11.60, p ¼ .003) with
the ADHD group having a significantly higher composition of men than the two control groups. This finding is in keeping with
many studies of children and adults with ADHD that demonstrate a greater representation of the disorder in men than women
(Barkley, 2006; Kessler et al., 2006). As for the ethnic composition of the groups, 94% of each group identified themselves as
of European American (White) descent. Such group differences in certain demographic and other characteristics are less
important to the present paper given that the groups are being combined in order to study the contribution of EF deficits to
impairment.
Concerning current psychiatric medication treatment status, 17% of the ADHD group, 30% of the clinical control group, and
none of the community control group were on medication. To evaluate the potential effect that medication status may have had
on ADHD severity, we compared those ADHD cases that were on medication to those not on medication in the following
measures reflecting severity of their disorder: The frequency of their ADHD symptoms from the interview, their age of
onset, the number of domains of impairment from the interview, the number of childhood ADHD symptoms (interview),
the total score for ADHD symptoms from self-ratings in adulthood and in childhood, self-rated impairment total scores on
these same scales, the total score for ADHD symptoms from ratings provided by others for both current and childhood behav-
ior, and the total impairment scores provided by others for both current and childhood functioning. None of these comparisons
were significant (p-values ¼ .13– .91; specific detailed analyses are available upon request from the first author). We conducted
the same analyses for those patients in the clinical control group who were currently on medication and who were not. Again,
no differences were significant (p-values ¼ .11– .99; specific detailed analyses are available upon request from the first author).
We therefore were reasonably confident that the small proportion of patients in these two groups currently taking medication
would not bias our results by significantly reducing the severity of their ADHD-related symptoms (the independent variable of
interest). If it were to do so, however, the bias would likely make the study a more conservative one by reducing differences
between the two clinical groups and the community control group. We therefore combined the medicated and unmedicated
patients in each clinical group and combined all of the groups together for all subsequent analyses done in this paper.

Procedures

After contacting a project staff member, all participants were scheduled for their initial diagnostic interview with the second
author and IQ screening test administered by a Master’s level psychological assistant. That interview was a structured interview
of ADHD diagnostic criteria, including symptoms, onset, and impairment that was designed for our research projects on adult
ADHD. These steps were done to determine eligibility for participation in any of the three groups. All eligible participants then
signed written statements of informed consent as approved by the medical school institutional review board and were scheduled
for their subsequent evaluation in this project on a separate date following this initial screening. This latter evaluation com-
prised the completion of a structured interview concerning various impairments in multiple domains of major life activities
R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173 161

including demographic information, educational and work history, current and prior psychiatric treatment, driving history,
money management, drug use and abuse, dating and marital history, and antisocial activities. The participants also completed
several behavior rating scales, academic achievement testing, and neuropsychological testing. For some patients, their sche-
dules necessitated that this testing be continued into an additional day. Following the evaluation, all participants were paid
$100 for their participation. Significantly others were paid $20 each for the forms we requested that they complete.
The vast majority of the results concerning the comparisons of these groups on the various measures collected in this project
have been reported previously (Barkley et al., 2008). The present paper focuses on information not previously reported con-
cerning relative utility of EF ratings compared with EF tests to predict impairment in the measures of occupational history and
functioning.

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


Measures Used to Define the Groups

Adult ADHD Symptoms Scale. All participants initially completed this scale as part of the initial determination of ADHD
symptom (Barkley & Murphy, 2006). This rating scale contains the items from the DSM-IV criteria for ADHD with each
item answered on a 4-point scale (0– 3) using the response format of not at all, sometimes, often, and very often. We obtained
these same ratings for current functioning from someone who knew the patient well, usually a parent (44% – 67% of each
group), spouse or cohabiting partner (30% – 53%), or less often, a sibling (3% per group). The groups did not differ from
each other in these percentages. An earlier DSM-III-R version of the current symptoms scale also correlated significantly
with the same scale completed by a parent (r ¼ .75) and completed by a spouse or intimate partner of the ADHD adult
(r ¼ .64; Murphy & Barkley, 1996). Agreement in the present project between participants and others who knew them well
on this scale was .70 (p , .001) for the total ADHD symptoms score. This compares favorably with the results of another
study on adults that found an inter-agreement correlation of .69 (Murphy & Schachar, 2000).

Structured clinical interview for ADHD. This is a paper-and-pencil interview consisting of the criteria from the DSM-IV for
ADHD (Barkley & Murphy, 2006). This interview was employed by an experienced clinician during the initial interview with
participants as part of the selection criteria used for identifying the groups as ADHD or not. Symptoms of ADHD were
reviewed twice, once for current functioning (past 6 months) and a second time for childhood between with the requirement
that the symptom only be endorsed if it occurs often or more frequently. The onset of symptoms was also obtained in this inter-
view. Inter-judge reliability (agreement) on this structured interview for ADHD DSM-IV criteria was established in this
project. This interview by this same expert clinician was audio taped. Approximately 11% (41) of these tapes were randomly
sampled and received a blinded independent review by another expert to determine if the subjects’ responses to this
DSM-based interview met DSM criteria (as amended for onset, see above). Agreement between the two judges on whether
or not the DSM-IV criteria for ADHD were met was 85.3% (kappa ¼ .712, Approx. T b ¼ 4.76, p , .001).

Shipley Institute of Living Scale. This short intelligence test served as a measure of IQ (Shipley, 1946). It is comprised of a
40-item vocabulary test and 20 items assessing abstract thinking. The composite IQ score correlates well with other measures
of intelligence (Zachary, 1988) and was employed here as a screening criterion for intellectual level as part of the study entry
criteria.

Measures Used to Establish Impairment

Structured Clinical Interview of Impairments. For this project, we created an interview consisting of highly specific questions
dealing with various domains of major life activities, including educational history, occupational history, antisocial activities,
drug use, driving, money management, and dating and marital history. This interview was administered by a psychological
technician holding a master’s degree in psychology and trained in the evaluation of clinic-referred adults. The questions
dealing with occupational history are the focus of this paper. Those questions dealt with: (1) the number of jobs held since
leaving high school, (2) a rating of overall current work quality (5-point Likert scale), and (3) the number of jobs from
which they had been fired, (4) on which they had trouble getting along with others, (5) on which they had trouble with
their own behavior, (6) which they had quit due to boredom, (7) which they had quit due to hostility with their employer,
and (8) which they had been formally disciplined due to substandard work. Because participants varied in the number of
jobs they had held to date since leaving high school, the measures (3) through (8) above were converted to percentages of
the total number of jobs held to date.
162 R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173

Employer Rating Scale. We also obtained ratings from the employers of our participants who were willing to grant such
permission (Barkley & Murphy, 2006). Employers were kept blinded to the diagnosis of the participants. This employer
scale contained questions about ADHD and oppositional deficit disorder symptoms and about any impairment in 10
domains of work activities, these being: Relations with coworkers, relations with supervisors, relations with clients or custo-
mers, completing assigned work, educational activities, punctuality, meeting deadlines, operating equipment, operating
vehicles, managing daily responsibilities. Both the ratings of ADHD symptoms and the impairment ratings were answered
using a Likert scale of 0 –3 (rare to very often). The employer also provided an overall work performance rating using a
1 – 5 Lickert scale (1 ¼ excellent to 5 ¼ poor). Only the overall rating of impairment (the sum across all the impairment
items) and overall work performance rating were used here.
We had such ratings on 39 of the ADHD group (27%), 25 of the clinical control group (26%), and 50 of the community
control group (46%). With each group, we compared those on whom we had employer ratings to those without such ratings

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


on age, sex, ethnic group, education, total current ADHD symptoms, age of onset of ADHD symptoms, the total number of
domains they reported as being impaired, their total childhood ADHD symptoms retrospectively recalled, and the clinician
Social and Occupational Functioning Assessment Scale (SOFAS) rating (see below). No differences were found in the
ADHD or community control group on any of these measures (all ps ..05; detailed analyses are available upon request
from the first author). Within the clinical control group, the only difference was that we had employer ratings on a larger pro-
portion of women than participants without such ratings. All other comparisons were not significant. With this one exception, it
appears that the subsets of each group on whom we obtained employer ratings are representative of their larger group in demo-
graphic factors and ADHD severity.

Social and Occupational Functioning Assessment Scale. The SOFAS provides a clinician a means to rate functioning on a
scale from 1 (grossly impaired) to 100 (superior or excellent functioning) based on the individual’s social, occupational,
and educational functioning (Patterson & Lee, 1995). Impairment is to be based on the totality of the patient’s current function-
ing mental and not a result of lack of opportunity or other environmental limitations. Descriptors are provided at each 10-point
markers on the scale to guide clinicians in making this rating. For instance, a score of 10 is indicated if the patient has “per-
sistent inability to maintain minimal personal hygiene, or unable to function without harming self or others or without con-
siderable external support (e.g., nursing care and supervision).” In contrast, a score of 70 would be given if there is “some
difficulty in social, occupational, or school functioning but generally functioning well; has some meaningful interpersonal
relations.”

Measures Used to Predict Impairment: EF Rating Scale

Deficits in EF Scale. The scale consists of 88 items with each item being answered on a 0 – 3 Likert scale (0 ¼ rarely or not at
all, 1 ¼ sometimes, 2 ¼ often, and 3 ¼ very often). The scale has two versions for collecting self- and other-reports. Creation
of the item pool and scale construction is explained in the paper by Barkley and Murphy (2009). An original pool of 91 items
was created to capture the nature of EF deficits in the constructs of behavioral inhibition, nonverbal working memory and sense
of time, verbal working memory and rule following, emotional, motivational, and arousal self-regulation, and planning and
problem-solving. The DSM-IV symptoms of ADHD were specifically excluded from this scale to permit an evaluation of
the relationships of the EF dimensions with ADHD symptom dimensions. The eventual set of 88 items was found to form
five-dimensions of executive dysfunctions using factor analysis: Self-Management to Time (23 items), Self-Organization
and Problem-Solving (21 items), Self-Discipline (inhibition—23 items), Self-Motivation (11 items), and Self-Activation
and Concentration (10 items).
We previously reported significant differences among these three groups on all five scales of both versions (Barkley &
Murphy, 2009). The ADHD group was rated as having more severe executive dysfunction mean scores on all five scales com-
pared with both the clinical and community control groups, with the clinical group also being rated worse than the community
group. About 89% – 94% of the ADHD group fell in the clinically impaired range (þ1.5 SD above the mean of the community
group) across these five scales as did 84% – 98% of the clinical control group and just 7% – 11% of the community group. This
indicates very little overlap in the distributions of these two clinic-referred groups with the community control group.
The relationship of the self- to other ratings was established based on all participants collapsed across groups. They were:
Self-Management to Time ¼ .79 (p , .001), Self-Organization ¼ .66 (p , .001), Inhibition Problems ¼ .74 (p , .001),
Self-Motivation ¼ .69 (p , .001), and Self-Activation/Concentration ¼ .75 (p , .001). This illustrates a reasonably satisfac-
tory level of agreement between participants and others who know them well. The correlations of severity of ADHD symptom
ratings to deficits in EF scale (DEFS) dimensional scores were: Self-Management to Time ¼ .91 and .71 (p , .001; inattention,
hyperactive-impulsive, respectively), Self-Organization ¼ .80 and .68 (p , .001), Inhibition Problems ¼ .85 and .84 (p ,
R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173 163

.001), Self-Motivation ¼ .83 and .71 (p , .001), and Self-Activation/Concentration ¼ .87 and .80 (p , .001). These relation-
ships are substantial implying sizeable shared variance between the ADHD and EF constructs if not colinearity (essentially
assessing the same constructs). Four of the five scales were not significantly correlated with IQ in this study (rs ranging
from .03 to .10) but IQ was correlated with a small but significant degree with the Self-Organization/Problem-Solving scale
(r ¼ .15, p ¼ .007, n ¼ 342).

Measures Used to Predict Impairment: EF Tests

Conners Continuous Performance Test. This is a standardized computer-administered continuous performance test in which
single letters are shown on a display screen at three different rates: one every second, one every 2 s, or one every 4 s (Conners,
1995). The task lasts 12 min. The variation in inter-stimulus interval allows the examination of this variable on the participant’s

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


performance. The task used a response format that is the reverse of most Continuous Performance Tests (CPTs). The participant
presses a button in response to every signal shown but then must cease or inhibit their responding when the target signal
appears. Norms are available for this CPT from the publisher (Multi-Health Systems). The dependent measures employed
here were the total number of omissions (missed targets), total commissions (false hits), reaction time (RT), and RT variability.
The scores for omissions and RT variability were chosen to assess sustained attention, whereas the scores for commissions and
RT were chosen to assess response inhibition in view of prior factor analyses of these tests that reflect such factor loadings
(Murphy, Barkley, & Bush, 2001). We previously reported the group differences on this test (reference withheld for blind
review) where we found the ADHD group to be significantly worse than the community control group on all scores and
worse than the clinical control group on Omission errors and RT variability.

Stroop Color-Word Test. This test measures the ability to inhibit competing responses in the presence of salient conflicting
information (Stroop, 1935; Trenerry, Crosson, Deboe, & Leber, 1989). We employed it here as our measure of resistance to
distraction, a form of inhibition often included in the concept of EF. The version and norms published by Trenerry and col-
leagues (1989) were used here. The task is comprised of three parts. In the first part, the participant reads a repeating list of
color names (e.g., red, blue, green) printed in black ink. In the second part, the participant names the colors of a repeated
series of Xs printed in an ink of those same colors. In the last or interference condition, the participant must say the color
of ink in which a color word is printed. For some words, the color of ink in which it is printed is the same as that of the
word, whereas for others, the color of ink differs from that specified by the word. This portion of the task is believed to
reflect problems with the capacity to inhibit habitual or dominant responses (reading the word, in this case). Three scores
were derived from this last portion of the test (Interference): The raw scores for the number of items completed and the
number of incorrect responses, as well as the percentile score. We previously reported the group comparisons on this test
(Barkley et al., 2008) where we found just the ADHD group to differ from the community group. Only the percentile score
was used here.

Wisconsin Card Sort Test. This test comprises 128 cards each containing sets of geometric designs that vary according to color,
shape, and number (Heaton, 1981). The subject is given four cards and then asked to sort the remaining deck using feedback
from the examiner. Following 10 correct sorts on a given category (e.g., color), the examiner switches the category unan-
nounced and the subject must now discover the new sorting rule from feedback given by the examiner. Although many
scores can be derived, we used just the four scores for percent errors, percent perseverative errors, percent concepts, and cat-
egories achieved score. These served as our measures of set shifting and rule development. We previously reported the com-
parisons among these groups on this test (none were significant; reference withheld for blind review).

Five-Point Test of Design Fluency. Originally developed by Regard, Strauss, and Knapp (1982) as a nonverbal version of more
commonly used verbal working memory and fluency tasks, this test involves a sheet of paper with 40 five-dot matrices on it
(Lee et al., 1997). Participants are required to produce as many different figures as possible by connecting the dots within each
rectangle within a 3-min time limit. Not all dots have to be used and only straight lines between dots are permitted. No figures
are to be repeated. If a violation occurs, participants are given a single warning on the first violation but the rules are not
repeated after any further infractions. Scores are the number of unique designs created, the number of repeated designs (per-
severation), the number of rule infractions, and the percentage of designs which are repeated designs (percent perseveration).
Patients with frontal lobe dysfunction have a significantly higher percentage of perseverative errors than do neurological
patients without frontal involvement and psychiatric patients (Lee et al., 1997). Using a modified version of this same task,
Ruff, Allen, Farrow, Nieman, and Wylie (1994) also found the task to be sensitive to frontal lobe injuries and perhaps is
more sensitive to right than left lobe involvement. Here, we used just the measure of number of unique designs generated
164 R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173

in the task as our measure of nonverbal working memory. We have previously reported significant group differences on this test
score among these three groups (Barkley et al., 2008).

Learning and Memory Battery. This battery contains nine separate tests involving verbal learning, verbal memory, and non-
verbal memory (Multi-Health Systems, Inc., 1995). A number of test scores are derived from these various tests (at least 3 per
test) but most reflect learning and memory retention. We found significant group differences for most of the memory retention
scores from this test and have reported the group differences for this entire test battery elsewhere (Barkley et al., 2008). Here,
we used just the Digit Span (total forward and backward score) as our index of verbal working memory. Each digit string is
presented twice with recall attempted after each presentation. In the first task, they must recall the digit sequence as presented.
In the second task, they must recall the digit sequences read to them in backward order. Again each sequence is presented
twice. In our earlier comparisons of these groups on this specific subtest, we found the ADHD group to perform worse

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


than both the clinical and community groups who did not differ from each other.

Results

Predicting Occupational Impairment from DEFS

Using the same samples as in the present study, we previously reported specific difficulties in occupational functioning
associated with adults with ADHD in comparison to both clinical and community control groups (Barkley et al., 2008).
More members of both the ADHD and clinical control groups had problems getting along with others at work (30%, 18%,
and 7%, respectively) and had difficulties with their behavior or work performance on the job (53%, 50%, and 5%, respect-
ively). Adults with ADHD reported having trouble with others, behavior problems at work, being fired or dismissed from a job,
quitting a job out of boredom, and being disciplined by their supervisor on the job in a higher percentage of the jobs they had
held than did participants in both the clinical and the community control groups. Those adults with ADHD also had quit more
jobs over their own hostility in the workplace than did adults in the community group. Despite being blind to the diagnoses of
our participants, employers rated the adults with ADHD as having significantly greater problems with inattention in the work-
place than was the case for either control group. Compared with either control group of adults, the adults with ADHD were
rated as being more impaired by their symptoms in performing assigned work, pursuing educational activities at work,
being punctual, using good time management, and managing their daily responsibilities. As a consequence, the adults with
ADHD were rated as having a poorer overall work performance level than were adults in either of the control groups.
Here, we examined the utility of the DEFS subscales in predicting these occupational difficulties using all participants. We
used linear multiple regression analyses (SPSS version 17.0) with IQ forced into the equation at Step 1 to remove any potential
relationship it may share with the DEFS and occupational measures. The DEFS were then allowed to enter stepwise at Step 2 if
their contribution was significant (p , .05). Given the significant agreement noted above between the self-ratings and those
provided by others on the DEFS, and to save space, we report here only the analyses using the self-ratings. The results for
the self-ratings on the DEFS are displayed in Table 1. IQ was not significantly related to 10 of the 11 occupational measures
but was significantly associated with the percentage of jobs participants had quit due to hostility with their employer.
It is clear from Table 1 that the Self-Organization scale was not related to any occupational measures. The Self-Activation/
Concentration scale was associated with just the clinician SOFAS rating. In contrast, problems with Self-Management to Time,
Inhibition, and Self-Motivation were predictive of five measures each, though not necessarily the same occupational measures.
In fact, most occupational measures were predicted by just a single DEFS subscale. The strongest relationships were between
the DEFS and the clinician rated SOFAS score, where three of the DEFS accounted for 63% of the variance in that clinician
rating. For the remaining occupational measures, the amount of variance accounted for by the DEFS that contributed to any
particular measure ranged from 5% to 22% in total.

Prediction of Occupational Impairments Using EF Tests

Again linear regression was used to examine the contribution of the EF tests to these same occupational measures forcing IQ
in at Step 1 and allowing the EF tests to enter at Step 2 in a stepwise fashion if their contribution was significant (p , .05).
These results are shown in Table 2. Most of the EF tests made no significant contribution to these occupational measures. No
EF test made a significant contribution to the percentage of jobs from which a participant had been fired. Most of the remaining
occupational measures were predicted by just one EF test that being the Commission Errors on the CPT. Its contributions
ranged from 1.6% (percent of jobs on which the participant was disciplined for substandard work) to 12.9% of variance
(SOFAS rating). The 5-Point Test score for number of unique designs contributed significantly to three measures, these
R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173 165

Table 1. Predicting occupational measures from the DEFS (self-ratings)

Outcome/predictors Beta R R2 R 2D F p

Number of jobs held since high school


IQ 2054 .065 .004 .004 1.10 NS
Inhibition .231 .240 .057 .053 14.52 ,.001
Self-rated quality of work
IQ .032 .063 .004 .004 0.80 NS
Self-motivation .366 .370 .137 .133 31.21 ,.001
Percent of jobs had trouble getting along with
others
IQ 2.094 .109 .012 .012 3.18 NS
Inhibition .363 .379 .143 .131 40.35 ,.001

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


Percent of jobs had trouble with own behavior
or work performance
IQ 2.071 .041 .002 .002 0.43 NS
Self-management to time .268 .459 .211 .209 67.33 ,.001
Inhibition .227 .475 .225 .014 4.73 .031
Percent of jobs from which were fired
IQ 2.092 .059 .004 .004 0.90 NS
Self-motivation .250 .255 .065 .061 16.75 ,.001
Percent of jobs quit due to hostility with
employer
IQ 2.149 .160 .026 .026 6.75 .010
Inhibition .279 .321 .103 .078 22.18 ,.001
Percent of jobs quit due to boredom
IQ 2.034 .019 .000 .000 0.09 NS
Self-motivation .248 .248 .062 .061 16.64 ,.001
Percent of jobs in which disciplined for
substandard work
IQ 2.103 .069 .005 .005 1.21 NS
Self-management to time .257 .264 .069 .065 17.82 ,.001
Employer rated impairment score
IQ 2.054 .036 .001 .001 0.09 NS
Self-management to time .234 .236 .056 .054 4.09 .047
Employer rated overall work performance
IQ 2.149 .166 .028 .028 2.45 NS
Self-motivation .386 .420 .177 .149 15.38 ,.001
Clinician SOFAS rating
IQ .121 .095 .009 .009 2.41 NS
Self-management to time 2.408 .775 .601 .592 392.37 ,.001
Self-activation and concentration 2.228 .790 .624 .024 16.72 ,.001
Inhibition 2.189 .794 .631 .007 4.84 .029
Notes: Beta ¼ standardized beta coefficient; R ¼ regression coefficient; R 2 ¼ percent of explained variance accounted for by all variables at this step; R 2D
(change) ¼ percent of explained variance accounted for by this variable added at this step; F ¼ F to change results; p ¼ probability value for the F-test;
NS ¼ not significant; EF ¼ executive function; SOFAS ¼ Social and Occupational Functioning Assessment Scale; DEFS ¼ Deficits in Executive
Functioning Scale. Analyses are for linear multiple regression with forced entry of IQ at Step 1 and stepwise entry of EF scales at Step 2. Self-rated work
performance and employer rated work performance were rated as 1 (excellent) to 5 (very poor).

being, employer rated impairment (7%), employer rated work performance (7.5%), and the clinician SOFAS rating (3.7%). RT
from the CPT made a small but significant contribution to two of the occupational measures: The number of jobs held since
leaving high school (1.7% of variance) and the clinical SOFAS rating (2.8%). As with the DEFS, the greatest contribution
made by any EF tests were to predicting the clinician SOFAS rating (21.2% of variance). For the remaining occupational
measures, the EF tests contributed 1.6% –18.6% of the variance.

Prediction of Occupational Impairments Using Both DEFS Subscales and EF Tests

Given the small and often nonsignificant relationship between the DEFS and EF tests reported previously (Barkley &
Murphy, 2009), it is likely that much of the contribution made by one method (rating scales) to these occupational measures
is not redundant with that made by the other (tests). We therefore examined the extent to which the EF tests and ratings
166 R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173

Table 2. Predicting occupational measures using the EF tests

Outcome/predictors Beta R R2 R 2D F p

Number of jobs held since high school


IQ 2.118 .104 .011 .011 2.74 NS
CPT RT .130 .165 .027 .017 4.24 .041
Self-rated quality of work
IQ .053 .035 .001 .001 0.23 NS
CPT Commission Errors .262 .264 .069 .068 14.31 ,.001
Percent of jobs had trouble getting along
with others
IQ 2.038 .060 .004 .004 0.93 NS
CPT Commission Errors .217 .224 .050 .047 12.56 ,.001

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


Percent of jobs had trouble with own behavior or
work performance
IQ 2.042 .076 .006 .006 1.42 NS
CPT Commission Errors .328 .335 .112 .107 29.54 ,.001
Percent of jobs from which were fired
IQ .088 .088 .008 .008 1.93 NS
No EF tests predicted this measure
Percent of jobs quit due to hostility with employer
IQ 2.212 .225 .051 .051 13.34 ,.001
CPT Commission Errors .131 .261 .068 .017 4.53 .034
Percent of jobs quit due to boredom
IQ 2.055 .071 .005 .005 1.25 NS
CPT Commission Errors .166 .180 .032 .027 6.95 .009
Percent of jobs in which disciplined for
substandard work
IQ 2.051 .064 .004 .004 1.04 NS
CPT Commission Errors .127 .142 .020 .016 4.05 .045
Employer rated impairment score
IQ .045 .062 .004 .004 0.30 NS
Five-Point Test Unique Designs 2.285 .271 .073 .070 5.63 .020
Employer rated overall work performance
IQ 2.020 .153 .024 .024 2.10 NS
Five-Point Test Unique Designs 2.274 .315 .099 .075 7.21 .009
CPT Commission Errors .228 .386 .149 .050 4.95 .029
Clinician SOFAS rating
IQ .050 .133 .018 .018 4.75 .030
CPT commissions errors 2.470 .384 .147 .129 39.74 ,.001
Five-Point Test Unique Designs .199 .429 .184 .037 11.77 .001
CPT hit RT 2.211 .460 .212 .028 9.27 .003

Notes: Beta ¼ standardized beta coefficient; R ¼ regression coefficient; R 2 ¼ percent of explained variance accounted for by all variables at this step; R 2D
(change) ¼ percent of explained variance accounted for by this variable added at this step; F ¼ F to change results; p ¼ probability value for the F-test;
NS ¼ not significant; EF ¼ executive function; SOFAS ¼ Social and Occupational Functioning Assessment Scale; CPT ¼ Conners Continuous
Performance Test; DEFS ¼ Deficits in Executive Functioning Scale; RT ¼ reaction time. Analyses are for linear multiple regression with stepwise entry.
Self-rated work performance and employer rated work performance were rated as 1 (excellent) to 5 (very poor). Predictors tested in the analyses of the
DEFS were its 5 subscale scores. Predictors tested in the analysis for the EF tests were: CPT Commission Errors, CPT omissions errors, CPT RT, CPT RT
variability, 5-Point Test number of unique designs, Digit Span Total (Learning and Memory Battery), Stroop Color-Word Test Interference Score,
Wisconsin Card Sort errors, perseverative errors, concepts, categories achieved, and failures to maintain set.

contributed uniquely to the prediction of these same occupational impairments when examined jointly. We did not use IQ in
these analyses given that it did not contribute significantly to the vast majority of the occupational measures in the analyses
conducted above. Once more, we used multiple linear regression in which we first entered all five DEFS jointly at Step 1
and then all EF tests jointly at Step 2. We then conducted these same analyses using the reverse order of entry of these two
assessment batteries. We employed this battery-wise entry method in order to evaluate the total contribution made by one
approach to EF against that made by the totality of the other approach in predicting occupational problems. The results
appear in Table 3.
Entering the DEFS subscales first and then the EF tests, the findings indicated that the DEFS subscales made a significant
contribution to 10 of the 11 occupational measures while the EF tests contributed significant and additional unique variance to
R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173 167

Table 3. Predicting occupational measures using all subscales of the deficits in EF Scale (DEFS self-ratings) and all EF Tests in two orders of entry

Outcome/(step)predictors R R2 R 2D F p

Number of jobs held since high school


(1) DEFS .314 .099 .099 4.24 .001
(2) EF Tests .406 .087 .066 1.20 NS
(1) EF Tests .258 .067 .067 1.11 NS
(2) DEFS .406 .165 .098 4.26 .001
Self-rated quality of work
(1) DEFS .407 .165 .165 6.12 ,.001
(2) EF Tests .511 .261 .095 1.53 NS
(1) EF Tests .378 .143 .143 2.04 .025
(2) DEFS .511 .261 .118 4.54 .001

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


Percent of jobs had trouble getting along
with others
(1) DEFS .410 .168 .168 8.05 .001
(2) EF Tests .459 .211 .043 0.84 NS
(1) EF Tests .297 .088 .088 1.55 NS
(2) DEFS .459 .211 .123 5.81 ,.001
Percent of jobs had trouble with own
behavior or work performance
(1) DEFS .479 .229 .229 11.37 ,.001
(2) EF Tests .573 .329 .099 2.21 .013
(1) EF Tests .432 .187 .187 3.53 ,.001
(2) DEFS .573 .329 .142 7.56 ,.001
Percent of jobs from which were fired
(1) DEFS .291 .085 .085 3.56 .004
(2) EF Tests .351 .123 .038 0.65 NS
(1) EF Tests .218 .047 .047 0.77 NS
(2) DEFS .351 .123 .076 3.11 .010
Percent of jobs quit due to hostility
with employer
(1) DEFS .347 .120 .120 5.28 ,.001
(2) EF Tests .392 .153 .033 0.59 NS
(1) EF Tests .251 .063 .063 1.04 NS
(2) DEFS .392 .153 .090 3.86 .002
Percent of jobs quit due to boredom
(1) DEFS .306 .093 .093 3.96 .002
(2) EF Tests .375 .141 .047 0.82 NS
(1) EF Tests .271 .074 .074 1.22 NS
(2) DEFS .375 .141 .067 2.81 .018
Percent of jobs in which disciplined for
substandard work
(1) DEFS .282 .080 .080 3.34 .006
(2) EF Tests .384 .147 .068 1.19 NS
(1) EF Tests .309 .095 .095 1.63 NS
(2) DEFS .384 .147 .052 2.21 NS
Employer rated impairment score
(1) DEFS .366 .134 .134 1.67 NS
(2) EF Tests .634 .402 .268 1.57 NS
(1) EF Tests .533 .284 .284 1.56 NS
(2) DEFS .634 .402 .117 1.65 NS
Employer rated overall work performance
(1) DEFS .522 .272 .272 4.79 .001
(2) EF Tests .677 .458 .186 1.49 NS
(1) EF Tests .503 .253 .253 1.61 NS
(2) DEFS .677 .458 .205 3.95 .004
Clinician SOFAS rating
(1) DEFS .819 .671 .671 83.86 ,.001
(2) EF Tests .830 .689 .019 0.97 NS

(continued on next page)


168 R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173

Table 3. (continued)
Outcome/(step)predictors R R2 R 2D F p

(1) EF Tests .490 .241 .241 5.25 ,.001


(2) DEFS .830 .689 .449 55.98 ,.001
Notes: R ¼ regression coefficient; R 2 ¼ percent of explained variance accounted for by all variables at this step; R 2D (change) ¼ percent of explained variance
accounted for by this variable added at this step; F ¼ F to change results; p ¼ probability value for the F-test; SOFAS ¼ Social and Occupational Functioning
Assessment Scale; DEFS ¼ Deficits in Executive Functioning Scale; EF ¼ executive function; CPT ¼ Conners’ Continuous Performance Test; RT ¼ reaction
time. Analyses are for linear multiple regression with stage-wise entry: All EF scales were entered initially at Step 1 and then all EF tests at Step 2 followed by
analyses in which the reverse order of entry was used. Self-rated work performance and employer rated work performance were rated as 1 (excellent) to 5 (very
poor). Predictors tested in the analyses were the 5 subscale scores of the DEFS self-ratings and the following EF tests: CPT Commission Errors, CPT omissions
errors, CPT RT, CPT RT variability, 5-Point Test number of unique designs, Digit Span Total (Learning and Memory Battery), Stroop Color-Word Test

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


Interference Score, Wisconsin Card Sort Test (WCST) percent errors, percent perseverative errors, concepts, and categories achieved.

just 1 of those 11 occupational measures. The DEFS contributed 8% – 27% of the variance to these measures of workplace
adjustment and 67% of the variance in the clinician SOFAS rating. Although not significant in their contributions to most
impairment measures, the EF tests contributed 2% – 27% additional variance but just 2% to the clinician SOFAS rating.
The EF tests appear to provide little additional significant variance beyond that contained in the EF ratings for most of
these occupational measures. Interestingly, both the EF ratings and the EF tests contributed substantially to employer rated
impairment (40% of the variance) and work performance (46% of the variance) but neither contribution reached significance
due to the small samples on which we had employer ratings. This argues for replicating these results with larger samples that
may result in these results becoming significant.
When the order of entry was reversed, with EF tests being entered first followed by EF ratings, the EF tests now contributed
to just three occupational measures (self-rated work quality, percent jobs quit due to problems with own behavior, clinician
SOFAS rating); but this is two more than that was found above for the opposite order of entry. In contrast, the DEFS subscales
contributed to nine occupational measures with just one measure now becoming nonsignificant. In sum, although it does appear
that EF tests do contribute to a few of the occupational impairment measures, the EF ratings capture most of that contribution as
well, contribute to the majority of such measures, and usually contribute more unique variance to them than do the EF tests.

Discussion

This study set out to determine the contribution of EF to impairment in occupational functioning. A secondary aim was an
examination of the relative utility of the two different methods of assessing EF (ratings vs. tests) in their capacity to predict
such impairment. When examined individually and apart from the EF tests, self-ratings on the DEFS subscales were found
to contribute significantly to all 11 occupational impairment measures, including self-rated work quality, the percentage of
jobs on which these adults had experienced various behavioral and interpersonal problems or had been fired, employer
ratings of overall work performance and impairment across a variety of work contexts, and clinician ratings of social and occu-
pational adjustment on the SOFAS. Three DEFS were especially useful in these predictions, these being Self-Discipline
(Inhibition), Self-Management to Time, and Self-Motivation with each contributing to five different occupational measures.
The amount of variance in the occupational impairment measures accounted for by the DEFS ranged from just 5% to 22%
except for the prediction of the clinician SOFAS rating (63%). These results indicate that EF as assessed by ratings of
daily life activities makes some contribution to occupational impairments.
In comparison, when examined individually and apart from the EF ratings, just three EF test scores (two tests) made sig-
nificant contributions to the occupational measures, the two most frequent being CPT Commission Errors and the 5-Point Test
Unique Designs score. The first is typically interpreted as a measure of inhibition and contributed to various occupational
impairments related to behavior, interactions with others, boredom, and hostility as well as to the number of jobs held
since high school. It is understandable why problems with behavioral inhibition might contribute to such occupational diffi-
culties. The CPT hit RT score is also viewed as a measure of response inhibition given its loading on the same factor as
CPT Commission Errors in previous factor analyses (Murphy et al., 2001). It likewise contributed to the number of jobs
held by our participants. These findings are also consistent with the findings above from the DEFS that problems with inhi-
bition, or self-discipline, in daily life contribute to these same occupational difficulties.
The second EF test of any utility was a measure of nonverbal working memory and fluency—the 5-Point Test. It made sep-
arate contributions to several occupational measures, specifically from the employer rating scale: Employer rated workplace
impairment and work performance quality. These results are consistent with current views that working memory may
R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173 169

contribute to some of the inattention symptoms seen in ADHD (Barkley, 1997/2001) and thus to workplace problems related to
inattention. Nonverbal working memory may be more impaired in ADHD than verbal working memory (Martinussen et al.,
2005) and thus may contribute more to inattention in ADHD which may explain the utility here of a nonverbal working
memory test to predict workplace problems possibly associated with inattention.
When the EF ratings and tests were examined jointly to evaluate their unique contributions to the occupational measures, the
EF ratings contributed significantly to 10 of the 11 occupational measures when entered first and to 9 of them when entered
second in the regression analyses. The greatest of these contributions was to the clinician SOFAS rating where they explained
45% – 67% of the variance depending on the order of entry. The contribution of the EF tests when entered second after the EF
ratings was not significant on 10 of the 11 measures. But it did contribute to a small degree (10% additional variance) to the
percentage of jobs on which the individual had difficulties with their own behavior and work performance. Recall that this was
the only occupational measure related to IQ and so it may be the involvement of IQ in the EF tests that led to this contribution.

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


When the EF tests were entered first, they contributed to just two additional occupational measures, whereas the EF ratings
continued to contribute unique variance to the majority of those measures. These results suggest that a few EF tests add
some unique variance to the prediction of occupational adjustment beyond that contribution predicted by EF ratings, but
the contribution is relatively small. EF ratings, in contrast, predict significant variance in the majority of occupational adjust-
ment measures and often do so beyond that variance captured by EF tests. We hypothesized that EF tests would show substan-
tially weaker relationships with our various measures of occupational impairment than would the EF ratings. This hypothesis
was confirmed. If predicting occupational impairment is an important aspect of the validity of EF measures, then EF ratings
were superior to EF tests in doing so. These findings also agree with the study by Mitchell and Miller (2008) that found that EF
tests were only modestly related to both ratings and observations of daily functional activities.
These results provide further support for our earlier contention that EF tests should not be viewed as the only standard of
evidence for establishing the presence of EF deficits, particularly in ADHD as prior research has stated or implied (Biederman
et al., 2006, 2008; Boonstra et al., 2005; Hervey et al., 2004; Jonsdottir et al., 2006; Nigg et al., 2005; Wilcutt et al., 2005). As
reported elsewhere (Barkley & Murphy, 2009), EF deficits are present in the vast majority of adults with ADHD (89% –98%)
when ratings of EF in daily life activities are used. Thus, where weak or no EF test deficits are found in those having ADHD
relative to control groups or are not significantly related to ADHD severity, this should not be taken to indicate that EF deficits
are not part of or related to ADHD, as some have concluded (Boonstra et al., 2005; Jonsdottir et al., 2006; Marchetta et al.,
2008; Wilcutt et al., 2005). Deficits may not be apparent in tests evaluating EF while being ubiquitous using ratings. And
if predicting impairment in major life activities is evidence of validity, then EF ratings are far superior to EF tests in doing
so. Thus, although neither method alone should serve as the gold standard for determining the presence of EF deficits, EF
ratings may be taken to have greater validity at predicting impairment in daily life activities, and particularly occupational
adjustment.
Our results, however, should not be taken to mean that EF tests may not be valuable for assessing certain features of EF. We
assert this despite the numerous concerns we have raised about these tests as the best indices of the construct of EF and despite
their limited predictive utility concerning impairments studied here. Although there appears to be uniformity of opinion that the
construct of EF is broad and comprises multiple components (Castellanos et al., 2006), we believe that the nature of EF is also
multileveled and hierarchical. Regardless of its definitional ambiguity, EF, like the prefrontal cortex that largely facilitates it, is
most likely organized in a hierarchical system that allows smaller sequences of behavior to become clustered into more
complex, nested sets of larger goal-directed actions that are sustained over longer intervals of time (Badre, 2008). And
those complex behavioral sets can be further arranged into even larger nested meta-sets to accomplish even longer term
and larger goals spanning days, weeks, months, or even years (Botvinick, 2008).
This hierarchical functional organization of the prefrontal lobes is highly consistent with the view that the EFs largely
created by those lobes must likewise be hierarchically organized. The EFs should comprise increasingly higher and larger
levels of behavioral organization with each comprised of longer and more varied and complex goal-directed actions. In our
view, the nature of EF is likely to be similar to that of driving a motor vehicle that involves not only multiple cognitive pro-
cesses at a basic level, but also several hierarchically organized levels of abilities (basic cognitive, instrumental, tactical, and
strategic). Research on driving, like that on EF, has shown little or no relationship between clinic-based evaluations of basic
cognitive abilities known to be necessary but not sufficient for driving (vision, RT, inhibition, motor coordination) or even
simulator-based assessments of driving and measures of tactical and strategic driving levels involved in actually driving in
real-world situations, such as may be measured by ratings or direct observations of actual driving behavior. And such basic
cognitive clinic-based tests have little or no association with measures of adverse driving outcomes (citations, accidents;
Barkley, Murphy, DuPaul, & Bush, 2002). These results can arise when measures of the lowest level of a complex and multi-
level domain are necessary, yet not sufficient, to represent higher level functions or abilities utilized in daily life situations and
done to meet strategic goals.
170 R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173

EF likewise can be conceptualized as not just involving multiple components at a basic instrumental neurocognitive level as
is likely assessed by EF tests, but also involving higher levels of more complex behavioral organization at a tactical level (daily
activities, immediate social goals). And those tactical actions may be further organized upward into even more complex actions
and for larger goals that can be considered a strategic level of EF (longer term social, economic, occupational, and other goals
spanning weeks, months, and even years). Above this level may be one of ultimate utility that encompasses the individual’s
long-term welfare and achievements that is likely reflected in measures of impairment that capture the long-term consequences
of EF deficits at the lower levels.
At each new level of this hierarchy additional abilities and skills come into play that are not represented in lower levels and
yet contribute to mastering and effectively performing executively at that and higher levels of EF. Therefore, one should not be
surprised that basic measures of more proximal, short-term instrumental EF constructs (EF tests) have little relationship with
the tactical or strategic level of EF as represented in ratings of EF ascertained across months. It should also not be puzzling that

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


such basic EF tests make little contribution to the ultimate outcomes of EF as indexed indirectly by impairment in domains of
major life activities that span years of EF utilization (occupational, driving, financial, social, marital, educational, etc.) and are
three levels or more removed in this hierarchy. All this is to say that the purpose of choosing any method for the assessment of
EF should be dictated by the purpose of the research or clinical undertaking in contrast to pitting measures of EF against each
other as if all assessed the same level.
The limitations of this study should be considered in evaluating the foregoing results and interpretations. First, our study is
limited by the method used to create the EF scale. It is possible that had other items of EF been generated besides the 91 we
tested additional dimensions of EF deficits might have been unearthed. Yet, we believe our initial efforts were sufficiently com-
prehensive to provide a first broad pass at determining the possible nature of EF deficits as evaluated by rating scales. It was
certainly more comprehensive, theory-based, and empirically constructed than the brief 20-item EF scale created in the study
by Burgess and colleagues (1998). Earlier findings (Barkley & Murphy, 2009) also suggest that no matter what narrowband
subscales of particular EF deficit studies may identify, such dimensions are highly inter-correlated and imply the possibility
that there is a single over-arching meta-construct of EF shared across all these dimensions.
A second limitation was the relatively circumscribed battery of EF tests used here to assess the various constructs believed to
characterize EF. Had other tests of these constructs been used or had additional constructs, such as planning and
problem-solving, been assessed, some differences in these results might have been evident. However, other studies that
have used the DEFS and examined its relationship with an entirely different battery of EF constructs did include such tests
of planning and problem-solving as well as different measures of response inhibition and working memory. Those measures
were collected at the adult follow-up of children with ADHD followed to adulthood and the study found very similar results to
those discussed earlier—that being little or no relationship between EF ratings and those EF tests (Barkley & Fischer, 2010).
Thus, we believe that the relatively poorer showing of EF tests to predicting impairment here is not entirely a consequence of
our selection of these EF tests.
A third limitation may have occurred in the occupational impairment measures we derived from self-reports of work history
that may be affected by recall biases and other influences that may make them less than accurate in reflecting the actual employ-
ment problems experienced by these participants. We tried to overcome this by also obtaining the reports of employers about
current workplace problems and performance but could only get consent to do so for a subset of participants. This does not
completely eliminate the problems with the historical nature of the self-reported information. We also did not measure
other problems in the workplace, such as actual productivity, use of sick leave, and workplace accidents that have been
found to be associated with ADHD in adults in earlier studies (de Graaf et al., 2008). Our employer rating scale can only
be considered a relatively crude index of actual workplace problems that might have been revealed by more thorough or
detailed workplace measures or direct observations of working. But such measures can be highly intrusive into the occupations
of research participants and cannot be undertaken easily or lightly in conducting research with psychiatric patients. As an initial
attempt to study occupational impairment, we felt that our employer rating scale offered minimal intrusiveness into the impor-
tant domain of work for our participants while still allowing us a cursory glimpse of their potential workplace problems.
A further limitation may have occurred in the procedure of collapsing the ADHD and clinical control groups in with the
community group to study the relationships among the EF measures and impairment measures. Such a heterogeneous grouping
would not be expected to resemble the distributions of these measures in a general population sample of adults, and the greater
range of scores and over-representation of extreme (clinical) cases may have inflated the size of the relationships obtained. This
would be expected to do as much for the EF tests as for the EF ratings and so would not necessarily account for the differences
we found between those measures in their predictive utility of impairments. Even so, we concede that these findings may not be
readily extrapolated to the general population or even to other clinical disorders not represented in the clinical samples used
here.
R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173 171

With these limitations in mind, this study found that EF deficits make a significant contribution to the occupational problems
of adults who vary as a function of the severity of their ADHD symptoms. It therefore seems to be the deficits in EF associated
with ADHD that are in part contributing to the workplace problems documented here and in past studies of adults with ADHD
and in children with ADHD followed to adulthood. In this regard, ratings of EF in daily life activities may be more predictive of
impairments in occupational history and current workplace functioning than are EF tests. These results and those of prior
studies indicate that these two methods of assessing EF are likely sampling different aspects and even different hierarchically
organized levels of EF. Consequently, neither should be taken alone as the sole index of the presence of EF deficits in various
clinical populations, and particularly in ADHD.

Funding

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


This research was supported by a grant to the first author from the National Institute of Mental Health (MH54509) while he
was at the University of Massachusetts Medical School. The preparation of this paper was also supported by a small grant to the
first author from Shire Pharmaceuticals. The opinions expressed here, however, do not necessarily represent those of the
funding institute or of Shire Pharmaceuticals.

Conflict of Interest

Dr. Barkley is a consultant/speaker for Eli Lilly, Shire, Novartis, Janssen-Ortho, Janssen-Cilag, and Medice. He has also
served as an expert witness for Lilly Canada. He receives product royalties from Guilford Publications, Jones and Bartlett,
ContinuingEdCourses.net, and J & K Seminars. Dr. Murphy receives product royalties from Guilford Publications.

Acknowledgements

We are exceptionally grateful to Tracie Bush for her assistance with the evaluation of the research participants in the study
and with their data entry. We also wish to thank Laura Montville for her administrative and data entry assistance and Thomas
Babcock, DO, for his comments on an earlier draft of this manuscript.

References

Alderman, N., Burgess, P. W., Knight, C., & Henman, C. (2003). Ecological validity a simplified version of the multiple errands shopping test. Journal of the
International Neuropsychological Society, 9, 31–44.
American Psychiatric Association (2001). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
Anderson, P. (2002). Assessment and development of executive function (EF) during childhood. Child Neuropsychology, 8, 71–82.
Anderson, V. A., Anderson, P., Northam, E., Jacobs, R., & Milkiewicz, O. (2002). Relationships between cognitive and behavioral measures of executive func-
tion in children with brain disease. Child Neuropsychology, 8, 231– 240.
Badre, D. (2008). Cognitive control, hierarchy, and the rostro-caudal organization of the frontal lobes. Trends in Cognitive Sciences, 12, 193– 200.
Barkley, R. A. (1997). Inhibition, sustained attention, and executive functions: Constructing a unifying theory of ADHD. Psychological Bulletin, 121, 65–94.
Barkley, R. A. (1997/2001). ADHD and the nature of self-control. New York: Guilford Press.
Barkley, R. A. (2006). Attention deficit hyperactivity disorder: A handbook for diagnosis and treatment (3rd ed). New York: Guilford Press.
Barkley, R. A., & Biederman, J. (1997). Towards a broader definition of the age-of-onset criterion for attention deficit hyperactivity disorder. Journal of the
American Academy of Child and Adolescent Psychiatry, 36, 1204– 1210.
Barkley, R. A., & Fischer, M. (2010). Predicting impairment in major life activities and occupational functioning in hyperactive children as adults:
Self-reported executive function (EF) deficits vs. EF tests. Developmental Neuropsychology, in press.
Barkley, R. A., & Murphy, K. R. (2006). Attention deficit hyperactivity disorder: A clinical workbook (3rd ed.). New York: Guilford.
Barkley, R. A., & Murphy, K. R. (2009). Evaluating executive function (EF) deficits in daily life activities with the Deficits in Executive Functioning Scale:
scale development and relationships with EF tests and severity of ADHD. Paper submitted for publication, Charleston, Medical University of South
Carolina.
Barkley, R. A., Murphy, K. R., Dupaul, G. I., & Bush, T. (2002). Driving in young adults with attention deficit hyperactivity disorder: Knowledge, performance,
adverse outcomes, and the role of executive functioning. Journal of the International Neuropsychological Society, 8, 655–672.
Barkley, R. A., Murphy, K. R., & Fischer, M. (2008). ADHD in adults: What the science says. New York: Guilford.
Biederman, J., Petty, C., Fried, R., Fontanella, J., Doyle, A. E., Seidman, L. J., et al. (2006). Impact of psychometrically defined deficits of executive function-
ing in adults with attention deficit hyperactivity disorder. American Journal of Psychiatry, 163, 1730–1738.
Biederman, J., Petty, C. R., Fried, R., Black, S., Faneuil, A., Doyle, A. E., et al. (2008). Discordance between psychometric testing and questionnaire-based
definitions of executive function deficits in individuals with ADHD. Journal of Attention Disorders, 12, 92–102.
Boonstra, A. M., Oosterlaan, J., Sergeant, J. A., & Buitelaar, J. K. (2005). Executive functioning in adult ADHD: A meta-analytic review. Psychological
Medicine, 35, 1097–1108.
Botvinick, M. M. (2008). Hierarchical models of behavior and prefrontal function. Trends in Cognitive Sciences, 12, 201–208.
172 R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173

Burgess, P. W., Alderman, N., Evans, J., Emslie, H., & Wilson, B. A. (1998). The ecological validity of tests of executive function. Journal of the International
Neuropsychological Society, 4, 547–558.
Castellanos, X., Sonuga-Barke, E., Milham, M., & Tannock, R. (2006). Characterizing cognition in ADHD: Beyond executive dysfunction. Trends in Cognitive
Science, 10, 117– 123.
Chaytor, N., Schmitter-Edgecombe, M., & Burr, R. (2006). Improving the ecological validity of executive functioning assessment. Archives of Clinical
Neuropsychology, 21, 217–227.
Conners, C. K. (1995). The Conners Continuous Performance Test. North Tonawanda, NY: Multi-Health Systems.
De Graaf, R., Kessler, R. C., Fayyad, J., ten Have, M., Alonso, J., Angermeyer, M., et al. (2008). The prevalence and effects of adult attention-deficit/hyper-
activity disorder (ADHD) on the performance of workers: Results from the WHO World Mental Health Survey Initiative. Occupational and Environmental
Medicine, 65 (12), 835.
De Quiros, G. B., & Kinsbourne, M. (2001). Adult ADHD: Analysis of self-ratings on a behavior questionnaire. In J. Wasserstein, L. Wolf, & F. Lefever (Eds.),
Adult attention deficit disorder: Brain mechanisms and life outcomes. Annals of the New York Academy of Sciences, 931, 140– 147.
Frazier, T. W., Demareem, H. A., & Youngstrom, E. A. (2004). Meta-analysis of intellectual and neuropsychological test performance in attention-deficit/

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018


hyperactivity disorder. Neuropsychology, 18, 543– 555.
Fuster, J. M. (1997). The prefrontal cortex. New York: Raven.
Gilotty, L., Kenworthy, L., Sirian, L., Black, D. O., & Wagner, A. E. (2002). Adaptive skills and executive function in autism spectrum disorders. Child
Neuropsychology, 8, 241–248.
Halmoy, A., Fasmer, O. B., Gillberg, C., & Haavik, J. (2009). Occupational outcome in adult ADHD: Impact of symptom profile, comorbid psychiatric pro-
blems, and treatment. Journal of Attention Disorders, 13, 175– 187.
Heaton, R. K. (1981). A manual for the Wisconsin Card Sorting Test. Odessa, TX: Psychological Assessment Resources.
Hervey, A. S., Epstein, J. N., & Curry, J. F. (2004). Neuropsychology of adults with attention-deficit/hyperactivity disorder: A meta-analytic review.
Neuropsychology, 18, 495–503.
Hollingshead, J. (1975). A four-factor index of social position. Yale University, New Haven, CT: Author.
Jonsdottir, S., Bouma, A., Sergeant, J. A., & Scherder, E. J. A. (2006). Relationship between neuropsychological measures of executive function and behavioral
measures of ADHD symptoms and comorbid behavior. Archives of Clinical Neuropsychology, 21, 383–394.
Kessler, R. C., Adler, L., Barkley, R. A., Biederman, J., Conners, C. K., Demler, O., et al. (2006). The prevalence and correlates of adult ADHD in the United
States: Results from the National Comorbidity Survey Replication. American Journal of Psychiatry, 163, 716– 723.
Lee, G. P., Strauss, E., Loring, D. W., McCloskey, L., Haworth, J. M., & Lehman, R. A. W. (1997). Sensitivity of figural fluency on the Five-Points Test to focal
neurological dysfunction. The Clinical Neuropsychologist, 11, 59– 68.
Mahone, E. M., Hagelthora, K. M., Cutting, L. E., Schuerholz, L. J., Pelletier, S. F., Rawlins, C., et al. (2002). Effects of IQ on executive function measures in
children with ADHD. Child Neuropsychology, 8, 52–65.
Mangeot, S., Armstrong, K., Colvin, A. N., Yeates, K., & Taylor, G. H. (2002). Long-term executive function deficits in children with traumatic brain injuries:
Assessment using the Behavior Rating Inventory of Executive Function (BRIEF). Child Neuropsychology, 8, 271– 284.
Marchetta, N. D. J., Hurks, P. P. M., Krabbendam, L., & Jolles, J. (2008). Interference control, working memory, concept shifting, and verbal fluency in adults
with attention-deficit/hyperactivity disorder (ADHD). Neuropsychology, 22, 74– 84.
Martinussen, R., Hayden, J., Hogg-Johnson, S., & Tannock, R. (2005). A meta-analysis of working memory impairments in children with attention-deficit/
hyperactivity disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 44, 377– 384.
Mitchell, M., & Miller, S. (2008). Executive functioning and observed versus self-reported measures of functional ability. The Clinical Neuropsychologist, 22,
471–479.
Multi-Health Systems, Inc. (1995). The learning and memory battery. North Tonawanda, NY: Author.
Murphy, K., & Barkley, R. A. (1996). ADHD in adults: Comorbidities and adaptive impairments. Comprehensive Psychiatry, 37, 393–401.
Murphy, K. R., Barkley, R. A., & Bush, T. (2001). Executive functioning and olfactory identification in young adults with attention deficit hyperactivity dis-
order. Neuropsychology, 15, 211– 220.
Murphy, P., & Schachar, R. (2000). Use of self-ratings in the assessment of symptoms of attention deficit hyperactivity disorder in adults. American Journal of
Psychiatry, 157.
Nigg, J. T., Wilcutt, E. G., Doyle, A. E., & Sonuga-Barke, J. S. (2005). Causal heterogeneity in attention-deficit/hyperactivity disorder: Do we need neurop-
sychologically impaired subtypes? Biological Psychiatry, 57, 1224– 1230.
Painter, C. A., Prevatt, F., & Welles, T. (2008). Career beliefs and job satisfaction in adults with symptoms of attention-deficit/hyperactivity disorder. Journal of
Employment Counseling, 45, 178– 188.
Patterson, D. A., & Lee, S. (1995). Field trial of the Global Assessment of Functioning Scale—Modified. American Journal of Psychiatry, 152, 1386– 1388.
Regard, M., Strauss, E., & Knapp, P. (1982). Children’s production on verbal and non-verbal fluency tasks. Perceptual and Motor Skills, 123, 17– 22.
Ruff, R. M., Allen, C. C., Farrow, C. E., Nieman, H., & Wylie, T. (1994). Figural fluency: Differential impairment in patients with left versus right frontal
lesions. Archives of Clinical Neuropsychology, 9, 41– 55.
Sergeant, J. A. (2005). Modeling attention-deficit/hyperactivity disorder: A critical appraisal of the cognitive-energetic model. Biological Psychiatry, 57,
1248– 1255.
Shallice, T., & Burgess, P. W. (1991). Deficits in strategy application following frontal lobe damage in man. Brain, 114, 727–741.
Shipley, W. C. (1946). The Shipley Institute of Living Scale. Los Angeles: Western Psychological Services, Inc.
Stroop, J. P. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18, 643–662.
Trenerry, M., Crosson, B., Deboe, J., & Leber, W. (1989). Stroop Neuropsychological Screening Test. Odessa, FL: Psychological Assessment Resources.
Vriezen, E. R., & Pigott, S. E. (2002). The relationship between parental report on the BRIEF and performance-based measures of executive function in chil-
dren with moderate to severe traumatic brain injury. Child Neuropsychology, 8, 296– 303.
Welsh, M. C., & Pennington, B. F. (1988). Assessing frontal lobe functioning in children: Views from developmental psychology. Developmental
Neuropsychology, 4, 199–230.
R.A. Barkley and K.R. Murphy / Archives of Clinical Neuropsychology 25 (2010) 157–173 173

Wilcutt, E. G., Doyle, A. E., Nigg, J. T., Faraone, S. V., & Pennington, B. F. (2005). Validity of the executive function theory of attention-deficit/hyperactivity
disorder: A meta-analytic review. Biological Psychiatry, 57, 1336– 1346.
Wood, R. L. I., & Liossi, C. (2006). The ecological validity of executive function tests in a severely brain injured sample. Archives of Clinical
Neuropsychology, 21, 429–437.
Zachary, R. A. (1988). Institute of Living Scale—revised manual. Los Angeles, CA: Western Psychological Services.

Downloaded from https://academic.oup.com/acn/article-abstract/25/3/157/3840 by guest on 16 November 2018

S-ar putea să vă placă și