Sunteți pe pagina 1din 10

Psychology of Addictive Behaviors © 2017 American Psychological Association

2017, Vol. 31, No. 8, 897–906 0893-164X/17/$12.00 http://dx.doi.org/10.1037/adb0000287

Contingency Management Treatment for Substance Use Disorders: How


Far Has It Come, and Where Does It Need to Go?

Nancy M. Petry and Sheila M. Alessi Todd A. Olmstead


University of Connecticut School of Medicine University of Texas-Austin

Carla J. Rash and Kristyn Zajac


University of Connecticut School of Medicine
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

Contingency management (CM) interventions consistently improve substance abuse treatment outcomes,
This document is copyrighted by the American Psychological Association or one of its allied publishers.

yet CM remains a highly controversial intervention and is rarely implemented in practice settings. This
article briefly outlines the evidence base of CM and then describes 4 of the most often-cited concerns
about it: philosophical, motivational, durability, and economic. Data supporting and refuting each of
these issues are reviewed. The article concludes with suggestions to address these matters and other
important areas for CM research and implementation, with the aims of improving uptake of this
efficacious intervention in practice settings and outcomes of patients with substance use disorders.

Keywords: behavioral treatments, contingency management, review, substance use disorders

Contingency management (CM) is a behavioral therapy, based sometimes hold negative views of this treatment and express
on operant conditioning principles, that provides tangible reinforc- concerns that it does not lead to long-term benefits. Implementa-
ers for evidence of behavior change. In the case of substance use tion into clinical practice has been slow, but is growing. This
disorders, it most often involves delivery of monetary-based rein- review initially summarizes the empirical evidence for CM and
forcers for submission of drug negative urine samples. Research on then describes the primary concerns about this treatment. It con-
this intervention dates back more than 30 years and consistently cludes by suggesting areas for future research and implementation
shows that CM improves drug abuse treatment outcomes (Higgins, efforts.
Silverman, & Heil, 2008; Petry, 2012). Importantly, CM is effi-
cacious for numerous substance use disorders, it can be imple-
Efficacy of CM
mented alongside virtually any platform psychotherapy or pharma-
cotherapy, and it is efficacious regardless of patients’ characteristics Numerous trials and meta-analyses (Benishek et al., 2014; Grif-
or preexisting conditions (e.g., Lussier, Heil, Mongeon, Badger, & fith, Rowan-Szal, Roark, & Simpson, 2000; Lussier et al., 2006;
Higgins, 2006; Prendergast, Podus, Finney, Greenwell, & Roll, 2006). Prendergast et al., 2006) demonstrate the efficacy of CM for
Despite the positive impact of CM and its generalization to a improving outcomes of patients with substance use disorders.
wide range of populations and settings, clinicians and the public Compared with other psychosocial treatments, CM has the largest
effect size of Cohen’s d ⫽ 0.58, whereas the next largest effect
size for relapse prevention interventions is substantially lower at
d ⫽ 0.32 (Dutra et al., 2008). In terms of an intuitive example, the
Editor’s Note. Stephen A. Maisto served as the action editor for this National Drug Abuse Treatment Clinical Trials Network study
article.—NMP (Petry et al., 2005a) randomized 415 patients with stimulant use
disorders to standard care at community clinics or to standard care
This article was published Online First June 22, 2017. plus CM. Patients receiving CM achieved an average of 4.4 weeks
Nancy M. Petry and Sheila M. Alessi, Calhoun Cardiology Center, of objectively verified continuous stimulant abstinence versus 2.6
University of Connecticut School of Medicine; Todd A. Olmstead, Depart- weeks for patients receiving standard care alone. In stimulant
ment of Public Affairs, University of Texas-Austin; Carla J. Rash and abusing methadone patients, another large Clinical Trials Network
Kristyn Zajac, Calhoun Cardiology Center, University of Connecticut study (Peirce et al., 2006) similarly found significant differences in
School of Medicine. durations of abstinence (2.8 weeks for CM vs. 1.7 weeks for
Preparation of this article was supported in part by National Insti- standard care), and proportions of samples stimulant negative
tutes of Health Grants R01-DA13444, P50-DA09241, P60-AA03510, (54.4% for CM and 38.7% for standard care). The odds ratio was
R01-HD075630, R01-AA021446, R01-AA023502, R21-DA03189, and
1.9 (95% confidence interval ⫽ 1.4 –2.6), indicating that CM
K23DA034879. All secondary authors contributed equally to this article
and are listed in alphabetical order.
nearly doubled the likelihood of stimulant negative samples.
Correspondence concerning this article should be addressed to Nancy M. Contingency management is efficacious in treating a variety of
Petry, Calhoun Cardiology Center/Behavioral Health (MC-3944), Univer- substance use disorders, including stimulant, opioid, marijuana,
sity of Connecticut School of Medicine, 263 Farmington Avenue, Farm- nicotine, and polydrug use disorders (Benishek et al., 2014; Cahill,
ington, CT 06030-3944. E-mail: npetry@uchc.edu Hartmann-Boyce, & Perera, 2015; Gates, Sabioni, Copeland, Le

897
898 PETRY, ALESSI, OLMSTEAD, RASH, AND ZAJAC

Foll, & Gowing, 2016; Lussier et al., 2006; Prendergast et al., management is listed in the National Registry of Evidence Based
2006; Schierenberg, van Amsterdam, van den Brink, & Goudriaan, Practices (http://legacy.nreppadmin.net/ViewIntervention.aspx?id⫽
2012). There is less research in the context of CM for treating 344), and the Department of Veterans Affairs is implementing it
alcohol use disorders, primarily because of limited ability to quan- throughout the United States (Petry, DePhilippis, Rash, Drapkin,
tify alcohol use objectively (Higgins & Petry, 1999). Nevertheless, & McKay, 2014). In the United Kingdom, it is included in the
recent technology to assess alcohol use over longer durations of National Institute for Health and Clinical Excellence (2007) guide-
time and in the natural environment is expanding the application of lines. It has also been successfully applied in other European
CM to this population as well (Alessi & Petry, 2013; Barnett, countries as well as Brazil and China (Chen et al., 2013; Etter &
Tidey, Murphy, Swift, & Colby, 2011; Dougherty et al., 2015a, Schmid, 2016; Hser et al., 2011; Miguel et al., 2016; Petitjean et al.,
2015b; McDonell et al., 2012). 2014; Secades-Villa, Garcia-Rodriguez, & Fernandez-Hermida,
Contingency management is effective regardless of patients’ 2015; Wang et al., 2014).
background characteristics, preexisting conditions, or presenting Hundreds of studies of CM, as well as recent systematic reviews
problems. Studies evaluating the influence of demographics such (e.g., Davis et al., 2016; Stanger, Lansing, & Budney, 2016), have
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

as age, sex, race/ethnicity, or income (Barry, Sullivan, & Petry, been published, along with meta-analyses demonstrating its effi-
This document is copyrighted by the American Psychological Association or one of its allied publishers.

2009; Rash, Dephilippis, McKay, Drapkin, & Petry, 2013; Rash, cacy (Benishek et al., 2014; Cahill et al., 2015; Castells et al.,
Olmstead, & Petry, 2009; Rash & Petry, 2015; Weiss & Petry, 2009; Dutra et al., 2008; Gates et al., 2016; Griffith et al., 2000;
2011) or psychopathology including posttraumatic stress disorder, Lussier et al., 2006; Prendergast et al., 2006; Schumacher et al.,
antisocial personality disorder, psychotic disorders, or general 2007; Terplan & Lui, 2007). The National Institute on Drug
psychiatric symptoms (e.g., Ford, Hawke, Alessi, Ledgerwood, & Abuse Clinical Trials Network created CM dissemination prod-
Petry, 2007; Hertzberg et al., 2013; Mancino, McGaugh, Feldman, ucts (http://ctndisseminationlibrary.org/) and Addiction Tech-
Poling, & Oliveto, 2010; McDonell et al., 2013; Messina, Farabee, nology and Transfer Centers have supported adoption initiatives
& Rawson, 2003; Petry, Alessi, & Rash, 2013a, 2013b; Petry, (e.g., Squires, Gumbley, & Storti, 2008). Despite consistent
Ford, & Barry, 2011; Tidey, Rohsenow, Kaplan, Swift, & Reid, benefits and increasing efforts toward dissemination, many
2011) reveal benefits of CM. Similarly, CM improves outcomes clinicians, the public, and even some researchers question the
compared with usual care among patients with issues like criminal utility of CM. Although its usage has increased in recent years,
justice system involvement, medical comorbidities, previous treat- CM remains the least implemented of the empirically based
ment attempts, unemployment, and homelessness (Petry, Rash, & treatments (Benishek, Kirby, Dugosh, & Padovano, 2010; Her-
Easton, 2011; Rash, Alessi, & Petry, 2008; Schumacher et al., beck, Hser, & Teruya, 2008; McGovern, Fox, Xie, & Drake,
2007; Silverman, DeFulio, & Sigurdsson, 2012; Walter & Petry, 2004). There are numerous reasons for this lack of clinical
2015). We are aware of no studies demonstrating adverse out- uptake, and addressing these concerns directly may ultimately
comes of CM relative to standard care in any population. enhance the application of this intervention and improve treat-
Furthermore, CM can be applied in virtually any context or ment outcomes.
setting and alongside any other form of treatment. It has been
evaluated as an adjunct to standard care in community clinics (e.g.,
Concerns About CM
Petry et al., 2004, 2005a, 2012a, 2012b; Petry, Alessi, Marx,
Austin, & Tardif, 2005b; Petry, Martin, & Simcic, 2005c), includ- Clinical treatment settings have not widely embraced CM for
ing methadone maintenance clinics (e.g., Petry et al., 2005c; Petry, reasons ranging from philosophical to theoretical and practical.
Alessi, Barry, & Carroll, 2015a; Peirce et al., 2006), with intensive This section outlines these issues as well as evidence supporting or
treatments such as Community Reinforcement Approach (e.g., refuting them.
Higgins et al., 2003, 2007), or other interventions such as
cognitive– behavioral and motivational enhancement therapies
Concordance With Usual Care Treatment Approaches
(e.g., Budney, Higgins, Radonovich, & Novy, 2000; Budney,
Moore, Rocha, & Higgins, 2006; Carroll et al., 2006, 2012), with The primary underpinnings of substance abuse treatment in the
computerized therapies (Bickel, Marsch, Buchhalter, & Badger, United States are 12-step. Between 60% and 75% of clinics con-
2008; Budney et al., 2015; Campbell et al., 2014; Christensen et sider 12-step to be their primary treatment approach (Roman &
al., 2014; Ondersma et al., 2012), and pharmacotherapies (e.g., Johnson, 2004a, 2004b), and most encourage 12-step participation
Alessi, Rash, & Petry, 2017; Carroll et al., 2016; Cooney et al., and use these principles in the context of standard care (Substance
2017; Poling et al., 2006; Rohsenow, Martin, Tidey, Colby, & Abuse & Mental Health Services Administration, 2013). Orienta-
Monti, 2017). Although CM can be integrated alongside virtually tion to a 12-step philosophy is negatively associated with accep-
any other therapy and almost always demonstrates benefits com- tance and use of CM and tangible reinforcers (Aletraris, Shelton, &
pared with standard care or other platform therapies, it does not Roman, 2015; Ducharme, Knudsen, Abraham, & Roman, 2010;
always yield synergistic effects with other treatments (Carroll et McGovern et al., 2004). Clinicians with a 12-step orientation
al., 2012; Godley et al., 2014). perceive more problems with implementing CM than counselors
Nevertheless, benefits of CM are noted even when controlling with others orientations (Rash et al., 2012), including both philo-
for therapist time and attention (Petry, Martin, Cooney, & Kran- sophical (e.g., “CM doesn’t address the underlying cause of ad-
zler, 2000; Petry et al., 2012a, 2012b) and availability of equal diction”) and practical (e.g., “I do not have time to administer CM
monetary amounts noncontingent on abstinence (Barnett et al., in a therapy session”) barriers.
2011; Higgins et al., 1994, 2003, 2014; Higgins, Wong, Badger, There are no known published data to suggest that CM ad-
Ogden, & Dantona, 2000; Sigmon et al., 2016). Contingency versely impacts participation in 12-step meetings or 12-step ori-
CONTINGENCY MANAGEMENT INTERVENTIONS 899

ented care. To the contrary, CM has been evaluated alongside external reinforcers can increase feelings of competence, which in
12-step oriented treatment, including professionally delivered turn may improve intrinsic motivation. In terms of CM for sub-
Twelve Step Facilitation (Petry, Weinstock, Alessi, Lewis, & stance use disorders specifically, only a handful of trials have
Dieckhaus, 2010), and it improves outcomes when administered investigated internal motivation, and only one known study found
with 12-step care in community clinics (Petry et al., 2000, 2004, results consistent with the hypothesis that CM may decrease in-
2005a, 2005b, 2005c, 2006, 2011, 2012a, 2012b; Petry, Alessi, ternal motivation. In a trial of detoxified patients with opioid use
Hanson, & Sierra, 2007; Petry, Barry, Alessi, Rounsaville, & disorder (Carroll, Sinha, Nich, Babuscio, & Rounsaville, 2002),
Carroll, 2012c). Therefore, even though CM may not address patients randomized to CM conditions that reinforced opioid ab-
deep-seated beliefs about causes of addiction, it still improves stinence and ingestion of naltrexone had declines over time in
substance abuse treatment outcomes. scores on a readiness to change substance use questionnaire,
Moreover, CM shares principles with 12-steps practices. Most whereas scores rose in participants in a standard care condition.
12-step meetings start with introductions that include, and publicly Three other studies (Budney et al., 2000; Ledgerwood & Petry,
recognize, each day of abstinence as a success. CM is built upon 2006; Litt, Kadden, Kabela-Cormier, & Petry, 2008) found no
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

this same premise— each day of abstinence is something to be differences over time on scores of readiness to change substance
This document is copyrighted by the American Psychological Association or one of its allied publishers.

celebrated. In the case of CM, periods of abstinence are reinforced use between patients receiving CM and other forms of treatment.
with tangible reinforcers along with verbal praise and recognition. Thus, the bulk of available evidence suggests that CM does not
In 12-step treatment, all three of these types of reinforcers are also have adverse effects on reducing motivation to change substance
provided, although the tangible reinforcers are of lower monetary use behaviors, and objective behavioral data (i.e., urinalysis tests)
value such as sobriety pins. Coffee and food are available at clearly indicate that it has beneficial effects on actual substance
meetings, intended to encourage attendance, in a similar vein as use behaviors.
the tangible reinforcers associated with CM. When clinicians see
the similarities between reinforcers associated with 12-step meet-
Durability of Effects
ings and CM and directly experience the impact that tangible
reinforcers can make in encouraging recovery behaviors, some A related concern about CM, predicted by cognitive evaluation
clinicians become proponents and champions of CM (Petry et al., theory, is that external reinforcers will undermine long-term be-
2005c; Petry, Martin, & Finocche, 2001; Petry & Simcic, 2002). havior change. Many studies have evaluated postintervention ef-
fects of CM on substance use months after external reinforcement
ceases, but most are underpowered to detect long term changes.
Motivation to Change
Although meta-analyses find effects of CM are not sustained at
Another concern is that CM, with its emphasis on external long term follow-ups (Benishek et al., 2014; Prendergast et al.,
reinforcement, may impede intrinsic motivation to change. Intrin- 2006), an increasing number of studies demonstrate benefits of
sic motivation refers to one’s desire to do something because it is CM months after treatment ends (Alessi, Hanson, Wieners, &
self-fulfilling, while extrinsic motivation relates to doing some- Petry, 2007; Carroll et al., 2016; Halpern et al., 2015; Higgins et
thing to obtain an item of value or to avoid punishment. Cognitive al., 2000, 2007; Higgins, Heil, & Lussier, 2004; Kadden, Litt,
evaluation theory proposes that external reinforcers, that shift Kabela-Cormier, & Petry, 2007; Kendzor et al., 2015; McDonell et
causality from internal factors to those outside the person, reduce al., 2013; McKay et al., 2010; Petitjean et al., 2014; Petry, An-
feelings of autonomy and competence necessary for behavior drade, Barry, & Byrne, 2013c; Petry, Alessi, Byrne, & White,
change (Deci & Ryan, 1985; Ryan & Deci, 2000). Accordingly, 2015b; Petry & Martin, 2002; Petry et al., 2005c; Reback et al.,
this theory predicts behavior should return to its initial state once 2010; Roll, Chudzynski, Cameron, Howell, & McPherson, 2013;
reinforcers are removed (Deci, Koestner, & Ryan, 1999). Secades-Villa et al., 2011; Secades-Villa, Garcia-Rodriguez,
Empirical evidence is mixed about whether external rewards Lopez-Nunez, Alonso-Perez, & Fernandez-Hermida, 2014; Schot-
impact intrinsic motivation. In nonclinical contexts, providing tenfeld, Moore, & Pantalon, 2011; Winhusen et al., 2014). A
external rewards to complete tasks such as puzzles or games may recent review (Davis et al., 2016) reported that 29% of studies that
undermine intrinsic motivation and subsequent participation in evaluated long-term effects of CM found that it retained significant
them (Deci et al., 1999). However, for behaviors that rarely occur benefits even after reinforcers were no longer delivered.
on their own or that are challenging in nature, external rewards Perhaps most importantly, there are no data to suggest that
may enhance engagement in them (Cameron, Banko, & Pierce, patients who earlier received CM have poorer long term substance
2001). Different associations may also relate to whether reinforc- use outcomes than patients who never received CM. All the data
ers are provided for attempting a task, finishing it, or reaching indicate that providing CM either results in no significant change
some threshold of performance (Cameron et al., 2001). Further- or reductions in drug use relative to treatments without CM at long
more, most studies of the effects of external rewards were con- term follow-ups. Thus, decades of research clearly indicate excel-
ducted in children or college students, not patients with serious lent short term benefits of CM, and no or possibly some long term
physical or mental disorders. The manner in which external re- improvements with this treatment.
wards impact internal motivations in patients receiving interven-
tions that tangibly reward health behaviors remains unclear.
Economics
Promberger and Marteau (2013) examined studies that provided
reinforcers for health-related behaviors and concluded they did not Finally, clinic administrators, policymakers, and payers express
undermine intrinsic motivation. To the contrary, they found that, concern about the economics (i.e., cost, benefit, and reimburse-
for health behaviors that depend upon self-control, provision of ment) of CM. Providing tangible reinforcers increases costs of
900 PETRY, ALESSI, OLMSTEAD, RASH, AND ZAJAC

treatment, especially because CM is typically an add-on to usual More efforts should promote understanding of CM and its
care. In addition to direct costs of the reinforcers that range up to benefits, as many clinicians do not believe CM improves outcomes
$300 to $1,200 per person for 12-week courses of treatment (e.g., (Benishek et al., 2010; Herbeck et al., 2008). In part, this lack of
Higgins et al., 1994, 2000, 2003; Petry et al., 2005a, 2005b, 2005c, understanding relates to the technical nature of research reports.
2012a, 2012b, 2012c), there are administrative costs that include Providing clear and interpretable information is one essential step,
time spent purchasing and tracking delivery of reinforcers, time and both brief educational approaches (Benishek et al., 2010) and
spent meeting with patients to review sample results and award more extensive in-person training workshops (e.g., Rash et al.,
reinforcers, and costs for frequent urinalysis testing (Olmstead & 2013) show promise in changing knowledge and attitudes about
Petry, 2009; Olmstead, Sindelar, Easton, & Carroll, 2007a). More- CM. Training efforts should directly address concerns about CM,
over, the incremental costs attributable to CM can be unpredictable including issues related to motivation to change and its durability.
depending on the patients’ success and, in the case of prize CM, They should emphasize that long-term change is not possible
the “luck of the draw.” The average per patient cost of adding CM without first achieving abstinence and no psychosocial interven-
to usual care ranged by nearly a factor of two—from $306 to tion does as well as CM in promoting abstinence during treatment.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

$582—across the eight clinics in the National Drug Abuse Treat- Furthermore, aligning reinforcement principles with 12-step and
This document is copyrighted by the American Psychological Association or one of its allied publishers.

ment Clinical Trials Network study (Olmstead, Sindelar, & Petry, standard care procedures is key, as well as emphasizing its effects
2007b). in virtually all patient populations (see Petry, 2012). Kropp, Lewis,
Of course, there is more to the economics than just the cost of and Winhusen (2017) provide an example of an implementation
CM. To the extent that CM leads to improvements in negative effort to integrate CM with 12-step treatment, and voices from
externalities associated with substance use disorders, CM may nonresearch perspectives may be more convincing to clinicians
result in societal benefits. For example, Olmstead, Sindelar, and than technical research reports. Other examples of implementation
Petry (2007c) found that, compared with usual care, the incremen- efforts provide valuable information on how CM can be tailored to
tal cost of CM to lengthen the longest duration of abstinence in unique needs of a clinic and population (Fitzsimons, Tuten, Bor-
stimulant abusers was $258 per week per patient. From a societal suk, Lookatch, & Hanks, 2015; Hartzler, 2015; Kellogg et al.,
perspective, this seems to be a very good investment inasmuch as 2005; Lott & Jencius, 2009; Petry et al., 2014; Sigmon & Stitzer,
a typical active stimulant abuser very likely costs society much 2005; Squires et al., 2008; Walker et al., 2010). In implementation
more than $258 per week in the form of criminal activity, spread science more generally, Damschroder and Hagedorn (2011) like-
of disease, and declines in both workplace productivity and family wise note the need to adapt evidence-based practices to the broader
functioning (Gordon, Tinsley, Godfrey, & Parrott, 2006). There context, distinguishing the core from the adaptable components.
remains, however, a dearth of information on the cost- In clinics that adopt CM, training and supervision are paramount
effectiveness of CM and substance abuse treatments more gen- to ensure core aspects of CM are retained. Only about half of
erally. clinics providing CM arranged for in-house or off-site training
On balance, it appears that the societal benefits of adding CM to (Olmstead, Abraham, Martino, & Roman, 2012). Clinician skill in
usual care likely outweigh its costs, at least for illicit substance use administering CM impacts patient outcomes (Hartzler, Beadnell,
disorders. So, why is CM not being used more often? The answer & Donovan, 2017; Petry et al., 2012a), and supervision can main-
is simple—reimbursement. Most of the assumed societal benefits tain fidelity over time (Petry et al., 2012a, 2012b). Most imple-
of CM accrue to neither the clinics that provide CM nor the payers mentation efforts were developed in collaboration with research
who pay for treatment (U.S. Department of Health & Human experts (e.g., Hartzler, 2015; Petry et al., 2014), and strategies that
Services, 2011). Even large payers (commercial insurers, Medic- provide greater reach include Web-based modules and phone con-
aid, Medicare) benefit little from reductions in crime, or other sultation (Petry et al., 2014).
negative behaviors, that may result from providing CM. Because Technology may not only enhance training and supervision but
clinics do not receive reimbursement for the extra testing or also delivery of CM. Cell phone and drug testing technologies
reinforcers needed to promote abstinence using CM, they have no allow for frequent assessment and reinforcement of alcohol and
economic incentive to do so. Moreover, even if clinicians want to cigarette abstinence in the natural environment. These approaches
provide CM, they cannot do so without adequate financial support. are efficacious and acceptable to patients (Alessi & Petry, 2013;
In the presence of myriad and substantial negative externalities Alessi & Rash, 2017; Alessi et al., 2017; Kong, 2013), as are
associated with substance use disorders, it is challenging to get all Internet-based reinforcement procedures (Carpenter et al., 2015;
CM beneficiaries to contribute their “fair share” to the reimburse- Dallery & Glenn, 2005; Dallery, Glenn, & Raiff, 2007; Dallery,
ment of CM treatment. Raiff, & Grabinski, 2013; Hertzberg et al., 2013; Meredith, Gra-
binski, & Dallery, 2011; Raiff, Jarvis, Turturici, & Dallery, 2013;
Reynolds et al., 2015; Stoops et al., 2009). Coupling these tech-
Next Steps
nologies with mobile reinforcement procedures may support ab-
Contingency management is clearly efficacious for promoting stinence in real-time and lead to more effective and efficient
abstinence and, therefore, merits consideration for adoption. Im- delivery of CM, which may enhance and extend its benefits.
plementation efforts should consider common concerns about CM, In terms of the economics of CM, implementation science also
as well as important understudied aspects related to this interven- provides key lessons. Successful implementation of an interven-
tion. In addition, implementation science should be consulted tion is driven by an interplay of external (e.g., reimbursement) and
because adoption of even noncontroversial evidence-based prac- internal (e.g., therapist desires to address patients’ needs) factors
tices can be slow (e.g., Lash, Timko, Curran, McKay, & Burden, (Sorensen & Kosten, 2011), but much of what we know about CM
2011; Sorensen & Kosten, 2011). implementation is related to internal barriers to implementation.
CONTINGENCY MANAGEMENT INTERVENTIONS 901

Manuel et al. (2011) note that the most effective implementation bursement at the federal level before implementation efforts can be
efforts in substance abuse treatment have involved organization- expected to be widespread.
ally focused approaches, rather than provider initiated ones. In
other words, organization-wide support or mandates were associ-
ated with better adoption. Before any agency is likely willing or References
able to implement CM, research will need to proceed along three Alessi, S. M., Hanson, T., Wieners, M., & Petry, N. M. (2007). Low-cost
fronts: cost, benefit, and reimbursement. First, addressing costs of contingency management in community clinics: Delivering incentives
reinforcers is critical for implementing this intervention. Even in partially in group therapy. Experimental and Clinical Psychopharma-
its simplest format, CM involves direct costs of reinforcers and cology, 15, 293–300. http://dx.doi.org/10.1037/1064-1297.15.3.293
drug use testing, and currently there are no methods to support Alessi, S. M., & Petry, N. M. (2013). A randomized study of cellphone
these costs in clinical settings. If reinforcers are of too minimal a technology to reinforce alcohol abstinence in the natural environment.
value or sample testing becomes too infrequent, the procedure Addiction, 108, 900 –909. http://dx.doi.org/10.1111/add.12093
Alessi, S. M., & Rash, C. J. (2017). Treatment satisfaction in a randomized
becomes less effective (Prendergast et al., 2006; Lussier et al.,
clinical trial of mHealth smoking abstinence reinforcement. Journal of
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

2006). Providing chances to win prizes of varying magnitudes is an


Substance Abuse Treatment, 72, 103–110.
This document is copyrighted by the American Psychological Association or one of its allied publishers.

efficacious strategy (Petry et al., 2005b, 2007, 2015a). Other Alessi, S. M., Rash, C. J., & Petry, N. M. (2017). A randomized trial of
strategies may include reinforcing only a proportion of patients adjunct mHealth abstinence reinforcement with transdermal nicotine and
rather than each individual (Alessi et al., 2007; Ledgerwood, counseling for smoking cessation. Nicotine & Tobacco Research, 19,
Alessi, Hanson, Godley, & Petry, 2008; Petry et al., 2001) and 290 –298. http://dx.doi.org/10.1093/ntr/ntw155
arranging interdependent group contingencies (Meredith et al., Aletraris, L., Shelton, J. S., & Roman, P. M. (2015). Counselor attitudes
2011; Meredith & Dallery, 2013). In short, a better understanding toward contingency management for substance use disorder: Effective-
of the minimal necessary reinforcement cost to achieve specific ness, acceptability, and endorsement of incentives for treatment atten-
patient outcomes would be useful. dance and abstinence. Journal of Substance Abuse Treatment, 57, 41–
48. http://dx.doi.org/10.1016/j.jsat.2015.04.012
Second, studies estimating societal benefits of CM are lacking
Barnett, N. P., Tidey, J., Murphy, J. G., Swift, R., & Colby, S. M. (2011).
(e.g., Shearer, Tie, & Byford, 2015). Ideally, such studies will
Contingency management for alcohol use reduction: A pilot study using
measure and monetize the value of improvements in the negative a transdermal alcohol sensor. Drug and Alcohol Dependence, 118(2–3),
externalities associated with substance use disorders, in both the 391–399. http://dx.doi.org/10.1016/j.drugalcdep.2011.04.023
long and short run, as well as to whom such benefits accrue. Barry, D., Sullivan, B., & Petry, N. M. (2009). Comparable efficacy of
Without such information, it is impossible for policymakers and contingency management for cocaine dependence among African Amer-
payers to know the full value that CM confers to society, or who ican, Hispanic, and White methadone maintenance clients. Psychology
should be responsible for paying for it. of Addictive Behaviors, 23, 168 –174. http://dx.doi.org/10.1037/
Third, formal mechanisms are needed by which clinics are a0014575
adequately reimbursed to provide CM. Such mechanisms include Benishek, L. A., Dugosh, K. L., Kirby, K. C., Matejkowski, J., Clements,
N. T., Seymour, B. L., & Festinger, D. S. (2014). Prize-based contin-
ways to identify and tap the beneficiaries of CM to contribute their
gency management for the treatment of substance abusers: A meta-
share of the treatment costs, government subsidies, or some com-
analysis. Addiction, 109, 1426 –1436. http://dx.doi.org/10.1111/add
bination thereof. As a practical matter, this is much easier said than .12589
done. Yet, there is hope. Screening and brief interventions for Benishek, L. A., Kirby, K. C., Dugosh, K. L., & Padovano, A. (2010).
alcohol use have been reimbursed by commercial insurance, Medi- Beliefs about the empirical support of drug abuse treatment interven-
care, and Medicaid for years (Neighbors, Barnett, Rohsenow, tions: A survey of outpatient treatment providers. Drug and Alcohol
Colby, & Monti, 2010; Bray et al., 2014; Substance Abuse & Dependence, 107, 202–208. http://dx.doi.org/10.1016/j.drugalcdep.2009
Mental Health Services Administration, 2016). These services are .10.013
reimbursed by private and public payers, begging the question as Bickel, W. K., Marsch, L. A., Buchhalter, A. R., & Badger, G. J. (2008).
to why they are not for CM. Computerized behavior therapy for opioid-dependent outpatients: A
randomized controlled trial. Experimental and Clinical Psychopharma-
Researchers and public research funds have invested decades
cology, 16, 132–143. http://dx.doi.org/10.1037/1064-1297.16.2.132
into designing and evaluating CM interventions, and CM clearly is
Bray, J. W., Mallonee, E., Dowd, W., Aldridge, A., Cowell, A. J., &
beneficial for improving substance use treatment outcomes when it Vendetti, J. (2014). Program- and service-level costs of seven screening,
is administered appropriately. It is now up to policymakers to brief intervention, and referral to treatment programs. Substance Abuse
ensure that substance use treatment patients receive this effica- and Rehabilitation, 5, 63–73. http://dx.doi.org/10.2147/SAR.S62127
cious intervention and that the intervention is delivered in a man- Budney, A. J., Higgins, S. T., Radonovich, K. J., & Novy, P. L. (2000).
ner similar to which it is known to be efficacious. In no other Adding voucher-based incentives to coping skills and motivational en-
medical field would a clinic, hospital, or provider be expected to hancement improves outcomes during treatment for marijuana depen-
cover costs of additional testing and treatment without reimburse- dence. Journal of Consulting and Clinical Psychology, 68, 1051–1061.
ment. Extensive adoption and implementation of CM by substance http://dx.doi.org/10.1037/0022-006X.68.6.1051
abuse treatment clinics will require that reimbursement procedures Budney, A. J., Moore, B. A., Rocha, H. L., & Higgins, S. T. (2006).
Clinical trial of abstinence-based vouchers and cognitive-behavioral
and policies are consistent with other medical and psychiatric
therapy for cannabis dependence. Journal of Consulting and Clinical
specialties. It may also necessitate development of methods to Psychology, 74, 307–316.
ensure that, when CM is administered, it is done according to Budney, A. J., Stanger, C., Tilford, J. M., Scherer, E. B., Brown, P. C., Li,
methods known to be efficacious, including appropriate magni- Z., . . . Walker, D. D. (2015). Computer-assisted behavioral therapy and
tudes and frequencies of reinforcement. Perhaps what CM needs contingency management for cannabis use disorder. Psychology of Ad-
most is a well-placed champion to break down barriers to reim- dictive Behaviors, 29, 501–511. http://dx.doi.org/10.1037/adb0000078
902 PETRY, ALESSI, OLMSTEAD, RASH, AND ZAJAC

Cahill, K., Hartmann-Boyce, J., & Perera, R. (2015). Incentives for smok- Dallery, J., Raiff, B. R., & Grabinski, M. J. (2013). Internet-based contin-
ing cessation. Cochrane Database of Systematic Reviews, 5, CD004307. gency management to promote smoking cessation: A randomized con-
Cameron, J., Banko, K. M., & Pierce, W. D. (2001). Pervasive negative trolled study. Journal of Applied Behavior Analysis, 46, 750 –764. http://
effects of rewards on intrinsic motivation: The myth continues. The dx.doi.org/10.1002/jaba.89
Behavior Analyst, 24, 1– 44. Damschroder, L. J., & Hagedorn, H. J. (2011). A guiding framework and
Campbell, A. N., Nunes, E. V., Matthews, A. G., Stitzer, M., Miele, G. M., approach for implementation research in substance use disorders treat-
Polsky, D., . . . Ghitza, U. E. (2014). Internet-delivered treatment for ment. Psychology of Addictive Behaviors, 25, 194 –205. http://dx.doi
substance abuse: A multisite randomized controlled trial. The American .org/10.1037/a0022284
Journal of Psychiatry, 171, 683– 690. http://dx.doi.org/10.1176/appi.ajp Davis, D. R., Kurti, A. N., Skelly, J. M., Redner, R., White, T. J., &
.2014.13081055 Higgins, S. T. (2016). A review of the literature on contingency man-
Carpenter, V. L., Hertzberg, J. S., Kirby, A. C., Calhoun, P. S., Moore, agement in the treatment of substance use disorders, 2009 –2014. Pre-
S. D., Dennis, M. F., . . . Beckham, J. C. (2015). Multicomponent ventive Medicine, 92, 36 – 46.
smoking cessation treatment including mobile contingency management Deci, E. L., Koestner, R., & Ryan, R. M. (1999). A meta-analytic review
in homeless veterans. The Journal of Clinical Psychiatry, 76, 959 –964. of experiments examining the effects of extrinsic rewards on intrinsic
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

http://dx.doi.org/10.4088/JCP.14m09053 motivation. Psychological Bulletin, 125, 627– 668. http://dx.doi.org/10


This document is copyrighted by the American Psychological Association or one of its allied publishers.

Carroll, K. M., Ball, S. A., Nich, C., Martino, S., Frankforter, T. L., .1037/0033-2909.125.6.627
Farentinos, C., . . . National Institute on Drug Abuse Clinical Trials Deci, E. L., & Ryan, R. (1985). Intrinsic motivation and self-determination
Network. (2006). Motivational interviewing to improve treatment en- in human behavior. New York, NY: Plenum Press. http://dx.doi.org/10
gagement and outcome in individuals seeking treatment for substance .1007/978-1-4899-2271-7
abuse: A multisite effectiveness study. Drug and Alcohol Dependence, Dougherty, D. M., Karns, T. E., Mullen, J., Liang, Y., Lake, S. L., Roache,
81, 301–312. J. D., & Hill-Kapturczak, N. (2015a). Transdermal alcohol concentration
Carroll, K. M., Nich, C., Lapaglia, D. M., Peters, E. N., Easton, C. J., & data collected during a contingency management program to reduce
Petry, N. M. (2012). Combining cognitive behavioral therapy and con- at-risk drinking. Drug and Alcohol Dependence, 148, 77– 84. http://dx
tingency management to enhance their effects in treating cannabis de- .doi.org/10.1016/j.drugalcdep.2014.12.021
pendence: Less can be more, more or less. Addiction, 107, 1650 –1659. Dougherty, D. M., Lake, S. L., Hill-Kapturczak, N., Liang, Y., Karns,
http://dx.doi.org/10.1111/j.1360-0443.2012.03877.x T. E., Mullen, J., & Roache, J. D. (2015b). Using contingency manage-
Carroll, K. M., Nich, C., Petry, N. M., Eagan, D. A., Shi, J. M., & Ball, ment procedures to reduce at-risk drinking in heavy drinkers. Alcohol-
S. A. (2016). A randomized factorial trial of disulfiram and contingency ism: Clinical and Experimental Research, 39, 743–751. http://dx.doi
management to enhance cognitive behavioral therapy for cocaine depen- .org/10.1111/acer.12687
dence. Drug and Alcohol Dependence, 160, 135–142. http://dx.doi.org/ Ducharme, L. J., Knudsen, H. K., Abraham, A. J., & Roman, P. M. (2010).
10.1016/j.drugalcdep.2015.12.036 Counselor attitudes toward the use of motivational incentives in addic-
Carroll, K. M., Sinha, R., Nich, C., Babuscio, T., & Rounsaville, B. J. tion treatment. The American Journal on Addictions, 19, 496 –503.
(2002). Contingency management to enhance naltrexone treatment of http://dx.doi.org/10.1111/j.1521-0391.2010.00081.x
opioid dependence: A randomized clinical trial of reinforcement mag- Dutra, L., Stathopoulou, G., Basden, S. L., Leyro, T. M., Powers, M. B., &
nitude. Experimental and Clinical Psychopharmacology, 10, 54 – 63. Otto, M. W. (2008). A meta-analytic review of psychosocial interven-
http://dx.doi.org/10.1037/1064-1297.10.1.54 tions for substance use disorders. The American Journal of Psychiatry,
Castells, X., Kosten, T. R., Capellà, D., Vidal, X., Colom, J., & Casas, M. 165, 179 –187. http://dx.doi.org/10.1176/appi.ajp.2007.06111851
(2009). Efficacy of opiate maintenance therapy and adjunctive interven- Etter, J. F., & Schmid, F. (2016). Effects of large financial incentives for
tions for opioid dependence with comorbid cocaine use disorders: A long-term smoking cessation: A randomized trial. Journal of the Amer-
systematic review and meta-analysis of controlled clinical trials. The ican College of Cardiology, 68, 777–785. http://dx.doi.org/10.1016/j
American Journal of Drug and Alcohol Abuse, 35, 339 –349. http://dx .jacc.2016.04.066
.doi.org/10.1080/00952990903108215 Fitzsimons, H., Tuten, M., Borsuk, C., Lookatch, S., & Hanks, L. (2015).
Chen, W., Hong, Y., Zou, X., McLaughlin, M. M., Xia, Y., & Ling, L. Clinician-delivered contingency management increases engagement and
(2013). Effectiveness of prize-based contingency management in a attendance in drug and alcohol treatment. Drug and Alcohol Depen-
methadone maintenance program in China. Drug and Alcohol Depen- dence, 152, 62– 67. http://dx.doi.org/10.1016/j.drugalcdep.2015.04.021
dence, 133, 270 –274. http://dx.doi.org/10.1016/j.drugalcdep.2013.05 Ford, J. D., Hawke, J., Alessi, S., Ledgerwood, D., & Petry, N. (2007).
.028 Psychological trauma and PTSD symptoms as predictors of substance
Christensen, D. R., Landes, R. D., Jackson, L., Marsch, L. A., Mancino, dependence treatment outcomes. Behaviour Research and Therapy, 45,
M. J., Chopra, M. P., & Bickel, W. K. (2014). Adding an Internet- 2417–2431. http://dx.doi.org/10.1016/j.brat.2007.04.001
delivered treatment to an efficacious treatment package for opioid de- Gates, P. J., Sabioni, P., Copeland, J., Le Foll, B., & Gowing, L. (2016).
pendence. Journal of Consulting and Clinical Psychology, 82, 964 –972. Psychosocial interventions for cannabis use disorder. Cochrane Data-
http://dx.doi.org/10.1037/a0037496 base of Systematic Reviews, 5, CD005336.
Cooney, J. L., Cooper, S., Grant, C., Sevarino, K., Krishnan-Sarin, S., Godley, M. D., Godley, S. H., Dennis, M. L., Funk, R. R., Passetti, L. L.,
Gutierrez, I. A., & Cooney, N. L. (2017). A randomized trial of contin- & Petry, N. M. (2014). A randomized trial of assertive continuing care
gency management for smoking cessation during intensive outpatient and contingency management for adolescents with substance use disor-
alcohol treatment. Journal of Substance Abuse Treatment, 72, 89 –96. ders. Journal of Consulting and Clinical Psychology, 82, 40 –51. http://
Dallery, J., & Glenn, I. M. (2005). Effects of an Internet-based voucher dx.doi.org/10.1037/a0035264
reinforcement program for smoking abstinence: A feasibility study. Gordon, L., Tinsley, L., Godfrey, C., & Parrott, S. (2006). The economic
Journal of Applied Behavior Analysis, 38, 349 –357. http://dx.doi.org/ and social costs of Class A drug use in England and Wales, 2003/04. In
10.1901/jaba.2005.150-04 Measuring different aspects of problem drug Use: Methodological de-
Dallery, J., Glenn, I. M., & Raiff, B. R. (2007). An internet-based absti- velopments (6th ed., Vol. 16). London, UK: Home Office.
nence reinforcement treatment for cigarette smoking. Drug and Alcohol Griffith, J. D., Rowan-Szal, G. A., Roark, R. R., & Simpson, D. D. (2000).
Dependence, 86, 230 –238. Contingency management in outpatient methadone treatment: A meta-
CONTINGENCY MANAGEMENT INTERVENTIONS 903

analysis. Drug and Alcohol Dependence, 58(1–2), 55– 66. http://dx.doi dence. Addictive Behaviors, 32, 1220 –1236. http://dx.doi.org/10.1016/j
.org/10.1016/S0376-8716(99)00068-X .addbeh.2006.08.009
Halpern, S. D., French, B., Small, D. S., Saulsgiver, K., Harhay, M. O., Kellogg, S. H., Burns, M., Coleman, P., Stitzer, M., Wale, J. B., & Kreek,
Audrain-McGovern, J., . . . Volpp, K. G. (2015). Randomized trial of M. J. (2005). Something of value: The introduction of contingency
four financial-incentive programs for smoking cessation. The New Eng- management interventions into the New York City Health and Hospital
land Journal of Medicine, 372, 2108 –2117. http://dx.doi.org/10.1056/ Addiction Treatment Service. Journal of Substance Abuse Treatment,
NEJMoa1414293 28, 57– 65. http://dx.doi.org/10.1016/j.jsat.2004.10.007
Hartzler, B. (2015). Building a bonfire that remains stoked: Sustain- Kendzor, D. E., Businelle, M. S., Poonawalla, I. B., Cuate, E. L., Kesh, A.,
ment of a contingency management intervention developed through Rios, D. M., . . . Balis, D. S. (2015). Financial incentives for abstinence
collaborative design. Substance Abuse Treatment, Prevention, and among socioeconomically disadvantaged individuals in smoking cessa-
Policy, 10, 30. http://dx.doi.org/10.1186/s13011-015-0027-0 tion treatment. American Journal of Public Health, 105, 1198 –1205.
Hartzler, B., Beadnell, B., & Donovan, D. (2017). Predictive validity of http://dx.doi.org/10.2105/AJPH.2014.302102
addiction treatment clinicians’ post-training contingency management Kong, G. (2013). Commentary on Alessi & Petry (2013): Cellular phone
skills for subsequent clinical outcomes. Journal of Substance Abuse technology and contingency management. Addiction, 108, 910 –911.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

Treatment, 72, 126 –133. http://dx.doi.org/10.1111/add.12133


This document is copyrighted by the American Psychological Association or one of its allied publishers.

Herbeck, D. M., Hser, Y. I., & Teruya, C. (2008). Empirically supported Kropp, F., Lewis, D., & Winhusen, T. (2017). The effectiveness of ultra-
substance abuse treatment approaches: A survey of treatment providers’ low magnitude reinforcers: Findings from a “real-world” application of
perspectives and practices. Addictive Behaviors, 33, 699 –712. http://dx contingency management. Journal of Substance Abuse Treatment, 72,
.doi.org/10.1016/j.addbeh.2007.12.003 111–116.
Hertzberg, J. S., Carpenter, V. L., Kirby, A. C., Calhoun, P. S., Moore, Lash, S. J., Timko, C., Curran, G. M., McKay, J. R., & Burden, J. L.
S. D., Dennis, M. F., . . . Beckham, J. C. (2013). Mobile contingency (2011). Implementation of evidence-based substance use disorder con-
management as an adjunctive smoking cessation treatment for smokers tinuing care interventions. Psychology of Addictive Behaviors, 25, 238 –
with posttraumatic stress disorder. Nicotine & Tobacco Research, 15, 251.
1934 –1938. http://dx.doi.org/10.1093/ntr/ntt060 Ledgerwood, D. M., Alessi, S. M., Hanson, T., Godley, M. D., & Petry,
Higgins, S. T., Budney, A. J., Bickel, W. K., Foerg, F. E., Donham, R., & N. M. (2008). Contingency management for attendance to group sub-
Badger, G. J. (1994). Incentives improve outcome in outpatient behav- stance abuse treatment administered by clinicians in community clinics.
ioral treatment of cocaine dependence. Archives of General Psychiatry, Journal of Applied Behavior Analysis, 41, 517–526. http://dx.doi.org/10
51, 568 –576. http://dx.doi.org/10.1001/archpsyc.1994.03950070060011 .1901/jaba.2008.41-517
Higgins, S. T., Heil, S. H., Dantona, R., Donham, R., Matthews, M., & Ledgerwood, D. M., & Petry, N. M. (2006). Does contingency manage-
Badger, G. J. (2007). Effects of varying the monetary value of voucher- ment affect motivation to change substance use? Drug and Alcohol
based incentives on abstinence achieved during and following treatment Dependence, 83, 65–72. http://dx.doi.org/10.1016/j.drugalcdep.2005.10
among cocaine-dependent outpatients. Addiction, 102, 271–281. http:// .012
dx.doi.org/10.1111/j.1360-0443.2006.01664.x Litt, M. D., Kadden, R. M., Kabela-Cormier, E., & Petry, N. M. (2008).
Higgins, S. T., Heil, S. H., & Lussier, J. P. (2004). Clinical implications of Coping skills training and contingency management treatments for mar-
reinforcement as a determinant of substance use disorders. Annual ijuana dependence: Exploring mechanisms of behavior change. Addic-
Review of Psychology, 55, 431– 461. http://dx.doi.org/10.1146/annurev tion, 103, 638 – 648. http://dx.doi.org/10.1111/j.1360-0443.2008
.psych.55.090902.142033 .02137.x
Higgins, S. T., & Petry, N. M. (1999). Contingency management. incen- Lott, D. C., & Jencius, S. (2009). Effectiveness of very low-cost contin-
tives for sobriety. Alcohol Research & Health, 23, 122–127. gency management in a community adolescent treatment program. Drug
Higgins, S. T., Sigmon, S. C., Wong, C. J., Heil, S. H., Badger, G. J., and Alcohol Dependence, 102(1–3), 162–165. http://dx.doi.org/10.1016/
Donham, R., . . . Anthony, S. (2003). Community reinforcement therapy j.drugalcdep.2009.01.010
for cocaine-dependent outpatients. Archives of General Psychiatry, 60, Lussier, J. P., Heil, S. H., Mongeon, J. A., Badger, G. J., & Higgins, S. T.
1043–1052. http://dx.doi.org/10.1001/archpsyc.60.9.1043 (2006). A meta-analysis of voucher-based reinforcement therapy for
Higgins, S. T., Silverman, K., & Heil, S. H. (Eds.). (2008). Contingency substance use disorders. Addiction, 101, 192–203. http://dx.doi.org/10
management in substance abuse treatment. New York, NY: Guilford .1111/j.1360-0443.2006.01311.x
Press. Mancino, M. J., McGaugh, J., Feldman, Z., Poling, J., & Oliveto, A.
Higgins, S. T., Washio, Y., Lopez, A. A., Heil, S. H., Solomon, L. J., (2010). Effect of PTSD diagnosis and contingency management proce-
Lynch, M. E., . . . Bernstein, I. M. (2014). Examining two different dures on cocaine use in dually cocaine- and opioid-dependent individ-
schedules of financial incentives for smoking cessation among pregnant uals maintained on LAAM: A retrospective analysis. The American
women. Preventive Medicine, 68, 51–57. http://dx.doi.org/10.1016/j Journal on Addictions, 19, 169 –177. http://dx.doi.org/10.1111/j.1521-
.ypmed.2014.03.024 0391.2009.00025.x
Higgins, S. T., Wong, C. J., Badger, G. J., Ogden, D. E., & Dantona, R. L. Manuel, J. K., Hagedorn, H. J., & Finney, J. W. (2011). Implementing
(2000). Contingent reinforcement increases cocaine abstinence during evidence-based psychosocial treatment in specialty substance use disor-
outpatient treatment and 1 year of follow-up. Journal of Consulting and der care. Psychology of Addictive Behaviors, 25, 225–237. http://dx.doi
Clinical Psychology, 68, 64 –72. http://dx.doi.org/10.1037/0022-006X .org/10.1037/a0022398
.68.1.64 McDonell, M. G., Howell, D. N., McPherson, S., Cameron, J. M., Srebnik,
Hser, Y. I., Li, J., Jiang, H., Zhang, R., Du, J., Zhang, C., . . . Zhao, M. D., Roll, J. M., & Ries, R. K. (2012). Voucher-based reinforcement for
(2011). Effects of a randomized contingency management intervention alcohol abstinence using the ethyl-glucuronide alcohol biomarker. Jour-
on opiate abstinence and retention in methadone maintenance treatment nal of Applied Behavior Analysis, 45, 161–165. http://dx.doi.org/10
in China. Addiction, 106, 1801–1809. http://dx.doi.org/10.1111/j.1360- .1901/jaba.2012.45-161
0443.2011.03490.x McDonell, M. G., Srebnik, D., Angelo, F., McPherson, S., Lowe, J. M.,
Kadden, R. M., Litt, M. D., Kabela-Cormier, E., & Petry, N. M. (2007). Sugar, A., . . . Ries, R. K. (2013). Randomized controlled trial of
Abstinence rates following behavioral treatments for marijuana depen- contingency management for stimulant use in community mental health
904 PETRY, ALESSI, OLMSTEAD, RASH, AND ZAJAC

patients with serious mental illness. The American Journal of Psychia- delivered brief intervention and low-intensity contingency management
try, 170, 94 –101. http://dx.doi.org/10.1176/appi.ajp.2012.11121831 for smoking during pregnancy. Nicotine & Tobacco Research, 14, 351–
McGovern, M. P., Fox, T. S., Xie, H., & Drake, R. E. (2004). A survey of 360. http://dx.doi.org/10.1093/ntr/ntr221
clinical practices and readiness to adopt evidence-based practices: Dis- Peirce, J. M., Petry, N. M., Stitzer, M. L., Blaine, J., Kellogg, S., Satter-
semination research in an addiction treatment system. Journal of Sub- field, F., . . . Li, R. (2006). Effects of lower-cost incentives on stimulant
stance Abuse Treatment, 26, 305–312. http://dx.doi.org/10.1016/j.jsat abstinence in methadone maintenance treatment: A National Drug
.2004.03.003 Abuse Treatment Clinical Trials Network study. Archives of General
McKay, J. R., Lynch, K. G., Coviello, D., Morrison, R., Cary, M. S., Psychiatry, 63, 201–208. http://dx.doi.org/10.1001/archpsyc.63.2.201
Skalina, L., & Plebani, J. (2010). Randomized trial of continuing care Petitjean, S. A., Dürsteler-MacFarland, K. M., Krokar, M. C., Strasser, J.,
enhancements for cocaine-dependent patients following initial engage- Mueller, S. E., Degen, B., . . . Farronato, N. S. (2014). A randomized,
ment. Journal of Consulting and Clinical Psychology, 78, 111–120. controlled trial of combined cognitive-behavioral therapy plus prize-
http://dx.doi.org/10.1037/a0018139 based contingency management for cocaine dependence. Drug and
Meredith, S. E., & Dallery, J. (2013). Investigating group contingencies to Alcohol Dependence, 145, 94 –100. http://dx.doi.org/10.1016/j
promote brief abstinence from cigarette smoking. Experimental and .drugalcdep.2014.09.785
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

Clinical Psychopharmacology, 21, 144 –154. http://dx.doi.org/10.1037/ Petry, N. M. (2012). Contingency management for substance abuse treat-
This document is copyrighted by the American Psychological Association or one of its allied publishers.

a0031707 ment: A guide to implementing this evidence-based practice. New York,


Meredith, S. E., Grabinski, M. J., & Dallery, J. (2011). Internet-based NY: Routledge.
group contingency management to promote abstinence from cigarette Petry, N. M., Alessi, S. M., Barry, D., & Carroll, K. M. (2015a). Standard
smoking: A feasibility study. Drug and Alcohol Dependence, 118, magnitude prize reinforcers can be as efficacious as larger magnitude
23–30. http://dx.doi.org/10.1016/j.drugalcdep.2011.02.012 reinforcers in cocaine-dependent methadone patients. Journal of Con-
Messina, N., Farabee, D., & Rawson, R. (2003). Treatment responsivity of sulting and Clinical Psychology, 83, 464 – 472. http://dx.doi.org/10
cocaine-dependent patients with antisocial personality disorder to .1037/a0037888
cognitive-behavioral and contingency management interventions. Jour- Petry, N. M., Alessi, S. M., Byrne, S., & White, W. B. (2015b). Reinforc-
nal of Consulting and Clinical Psychology, 71, 320 –329. http://dx.doi ing adherence to antihypertensive medications. Journal of Clinical Hy-
.org/10.1037/0022-006X.71.2.320 pertension, 17, 33–38. http://dx.doi.org/10.1111/jch.12441
Miguel, A. Q., Madruga, C. S., Cogo-Moreira, H., Yamauchi, R., Simoes, Petry, N. M., Alessi, S. M., Carroll, K. M., Hanson, T., MacKinnon, S.,
V., da Silva, C. J., . . . Laranjeira, R. R. (2016). Contingency manage- Rounsaville, B., & Sierra, S. (2006). Contingency management treat-
ment is effective in promoting abstinence and retention in treatment ments: Reinforcing abstinence versus adherence with goal-related activ-
among crack cocaine users in brazil: A randomized controlled trial. ities. Journal of Consulting and Clinical Psychology, 74, 592– 601.
Psychology of Addictive Behaviors: Journal of the Society of Psychol- Petry, N. M., Alessi, S. M., Hanson, T., & Sierra, S. (2007). Randomized
ogists in Addictive Behaviors, 30, 536 –543. http://dx.doi.org/10.1037/ trial of contingent prizes versus vouchers in cocaine-using methadone
adb0000192 patients. Journal of Consulting and Clinical Psychology, 75, 983–991.
National Institute for Health and Clinical Excellence. (2007). NICE clinical http://dx.doi.org/10.1037/0022-006X.75.6.983
guideline 51: Drug misuse: Psychosocial interventions. Accessed De- Petry, N. M., Alessi, S. M., & Ledgerwood, D. M. (2012a). A randomized
cember 29, 2014, retrieved from http://www.nice.org.uk/guidance/cg51 trial of contingency management delivered by community therapists.
Neighbors, C. J., Barnett, N. P., Rohsenow, D. J., Colby, S. M., & Monti, Journal of Consulting and Clinical Psychology, 80, 286 –298. http://dx
P. M. (2010). Cost-effectiveness of a motivational intervention for .doi.org/10.1037/a0026826
alcohol-involved youth in a hospital emergency department. Journal of Petry, N. M., Alessi, S. M., & Ledgerwood, D. M. (2012b). Contingency
Studies on Alcohol and Drugs, 71, 384 –394. http://dx.doi.org/10.15288/ management delivered by community therapists in outpatient settings.
jsad.2010.71.384 Drug and Alcohol Dependence, 122, 86 –92. http://dx.doi.org/10.1016/j
Olmstead, T. A., Abraham, A. J., Martino, S., & Roman, P. M. (2012). .drugalcdep.2011.09.015
Counselor training in several evidence-based psychosocial addiction Petry, N. M., Alessi, S. M., Marx, J., Austin, M., & Tardif, M. (2005b).
treatments in private US substance abuse treatment centers. Drug and Vouchers versus prizes: Contingency management treatment of sub-
Alcohol Dependence, 120, 149 –154. http://dx.doi.org/10.1016/j stance abusers in community settings. Journal of Consulting and Clin-
.drugalcdep.2011.07.017 ical Psychology, 73, 1005–1014. http://dx.doi.org/10.1037/0022-006X
Olmstead, T. A., & Petry, N. M. (2009). The cost-effectiveness of prize- .73.6.1005
based and voucher-based contingency management in a population of Petry, N. M., Alessi, S. M., & Rash, C. J. (2013a). A randomized study of
cocaine- or opioid-dependent outpatients. Drug and Alcohol Depen- contingency management in cocaine-dependent patients with severe and
dence, 102, 108 –115. http://dx.doi.org/10.1016/j.drugalcdep.2009.02 persistent mental health disorders. Drug and Alcohol Dependence,
.005 130(1–3), 234 –237. http://dx.doi.org/10.1016/j.drugalcdep.2012.10.017
Olmstead, T. A., Sindelar, J. L., Easton, C. J., & Carroll, K. M. (2007a). Petry, N. M., Alessi, S. M., & Rash, C. J. (2013b). Contingency manage-
The cost-effectiveness of four treatments for marijuana dependence. ment treatments decrease psychiatric symptoms. Journal of Consulting
Addiction, 102, 1443–1453. http://dx.doi.org/10.1111/j.1360-0443.2007 and Clinical Psychology, 81, 926 –931. http://dx.doi.org/10.1037/
.01909.x a0032499
Olmstead, T. A., Sindelar, J. L., & Petry, N. M. (2007b). Clinic variation Petry, N. M., Andrade, L. F., Barry, D., & Byrne, S. (2013c). A random-
in the cost-effectiveness of contingency management. The American ized study of reinforcing ambulatory exercise in older adults. Psychology
Journal on Addictions/American Academy of Psychiatrists in Alcoholism and Aging, 28, 1164 –1173. http://dx.doi.org/10.1037/a0032563
and Addictions, 16, 457– 460. Petry, N. M., Barry, D., Alessi, S. M., Rounsaville, B. J., & Carroll, K. M.
Olmstead, T. A., Sindelar, J. L., & Petry, N. M. (2007c). Cost-effectiveness (2012c). A randomized trial adapting contingency management targets
of prize-based incentives for stimulant abusers in outpatient psychoso- based on initial abstinence status of cocaine-dependent patients. Journal
cial treatment programs. Drug and Alcohol Dependence, 87, 175–182. of Consulting and Clinical Psychology, 80, 276 –285. http://dx.doi.org/
http://dx.doi.org/10.1016/j.drugalcdep.2006.08.012 10.1037/a0026883
Ondersma, S. J., Svikis, D. S., Lam, P. K., Connors-Burge, V. S., Ledger- Petry, N. M., DePhilippis, D., Rash, C. J., Drapkin, M., & McKay, J. R.
wood, D. M., & Hopper, J. A. (2012). A randomized trial of computer- (2014). Nationwide dissemination of contingency management: The
CONTINGENCY MANAGEMENT INTERVENTIONS 905

Veterans Administration initiative. The American Journal on Addictions, Rash, C. J., Alessi, S. M., & Petry, N. M. (2008). Contingency manage-
23, 205–210. http://dx.doi.org/10.1111/j.1521-0391.2014.12092.x ment is efficacious for cocaine abusers with prior treatment attempts.
Petry, N. M., Ford, J. D., & Barry, D. (2011). Contingency management is Experimental and Clinical Psychopharmacology, 16, 547–554. http://dx
especially efficacious in engendering long durations of abstinence in .doi.org/10.1037/a0014042
patients with sexual abuse histories. Psychology of Addictive Behaviors: Rash, C. J., Dephilippis, D., McKay, J. R., Drapkin, M., & Petry, N. M.
Journal of the Society of Psychologists in Addictive Behaviors, 25, (2013). Training workshops positively impact beliefs about contingency
293–300. http://dx.doi.org/10.1037/a0022632;10.1037/a0022632 management in a nationwide dissemination effort. Journal of Substance
Petry, N. M., & Martin, B. (2002). Low-cost contingency management for Abuse Treatment, 45, 306 –312. http://dx.doi.org/10.1016/j.jsat.2013.03
treating cocaine- and opioid-abusing methadone patients. Journal of .003;10.1016/j.jsat.2013.03.003
Consulting and Clinical Psychology, 70, 398 – 405. http://dx.doi.org/10 Rash, C. J., Olmstead, T. A., & Petry, N. M. (2009). Income does not affect
.1037/0022-006X.70.2.398 response to contingency management treatments among community
Petry, N. M., Martin, B., Cooney, J. L., & Kranzler, H. R. (2000). Give substance abuse treatment-seekers. Drug and Alcohol Dependence, 104,
them prizes, and they will come: Contingency management for treatment 249 –253. http://dx.doi.org/10.1016/j.drugalcdep.2009.05.018
of alcohol dependence. Journal of Consulting and Clinical Psychology, Rash, C. J., & Petry, N. M. (2015). Contingency management treatments
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

68, 250 –257. http://dx.doi.org/10.1037/0022-006X.68.2.250 are equally efficacious for both sexes in intensive outpatient settings.
This document is copyrighted by the American Psychological Association or one of its allied publishers.

Petry, N. M., Martin, B., & Finocche, C. (2001). Contingency management Experimental and Clinical Psychopharmacology, 23, 369 –376. http://
in group treatment: A demonstration project in an HIV drop-in center. dx.doi.org/10.1037/pha0000035
Journal of Substance Abuse Treatment, 21, 89 –96. http://dx.doi.org/10 Rash, C. J., Petry, N. M., Kirby, K. C., Martino, S., Roll, J., & Stitzer,
.1016/S0740-5472(01)00184-2 M. L. (2012). Identifying provider beliefs related to contingency man-
Petry, N. M., Martin, B., & Simcic, F., Jr. (2005c). Prize reinforcement agement adoption using the contingency management beliefs question-
contingency management for cocaine dependence: Integration with naire. Drug and Alcohol Dependence, 121, 205–212. http://dx.doi.org/
group therapy in a methadone clinic. Journal of Consulting and Clinical 10.1016/j.drugalcdep.2011.08.027
Psychology, 73, 354 –359. http://dx.doi.org/10.1037/0022-006X.73.2 Reback, C. J., Peck, J. A., Dierst-Davies, R., Nuno, M., Kamien, J. B., &
.354 Amass, L. (2010). Contingency management among homeless, out-of-
treatment men who have sex with men. Journal of Substance Abuse
Petry, N. M., Peirce, J. M., Stitzer, M. L., Blaine, J., Roll, J. M., Cohen, A.,
Treatment, 39, 255–263. http://dx.doi.org/10.1016/j.jsat.2010.06.007
. . . Li, R. (2005a). Effect of prize-based incentives on outcomes in
Reynolds, B., Harris, M., Slone, S. A., Shelton, B. J., Dallery, J., Stoops,
stimulant abusers in outpatient psychosocial treatment programs: A
W., & Lewis, R. (2015). A feasibility study of home-based contingency
national drug abuse treatment clinical trials network study. Archives of
management with adolescent smokers of rural Appalachia. Experimental
General Psychiatry, 62, 1148 –1156. http://dx.doi.org/10.1001/archpsyc
and Clinical Psychopharmacology, 23, 486 – 493. http://dx.doi.org/10
.62.10.1148
.1037/pha0000046
Petry, N. M., Rash, C. J., & Easton, C. J. (2011). Contingency management
Rohsenow, D. J., Martin, R. A., Tidey, J. W., Colby, S. M., & Monti, P. M.
treatment in substance abusers with and without legal problems. The
(2017). Treating smokers in substance treatment with contingent vouch-
Journal of the American Academy of Psychiatry and the Law, 39,
ers, nicotine replacement and brief advice adapted for sobriety settings.
370 –378.
Journal of Substance Abuse Treatment, 72, 72–79. http://dx.doi.org/10
Petry, N. M., & Simcic, F., Jr. (2002). Recent advances in the dissemina-
.1016/j.jsat.2016.08.012
tion of contingency management techniques: Clinical and research per-
Roll, J. M., Chudzynski, J., Cameron, J. M., Howell, D. N., & McPherson,
spectives. Journal of Substance Abuse Treatment, 23, 81– 86.
S. (2013). Duration effects in contingency management treatment of
Petry, N. M., Tedford, J., Austin, M., Nich, C., Carroll, K. M., & Roun-
methamphetamine disorders. Addictive Behaviors, 38, 2455–2462.
saville, B. J. (2004). Prize reinforcement contingency management for http://dx.doi.org/10.1016/j.addbeh.2013.03.018
treating cocaine users: How low can we go, and with whom? Addiction, Roman, P. M., & Johnson, J. (2004a). National treatment center study
99, 349 –360. http://dx.doi.org/10.1111/j.1360-0443.2003.00642.x summary report: Private treatment centers. Athens, GA: Institute for
Petry, N. M., Weinstock, J., Alessi, S. M., Lewis, M. W., & Dieckhaus, K. Behavioral Research, University of Georgia.
(2010). Group-based randomized trial of contingencies for health and Roman, P. M., & Johnson, J. (2004b). National treatment center study
abstinence in HIV patients. Journal of Consulting and Clinical Psychol- summary report: Public treatment centers. Athens, GA: Institute for
ogy, 78, 89 –97. http://dx.doi.org/10.1037/a0016778 Behavioral Research, University of Georgia.
Poling, J., Oliveto, A., Petry, N., Sofuoglu, M., Gonsai, K., Gonzalez, G., Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the
. . . Kosten, T. R. (2006). Six-month trial of bupropion with contingency facilitation of intrinsic motivation, social development, and well-being.
management for cocaine dependence in a methadone-maintained popu- American Psychologist, 55, 68 –78. http://dx.doi.org/10.1037/0003-
lation. Archives of General Psychiatry, 63, 219 –228. http://dx.doi.org/ 066X.55.1.68
10.1001/archpsyc.63.2.219 Schierenberg, A., van Amsterdam, J., van den Brink, W., & Goudriaan,
Prendergast, M., Podus, D., Finney, J., Greenwell, L., & Roll, J. (2006). A. E. (2012). Efficacy of contingency management for cocaine depen-
Contingency management for treatment of substance use disorders: A dence treatment: A review of the evidence. Current Drug Abuse Re-
meta-analysis. Addiction, 101, 1546 –1560. http://dx.doi.org/10.1111/j views, 5, 320 –331. http://dx.doi.org/10.2174/1874473711205040006
.1360-0443.2006.01581.x Schottenfeld, R. S., Moore, B., & Pantalon, M. V. (2011). Contingency
Promberger, M., & Marteau, T. M. (2013). When do financial incentives management with community reinforcement approach or twelve-step
reduce intrinsic motivation? comparing behaviors studied in psycholog- facilitation drug counseling for cocaine dependent pregnant women or
ical and economic literatures. Health Psychology, 32, 950 –957. http:// women with young children. Drug and Alcohol Dependence, 118, 48 –
dx.doi.org/10.1037/a0032727 55. http://dx.doi.org/10.1016/j.drugalcdep.2011.02.019
Raiff, B. R., Jarvis, B. P., Turturici, M., & Dallery, J. (2013). Acceptability Schumacher, J. E., Milby, J. B., Wallace, D., Meehan, D. C., Kertesz, S.,
of an Internet-based contingency management intervention for smoking Vuchinich, R., . . . Usdan, S. (2007). Meta-analysis of day treatment and
cessation: Views of smokers, nonsmokers, and healthcare professionals. contingency-management dismantling research: Birmingham homeless
Experimental and Clinical Psychopharmacology, 21, 204 –213. http:// cocaine studies (1990 –2006). Journal of Consulting and Clinical Psy-
dx.doi.org/10.1037/a0032451 chology, 75, 823– 828.
906 PETRY, ALESSI, OLMSTEAD, RASH, AND ZAJAC

Secades-Villa, R., García-Rodríguez, O., & Fernández-Hermida, J. R. and Alcohol Dependence, 105, 56 – 62. http://dx.doi.org/10.1016/j
(2015). Contingency management for substance use disorders in Spain: .drugalcdep.2009.06.010
Implications for research and practice. Preventive Medicine, 80, 82– 88. Substance Abuse and Mental Health Services Administration. (2013).
http://dx.doi.org/10.1016/j.ypmed.2015.07.001 National survey of substance abuse treatment services (N-SSATS): 2012
Secades-Villa, R., García-Rodríguez, O., García-Fernández, G., Sánchez- data on substance abuse treatment facilities. BHSIS series: S-66, HHS
Hervás, E., Fernandez-Hermida, J. R., & Higgins, S. T. (2011). Com- publication no (SMA) 14 – 4809.
munity reinforcement approach plus vouchers among cocaine-dependent Substance Abuse and Mental Health Services Administration. (2016).
outpatients: Twelve-month outcomes. Psychology of Addictive Behav- Coding for screening and brief intervention reimbursement. Retrieved
iors, 25, 174 –179. http://dx.doi.org/10.1037/a0021451 from http://www.samhsa.gov/sbirt/coding-reimbursement
Secades-Villa, R., García-Rodríguez, O., López-Núñez, C., Alonso-Pérez, Terplan, M., & Lui, S. (2007). Psychosocial interventions for pregnant
F., & Fernández-Hermida, J. R. (2014). Contingency management for women in outpatient illicit drug treatment programs compared to other
smoking cessation among treatment-seeking patients in a community interventions. Cochrane Database of Systematic Reviews, 4, CD006037.
setting. Drug and Alcohol Dependence, 140, 63– 68. http://dx.doi.org/ Tidey, J. W., Rohsenow, D. J., Kaplan, G. B., Swift, R. M., & Reid, N.
10.1016/j.drugalcdep.2014.03.030 (2011). Effects of contingency management and bupropion on cigarette
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.

Shearer, J., Tie, H., & Byford, S. (2015). Economic evaluations of con- smoking in smokers with schizophrenia. Psychopharmacology, 217,
279 –287. http://dx.doi.org/10.1007/s00213-011-2282-8
This document is copyrighted by the American Psychological Association or one of its allied publishers.

tingency management in illicit drug misuse programmes: A systematic


review. Drug and Alcohol Review, 34, 289 –298. http://dx.doi.org/10 U.S. Department of Health and Human Services. (2011). National diabetes
statistics. Washington, DC: National Diabetes Information Clearing-
.1111/dar.12240
house.
Sigmon, S. C., Miller, M. E., Meyer, A. C., Saulsgiver, K., Badger, G. J.,
Walker, R., Rosvall, T., Field, C. A., Allen, S., McDonald, D., Salim, Z.,
Heil, S. H., & Higgins, S. T. (2016). Financial incentives to promote
. . . Adinoff, B. (2010). Disseminating contingency management to
extended smoking abstinence in opioid-maintained patients: A random-
increase attendance in two community substance abuse treatment cen-
ized trial. Addiction, 111, 903–912. http://dx.doi.org/10.1111/add.13264
ters: Lessons learned. Journal of Substance Abuse Treatment, 39, 202–
Sigmon, S. C., & Stitzer, M. L. (2005). Use of a low-cost incentive
209. http://dx.doi.org/10.1016/j.jsat.2010.05.010
intervention to improve counseling attendance among methadone-
Walter, K. N., & Petry, N. M. (2015). Patients with diabetes respond well
maintained patients. Journal of Substance Abuse Treatment, 29, 253–
to contingency management treatment targeting alcohol and substance
258. http://dx.doi.org/10.1016/j.jsat.2005.08.004 use. Psychology, Health, and Medicine, 20, 916 –926. http://dx.doi.org/
Silverman, K., DeFulio, A., & Sigurdsson, S. O. (2012). Maintenance of 10.1080/13548506.2014.991334
reinforcement to address the chronic nature of drug addiction. Preventive Wang, L., Wei, X., Wang, X., Li, J., Li, H., & Jia, W. (2014). Long-term
Medicine, 55, S46 –S53. http://dx.doi.org/10.1016/j.ypmed.2012.03.013 effects of methadone maintenance treatment with different psychosocial
Sorensen, J. L., & Kosten, T. (2011). Developing the tools of implemen- intervention models. PLoS ONE, 9(2), e87931. http://dx.doi.org/10
tation science in substance use disorders treatment: Applications of the .1371/journal.pone.0087931
consolidated framework for implementation research. Psychology of Weiss, L. M., & Petry, N. M. (2011). Interaction effects of age and
Addictive Behaviors, 25, 262–268. contingency management treatments in cocaine-dependent outpatients.
Squires, D. D., Gumbley, S. J., & Storti, S. A. (2008). Training substance Experimental and Clinical Psychopharmacology, 19, 173–181. http://dx
abuse treatment organizations to adopt evidence-based practices: The .doi.org/10.1037/a0023031
Addiction Technology Transfer Center of New England science to Winhusen, T. M., Brigham, G. S., Kropp, F., Lindblad, R., Gardin, J. G.,
service laboratory. Journal of Substance Abuse Treatment, 34, 293–301. II, Penn, P., . . . Ghitza, U. (2014). A randomized trial of concurrent
Stanger, C., Lansing, A. H., & Budney, A. J. (2016). Advances in research smoking-cessation and substance use disorder treatment in stimulant-
on contingency management for adolescent substance use. Child and dependent smokers. The Journal of Clinical Psychiatry, 75, 336 –343.
Adolescent Psychiatric Clinics of North America, 25, 645– 659. http:// http://dx.doi.org/10.4088/JCP.13m08449
dx.doi.org/10.1016/j.chc.2016.05.002
Stoops, W. W., Dallery, J., Fields, N. M., Nuzzo, P. A., Schoenberg, N. E., Received January 12, 2017
Martin, C. A., . . . Wong, C. J. (2009). An internet-based abstinence Revision received April 10, 2017
reinforcement smoking cessation intervention in rural smokers. Drug Accepted April 23, 2017 䡲

S-ar putea să vă placă și