Skip to main content

Advertisement

SpringerLink
Log in

Is Project Towards No Drug Abuse (Project TND) an Evidence-Based Drug and Violence Prevention Program? A Review and Reappraisal of the Evaluation Studies

  • Literature Review
  • Published:
The Journal of Primary Prevention Aims and scope Submit manuscript

A Commentary to this article was published on 01 May 2014

Abstract

This paper critically reviews the published evidence pertaining to Project Towards No Drug Abuse (Project TND). Publications from seven evaluation studies of Project TND are reviewed, and the results from these are discussed as related to the following outcomes: main effects on the use of cigarettes, alcohol and marijuana; main effects on the use of “hard drugs,” defined in the evaluations as cocaine, hallucinogens, stimulants, inhalants, ecstasy and other drugs (e.g., depressants, PCP, steroids and heroin); subgroup and interaction analyses of drug use; and violence-related behaviors. Very few main effects have been found for cigarette, alcohol and marijuana use in the Project TND evaluations. While studies do report main effects for hard drug use, these findings are subject to numerous threats to validity and may be attributable to the data analyses employed. Similarly, while isolated subgroup and interaction effects were found for alcohol use among baseline nonusers and some violence-related behaviors in the early Project TND evaluations, these findings have not been replicated in more recent studies and may result from multiple comparisons between study conditions. In conclusion, there is little evidence to support the assertion that Project TND is an effective drug or violence prevention program. The broader implications of these findings for prevention science are discussed and suggestions are made as to how the quality of research in the field might be improved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Atkinson, R. L., & Macdonald, I. (2010). White hat bias: The need for authors to have the spin stop with them. International Journal of Obesity, 34, 89.

    Article  Google Scholar 

  • Barnett, E., Spruijt-Metz, D., Umger, J. B., Sun, P., Rohrbach, L. A., & Sussman, S. (2012). Boosting a teen substance use prevention program with motivational interviewing. Substance Use and Misuse, 47, 418–428.

    Article  PubMed Central  PubMed  Google Scholar 

  • Botvin, G. J., Sussman, S., & Biglan, A. (2001). The Hutchinson Smoking Prevention Project: A lesson on inaccurate media coverage and the importance of prevention advocacy (Editorial). Prevention Science, 2, 67–70.

    Article  CAS  PubMed  Google Scholar 

  • Brown, J. H. (2001). Youth, drugs and resilience education. Journal of Drug Education, 31, 83–122.

    Article  CAS  PubMed  Google Scholar 

  • Cope, M. B., & Allison, D. B. (2010). White hat bias: Examples of its presence in obesity research and a call for renewed commitment to faithfulness in research reporting. International Journal of Obesity, 34, 84–88.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Dent, C. W., Sussman, S., & Stacy, A. W. (2001). Project towards no drug abuse: Generalizability to a general high school sample. Preventive Medicine, 32, 514–520.

    Article  CAS  PubMed  Google Scholar 

  • Department of Health and Human Services (2007). Notice regarding Substance Abuse and Mental Health Services Administration’s National Registry of Evidence-Based Programs and Practices (NREPP): Priorities for NREPP Reviews. Federal Register, 72, 30814-30816. Retrieved May 1, 2013 from http://www.nrepp.samhsa.gov/pdfs/FRN060407.pdf.

  • Dodge, K. A., Dishion, T. J., & Lansford, J. E. (2006). Deviant peer influences in intervention and public policy for youth. Social Policy Report, 20, 1.

    Google Scholar 

  • Ellickson, P. L., & Bell, R. M. (1990). Drug prevention in junior high: A multi-site longitudinal test. Science, 247, 1299–1305.

    Article  CAS  PubMed  Google Scholar 

  • Fanelli, D. (2010). “Positive” results increase down the hierarchy of the sciences. PLoS ONE, 5(4), e10068. doi:10.1371/journal.pone.0010068.

    Article  PubMed Central  PubMed  Google Scholar 

  • Fanelli, D. (2012). Negative results are disappearing from most disciplines and countries. Scientometrics, 90, 891–904.

    Article  Google Scholar 

  • Fanelli, D. (2013). Only reporting guidelines can save (soft) science. European Journal of Personality, 27, 124–125.

    Google Scholar 

  • Fanelli, D., & Ioannidis, J. P. A. (2013). US studies may overestimate effect sizes in softer research. Proceedings of the National Academies of Science, 110, 15031–15036.

    Article  CAS  Google Scholar 

  • Ferguson, C. J., & Heene, M. (2012). A vast graveyard of undead theories: Publication bias and psychological science’s aversion to the null. Perspectives on Psychological Science, 7, 555–561.

    Article  Google Scholar 

  • Flick, S. N. (1988). Managing attrition in clinical research. Clinical Psychology Review, 8, 499–515.

    Article  Google Scholar 

  • Gandhi, A. G., Murphy-Graham, E., Petrosino, A., Chrismer, S. S., & Weiss, C. H. (2007). The devil is in the details: Examining the evidence for “proven” school-based drug abuse prevention program. Evaluation Review, 31, 43–74.

    Article  PubMed  Google Scholar 

  • Gerstein, D. R., & Green, L. W. (1993). Preventing drug abuse: What do we know?. Washington, DC: National Academy Press.

    Google Scholar 

  • Gorman, D. M. (2002a). Defining and operationalizing “research-based” prevention: A critique (with case studies) of the US Department of Education’s Safe, Disciplined and Drug-Free Schools Exemplary Programs. Evaluation and Program Planning, 25, 295–302.

    Article  Google Scholar 

  • Gorman, D. M. (2002b). The “science” of drug and alcohol prevention: The case of the randomized trial of the Life Skills Training Program. International Journal of Drug Policy, 13, 21–26.

    Article  Google Scholar 

  • Gorman, D. M. (2005a). Does measurement dependence explain the effects of the Life Skills Training Program on smoking outcomes? Preventive Medicine, 40, 479–487.

    Article  PubMed  Google Scholar 

  • Gorman, D. M. (2005b). Drug and violence prevention: Rediscovering the critical rational dimension of evaluation research. Journal of Experimental Criminology, 1, 39–62.

    Article  Google Scholar 

  • Gorman, D. M. (2011). Does the Life Skills Training program prevent use of marijuana? Addiction Research & Theory, 19, 470–481.

    Article  Google Scholar 

  • Gorman, D. M., & Conde, E. (2009). Further comments on the path to drawing reasonable conclusions about prevention. Addiction, 104, 152–154.

    Article  PubMed  Google Scholar 

  • Gorman, D. M., & Conde, E. (2010). The making of evidence-based practice: The case of project alert. Children and Youth Services Review, 32, 214–222.

    Article  PubMed Central  PubMed  Google Scholar 

  • Gorman, D. M., Conde, E., & Huber, J. C., Jr. (2007). The creation of evidence in “evidenced-based” drug prevention: A critique of the Strengthening Families Program Plus Life Skills Training evaluation. Drug and Alcohol Review, 26, 585–593.

    Article  CAS  PubMed  Google Scholar 

  • Gorman, D. M., & Huber, J. C., Jr. (2009). The social construction of “evidence-based” drug prevention: A reanalysis of data from the Drug Abuse Resistance Education (DARE) program. Evaluation Review, 33, 396–414.

    Article  PubMed  Google Scholar 

  • Hallfors, D., Cho, H., Sanchez, V., Khatapoush, S., Kim, H. M., & Bauer, D. (2006). Efficacy vs effectiveness trial results of an indicated “model” substance abuse program: Implications for public health. American Journal of Public Health, 96, 2254–2259.

    Article  PubMed Central  PubMed  Google Scholar 

  • Hallfors, D. D., Pankratz, M., & Hartman, S. (2007). Does federal policy support the use of scientific evidence in school-based prevention programs? Prevention Science, 8, 75–81.

    Article  PubMed  Google Scholar 

  • Herbert, J. D., Lilienfeld, S. O., Lohr, J. M., Montgomery, R. W., O’Donohue, W. T., Rosen, G. M., et al. (2000). Science and pseudoscience in the development of eye movement desensitization and reprocessing: Implications for clinical psychology. Clinical Psychology Review, 20, 945–971.

    Article  CAS  PubMed  Google Scholar 

  • Holder, H. D. (2010). Prevention programs in the 21st century: What we do not discuss in public. Addiction, 105, 578–581.

    Article  PubMed  Google Scholar 

  • Institute for Prevention Research, University of Southern California (no date). Project Towards No Drug Abuse: Awards and recognition. Retrieved May 1, 2013 from http://tnd.usc.edu/overview_award.php.

  • Ioannidis, J. P. A. (2005). Why most published research findings are false. PLoS Medicine, 2, 124. (0696-0701).

    Article  Google Scholar 

  • Juni, P., Altman, D. G., & Egger, M. (2001). Assessing the quality of controlled clinical trials. British Medical Journal, 323, 42–46.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Kerr, N. L. (1998). HARKing: Hypothesizing after the results are known. Personality and Social Psychology Review, 2, 196–217.

    Article  CAS  PubMed  Google Scholar 

  • Lishna, N. E., Sun, P., Rohrbach, L. A., Spruijt-Metz, D., Unger, J. B., & Sussman, S. (2012). An evaluation of immediate outcomes and fidelity of a drug abuse prevention program in continuation high schools: Project Towards No Drug Abuse (TND). Journal of Drug Education, 42, 33–57.

    Article  Google Scholar 

  • Littell, J. H. (2006). Methodological critique and meta-analysis as Trojan horse. Children and Youth Services Review, 28, 447–457.

    Article  Google Scholar 

  • Littell, J. H., Popa, M., & Forsythe, B. (2005). Multisystemic Therapy for social, emotional, and behavioral problems in youth aged 10–17 (Cochrane Review). Cochrane Database of Systematic Reviews 2005, Issue 4, Art. No.CD004797. doi:10.1002/14651858.CD004797. pub4 (Also available in Campbell Systematic Reviews 2005, Issue 1. doi:10.4703/csr.2005.1).

  • McCuller, W. J., Sussman, S., Holiday, K., Craig, S., & Dent, C. L. (2002). Tracking procedures for locating high-risk youth. Evaluation and the Health Professions, 25, 345–362.

    Article  PubMed  Google Scholar 

  • Midford, R. (2008). Is this the path to effective prevention? Addiction, 103, 1169–1173.

    Article  PubMed  Google Scholar 

  • Popper, K. R. (1963). Conjectures and refutations: The growth of scientific knowledge. New York: Routledge.

    Google Scholar 

  • Ringwalt, C. L., Clark, H. K., Hanley, S., Shamblen, S. R., & Flewelling, R. L. (2010). The effects of project alert one year past curriculum completion. Prevention Science, 11, 172–184.

    Article  PubMed  Google Scholar 

  • Ringwalt, C., Paschall, M. J., Gorman, D. M., Derzon, J., & Kinlaw, A. (2011). The use of one- versus two-tail tests to evaluate prevention programs. Evaluation and the Health Professions, 34, 135–150.

    Article  PubMed  Google Scholar 

  • Rohrbach, L. A., Gunning, M., Sun, P., & Sussman, S. (2010a). The Project Towards No Drug Abuse (TND) dissemination trial: Implementation fidelity and immediate outcomes. Prevention Science, 11, 77–88.

    Article  PubMed Central  PubMed  Google Scholar 

  • Rohrbach, L. A., Sun, P., & Sussman, S. (2010b). One-year follow-up evaluation of the Project Towards No Drug Abuse (TND) dissemination trial. Preventive Medicine, 51, 313–319.

    Article  PubMed Central  PubMed  Google Scholar 

  • Schulz, K. F., & Grimes, D. A. (2002). Sample size slippages in randomized trials: Exclusions and the lost and wayward. The Lancet, 359, 781–785.

    Article  Google Scholar 

  • Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366.

    Article  PubMed  Google Scholar 

  • Simon, T. R., Sussman, S., Dahlberg, L. L., & Dent, C. W. (2002). Influence of a substance-abuse-prevention curriculum on violence-related behavior. American Journal of Health Behavior, 26, 103–110.

    Article  PubMed  Google Scholar 

  • Society for Prevention Research (2004). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Falls Church, VA: Society for prevention research. Retrieved September 11, 20133 from http://www.preventionresearch.org/advocacy/#SofE.

  • St. Pierre, T. L., Osgood, D. W., Mincemoyer, C. C., Kaltreider, D. L., & Kauh, T. J. (2005). Results of an independent evaluation of project alert delivered in schools by cooperative extension. Prevention Science, 6, 305–317.

    Article  PubMed  Google Scholar 

  • Sun, W., Skara, S., Sun, P., Dent, C. W., & Sussman, S. (2006). Project Towards No Drug Abuse: Long-term substance use outcome evaluation. Preventive Medicine, 42, 188–192.

    Article  CAS  PubMed  Google Scholar 

  • Sun, P., Sussman, S., Dent, C. W., & Rohrbach, L. A. (2008). One-year follow-up evaluation of Project Towards No Drug Abuse (TND-4). Preventive Medicine, 47, 438–442.

    Article  PubMed Central  PubMed  Google Scholar 

  • Sussman, S., Dent, C., Simon, T. R., Stacy, A. W., Galaif, E. R., Moss, M. A., et al. (1995). Immediate impact of social influence-orientated substance abuse prevention curricula in traditional and continuation high schools. Drugs and Society, 8, 65–81.

    Article  Google Scholar 

  • Sussman, S., Dent, C. W., & Stacy, A. W. (2002). Project Towards No Drug Abuse: A review of the findings and future directions. American Journal of Health Behavior, 26, 354–365.

    Article  PubMed  Google Scholar 

  • Sussman, S., Dent, C. W., Stacy, A. W., & Craig, S. (1998a). One-year outcomes of Project Towards No Drug Abuse. Preventive Medicine, 27, 632–642.

    Article  CAS  PubMed  Google Scholar 

  • Sussman, S., Dent, C. W., Stacy, A. W., & Craig, S. (1998b). One-year outcomes of Project Towards No Drug Abuse. Erratum. Preventive Medicine, 27, 766.

    Article  Google Scholar 

  • Sussman, S., Hansen, W. B., Flay, B. R., & Botvin, G. J. (2001). Re: Hutchinson Smoking Prevention Project: Long-term randomized trial in school-based tobacco use prevention—results on smoking. Journal of the National Cancer Institute, 93, 1267.

    Article  CAS  PubMed  Google Scholar 

  • Sussman, S., Rohrbach, L., & Mihalic, S. (2004). Blueprints for violence prevention: Project Towards No Drug Abuse. Boulder, CO: Center for the Study and Prevention of Violence, University of Colorado.

    Google Scholar 

  • Sussman, S., Sun, P., McCuller, W. J., & Dent, C. W. (2003). Project Towards No Drug Abuse: Two-year outcomes of a trial that compares health educator delivery to self-instruction. Preventive Medicine, 37, 155–162.

    Article  PubMed  Google Scholar 

  • Sussman, S., Sun, P., Rohrbach, L. A., & Spruijt-Metz, D. (2012). One-year outcomes of a drug abuse prevention program for older teens and emerging adults: Evaluating a motivational interviewing booster component. Health Psychology, 31, 476–485.

    Article  PubMed Central  PubMed  Google Scholar 

  • US Substance Abuse and Mental Health Services Administration (2007). Intervention Summary: Project Towards No Drug Abuse. Retrieved May 1, 2013 from http://nrepp.samhsa.gov/ViewIntervention.aspx?id=21#Study%205.

  • US Substance Abuse and Mental Health Services Administration (2013a). SAMHSA’s National Registry of Evidence-based Programs and Practices: Viewing 303 interventions. Retrieved September 10, 2013 from http://www.nrepp.samhsa.gov/ViewAll.aspx.

  • US Substance Abuse and Mental Health Services Administration (2013b). About NREPP. Retrieved September 10, 2013 from http://www.nrepp.samhsa.gov/AboutNREPP.aspx.

  • Valente, T. W., Ritt-Olson, A., Stacey, A., Unger, J. B., Okamoto, J., & Sussman, S. (2007). Peer acceleration: Effects of a social network tailored substance abuse prevention program among high-risk adolescents. Addiction, 102, 1804–1815.

    Article  PubMed  Google Scholar 

  • Weiss, C. H., Murphy-Graham, E., Petrosini, A., & Gandhi, A. G. (2008). The fairy godmother—and her warts: Making the dream of evidence-based policy come true. Evaluation Review, 29, 29–47.

    Google Scholar 

Download references

Acknowledgments

I would like to thank the anonymous reviewers of the manuscript and three members of the journal editorial board for their very helpful comments and suggestions.

Author information

Authors and Affiliations

  1. Department of Epidemiology and Biostatistics, School of Public Health, Texas A&M Health Science Center, TAMU 1266, College Station, TX, 77843-1266, USA

    Dennis M. Gorman

Authors
  1. Dennis M. Gorman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dennis M. Gorman.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gorman, D.M. Is Project Towards No Drug Abuse (Project TND) an Evidence-Based Drug and Violence Prevention Program? A Review and Reappraisal of the Evaluation Studies. J Primary Prevent 35, 217–232 (2014). https://doi.org/10.1007/s10935-014-0348-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10935-014-0348-1

Keywords

Search

Navigation