Placebo response in clinical trials of depression and its implications for research on chronic neuropathic pain
Abstract
This article reviews studies of the placebo response in antidepressant clinical trials, describes methods that have been attempted to decrease it, and discusses implications of the placebo response in depression for research on treatments for neuropathic pain. Literature reviews and research studies examining the placebo response in clinical trials of treatments for depression were reviewed. Existing data suggest that the placebo response in antidepressant clinical trials is substantial and that a high placebo response in a clinical trial is associated with a reduced likelihood of demonstrating the statistical superiority of antidepressant treatment vs. placebo. Attempts to decrease the placebo response in antidepressant clinical trials have generally not been effective. In addition, there is little evidence that decreasing the placebo response rate makes it more likely that superiority of active vs. placebo treatment will be demonstrated. Analyses of neuropathic pain clinical trial databases should be conducted to examine factors associated with trial outcomes. Aspects of neuropathic pain clinical trials that require further consideration or investigation include the following: (a) exclusion of patients with mild pain severity; (b) exclusion of patients with short episode duration; (c) maximizing reliability, validity, and responsiveness of outcome measures; (d) minimizing extraneous contact with investigative staff and other sources of nonspecific therapeutic effects; (e) trial duration; (f) minimizing the number of treatment groups; (g) flexible vs. fixed dose designs; (h) strategies for identifying patients and accelerating enrollment; (i) identification of run-in periods that reduce the placebo response rate; and (j) registration of clinical trials and publication of negative studies.
Get full access to this article
View all available purchase options and get full access to this article.
References
1.
Watson CP, Evans RJ, Reed K, Merskey H, Goldsmith L, Warsh J. Amitriptyline versus placebo in postherpetic neuralgia. Neurology 1982;32:671–673.
2.
Kvinesdal B, Molin J, Froland A, Gram LF. Imipramine treatment of painful diabetic neuropathy. JAMA 1984;251:1727–1730.
3.
Max MB, Culnane M, Schafer SC, et al. Amitriptyline relieves diabetic neuropathy pain in patients with normal or depressed mood. Neurology 1987;37:589–596.
4.
Backonja M, Beydoun A, Edwards KR, et al., for the Gabapentin Diabetic Neuropathy Study Group: Gabapentin for the symptomatic treatment of painful neuropathy in patients with diabetes mellitus. JAMA 1998;280:1831–1836.
5.
Rowbotham MC, Harden N, Stacey B, Bernstein P, Magnus-Miller L, for the Gabapentin Postherpetic Neuralgia Study Group: Gabapentin for the treatment postherpetic neuralgia: a randomized controlled trial. JAMA 1998;280:1837–1842.
6.
Farrar JT, Young JP Jr, LaMoreaux L, Werth JL, Poole RM. Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale. Pain 2001;94:149–158.
7.
Woolf CJ, Max MB. Mechanism-based pain diagnosis. Anesthesiology 2001;95:241–249.
8.
Woolf CJ. Pain: moving from symptom control toward mechanism-specific pharmacologic management. Ann Intern Med 2004;140:441–451.
9. Abstract.
Safirstein B, Tuchman M, Dogra S, et al. Efficacy of lamotrigine in painful diabetic neuropathy: results from two large double-blind trials. J Pain 2005;6(suppl 3):S34.
10.
Eisenberg E, Luria Y, Braker C, Daoud D, Ishay A. Lamotrigine reduces painful diabetic neuropathy: a randomized, controlled study. Neurology 2001;57:505–509.
11.
Vestergaard K, Andersen G, Gottrup H, Kristensen BT, Jensen TS: Lamotrigine for central poststroke pain: a randomized controlled trial. Neurology 2001;56:184–190.
12.
Finnerup NB, Sindrup SH, Bach FW, Johannesen IL, Jensen TS. Lamotrigine in spinal cord injury pain: a randomized controlled trial. Pain 2002;96:375–383.
13.
Simpson DM, Olney R, McArthur JC, Khan A, Godbold J, Ebel-Frommer K. A placebo-controlled trial of lamotrigine for painful HIV associated neuropathy. Neurology 2000;54:2115–2119.
14.
Simpson DM, McArthur JC, Olney R, et al. Lamotrigine for HIV-associated painful sensory neuropathies: a placebo-controlled trial. Neurology 2003;60:1508–1514.
15.
Thienel U, Neto W, Schwabe SK, Vijapurkur U. Topiramate in painful diabetic polyneuropathy: findings from three double-blind placebo-controlled trials. Acta Neurol Scand 2004;110:221–231.
16.
Raskin P, Donofrio PD, Rosenthal NR, et al. Topiramate vs placebo in painful diabetic neuropathy: analgesic and metabolic effects. Neurology 2004;63:865–873.
17.
Backonja M, Glanzman RL. Gabapentin dosing for neuropathic pain: evidence from randomized, placebo-controlled clinical trials. Clin Ther 2003;25:81–104.
18.
Dworkin RH, Backonja M, Rowbotham MC, et al. Advances in neuropathic pain: diagnosis, mechanisms, and treatment recommendations. Arch Neurol 2003;60:1524–1534.
19.
Neurobiological technologies. Memantine. www.ntii.com/products/memantine.shtml, accessed June 20, 2005.
20. Abstract.
Pellegino RG, Petit WA, Brazg R, et al. Memantine in the treatment of diabetic peripheral neuropathy: a placebo-controlled phase IIB trial. Neurology 2000;54(Suppl):A82.
21.
Dogra S, Beydoun S, Mazzola J, Hopwood M, Wan Y. Oxcarbazepine in painful diabetic neuropathy: a randomized, placebo-controlled study. Eur J Pain 2005;9:543–554.
22.
Max MB. Thirteen consecutive well-designed randomized trials show that antidepressants reduce pain in diabetic neuropathy and postherpetic neuralgia. Pain Forum 1995;4:248–253.
23.
Harati Y, Gooch C, Swenson M, et al. Double-blind randomized trial of tramadol for the treatment of the pain of diabetic neuropathy. Neurology 1998;50:1842–1846.
24.
Gimbel JS, Richards P, Portenoy RK. Controlled-release oxycodone for pain in diabetic neuropathy: a randomized controlled trial. Neurology 2003;60:927–934.
25.
Watson CPN, Moulin D, Watt-Watson J, Gordon A, Eisenhoffer J. Controlled-release oxycodone relieves neuropathic pain: a randomized controlled trial in painful diabetic neuropathy. Pain 2003;105:71–78.
26.
Goldstein DJ, Pritchett YL, Detke MJ, Lee TC, Iyengar S. Duloxetine vs. placebo in patients with painful diabetic neuropathy. Pain 2005;116:109–118.
27.
Raskin J, Pritchett YL, Wang F, D'Souza DN, Waninger AL, Wernicke JF. A double-blind, randomized multicenter trial comparing duloxetine with placebo in the management of diabetic peripheral neuropathic pain. Pain Med 2005;6:346–356.
28.
Lesser H, Sharma U, LaMoreaux L, Poole RM. Pregabalin relieves symptoms of painful diabetic neuropathy. Neurology 2004;63:2104–2110.
29.
Rosenstock J, Tuchman M, LaMoreaux L, Sharma U. Pregabalin for the treatment of painful diabetic peripheral neuropathy: a double-blind, placebo-controlled trial. Pain 2004;110:628–638.
30.
Richter RW, Portenoy R, Sharma U, Lamoreaux L, Bockbrader H, Knapp LE. Relief of painful diabetic peripheral neuropathy with pregabalin: a randomized, placebo-controlled trial. J Pain 2005;6:253–260.
31.
Klein DF, Thase ME, Endicott J, et al. Improving clinical trials: American Society of Clinical Psychopharmacology recommendations. Arch Gen Psychiatry 2002;59:272–278.
32.
Khan A, Detke M, Khan SRF, Mallinckrodt C. Placebo response and antidepressant clinical trial outcome. J Nerv Ment Dis 2003;191:211–218.
33.
Montgomery SA. Alternatives to placebo-controlled trials in psychiatry. Eur Neuropsychopharmacology 1999;9:265–269.
34.
Charney DS, Nemeroff CB, Lewis L, et al. National Depressive and Manic-Depressive Association consensus statement on the use of placebo in clinical trials of mood disorders. Arch Gen Psychiatry 2002;59:262–270.
35.
Ernst E, Resch KL. Concept of true and perceived placebo effects. BMJ 1995;311:551–553.
36.
Kienle GS, Kiene H. The powerful placebo effect: fact or fiction? J Clin Epidemiol 1997;50:1311–1318.
37.
Vase L, Riley JL III, Price DD. A comparison of placebo effects in clinical analgesic trials versus studies of placebo analgesia. Pain 2002;99:443–452.
38.
Kleijnen J, de Craen AJM, van Everdingen J, Krol L. Placebo effect in double-blind clinical trials: a review of interactions with medications. Lancet 1994;344:1347–1349.
39.
Quitkin FM. Placebos, drug effects, and study design: a clinician's guide. Am J Psychiatry 1999;156:829–836.
40.
Kirsch I. Are drug and placebo effects in depression additive? Biol Psychiatry 2000;47:733–735.
41.
Whitney CW, Von Korff M. Regression to the mean in treated versus untreated chronic pain. Pain 1992;50:281–285.
42.
Schatzberg AF, Kraemer HC. Use of placebo control groups in evaluating efficacy of treatment of unipolar major depression. Biol Psychiatry 2000;47:736–744.
43.
Walsh BT, Seidman SN, Sysko R, Gould M. Placebo response in studies of major depression: variable, substantial, and growing. JAMA 2002;287:1840–1847.
44.
Robinson DS, Rickels K. Concerns about clinical drug trials. J Clin Psychopharmacol 2000;20:593–596.
45.
Rush AJ. The use of placebos in unipolar major depression: the current status. Biol Psychiatry 2000;47:745–747.
46.
Montgomery SA. The failure of placebo-controlled studies. Eur Neuropsychopharmacol 1999;9:271–276.
47.
Max MB. Small clinical trials. In: Gallin JI, ed. Principles and practice of clinical research. New York: Academic Press, 2002;207–224.
48.
Charney DS. The use of placebos in randomized clinical trials of mood disorders: well-justified, but improvements in design are indicated. Biol Psychiatry 2000;47:687–688.
49.
Fava M, Evins AE, Dorer DJ, Schoenfeld DA. The problem of the placebo response in clinical trials for psychiatric disorders: culprits, possible remedies, and a novel study design approach. Psychother Psychosom 2003;72:115–127.
50.
Fairchild CJ, Rush AJ, Vasavada N, Giles DE, Khatami M. Which depressions respond to placebo? Psychiatry Res 1986;18:217–226.
51.
Rabkin JG, Stewart JW, McGrath PJ, Markowitz JS, Harrison W, Quitkin FM. Baseline characteristics of 10-day placebo washout responders in antidepressant trials. Psychiatry Res 1987;21:9–22.
52.
Rapaport MH, Hyman M, Zisook S, et al. A comparison of descriptive variables for clinical patients and symptomatic volunteers with depressive disorders. J Clin Psychopharmacol 1996;16:242–246.
53.
Moleman P. Symptomatic volunteers different from patients with depressive disorders? J Clin Psychopharmacol 1997;17:323–324.
54.
Landin R, DeBrota DJ, DeVries TA, Potter WZ, Demitrack MA. The impact of restrictive entry criterion during the placebo lead-in period. Biometrics 2000;56:271–278.
55.
Niklson IA, Reimitz PE, Sennef C. Factors that influence the outcome of placebo-controlled antidepressant clinical trials. Psychopharmacol Bull 1997;33:41–51.
56.
Demitrack MA, Faries D, Herrera JM, DeBrota DJ, Potter WZ. The problem of measurement error in multisite clinical trials. Psychopharmacol Bull 1998;34:19–24.
57.
Hamilton M. A rating scale for depression. J Neurol Neurosurg Psychiatry 1960;23:56–61.
58.
Posternak MA, Zimmerman M, Keitner GI, Miller IW. A reevaluation of the exclusion criteria used in antidepressant efficacy trials. Am J Psychiatry 2002;159:191–200.
59.
Zimmerman M, Mattia JI, Posternak MA. Are subjects in pharmacological treatment trials of depression representative of patients in routine clinical practice? Am J Psychiatry 2002;159:469–473.
60.
Keitner GI, Posternak MA, Ryan CE. How many subjects with major depressive disorder meet eligibility requirements of an antidepressant efficacy trial? J Clin Psychiatry 2003;64:1091–1093.
61.
Posternak MA, Zimmerman M. Is there a delay in the antidepressant effect? A meta-analysis. J Clin Psychiatry 2005;66:148–158.
62.
Rochon PA, Binns MA, Litner JA, et al. Are randomized control trial outcomes influenced by the inclusion of a placebo group?: a systematic review of nonsteroidal anti-inflammatory drug trials for arthritis treatment. J Clin Epidemiol 1999;52:113–122.
63.
Colloca L, Lopiano L, Lanotte M, Benedetti F. Overt versus covert treatment for pain, anxiety, and Parkinson's disease. Lancet Neurol 2004;3:679–684.
64.
Khan A, Khan SR, Walens G, Kolts R, Giller EL. Frequency of positive studies among fixed and flexible dose antidepressant clinical trials: an analysis of the Food and Drug Administration summary basis of approval reports. Neuropsychopharmacology 2003;28:552–557.
65.
Pablos-Mendez A, Barr RG, Shea S. Run-in periods in randomized trials: implications for the application of results in clinical practice. JAMA 1998;279:222–225.
66.
Lang JM. The use of a run-in to enhance compliance. Stat Med 1990;9:87–95.
67.
Lang JM, Buring JE, Rosner B, Cook N, Hennekens CH. Estimating the effect of the run-in on the power of the Physicians' Health Study. Stat Med 1991;10:1585–1593.
68.
Schnitzer TJ, Gray WL, Paster Z, Kamin M. Efficacy of tramadol in treatment of chronic low back pain. J Rheumatol 2000;27:772–778.
69.
Schnitzer TJ, Kamin M, Olson WH. Tramadol allows reduction of naproxen dose among patients with naproxen-responsive osteoarthritis pain: a randomized, double-blind, placebo-controlled study. Arthritis Rheum 1999;42:1370–1377.
70.
Rapaport MH, Judd LL, Schettler PJ, et al. A descriptive analysis of minor depression. Am J Psychiatry 2002;159:637–643.
71.
Max MB. Neuropathic pain syndromes. In: Max MB, Portenoy RK, Laska EM, eds. The design of analgesic clinical trials. New York: Raven Press, 1991;193–219.
72. Letter.
Kramer M. Placebo run-in for antidepressant trials. Neuropsychopharmacology 1996;15:105.
73.
Lader M, Scotto JC. A multicentre double-blind comparison of hydroxyzine, buspirone and placebo in patients with generalized anxiety disorder. Psychopharmacology 1998;139:402–406.
74. Abstract.
Greenhill LL, Findling RL, Swanson JM. A double-blind, placebo-controlled study of modified-release methylphenidate in children with attention-deficit/hyperactivity disorder. Pediatrics 2002;109:e39.
75.
Liebowitz MR, Stein MB, Tancer M, Carpenter D, Oakes R, Pitts CD. A randomized, double-blind, fixed-dose comparison of paroxetine and placebo in the treatment of generalized social anxiety disorder. J Clin Psychiatry 2002;63:66–74.
76.
Adhoute G, Andreassian B, Boccalon H, et al. Treatment of Stage II chronic arterial disease of the lower limbs with the serotonergic antagonist naftidrofuryl: results after 6 months of a controlled, multicenter study. J Cardiovasc Pharmacol 1990;16(suppl 3):S75–80.
77.
Varia I, Logue E, O'Connor C, et al. Randomized trial of sertraline in patients with unexplained chest pain of noncardiac origin. Am Heart J 2000;140:367–372.
78.
Krogh K, Jensen MB, Gandrup P, et al. Efficacy and tolerability of prucalopride in patients with constipation due to spinal cord injury. Scand J Gastroenterol 2002;37:431–436.
79.
Trivedi MH, Rush J. Does a placebo run-in or a placebo treatment cell affect the efficacy of antidepressant medications? Neuropsychopharmacology 1994;11:33–43.
80.
Greenberg RP, Fisher S, Riter JA. Placebo washout is not a meaningful part of antidepressant drug trials. Percept Mot Skills 1995;98:688–690.
81.
Lee S, Walker JR, Jakul L, Sexton K. Does elimination of placebo responders in a placebo run-in increase the treatment effect in randomized clinical trials? A meta-analytic evaluation. Depress Anxiety 2004;19:10–19.
82.
Reimherr FW, Ward MR, Byerly WF. The introductory placebo washout: a retrospective evaluation. Psychiatry Res 1989;30:191–199.
83.
Rabkin JG, McGrath P, Stewart JW, Harrison W, Markowitz JS, Quitkin F. Follow-up of patients who improved during placebo. J Clin Psychopharmacol 1986;6:274–278.
84.
Quitkin FM, Stewart JW, McGrath PJ, et al. Further evidence that a placebo response to antidepressants can be identified. Am J Psychiatry 1993;150:566–570.
85.
Trivedi MH, Baker SM. Clinical significance of monitoring early symptom change to predict outcome. J Clin Psychiatry 2001;62(suppl 4):27–33.
86.
Quitkin FM, McGrath PJ, Stewart JW, et al. Placebo run-in period in studies of depressive disorders: clinical, heuristic and research implications. Br J Psychiatry 1998;173:242–248.
87.
Ramsay LE. Commentary: placebo run-ins have some value. BMJ 1997;314:7088.
88.
Senn S. A personal view of some controversies in allocating treatment to patients in clinical trials. Stat Med 1995;14:2661–2674.
89.
Senn S. Are placebo run-ins justified? BMJ 1997; 314: 1191–1193.
90.
Skovlund E. Should the single-blind placebo responder exclusion phase be omitted from clinical trials? Nord J Psychiatry 1994;48:159–165.
91.
Glynn RJ, Buring JE, Hennekens CH. Concerns about run-in periods in randomized trials. JAMA 1998;279:1526–1527.
92.
Evans KR, Sills T, Wunderlich GR, McDonald HP. Worsening of depressive symptoms prior to randomization in clinical trials: a possible screen for placebo responders? J Psychiatr Res 2004;38:437–444.
93.
Faries DE, Heiligenstein JH, Tollefson GD, Potter WZ. The double-blind variable placebo lead-in period: results from two antidepressant clinical trials. J Clin Psychopharmacol 2001;21:561–568.
94.
Detke MJ, Lu Y, Goldstein DJ, Hayes JR, Demitrack MA. Duloxetine, 60 mg once daily, for major depressive disorder: a randomized double-blind placebo-controlled trial. J Clin Psychiatry 2002;63:308–315.
95.
Goldstein DJ, Lu Y, Detke MJ, Wiltse C, Mallinckrodt C, Demitrack MA. Duloxetine in the treatment of depression: a double-blind placebo-controlled comparison with paroxetine. J Clin Psychopharmacol 2004;24:389–399.
96.
Loebel AD, Hyde TS, Dunner DL. Early placebo response in anxious and depressed patients. J Clin Psychiatry 1986;47:230–233.
97.
Katz N. Methodological issues in clinical trials of opioids for chronic pain. Neurology 2005;65(Suppl 4):S32–S49.
98.
Turner JA, Deyo RA, Loeser JD, Von Korff M, Fordyce WE. The importance of placebo effects in pain treatment and research. JAMA 1994;271:1609–1614.
99.
Hrobjartsson A, Gotzsche PC. Is the placebo powerless? An analysis of clinical trials comparing placebo with no treatment. N Engl J Med 2001;344:1594–1602.
100.
Khan A, Warner HA, Brown WA. Symptom reduction and suicide risk in patients treated with placebo in antidepressant clinical trials: an analysis of the Food and Drug Administration database. Arch Gen Psychiatry 2000;57:311–317.
101.
Bjune K, Stubhaug A, Dodgson MS, Breivik H. Additive analgesic effect of codeine and paracetamol can be detected in strong, but not moderate, pain after Caesarean section: baseline pain-intensity is a determinant of assay-sensitivity in a postoperative analgesic trial. Acta Anaesthesiol Scand 1996;40:399–407.
102.
Averbuch M, Katzper M. Baseline pain and response to analgesic medications in the postsurgery dental pain model. J Clin Pharmacol 2000;40:133–137.
103.
Perkins DO, Wyatt RJ, Bartko JJ. Penny-wise and pound-foolish: the impact of measurement error on sample size requirements in clinical trials. Biol Psychiatry 2000;47:762–766.
104.
Dworkin RH, Turk DC, Farrar JT, et al. Core outcome measures for chronic pain clinical trials: IMMPACT recommendations. Pain 2005;113:9–19.
105.
Jensen MP, Karoly P. Self-report scales and procedures for assessing pain in adults. In: Turk DC, Melzack R, eds. Handbook of pain assessment. 2nd ed. New York: Guilford Press, 2001;15–34.
106.
Kane RL, Bershadsky B, Lin WC, Rockwood T, Wood K. Efforts to standardize the reporting of pain. J Clin Epidemiol 2002;55:105–110.
107.
Arnold LM, Lu Y, Crofford LJ, et al. A double-blind, multicenter trial comparing duloxetine with placebo in the treatment of fibromyalgia patients with or without major depressive disorder. Arthritis Rheum 2004;50:2974–2984.
108.
De Angelis CD, Drazen JM, Frizelle FA, et al. Is this clinical trial fully registered? —A statement from the International Committee of Medical Journal Editors. N Engl J Med 2005;352:2436–2438.
109.
Krishnan KR. Efficient trial designs to reduce placebo requirements. Biol Psychiatry 2000;47:724–726.
110.
Mattocks KM, Horwitz RI. Placebos, active control groups, and the unpredictability paradox. Biol Psychiatry 2000;47:693–698.
111.
Leber P. Not in our methods, but in our ignorance. Arch Gen Psychiatry. 2002;59:279–280.
112.
Jensen TS, Baron R. Translation of symptoms and signs into mechanisms in neuropathic pain. Pain 2003;102:1–8.
113.
Rowbotham MC. Mechanisms of neuropathic pain and their implications for the design of clinical trials. Neurology 2005;65(Suppl 4):S66–S73.
Information & Authors
Information
Published In
Copyright
© 2005.
Publication History
Published online: December 29, 2005
Published in print: December 29, 2005
Authors
Metrics & Citations
Metrics
Citations
Download Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Select your manager software from the list below and click Download.
Cited By
- Thirty Years of Neuroscientific Investigation of Placebo and Nocebo: The Interesting, the Good, and the Bad, Annual Review of Pharmacology and Toxicology, 62, 1, (323-340), (2022).https://doi.org/10.1146/annurev-pharmtox-052120-104536
- A Quantitative Bias Analysis to Assess Constancy Assumption in Noninferiority Trials Using Bayesian Hierarchical Models, Statistics in Biopharmaceutical Research, 14, 4, (473-479), (2022).https://doi.org/10.1080/19466315.2022.2071979
- Glutamatergic systems in neuropathic pain and emerging non-opioid therapies, Pharmacological Research, 185, (106492), (2022).https://doi.org/10.1016/j.phrs.2022.106492
- Oral appliances in the management of neuropathic orofacial pain: A retrospective case series, Oral Diseases, 28, 3, (805-812), (2021).https://doi.org/10.1111/odi.13824
- Vulnerability in Clinical Research with Patients in Pain: A Risk Analysis, Journal of Law, Medicine & Ethics, 37, 1, (59-72), (2021).https://doi.org/10.1111/j.1748-720X.2009.00351.x
- Design and conduct of confirmatory chronic pain clinical trials, PAIN Reports, 6, 1, (e845), (2021).https://doi.org/10.1097/PR9.0000000000000854
- What is the role of placebo in neurotherapeutics?, Expert Review of Neurotherapeutics, 22, 1, (15-25), (2021).https://doi.org/10.1080/14737175.2022.2012156
- Can insights from placebo and nocebo mechanisms studies improve the randomized controlled trial?, Scandinavian Journal of Pain, 20, 3, (451-467), (2020).https://doi.org/10.1515/sjpain-2019-0183
- Meta-analysis comparing placebo responses in clinical trials of painful HIV-associated sensory neuropathy and diabetic polyneuropathy, Scandinavian Journal of Pain, 20, 3, (439-449), (2020).https://doi.org/10.1515/sjpain-2019-0152
- Placebo response in trials of drug treatments for cancer-related fatigue: a systematic review, meta-analysis and meta-regression, BMJ Supportive & Palliative Care, 10, 4, (385-394), (2020).https://doi.org/10.1136/bmjspcare-2019-002163
- See more
Loading...
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Personal login Institutional LoginPurchase Options
Purchase this article to get full access to it.