Testing Cold and Hot Cognitive Control as Moderators of a Network of Comorbid Psychopathology Symptoms in Adolescence
Abstract
Comorbidity is pervasive across psychopathological symptoms, diagnoses, and domains. Network analysis is a method for investigating symptom-level associations that underlie comorbidity, particularly through bridge symptoms connecting diagnostic syndromes. We applied network analyses of comorbidity to data from a population-based sample of adolescents (N = 849). We implemented a method for assessing nonparametric moderation of psychopathology networks to evaluate differences in network structure across levels of intelligence and emotional control. Symptoms generally clustered by clinical diagnoses, but specific between-cluster bridge connections emerged. Internalizing symptoms demonstrated unique connections with aggression symptoms of interpersonal irritability, whereas externalizing symptoms showed more diffuse interconnections. Aggression symptoms identified as bridge nodes in the cross-sectional network were enriched for longitudinal associations with internalizing symptoms. Cross-domain connections did not significantly vary across intelligence but were weaker at lower emotional control. Our findings highlight transdiagnostic symptom relationships that may underlie co-occurrence of clinical diagnoses or higher-order factors of psychopathology.
Get full access to this article
View all access and purchase options for this article.
Open practices
- Open Materials
All materials have been made publicly available via the Open Science Framework and can be accessed at https://osf.io/a8cu6/. The complete Open Practices Disclosure for this article can be found at Supplementary Material. This article has received the badge for Open Materials. More information about the Open Practices badges can be found at https://www.psychologicalscience.org/publications/badges.
References
Achenbach T. M. (1966). The classification of children’s psychiatric symptoms: A factor-analytic study. Psychological Monographs: General and Applied, 80, 1–37.
Achenbach T. M., Edelbrock C. S. (1983). Manual for the Child Behavior Checklist and Revised Child Behavior Profile. Burlington: University of Vermont, Department of Psychiatry.
Achenbach T. M., Edelbrock C. (1991). Child Behavior Checklist. Burlington: University of Vermont.
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
Andrews-Hanna J. R., Seghete K. L. M., Claus E. D., Burgess G. C., Ruzic L., Banich M. T. (2011). Cognitive control in adolescence: Neural underpinnings and relation to self-report behaviors. PLOS ONE, 6, Article e21598.
Arcelus J., Vostanis P. (2005). Psychiatric comorbidity in children and adolescents. Current Opinion in Psychiatry, 18, 429–434.
Armour C., Fried E. I., Olff M. (2017). PTSD symptomics: Network analyses in the field of psychotraumatology. European Journal of Psychotraumatology, 8(Suppl. 3), Article 1398003.
Bates D., Maechler M. (2010). Matrix: Sparse and dense matrix classes and methods (R package Version 0.999375-43). Retrieved from http://cran.r-project.org/package=Matrix
Beard C., Millner A. J., Forgeard M. J., Fried E. I., Hsu K. J., Treadway M. T., . . . Björgvinsson T. (2016). Network analysis of depression and anxiety symptom relationships in a psychiatric sample. Psychological Medicine, 46, 3359–3369.
Berg J. M., Latzman R. D., Bliwise N. G., Lilienfeld S. O. (2015). Parsing the heterogeneity of impulsivity: A meta-analytic review of the behavioral implications of the UPPS for psychopathology. Psychological Assessment, 27, 1129–1146.
Borsboom D. (2017). A network theory of mental disorders. World Psychiatry, 16, 5–13.
Borsboom D., Cramer A. O. (2013). Network analysis: An integrative approach to the structure of psychopathology. Annual Review of Clinical Psychology, 9, 91–121.
Borsboom D., Fried E. I., Epskamp S., Waldorp L. J., van Borkulo C. D., van der Maas H. L. J., Cramer A. O. J. (2017). False alarm? A comprehensive reanalysis of “Evidence that psychopathology symptom networks have limited replicability” by Forbes, Wright, Markon, and Krueger (2017). Journal of Abnormal Psychology, 126, 989–999.
Boschloo L., Schoevers R. A., van Borkulo C. D., Borsboom D., Oldehinkel A. J. (2016). The network structure of psychopathology in a community sample of preadolescents. Journal of Abnormal Psychology, 125, 599–606.
Boschloo L., van Borkulo C. D., Rhemtulla M., Keyes K. M., Borsboom D., Schoevers R. A. (2015). The network structure of symptoms of the Diagnostic and Statistical Manual of Mental Disorders. PLOS ONE, 10, Article e0137621.
Briley D. A., Harden K. P., Bates T. C., Tucker-Drob E. M. (2015). Nonparametric estimates of gene × environment interaction using local structural equation modeling. Behavior Genetics, 45, 581–596.
Carver C. S., Johnson S. L., Timpano K. R. (2017). Toward a functional view of the p factor in psychopathology. Clinical Psychological Science, 5, 880–889.
Caspi A., Houts R. M., Belsky D. W., Goldman-Mellor S. J., Harrington H., Israel S., . . . Moffitt T. E. (2014). The p factor: One general psychopathology factor in the structure of psychiatric disorders? Clinical Psychological Science, 2, 119–137.
Caspi A., Moffitt T. E. (2018). All for one and one for all: Mental disorders in one dimension. American Journal of Psychiatry, 175, 831–844.
Chuderski A., Ne˛cka E. (2010). Intelligence and cognitive control. In Gruszka A., Matthews G., Szymura B. (Eds.), Handbook of individual differences in cognition. The Springer series on human exceptionality (pp. 263–282). New York, NY: Springer.
Clark L. A., Cuthbert B., Lewis-Fernández R., Narrow W. E., Reed G. M. (2017). Three approaches to understanding and classifying mental disorder: ICD-11, DSM-5, and the National Institute of Mental Health’s Research Domain Criteria (RDoC). Psychological Science in the Public Interest, 18, 72–145.
Conners C. K., Pitkanen J., Rzepa S. R. (2011). Conners Comprehensive Behavior Rating Scale. In Encyclopedia of clinical neuropsychology (pp. 678–680). New York, NY: Springer.
Costantini G., Perugini M. (2016). The network of conscientiousness. Journal of Research in Personality, 65, 68–88.
Cramer A. O., Waldorp L. J., van der Maas H. L., Borsboom D. (2010). Complex realities require complex theories: Refining and extending the network approach to mental disorders. Behavioral and Brain Sciences, 33, 178–193.
Csardi G., Nepusz T. (2006). The igraph software package for complex network research. InterJournal, Complex Systems, 1695, 1–9.
Curtiss J., Ito M., Takebayashi Y., Hofmann S. G. (2018). Longitudinal network stability of the functional impairment of anxiety and depression. Clinical Psychological Science, 6, 325–334.
Curtiss J., Klemanski D. H. (2016). Taxonicity and network structure of generalized anxiety disorder and major depressive disorder: An admixture analysis and complex network analysis. Journal of Affective Disorders, 199, 99–105.
Cyders M. A., Smith G. T. (2007). Mood-based rash action and its components: Positive and negative urgency. Personality and Individual Differences, 43, 839–850.
Cyders M. A., Smith G. T. (2010). Longitudinal validation of the urgency traits over the first year of college. Journal of Personality Assessment, 92, 63–69.
David A. S., Zammit S., Lewis G., Dalman C., Allebeck P. (2008). Impairments in cognition across the spectrum of psychiatric disorders: Evidence from a Swedish conscript cohort. Schizophrenia Bulletin, 34, 1035–1041.
Dirks M. A., De Los Reyes A., Briggs-Gowan M. J., Cella D., Wakschlag L. S. (2012). Embracing not erasing contextual variability in children’s behavior. Journal of Child Psychology and Psychiatry, 53, 558–574.
Ebesutani C., Bernstein A., Nakamura B. J., Chorpita B. F., Higa-McMillan C. K., Weisz J. R. &; Research Network on Youth Mental Health. (2010). Concurrent validity of the Child Behavior Checklist DSM-Oriented Scales: Correspondence with DSM diagnoses and comparison to syndrome scales. Journal of Psychopathology and Behavioral Assessment, 32, 373–384.
Engelhardt L. E., Mann F. D., Briley D. A., Church J. A., Harden K. P., Tucker-Drob E. M. (2016). Strong genetic overlap between executive functions and intelligence. Journal of Experimental Psychology: General, 145, 1141–1159.
Epskamp S., Borsboom D., Fried E. I (2018). Estimating psychological networks and their accuracy: A tutorial paper. Behavior Research Methods, 50, 195–212.
Epskamp S., Cramer A. O., Waldorp L. J., Schmittmann V. D., Borsboom D. (2012). qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software, 48, 1–18. Retrieved from http://www.jstatsoft.org/v48/i04/
Epskamp S., Fried E. I. (2018). A tutorial on regularized partial correlation networks. Psychological Methods, 23, 617–634.
Epskamp S., Waldorp L. J., Mõttus R., Borsboom D. (2018). The Gaussian graphical model in cross-sectional and time-series data. Multivariate Behavioral Research, 53, 453–480.
Erford B. T. (1995). Reliability and validity of the Conners Teacher Rating Scale–28 (CTRS-28). Diagnostique, 21, 19–28.
Fair D. A., Bathula D., Nikolas M. A., Nigg J. T. (2012). Distinct neuropsychological subgroups in typically developing youth inform heterogeneity in children with ADHD. Proceedings of the National Academy of Sciences, USA, 109, 6769–6774.
Fisher A. J. (2015). Toward a dynamic model of psychological assessment: Implications for personalized care. Journal of Consulting and Clinical Psychology, 83, 825–836.
Fite P. J., Rathert J. L., Stoppelbein L., Greening L. (2012). Social problems as a mediator of the link between reactive aggression and withdrawn/depressed symptoms. Journal of Child and Family Studies, 21, 184–189.
Fite P. J., Rubens S. L., Preddy T. M., Raine A., Pardini D. A. (2014). Reactive/proactive aggression and the development of internalizing problems in males: The moderating effect of parent and peer relationships. Aggressive Behavior, 40, 69–78.
Fite P. J., Stoppelbein L., Greening L. (2009). Proactive and reactive aggression in a child psychiatric inpatient population: Relations to psychopathic characteristics. Criminal Justice and Behavior, 36, 481–493.
Fossati A., Gratz K. L., Maffei C., Borroni S. (2014). Impulsivity dimensions, emotion dysregulation, and borderline personality disorder features among Italian nonclinical adolescents. Borderline Personality Disorder and Emotion Dysregulation, 1, 5.
Foygel R., Drton M. (2010). Extended Bayesian information criteria for Gaussian graphical models. In Lafferty J. D., Williams C. K. I., Shawe-Taylor J., Zemel R. S., Culotta A. (Eds.), Proceedings of the 23rd International Conference on Neural Information Processing Systems (Vol. 1, pp. 604–612). Red Hook, NY: Curran Associates.
Fried E. I., Boschloo L., van Borkulo C. D., Schoevers R. A., Romeijn J.-W., Wichers M. C., . . . Borsboom D. (2015). Symptomics as a new research paradigm for psychiatry. Frontiers in Psychiatry, 6, 1–3.
Fried E. I., Eidhof M. B., Palic S., Costantini G., Huisman-van Dijk H. M., Bockting C. L., . . . Karstoft K. I. (2018). Replicability and generalizability of posttraumatic stress disorder (PTSD) networks: A cross-cultural multisite study of PTSD symptoms in four trauma patient samples. Clinical Psychological Science, 6, 335–351.
Fried E. I., Epskamp S., Nesse R. M., Tuerlinckx F., Borsboom D. (2016). What are ‘good’ depression symptoms? Comparing the centrality of DSM and non-DSM symptoms of depression in a network analysis. Journal of Affective Disorders, 189, 314–320.
Fried E. I., Nesse R. M. (2015a). Depression is not a consistent syndrome: An investigation of unique symptom patterns in the STAR*D study. Journal of Affective Disorders, 172, 96–102.
Fried E. I., Nesse R. M. (2015b). Depression sum-scores don’t add up: Why analyzing specific depression symptoms is essential. BMC Medicine, 13, 1–11.
Fried E. I., van Borkulo C. D., Cramer A. O., Boschloo L., Schoevers R. A., Borsboom D. (2017). Mental disorders as networks of problems: A review of recent insights. Social Psychiatry and Psychiatric Epidemiology, 52, 1–10.
Friedman J. H., Hastie T., Tibshirani R. (2014). glasso: Graphical lasso-estimation of Gaussian graphical models (R package Version 1.8). Retrieved from https://CRAN.R-project.org/package=glasso
Goekoop R., Goekoop J. G. (2014). A network view on psychiatric disorders: Network clusters of symptoms as elementary syndromes of psychopathology. PLOS ONE, 9, Article e112734.
Graham J. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576.
Griffith J. W., Zinbarg R. E., Craske M. G., Mineka S., Rose R. D., Waters A. M., Sutton J. M. (2010). Neuroticism as a common dimension in the internalizing disorders. Psychological Medicine, 40, 1125–1136.
Harden K. P., Engelhardt L. E., Mann F. D., Patterson M. W., Grotzinger A. D., Savicki S. L., . . . Tucker-Drob E. M. (2017). Overlapping genetic influences on executive functions, intelligence, and a general factor of psychopathology. Manuscript submitted for publication.
Harden K. P., Tucker-Drob E. M., Tackett J. L. (2013). The Texas Twin Project. Twin Research and Human Genetics, 16, 385–390.
Hasin D., Kilcoyne B. (2012). Comorbidity of psychiatric and substance use disorders in the United States: Current issues and findings from the NESARC. Current Opinion in Psychiatry, 25, 165–171.
Hettema J. M., Neale M. C., Myers J. M., Prescott C. A., Kendler K. S. (2006). A population-based twin study of the relationship between neuroticism and internalizing disorders. American Journal of Psychiatry, 163, 857–864.
Hildebrandt A., Luedtke O., Robitzsch A., Sommer C., Wilhelm O. (2016). Exploring factor model parameters across continuous variables with local structural equation models. Multivariate Behavioral Research, 51, 257–278.
Hildebrandt A., Wilhelm O., Robitzsch A. (2009). Complementary and competing analytic approaches for the investigation of measurement invariance. Review of Psychology, 16, 87–102.
Hofmann S. G., Curtiss J., McNally R. J. (2016). A complex network perspective on clinical science. Perspectives on Psychological Science, 11, 597–605.
Hunsley J., Mash E. J. (2007). Evidence-based assessment. Annual Review of Clinical Psychology, 3, 29–51.
John O. P., Srivastava S. (1999). The Big Five Trait taxonomy: History, measurement, and theoretical perspectives. In Pervin L. A., John O. P. (Eds.), Handbook of personality: Theory and research (pp. 102–138). New York, NY: Guilford Press.
Johnson S. L., Carver C. S., Joormann J. (2013). Impulsive responses to emotion as a transdiagnostic vulnerability to internalizing and externalizing symptoms. Journal of Affective Disorders, 150, 872–878.
Johnson S. L., Tharp J. A., Peckham A. D., Carver C. S., Haase C. M. (2017). A path model of different forms of impulsivity with externalizing and internalizing psychopathology: Towards greater specificity. British Journal of Clinical Psychology, 56, 235–252.
Jones P. (2018). networktools: Tools for identifying important nodes in networks (R package Version 1.1.1). Retrieved from https://CRAN.R-project.org/package=networktools
Kessler R. C., Berglund P., Demler O., Jin R., Merikangas K. R., Walters E. E. (2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry, 62, 593–602.
Kessler R. C., Chiu W. T., Demler O., Walters E. E. (2005). Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry, 62, 617–627.
Koechlin E., Ody C., Kouneiher F. (2003). The architecture of cognitive control in the human prefrontal cortex. Science, 302, 1181–1185.
Koenen K. C., Moffitt T. E., Roberts A. L., Martin L. T., Kubzansky L., Harrington H., . . . Caspi A. (2009). Childhood IQ and adult mental disorders: A test of the cognitive reserve hypothesis. American Journal of Psychiatry, 166, 50–57.
Kret M. E., Ploeger A. (2015). Emotion processing deficits: A liability spectrum providing insight into comorbidity of mental disorders. Neuroscience & Biobehavioral Reviews, 52, 153–171.
Kring A. M., Sloan D. M. (Eds.). (2009). Emotion regulation and psychopathology: A transdiagnostic approach to etiology and treatment. New York, NY: Guilford Press.
Krueger R. F., Hicks B. M., Patrick C. J., Carlson S. R., Iacono W. G., McGue M. (2002). Etiologic connections among substance dependence, antisocial behavior and personality: Modeling the externalizing spectrum. Journal of Abnormal Psychology, 111, 411–424.
Krueger R. F., Markon K. E., Patrick C. J., Iacono W. G. (2005). Externalizing psychopathology in adulthood: A dimensional-spectrum conceptualization and its implications for DSM-V. Journal of Abnormal Psychology, 114, 537–550.
Lahey B. B., Rathouz P. J., Keenan K., Stepp S. D., Loeber R., Hipwell A. E. (2015). Criterion validity of the general factor of psychopathology in a prospective study of girls. Journal of Child Psychology and Psychiatry, 56, 415–422.
Lindhiem O., Bennett C. B., Hipwell A. E., Pardini D. A. (2015). Beyond symptom counts for diagnosing oppositional defiant disorder and conduct disorder? Journal of Abnormal Child Psychology, 43, 1379–1387.
Lundervold A. J., Bøe T., Lundervold A. (2017). Inattention in primary school is not good for your future school achievement—A pattern classification study. PLOS ONE, 12, Article e0188310.
Marmorstein N. R. (2013). Associations between dispositions to rash action and internalizing and externalizing symptoms in children. Journal of Clinical Child & Adolescent Psychology, 42, 131–138.
McNally R. J. (2016). Can network analysis transform psychopathology? Behaviour Research and Therapy, 86, 95–104.
Michaud P. A., Fombonne E. (2005). Common mental health problems. BMJ, 330, 835–838.
Muthén L. K., Muthén B. O. (2010). Mplus user’s guide (6th ed.). Los Angeles, CA: Author.
Nakamura B. J., Ebesutani C., Bernstein A., Chorpita B. F. (2009). A psychometric analysis of the Child Behavior Checklist DSM-Oriented Scales. Journal of Psychopathology and Behavioral Assessment, 31, 178–189.
Neumann A., Pappa I., Lahey B. B., Verhulst F. C., Medina-Gomez C., Jaddoe V. W., . . . Tiemeier H. (2016). Single nucleotide polymorphism heritability of a general psychopathology factor in children. Journal of the American Academy of Child & Adolescent Psychiatry, 55, 1038–1045.
R Core Team. (2017). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
Reichardt J., Bornholdt S. (2006). Statistical mechanics of community detection. Physical Review E, 74(1), Article 016110.
Rhemtulla M., Fried E. I., Aggen S. H., Tuerlinckx F., Kendler K. S., Borsboom D. (2016). Network analysis of substance abuse and dependence symptoms. Drug and Alcohol Dependence, 161, 230–237.
Rigdon E. E. (1997, June 11). Not positive definite matrices—causes and cures. Retrieved from http://www2.gsu.edu/~mkteer/npdmatri.html
Robinaugh D. J., Leblanc N. J., Vuletich H. A., McNally R. J. (2014). Network analysis of persistent complex bereavement disorder in conjugally bereaved adults. Journal of Abnormal Psychology, 123, 510–522.
Roiser J. P., Sahakian B. J. (2013). Hot and cold cognition in depression. CNS Spectrums, 18, 139–149.
Rouquette A., Pingault J. B., Fried E. I., Orri M., Falissard B., Kossakowski J. J., . . . Borsboom D. (2018). Emotional and behavioral symptom network structure in elementary school girls and association with anxiety disorders and depression in adolescence and early adulthood: A network analysis. JAMA Psychiatry, 75, 1173–1181.
Rudolph K. D., Lansford J. E., Rodkin P. C. (2016). Interpersonal theories of developmental psychopathology. Developmental Psychopathology. Advance online publication.
Ruzzano L., Borsboom D., Geurts H. M. (2015). Repetitive behaviors in autism and obsessive–compulsive disorder: New perspectives from a network analysis. Journal of Autism and Developmental Disorders, 45, 192–202.
Sijtsema J. J., Verboom C. E., Penninx B. W. J. H., Verhulst F. C., Ormel J. (2014). Psychopathology and academic performance, social well-being, and social preference at school: The TRAILS study. Child Psychiatry & Human Development, 45, 273–284.
Smith G. T., Guller L., Zapolski T. C. (2013). A comparison of two models of urgency: Urgency predicts both rash action and depression in youth. Clinical Psychological Science, 1, 266–275.
Snyder H. R., Miyake A., Hankin B. L. (2015). Advancing understanding of executive function impairments and psychopathology: Bridging the gap between clinical and cognitive approaches. Frontiers in Psychology, 6, 328.
Solomon M., Ozonoff S. J., Cummings N., Carter C. S. (2008). Cognitive control in autism spectrum disorders. International Journal of Developmental Neuroscience, 26, 239–247.
Svaldi J., Griepenstroh J., Tuschen-Caffier B., Ehring T. (2012). Emotion regulation deficits in eating disorders: A marker of eating pathology or general psychopathology? Psychiatry Research, 197, 103–111.
van Buuren S., Groothuis-Oudshoorn K. (2011). mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45. Retrieved from http://www.jstatsoft.org/v45/i03/
Wechsler D. (2011). Wechsler Abbreviated Scale of Intelligence–2nd ed. (WASI-II). San Antonio, TX: NCS Pearson.
Werner K., Gross J. J. (2010). Emotion regulation and psychopathology: A conceptual framework. In Kring A. M., Sloan D. M. (Eds.), Emotion regulation and psychopathology: A transdiagnostic approach to etiology and treatment (pp. 13–37). New York, NY: Guilford Press.
Whiteside S. P., Lynam D. R. (2001). The Five Factor Model and impulsivity: Using a structural model of personality to understand impulsivity. Personality and Individual Differences, 30, 669–689.
Whiteside S. P., Lynam D. R., Miller J. D., Reynolds S. K. (2005). Validation of the UPPS Impulsive Behaviour Scale: A four-factor model of impulsivity. European Journal of Personality, 19, 559–574.
Wright A. G., Hallquist M. N., Morse J. Q., Scott L. N., Stepp S. D., Nolf K. A., Pilkonis P. A. (2013). Clarifying interpersonal heterogeneity in borderline personality disorder using latent mixture modeling. Journal of Personality Disorders, 27, 125–143.
Zapolski T. C., Cyders M. A., Smith G. T. (2009). Positive urgency predicts illegal drug use and risky sexual behavior. Psychology of Addictive Behaviors, 23, 348–354.
Zelazo P. D., Müller U. (2002). Executive function in typical and atypical development. In Goswami U. (Ed.), Blackwell handbook of childhood cognitive development (pp. 445–469). New York, NY: Wiley.
Supplementary Material
Supplemental material files:
