Abstract
Idiographic measures, such as the Top Problems Assessment (TPA), offer great utility over nomothetic measures as they can be used to characterize participants in a person-centered manner. Despite such utility, idiographic measures rely on heuristic coding systems, which limit their applicability as a research tool. To address such concerns, the present study utilized Latent Dirichlet Allocation (LDA) to model the latent topics in youth- and parent-reported concerns identified by the TPA in a sample of 172 treatment-seeking youth. Clinical and demographic correlates associated with the identified topics were assessed using general linear models. Topic modeling identified four latent topics in youth-reported concerns that were characterized by Emotional Reactivity, Worry, Avoidance, and Contexts and six latent topics in the parent-reported concerns, Worry, Avoidance, Emotional Reactivity, Negative-Valenced Emotions, Parent–Child Interactions, and Other Maladaptive Behavioral Response. Certain latent topics were significantly associated with standardized measures of anxiety, avoidance, age and reported sex. Results serve as a proof of concept for applying topic modeling to the TPA and further contribute to efforts that characterize domains of impairment in youth with psychopathology. Results of the present study and subsequent discussion of important methodological and conceptual considerations may guide the use of similar research in leveraging data-driven modeling to elucidate latent topics underlying qualitative clinical data.
Similar content being viewed by others
Data Availability
The data that support the findings of this study are available from the corresponding author, HLG, upon reasonable request.
References
Aggarwal, C. C., & Zhai, C. (2012). A survey of text classification algorithms. Mining Text Data, 163–222.
Angold, A., Costello, E. J., Messer, S. C., Pickles, A., Winder, F., & Silver, D. (1995). The development of a short questionnaire for use in epidemiological studies of depression in children and adolescents. International Journal of Methods in Psychiatric Research, 5, 237–249.
Atkins, D. C., Rubin, T. N., Steyvers, M., Doeden, M. A., Baucom, B. R., & Christensen, A. (2012). Topic models: A novel method for modeling couple and family text data. Journal of Family Psychology, 26(5), 816.
Birmaher, B., Brent, D., & AACAP Work Group on Quality Issues. (2007). Practice parameter for the assessment and treatment of children and adolescents with depressive disorders. Journal of the American Academy of Child & Adolescent Psychiatry, 46(11), 1503–1526.
Birmaher, B., Khetarpal, S., Brent, D., Cully, M., Balach, L., Kaufman, J., & Neer, S. M. (1997). The screen for child anxiety related emotional disorders (SCARED): Scale construction and psychometric characteristics. Journal of the American Academy of Child & Adolescent Psychiatry, 36(4), 545–553.
Bittermann, A., & Fischer, A. (2018). How to identify hot topics in psychology using topic modeling. Zeitschrift Für Psychologie, 226(1), 3.
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3(Jan), 993–1022.
Chorpita, B. F., Daleiden, E. L., Park, A. L., Ward, A. M., Levy, M. C., Cromley, T., ... & Krull, J. L. (2017). Child STEPs in California: A cluster randomized effectiveness trial comparing modular treatment with community implemented treatment for youth with anxiety, depression, conduct problems, or traumatic stress. Journal of Consulting and Clinical Psychology, 85(1), 13.
Chorpita, B. F., Moffitt, C., & Gray, J. (2005). Psychometric properties of the Revised Child Anxiety and Depression Scale in a clinical sample. Behaviour Research and Therapy, 43, 309–322.
Chorpita, B. F., Yim, L. M., Moffitt, C. E., Umemoto, L. A., & Francis, S. E. (2000). Assessment of symptoms of DSM-IV anxiety and depression in children: A Revised Child Anxiety and Depression Scale. Behaviour Research and Therapy, 38, 835–855.
Compton, S. N., Peris, T. S., Almirall, D., Birmaher, B., Sherrill, J., Kendall, P. C., ... & Albano, A. M. (2014). Predictors and moderators of treatment response in childhood anxiety disorders: results from the CAMS trial. Journal of Consulting and Clinical Psychology, 82(2), 212.
Connolly, S. D., & Bernstein, G. A. (2007). Practice parameter for the assessment and treatment of children and adolescents with anxiety disorders. Journal of the American Academy of Child & Adolescent Psychiatry, 46(2), 267–283.
Cummings, C. M., Caporino, N. E., & Kendall, P. C. (2014). Comorbidity of anxiety and depression in children and adolescents: 20 years after. Psychological Bulletin, 140(3), 816.
De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131(4), 483.
Ebesutani, C., Bernstein, A., Nakamura, B. J., Chorpita, B. F., & Weisz, J. R. (2010). A psychometric analysis of the Revised Child Anxiety and Depression Scale— Parent Version in a clinical sample. Journal of Abnormal Child Psychology, 38(2), 249–260.
Ehrenreich-May, J., Kennedy, S. M., Sherman, J. A., Bilek, E. L., Buzzella, B. A., Bennett, S. M., & Barlow, D. H. (2018). Unified protocols for transdiagnostic treatment of emotional disorders in children and adolescents: Therapist guide. Oxford University Press.
Franz, P. J., Nook, E. C., Mair, P., & Nock, M. K. (2020). Using topic modeling to detect and describe self-injurious and related content on a large-scale digital platform. Suicide and Life-Threatening Behavior, 50(1), 5–18.
Finch, W. H., Hernández Finch, M. E., McIntosh, C. E., & Braun, C. (2018). The use of topic modeling with latent Dirichlet analysis with open-ended survey items. Translational Issues in Psychological Science, 4(4), 403.
Feldman, R., & Sanger, J. (2007). The text mining handbook: Advanced approaches in analyzing unstructured data. Cambridge University Press.
Fisher, A. J., Bosley, H. G., Fernandez, K. C., Reeves, J. W., Soyster, P. D., Diamond, A. E., & Barkin, J. (2019). Open trial of a personalized modular treatment for mood and anxiety. Behaviour Research and Therapy, 116, 69–79.
Fitzpatrick, O., Carson, A., & Weisz, J. R. (2021). Using mixed methods to identify the primary mental health problems and needs of children, adolescents, and their caregivers during the coronavirus (COVID-19) pandemic. Child Psychiatry & Human Development, 52(6), 1082–1093.
Garber, J., & Weersing, V. R. (2010). Comorbidity of anxiety and depression in youth: Implications for treatment and prevention. Clinical Psychology: Science and Practice, 17(4), 293.
Ginsburg, G. S., Kendall, P. C., Sakolsky, D., Compton, S. N., Piacentini, J., Albano, A. M., ... & March, J. (2011). Remission after acute treatment in children and adolescents with anxiety disorders: findings from the CAMS. Journal of Consulting and Clinical Psychology, 79(6), 806.
Guy, W. (1976). Clinical global impressions scale. Psychiatry.
Haynes, S. N., Mumma, G. H., & Pinson, C. (2009). Idiographic assessment: Conceptual and psychometric foundations of individualized behavioral assessment. Clinical Psychology Review, 29(2), 179–191.
He, Q. (2013). Text mining and IRT for psychiatric and psychological assessment. Universiteit Twente.
Hofmann, T. (1999). Probabilistic latent semantic indexing. Proceedings of the Twenty- Second Annual International SIGIR Conference, 50 –57. Berkeley, CA.
Jakubovski, E., & Bloch, M. H. (2016). Anxiety disorder-specific predictors of treatment outcome in the coordinated anxiety learning and management (CALM) trial. Psychiatric Quarterly, 87(3), 445–464.
Kazdin, A. E. (2007). Mediators and mechanisms of change in psychotherapy research. Annual Review of Clinical Psychology, 3, 1–27.
Kennedy, S. M., & Ehrenreich-May, J. (2019). Psychometric Properties of the Safety Maneuver Scale for Adolescents (SMS-A) and Relationship to Outcomes of a Transdiagnostic Treatment. Child Psychiatry & Human Development, 50(4), 702–716.
Kennedy, S. M., Tonarely, N. A., Sherman, J. A., & Ehrenreich-May, J. (2018). Predictors of treatment outcome for the unified protocol for transdiagnostic treatment of emotional disorders in children (UP-C). Journal of Anxiety Disorders, 57, 66–75.
Liu, S., Zhang, R. Y., & Kishimoto, T. (2021). Analysis and prospect of clinical psychology based on topic models: Hot research topics and scientific trends in the latest decades. Psychology, Health & Medicine, 26(4), 395–407.
Lyneham, H. J., Abbott, M. J., & Rapee, R. M. (2007). Interrater reliability of the Anxiety Disorders Interview Schedule for DSM-IV: Child and parent version. Journal of the American Academy of Child & Adolescent Psychiatry, 46(6), 731–736.
Midway, S., Robertson, M., Flinn, S., & Kaller, M. (2020). Comparing multiple comparisons: Practical guidance for choosing the best multiple comparisons test. PeerJ, 8, e10387.
Merikangas, K. R., He, J. P., Burstein, M., Swanson, S. A., Avenevoli, S., Cui, L., ... & Swendsen, J. (2010). Lifetime prevalence of mental disorders in US adolescents: Results from the National Comorbidity Survey Replication-Adolescent Supplement (NCS-A). Journal of the American Academy of Child & Adolescent Psychiatry, 49(10), 980–989.
Muris, P., Merckelbach, H., Ollendick, T., King, N., & Bogie, N. (2002). Three traditional and three new childhood anxiety questionnaires: Their reliability and validity in a normal adolescent sample. Behaviour Research and Therapy, 40(7), 753–772.
Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic analysis: Striving to meet the trustworthiness criteria. International Journal of Qualitative Methods, 16(1), 1609406917733847.
Ong, N. C., Kee, Y. H., Pillai, J. S., Lim, H. B., & Chua, J. H. (2022). Problematic mobile phone use among youth athletes: A topic modelling approach. International Journal of Sport and Exercise Psychology, 1–22.
Otsuka, S., Ueda, Y., & Saiki, J. (2021). Diversity in psychological research activities: Quantitative approach with topic modeling. Frontiers in Psychology, 12.
Rehurek, R., & Sojka, P. (2011). Gensim–python framework for vector space modelling. NLP Centre, Faculty of Informatics, Masaryk University, Brno, Czech Republic, 3(2).
Röder, M., Both, A., & Hinneburg, A. (2015). Exploring the space of topic coherence measures. Proceedings of the Eighth ACM International Conference on Web Search and Data Mining (pp. 399–408).
Rohrer, J. M., Brümmer, M., Schmukle, S. C., Goebel, J., & Wagner, G. G. (2017). “ What else are you worried about?”–Integrating textual responses into quantitative social science research. PLoS ONE, 12(7), e0182156.
Simons, J. S., & Gaher, R. M. (2005). The distress tolerance scale: Development and validation of a self-report measure. Motivation and Emotion, 29(2), 83–102.
Silverman, W. K. & Albano, A. M. (1996). The anxiety disorders interview schedule for children for DSM-IV: Child and parent versions. Psychological Corporation.
Silverman, W. K., & Albano, A. M. (2022). Anxiety and related disorders interview schedule for DSM-5, child and parent version. Oxford University Press.
Southam-Gerow, M. A., Kendall, P. C., & Weersing, V. R. (2001). Examining outcome variability: Correlates of treatment response in a child and adolescent anxiety clinic. Journal of Clinical Child Psychology, 30(3), 422–436.
Sund, A. M., Larsson, B., & Wichstrøm, L. (2001). Depressive symptoms among young Norwegian adolescents as measured by the Mood and Feelings Questionnaire (MFQ). European Child and Adolescent Psychiatry, 10(4), 222–229.
Tonarely, N. A., Hirlemann, A., Shaw, A. M., LoCurto, J., Souer, H., Ginsburg, G. S., ... & Ehrenreich-May, J. (2020). Validation and Clinical Correlates of the Behavioral Indicator of Resiliency to Distress Task (BIRD) in a University-and Community-Based Sample of Youth with Emotional Disorders. Journal of Psychopathology and Behavioral Assessment, 42(4), 787–798.
Wasil, A. R., Venturo-Conerly, K. E., Gillespie, S., Osborn, T. L., & Weisz, J. R. (2021). In their own words: using open-ended assessment to identify culturally relevant concerns among Kenyan adolescents. Culture, Medicine, and Psychiatry, 1–25.
Weersing, V. R., & Weisz, J. R. (2002). Mechanisms of action in youth psychotherapy. Journal of Child Psychology and Psychiatry, 43(1), 3–29.
Weisz, J. R., Bearman, S. K., Ugueto, A. M., Herren, J. A., Evans, S. C., Cheron, D. M., ... & Jensen-Doss, A. (2020). Testing robustness of child STEPs effects with children and adolescents: A randomized controlled effectiveness trial. Journal of Clinical Child & Adolescent Psychology, 49(6), 883–896.
Weisz, J. R., Chorpita, B. F., Frye, A., Ng, M. Y., Lau, N., Bearman, S. K., ... & Hoagwood, K. E. (2011). Youth top problems: Using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. Journal of consulting and clinical psychology, 79(3), 369.
Weisz, J. R., Chorpita, B. F., Palinkas, L. A., Schoenwald, S. K., Miranda, J., Bearman, S. K., ... & Research Network on Youth Mental Health. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of general psychiatry, 69(3), 274–282.
Weisz, J. R., Kuppens, S., Ng, M. Y., Eckshtain, D., Ugueto, A. M., Vaughn-Coaxum, R., ... & Fordwood, S. R. (2017). What five decades of research tells us about the effects of youth psychological therapy: a multilevel meta-analysis and implications for science and practice. American Psychologist, 72(2), 79.
Weisz, J. R., Sandler, I. N., Durlak, J. A., & Anton, B. S. (2005). Promoting and protecting youth mental health through evidence-based prevention and treatment. American Psychologist, 60(6), 628.
Wergeland, G. J. H., Fjermestad, K. W., Marin, C. E., Bjelland, I., Haugland, B. S. M., Silverman, W. K., ... & Heiervang, E. R. (2016). Predictors of treatment outcome in an effectiveness trial of cognitive behavioral therapy for children with anxiety disorders. Behaviour Research and Therapy, 76, 1–12.
Funding
Dr. Ehrenreich-May is funded by the Institute of Education Sciences (IES), Children's Trust, Henry Ford Foundation, Batchelor Foundation.
Author information
Authors and Affiliations
Contributions
All authors contributed equally to the manuscript.
Corresponding author
Ethics declarations
Conflict of Interest
Hannah Louise Grassie and Jill Ehrenreich-May declare that they have no conflict of interest.
Experiment Participants
All study procedures were approved by University of Miami’s Institutional Review Board.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Grassie, H.L., Ehrenreich-May, J. Applying Quantitative Analyses to Qualitative Data: Investigating Latent Topics and Their Clinical Correlates in Treatment-Seeking Youth’s Top Problems. J Psychopathol Behav Assess (2024). https://doi.org/10.1007/s10862-023-10095-z
Accepted:
Published:
DOI: https://doi.org/10.1007/s10862-023-10095-z