Yi-Chieh Lee
Naomi Yamashita
Yun Huang
Skip Abstract Section
Abstract
Chatbots are regarded as a promising technology for delivering guidance. Prior studies show that chatbots have the potential of coaching users to learn different skills; however, several limitations of chatbot-based approaches remain. People may become disengaged from using chatbot-guided systems and fail to follow the guidance for complex tasks. In this paper, we design chatbots with (HC) and without (OC) human support to deliver guidance for people to practice journaling skills. We conducted a mixed-method study with 35 participants to investigate their actual interaction, perceived interaction, and the effects of interacting with the two chatbots. The participants were randomly assigned to use one of the chatbots for four weeks. Our results show that the HC participants followed the guidance more faithfully during journaling practices and perceived a significantly higher level of engagement and trust with the chatbot system than the OC participants. However, after finishing the journaling-skill training session, the OC participants were more willing to keep using the learned skills than the HC participants. Our work provides new insights into the design of integrating human support into chatbot-based interventions for delivering guidance.
- Gerhard Andersson and Pim Cuijpers. 2009. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cognitive behaviour therapy, Vol. 38, 4 (2009), 196--205.Google Scholar
- Arthur Aron, Edward Melinat, Elaine N Aron, Robert Darrin Vallone, and Renee J Bator. 1997. The experimental generation of interpersonal closeness: A procedure and some preliminary findings. Personality and Social Psychology Bulletin, Vol. 23, 4 (1997), 363--377.Google ScholarCross Ref
- Karen A Baikie and Kay Wilhelm. 2005. Emotional and physical health benefits of expressive writing. Advances in psychiatric treatment, Vol. 11, 5 (2005), 338--346.Google Scholar
- Azy Barak and Orit Gluck-Ofri. 2007. Degree and reciprocity of self-disclosure in online forums. CyberPsychology & Behavior, Vol. 10, 3 (2007), 407--417.Google ScholarCross Ref
- Izak Benbasat and Weiquan Wang. 2005. Trust in and adoption of online recommendation agents. Journal of the association for information systems, Vol. 6, 3 (2005), 4.Google ScholarCross Ref
- Ellen Berscheid, Mark Snyder, and Allen M Omoto. 1989. The relationship closeness inventory: Assessing the closeness of interpersonal relationships. Journal of personality and Social Psychology, Vol. 57, 5 (1989), 792.Google ScholarCross Ref
- Timothy Bickmore and Justine Cassell. 1999. Small talk and conversational storytelling in embodied conversational interface agents. In AAAI fall symposium on narrative intelligence. 87--92.Google Scholar
- Timothy Bickmore, Daniel Schulman, and Langxuan Yin. 2010. Maintaining engagement in long-term interventions with relational agents. Applied Artificial Intelligence, Vol. 24, 6 (2010), 648--666.Google ScholarDigital Library
- Timothy W Bickmore, Lisa Caruso, Kerri Clough-Gorr, and Tim Heeren. 2005. "It's just like you talk to a friend'relational agents for older adults. Interacting with Computers, Vol. 17, 6 (2005), 711--735.Google ScholarDigital Library
- Gillian Cameron, David Cameron, Gavin Megaw, Raymond Bond, Maurice Mulvenna, Siobhan O'Neill, Cherie Armour, and Michael McTear. 2017. Towards a chatbot for digital counselling. In Proceedings of the 31st British Computer Society Human Computer Interaction Conference. BCS Learning & Development Ltd., 24.Google ScholarDigital Library
- Ana Paula Chaves and Marco Aurelio Gerosa. 2018. Single or Multiple Conversational Agents? An Interactional Coherence Comparison. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--13.Google ScholarDigital Library
- Paul C Cozby. 1973. Self-disclosure: a literature review. Psychological bulletin, Vol. 79, 2 (1973), 73.Google Scholar
- Don E Davis, Elise Choe, Joel Meyers, Nathaniel Wade, Kristen Varjas, Allison Gifford, Amy Quinn, Joshua N Hook, Daryl R Van Tongeren, Brandon J Griffin, et almbox. 2016. Thankful for the little things: A meta-analysis of gratitude interventions. Journal of counseling psychology, Vol. 63, 1 (2016), 20.Google ScholarCross Ref
- S Divya, V Indumathi, S Ishwarya, M Priyasankari, and S Kalpana Devi. 2018. A self-diagnosis medical chatbot using artificial intelligence. Journal of Web Development and Web Designing, Vol. 3, 1 (2018), 1--7.Google Scholar
- Wen Duan, Naomi Yamashita, Sun Young Hwang, and Susan Fussell. 2018. "Let Me Ask Them to Clarify If You Don't Want To"-A Clarification Agent for Nonnative Speakers. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 1--6.Google ScholarDigital Library
- David Daniel Ebert, Dirk Lehr, Filip Smit, Anna-Carlotta Zarski, Heleen Riper, Elena Heber, Pim Cuijpers, and Matthias Berking. 2014. Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial. BMC Public Health, Vol. 14, 1 (2014), 807.Google ScholarCross Ref
- Kathleen Kara Fitzpatrick, Alison Darcy, and Molly Vierhile. 2017. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR mental health, Vol. 4, 2 (2017), e19.Google ScholarCross Ref
- Silvia Gabrielli, Silvia Rizzi, Sara Carbone, and Valeria Donisi. 2020. A Chatbot-Based Coaching Intervention for Adolescents to Promote Life Skills: Pilot Study. JMIR Human Factors, Vol. 7, 1 (2020), e16762.Google ScholarCross Ref
- Marvin R Goldfried, Lisa A Burckell, and Catherine Eubanks-Carter. 2003. Therapist self-disclosure in cognitive-behavior therapy. Journal of clinical psychology, Vol. 59, 5 (2003), 555--568.Google ScholarCross Ref
- John M Govern and Lisa A Marsch. 2001. Development and validation of the situational self-awareness scale. Consciousness and cognition, Vol. 10, 3 (2001), 366--378.Google Scholar
- Anthony M Grant, John Franklin, and Peter Langford. 2002. The self-reflection and insight scale: A new measure of private self-consciousness. Social Behavior and Personality: an international journal, Vol. 30, 8 (2002), 821--835.Google Scholar
- Brenda Hayman, Lesley Wilkes, and Debra Jackson. 2012. Journaling: Identification of challenges and reflection on strategies. Nurse researcher, Vol. 19, 3 (2012).Google Scholar
- Charles T Hill and Donald E Stull. 1987. Gender and self-disclosure. In Self-Disclosure. Springer, 81--100.Google Scholar
- Ayanna Howard and Jason Borenstein. 2019. Trust and Bias in Robots: These elements of artificial intelligence present ethical challenges, which scientists are trying to solve. American Scientist, Vol. 107, 2 (2019), 86--90.Google ScholarCross Ref
- Delaura L Hubbs and Charles F Brand. 2005. The paper mirror: Understanding reflective journaling. Journal of Experiential Education, Vol. 28, 1 (2005), 60--71.Google ScholarCross Ref
- Maia L Jacobs, James Clawson, and Elizabeth D Mynatt. 2015. Comparing health information sharing preferences of cancer patients, doctors, and navigators. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. 808--818.Google ScholarDigital Library
- Jinkyu Jang and Jinwoo Kim. 2019. Healthier Life with Digital Companions: Effects of Reflection-Level and Statement-Type of Messages on Behavior Change via a Perceived Companion. International Journal of Human-Computer Interaction (2019), 1--18.Google Scholar
- Christina Kelley, Bongshin Lee, and Lauren Wilcox. 2017. Self-tracking for mental wellness: understanding expert perspectives and student experiences. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 629--641.Google ScholarDigital Library
- Rafal Kocielnik, Lillian Xiao, Daniel Avrahami, and Gary Hsieh. 2018. Reflection companion: A conversational system for engaging users in reflection on physical activity. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 2, 2 (2018), 70.Google ScholarDigital Library
- Kira Kretzschmar, Holly Tyroll, Gabriela Pavarini, Arianna Manzini, Ilina Singh, and NeurOx Young People's Advisory Group. 2019. Can your phone be your therapist? Young people's ethical perspectives on the use of fully automated conversational agents (chatbots) in mental health support. Biomedical Informatics Insights, Vol. 11 (2019), 1178222619829083.Google ScholarCross Ref
- Rohit Kumar and Carolyn P Rose. 2010. Architecture for building conversational agents that support collaborative learning. IEEE Transactions on Learning Technologies, Vol. 4, 1 (2010), 21--34.Google ScholarDigital Library
- Minha Lee, Sander Ackermans, Nena van As, Hanwen Chang, Enzo Lucas, and Wijnand IJsselsteijn. 2019. Caring for Vincent: A Chatbot for Self-Compassion (CHI '19). ACM, New York, NY, USA, Article 702, 13 pages. https://doi.org/10.1145/3290605.3300932Google ScholarDigital Library
- SeoYoung Lee and Junho Choi. 2017. Enhancing user experience with conversational agent for movie recommendation: Effects of self-disclosure and reciprocity. International Journal of Human-Computer Studies, Vol. 103 (2017), 95--105.Google ScholarDigital Library
- Yi-Chieh Lee, Naomi Yamashita, and Yun Huang. 2020 a. Designing a Chatbot as a Mediator for Promoting Deep Self-Disclosure to a Real Mental Health Professional. Proceedings of the ACM on Human-Computer Interaction (2020).Google ScholarDigital Library
- Yi-Chieh Lee, Naomi Yamashita, Yun Huang, and Wai Fu. 2020 b. "I Hear You, I Feel You": Encouraging Deep Self-disclosure through a Chatbot. ACM CHI Conference on Human Factors in Computing Systems (2020).Google ScholarDigital Library
- Gale M Lucas, Albert Rizzo, Jonathan Gratch, Stefan Scherer, Giota Stratou, Jill Boberg, and Louis-Philippe Morency. 2017. Reporting mental health symptoms: breaking down barriers to care with virtual human interviewers. Frontiers in Robotics and AI, Vol. 4 (2017), 51.Google ScholarCross Ref
- Kai Lukoff, Taoxi Li, Yuan Zhuang, and Brian Y Lim. 2018. TableChat: Mobile Food Journaling to Facilitate Family Support for Healthy Eating. Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW (2018), 1--28.Google ScholarDigital Library
- Michal Luria, Samantha Reig, Xiang Zhi Tan, Aaron Steinfeld, Jodi Forlizzi, and John Zimmerman. 2019. Re-Embodiment and Co-Embodiment: Exploration of social presence for robots and conversational agents. In Proceedings of the 2019 on Designing Interactive Systems Conference. 633--644.Google ScholarDigital Library
- Sonja Lyubomirsky, Rene Dickerhoof, Julia K Boehm, and Kennon M Sheldon. 2011. Becoming happier takes both a will and a proper way: An experimental longitudinal intervention to boost well-being. Emotion, Vol. 11, 2 (2011), 391.Google ScholarCross Ref
- Adam S Miner, Nigam Shah, Kim D Bullock, Bruce A Arnow, Jeremy Bailenson, and Jeff Hancock. 2019. Key considerations for incorporating conversational AI in psychotherapy. Frontiers in psychiatry, Vol. 10 (2019).Google Scholar
- David Mohr, Pim Cuijpers, and Kenneth Lehman. 2011. Supportive accountability: a model for providing human support to enhance adherence to eHealth interventions. Journal of medical Internet research, Vol. 13, 1 (2011), e30.Google ScholarCross Ref
- Clifford Nass, Jonathan Steuer, and Ellen R Tauber. 1994. Computers are social actors. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 72--78.Google ScholarDigital Library
- Harri Oinas-Kukkonen. 2013. A foundation for the study of behavior change support systems. Personal and ubiquitous computing, Vol. 17, 6 (2013), 1223--1235.Google Scholar
- Heather L O'Brien, Paul Cairns, and Mark Hall. 2018. A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form. International Journal of Human-Computer Studies, Vol. 112 (2018), 28--39.Google ScholarCross Ref
- Nansook Park and Christopher Peterson. 2009. Character strengths: Research and practice. Journal of college and character, Vol. 10, 4 (2009).Google ScholarCross Ref
- SoHyun Park, Jeewon Choi, Sungwoo Lee, Changhoon Oh, Changdai Kim, Soohyun La, Joonhwan Lee, and Bongwon Suh. 2019. Designing a Chatbot for a Brief Motivational Interview on Stress Management: Qualitative Case Study. Journal of medical Internet research, Vol. 21, 4 (2019), e12231.Google ScholarCross Ref
- James W Pennebaker. 2010. Expressive writing in a clinical setting. The Independent Practitioner, Vol. 30 (2010), 23--25.Google Scholar
- Juanan Pereira and Óscar Díaz. 2019. Using health chatbots for behavior change: a mapping study. Journal of Medical Systems, Vol. 43, 5 (2019), 135.Google ScholarDigital Library
- Judith J Prochaska, Hai-Yen Sung, Wendy Max, Yanling Shi, and Michael Ong. 2012. Validity study of the K6 scale as a measure of moderate mental distress based on mental health treatment need and utilization. International journal of methods in psychiatric research, Vol. 21, 2 (2012), 88--97.Google ScholarCross Ref
- Abhilasha Ravichander and Alan W Black. 2018. An Empirical Study of Self-Disclosure in Spoken Dialogue Systems. In Proceedings of the 19th Annual SIGdial Meeting on Discourse and Dialogue. 253--263.Google ScholarCross Ref
- Lindsey M Rodriguez, Chelsie M Young, Clayton Neighbors, Michelle T Campbell, and Qian Lu. 2015. Evaluating guilt and shame in an expressive writing alcohol intervention. Alcohol, Vol. 49, 5 (2015), 491--498.Google ScholarCross Ref
- Stephen M Schueller, Kathryn Noth Tomasino, Emily G Lattie, and David C Mohr. 2016. Human support for behavioral intervention technologies for mental health: the efficiency model. management, Vol. 21 (2016), 22.Google Scholar
- Stephen M Schueller, Kathryn Noth Tomasino, and David C Mohr. 2017. Integrating human support into behavioral intervention technologies: the efficiency model of support. Clinical Psychology: Science and Practice, Vol. 24, 1 (2017), 27--45.Google ScholarCross Ref
- Martin EP Seligman and Mihaly Csikszentmihalyi. 2014. Positive psychology: An introduction. In Flow and the foundations of positive psychology. Springer, 279--298.Google ScholarCross Ref
- Martin EP Seligman, Tracy A Steen, Nansook Park, and Christopher Peterson. 2005. Positive psychology progress: empirical validation of interventions. American psychologist, Vol. 60, 5 (2005), 410.Google Scholar
- Kennon M Sheldon and Sonja Lyubomirsky. 2006. How to increase and sustain positive emotion: The effects of expressing gratitude and visualizing best possible selves. The journal of positive psychology, Vol. 1, 2 (2006), 73--82.Google Scholar
- Weiyan Shi, Xuewei Wang, Yoo Jung Oh, Jingwen Zhang, Saurav Sahay, and Zhou Yu. 2020. Effects of Persuasive Dialogues: Testing Bot Identities and Inquiry Strategies (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3313831.3376843Google ScholarDigital Library
- Ha Trinh, Ameneh Shamekhi, Everlyne Kimani, and Timothy W Bickmore. 2018. Predicting User Engagement in Longitudinal Interventions with Virtual Agents. In Proceedings of the 18th International Conference on Intelligent Virtual Agents. 9--16.Google ScholarDigital Library
- Allison Utley and Yvonne Garza. 2011. The therapeutic use of journaling with adolescents. Journal of Creativity in Mental Health, Vol. 6, 1 (2011), 29--41.Google ScholarCross Ref
- Alastair van Heerden, Xolani Ntinga, and Khanya Vilakazi. 2017. The potential of conversational agents to provide a rapid HIV counseling and testing services. In 2017 international conference on the frontiers and advances in data science (FADS). IEEE, 80--85.Google ScholarCross Ref
- Jinping Wang, Hyun Yang, Ruosi Shao, Saeed Abdullah, and S Shyam Sundar. 2020. Alexa as Coach: Leveraging Smart Speakers to Build Social Agents that Reduce Public Speaking Anxiety. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--13.Google ScholarDigital Library
- Lawrence R Wheeless and Janis Grotz. 1977. The measurement of trust and its relationship to self-disclosure. Human Communication Research, Vol. 3, 3 (1977), 250--257.Google ScholarCross Ref
- Alex C. Williams, Harmanpreet Kaur, Gloria Mark, Anne Loomis Thompson, Shamsi T. Iqbal, and Jaime Teevan. 2018. Supporting Workplace Detachment and Reattachment with Conversational Intelligence (CHI '18). ACM, New York, NY, USA, Article 88, 13 pages. https://doi.org/10.1145/3173574.3173662Google ScholarDigital Library
- Rainer Winkler, Sebastian Hobert, Antti Salovaara, Matthias Söllner, and Jan Marco Leimeister. 2020. Sara, the lecturer: Improving learning in online education with a scaffolding-based conversational agent. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--14.Google ScholarDigital Library
- Kieran Woodward, Eiman Kanjo, David Brown, T Martin McGinnity, Becky Inkster, Donald J Macintyre, and Athanasios Tsanas. 2019. Beyond Mobile Apps: A Survey of Technologies for Mental Well-being. arXiv preprint arXiv:1905.00288 (2019).Google Scholar
- Ziang Xiao, Michelle X Zhou, Q Vera Liao, Gloria Mark, Changyan Chi, Wenxi Chen, and Huahai Yang. 2019. Tell Me About Yourself: Using an AI-Powered Chatbot to Conduct Conversational Surveys. arXiv preprint arXiv:1905.10700 (2019).Google Scholar
- Jin Xu, G Bryant De'Aira, Yu-Ping Chen, and Ayanna Howard. 2018b. Robot therapist versus human therapist: Evaluating the effect of corrective feedback on human motor performance. In 2018 International Symposium on Medical Robotics (ISMR). IEEE, 1--6.Google ScholarCross Ref
- Jin Xu, G Bryant De'Aira, and Ayanna Howard. 2018a. Would You Trust a Robot Therapist? Validating the Equivalency of Trust in Human-Robot Healthcare Scenarios. In 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, 442--447.Google Scholar
- Jingwen Zhang, Yoo Jung Oh, Patrick Lange, Zhou Yu, and Yoshimi Fukuoka. 2020. Artificial Intelligence Chatbot Behavior Change Model for Designing Artificial Intelligence Chatbots to Promote Physical Activity and a Healthy Diet. Journal of Medical Internet Research, Vol. 22, 9 (2020), e22845.Google ScholarCross Ref
Index Terms
-
Exploring the Effects of Incorporating Human Experts to Deliver Journaling Guidance through a Chatbot
-
Recommendations
-
Designing a Chatbot as a Mediator for Promoting Deep Self-Disclosure to a Real Mental Health Professional
CSCWChatbots are becoming increasingly popular. One promising application for chatbots is to elicit people's self-disclosure of their personal experiences, thoughts, and feelings. As receiving one's deep self-disclosure is critical for mental health ...
-
Food Diary Coaching Chatbot
UbiComp '18: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable ComputersThis article presents the design of a conversational agent whose goal is to coach people who wish to improve their food lifestyle. The data gathering method is easy and especially fast in order to simplify the life of the user. The goals are defined by ...
-
Dialoging Resonance in Human-Chatbot Conversation: How Users Perceive and Reciprocate Recommendation Chatbot's Self-Disclosure Strategy
CSCWUsing chatbots to make recommendations is increasingly popular. The design of recommendation chatbots has mainly been taking an information-centric approach by focusing on the recommended content per se. Limited attention is on how social connection and ...
Comments