Psychometric evaluation of the bottom-up developed Experiencing Grace Scale
Abstract
The experience of grace is currently attracting increased empirical interest. Validated instruments to assess aspects of the experience of grace in a secularized context are scarce which limits current psychological research on grace in other than highly religious populations. We present a bottom-up construction of the Experiencing Grace Scale (EGS) and evidence supporting its reliability and validity. Confirmatory factor analysis showed a good fit for the four subscales: Appraising Grace, Giving Grace, Receiving Grace, and Divine Grace. Reliability analysis showed overall good internal consistency and test–retest stability. Convergent validity was demonstrated by means of expected associations between subscales of the EGS and other relevant measures. Predictive validity was confirmed by associations between subscales of the EGS at measurement Wave 1 with mental well-being scales at Wave 2. The EGS contributes to further research on the experience of grace and its relationship to other psychosocial variables in the field of positive psychology.
Get full access to this article
View all access and purchase options for this article.
Data availability statement
Data, analyses, and additional online materials are openly available on the project’s Open Science Framework page – list of content in Appendix 3 (https://osf.io/7e35b/).
References
Bassett R. L., & the Roberts Wesleyan College Psychology Research Group. (2013). An empirical consideration of grace and legalism within Christian experience. Journal of Psychology and Christianity, 32, 43–69. https://doi.org/10.1080/0039338X.2014.906064
Beckenbach J., Patrick S., Sells J. (2010). Relationship conflict and restoration model: A preliminary exploration of concepts and therapeutic utility. Contemporary Family Therapy: An International Journal, 32, 290–301. https://doi.org/10.1007/s10591-010-9117-3
Beinert W., Fiorenza F. S. (Eds.) (1995). Handbook of Catholic theology. Crossroad Publishing Company.
Betz D., Browning Don S., Janowski B., Jüngel E. (2007). Religion past & present: Encyclopedia of theology and religion. Brill.
Blackburn A. M., Sisemore T. A., Smith R. E., Re D. (2012). Hope and forgiveness as mediators of enacted grace in Christians: A survey with implications for psychotherapy [Paper presentation]. Meeting of the Christian Association for Psychological Studies, Washington, DC.
Briggs S. R., Cheek J. M. (1986). The role of factor analysis in the development and evaluation of personality scales. Journal of Personality, 54(1), 106–148. https://doi.org/10.1111/j.1467-6494.1986.tb00391.x
Bronte J. C., Wade J. (2012). The experience of grace: Divine assistance in making a change. Journal of Transpersonal Psychology, 44(2), 182–223.
Brown R. P. (2003). Measuring individual differences in the tendency to forgive: Construct validity and links with depression. Personality and Social Psychology Bulletin, 29, 759–771. https://doi-org.kuleuven.e-bronnen.be/10.1177%2F0146167203029006008
Bufford R. K., Sisemore T. A., Blackburn A. M. (2017). Dimensions of grace: Factor analysis of three grace scales. Psychology of Religion and Spirituality, 9(1), Article 56. https://psycnet.apa.org/doi/10.1037/rel0000064
Catholic Encyclopedia (1909). Robert Appleton Company (Vol.5). The Encyclopedia Press, Inc.
Carpenter S. (2018). Ten steps in scale development and reporting: A guide for researchers. Communication Methods and Measures, 12(1), 25–44. https://doi-org.kuleuven.e-bronnen.be/10.1080/19312458.2017.1396583
Carver C. S., Scheier M. F., Weintraub J. K. (1989). Assessing coping strategies: A theoretically based approach. Journal of Personality and Social Psychology, 56(2), 267–283. https://psycnet.apa.org/doi/10.1037/0022-3514.56.2.267
Cary P. (2008). Inner Grace: Augustine in the traditions of Plato and Paul. Oxford University Press.
Clark L. A., Watson D. (2016). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309–319. https://psycnet.apa.org/doi/10.1037/14805-012
Cook D. A., Beckman T. J. (2006). Current concepts in validity and reliability for psychometric instruments: Theory and application. The American Journal of Medicine, 119(2), 166–16.e7.
Cook J. D. (2013). Relational Attitudes Conflict Exam (GRACE) Scale: An exploratory factor analysis [Doctoral dissertation, Regent University].
Cunningham L. (2003). Grace can do more: Spiritual accompaniment and spiritual growth. Cistercian Studies Quarterly, 38(2), 234–236.
DeAngelis R. T., Ellison C. G. (2017). Kept in his care: The role of perceived divine control in positive reappraisal coping. Religions, 8(8), Article 133. https://doi.org/10.3390/rel8080133
De Lubac H. D. (1946). Surnaturel: études historiques/Supernatural: historical studies. Parijs.
DeVellis R. F. (2017). Scale development: Theory and applications (4th ed.). Sage.
Dezutter J., Robertson L., Luyckx K., Hutsebaut D. (2010). Life satisfaction in chronic pain patients: The stress-buffering role of the centrality of religion. Journal for the Scientific Study of Religion, 49(3), 507–516. https://doi.org/10.1111/j.1468-5906.2010.01525.x
Diener E. D., Emmons R. A., Larsen R. J., Griffin S. (1985). The satisfaction with life scale. Journal of Personality Assessment, 49(1), 71–75. https://doi.org/10.1207/s15327752jpa4901_13
Drost E. A. (2011). Validity and reliability in social science research. Education Research and Perspectives, 38(1), 105–123. https://www-proquest-com.kuleuven.e-bronnen.be/scholarly-journals/validity-reliability-social-science-research/docview/1020696142/se-2
Dudley R. L. (1995). Grace, relevancy, and confidence in the future: Why Adventist young adults commit to the church. Journal of Psychology and Christianity, 14, 215–227.
Emmons R. A., Hill P. C., Barrett J. L., Kapic K. M. (2017). Psychological and theological reflections on grace and its relevance for science and practice. Psychology of Religion and Spirituality, 9(3), 276–284. dois:http://doi.org/10.1037/rel0000136
George D., Mallery P. (2003). SPSS for Windows step by step: A simple guide and reference (11.0 update, 4th ed.). Allyn & Bacon.
Gliem J. A., Gliem R. R. (2003). Calculating, interpreting, and reporting Cronbach’s alpha reliability coefficient for Likert-type scales [Conference session]. Midwest Research-to-Practice Conference in Adult, Continuing, and Community Education.
Goetz J. L., Keltner D., Simon-Thomas E. (2010). Compassion: An evolutionary analysis and empirical review. Psychological Bulletin, 136(3), 351–374. https://doi.org/10.1037/a0018807
Graves M. (2017). Grace and virtue: Theological and psychological dispositions and practices. Psychology of Religion and Spirituality, 9(3), 303–308. https://doi.org/10.1037/rel0000129
Graves M. (2014). Gracing Neuroscientific Tendencies of the Embodied Soul. Philosophy and Theology, 26(1), 97–129. https://doi.org/10.5840/philtheol20143125
Greenglass E. R., Julkunen J. (1989). Construct validity and sex differences in Cook-Medley hostility. Personality and Individual Differences, 10(2), 209–218. https://doi-org.kuleuven.e-bronnen.be/10.1016/0191-8869(89)90206-7
Heale R., Twycross A. (2015). Validity and reliability in quantitative studies. Evidence-Based Nursing, 18(3), 66–67.
Herman G. (2002). Ritualised friendship and the Greek city. Cambridge University Press.
Hodge A. S., Hook J. N., Davis D. E., Van Tongeren D. R., Bufford R. K., Bassett R. L., McMinn M. R. (2021). Experiencing grace: A review of the empirical literature. The Journal of Positive Psychology, 17, 375–388. https://doi.org/10.1080/17439760.2020.1858943
Hwang J. Y., Plante T., Lackey K. (2008). The development of the Santa Clara Brief Compassion Scale: An abbreviation of Sprecher and Fehr’s Compassionate Love Scale. Pastoral Psychology, 56, 421–428. https://doi.org/10.1007/s11089-008-0117-2
James W. (1902). The varieties of religious experience. Longmans, Green.
Julkunen J., Ahlström R. (2006). Hostility, anger, and sense of coherence as predictors of health-related quality of life. Results of an ASCOT substudy. Journal of Psychosomatic Research, 61(1), 33–39. https://doi.org/10.1016/j.jpsychores.2005.12.005
Kelley H. H., Michela J. L. (1980). Attribution theory and research. Annual Review of Psychology, 31(1), 457–501. https://doi.org/10.1146/annurev.ps.31.020180.002325
Kline R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). The Guilford Press.
Koo T. K., Li M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012
Lacoste J.-Y., Riaudel O., Beauchamp P. (2007). Dictionnaire critique de théologie/Theological Dictionary. Paris: Presses universitaires de France.
Lawler-Row K. A., Scott C. A., Raines R. L., Edlis-Matityahou M., Moore E. W. (2007). The varieties of forgiveness experience: Working toward a comprehensive definition of forgiveness. Journal of Religion and Health, 46(2), 233–248. https://doi.org/10.1007/s10943-006-9077-y
Löw Ο. (1908). ΧΑΡΙΣ. Dissertation. Marburg.
MacLachlan B. (1993). The age of grace: Charis in early greek poetry. Princeton University Press.
Marks D. C. (2010). The mind under grace: Why theology is an essential nutrient for spiritual growth.(Cover story). Christianity Today, 54(3), 22.
McCullough M. E., Emmons R. A., Tsang J. (2002). The grateful disposition: A conceptual and empirical topography. Journal of Personality and Social Psychology, 82, 112–127. https://psycnet.apa.org/doi/10.1037/0022-3514.82.1.112
McMinn M. R. (2010). Sin and grace in Christian counseling: An integrative paradigm. InterVarsity Press.
McMinn M. R., Ruiz J. N., Marx D., Wright J. B., Gilbert N. B. (2006). Professional psychology and the doctrines of sin and grace: Christian leaders’ perspectives. Professional Psychology: Research and Practice, 37(3), 295–302. https://doi.org/10.1037/0735-7028.37.3.295
Meissner W. W. (1966). Foundations for a psychology of grace. Paulist Press.
Neff K. D. (2003). The development and validation of a scale to measure self-compassion. Self and Identity, 2(3), 223–250. https://doi.org/10.1080/15298860309027
Neff K. D., Rude S. S., Kirkpatrick K. L. (2007). An examination of self-compassion in relation to positive psychological functioning and personality traits. Journal of Research in Personality, 41(4), 908–916. https://psycnet.apa.org/doi/10.1016/j.jrp.2006.08.002
New Catholic Encyclopedia. (1967). MacGraw-Hill.
Oakes E. T. (2016). A theology of grace in six controversies. Wm. B. Eerdmans Publishing.
Patrick S., Beckenbach J., Sells J., Reardon R. F. (2013). An empirical investigation into justice, grace, and forgiveness: Paths to relationship satisfaction. The Family Journal, 21(2), 146–153.
Payton J. T., Spradlin J. D., Bufford R. K. (2000, March). A measure of grace: Preliminary development of a grace scale [Paper presentation]. Christian Association for Psychological Studies annual meetings, Tulsa, OK.
Perinetti G. (2018). StaTips Part IV: Selection, interpretation and reporting of the intraclass correlation coefficient. South European Journal of Orthodontics and Dentofacial Research, 5(1), 3–5. https://doi.org/10.5937/sejodr5-17434
Radloff L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1(3), 385–401. https://doi-org.kuleuven.e-bronnen.be/10.1177%2F014662167700100306
Rahner K. (1954). Über das Verhältnis von Natur und Gnade. Schriften zur Theologie, 1, 323–345.
Rao M. A., Donaldson S. I. (2015). Expanding opportunities for diversity in positive psychology: An examination of gender, race, and ethnicity. Canadian Psychology/Psychologie Canadienne, 56(3), 271–282. https://doi.org/10.1037/cap0000036
Roach K. E. (2006). Measurement of health outcomes: Reliability, validity and responsiveness. JPO: Journal of Prosthetics and Orthotics, 18(6), 8–12.
Rogers C. R. (1951). Client-centered therapy: Its current practice, implications and theory. Houghton Mifflin.
Rosseel Y. (2012). Lavaan: An R package for structural equation modeling and more. Version 0.5–12 (BETA). Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02
Rush C. L., Masters K. S., Wooldridge J. S., Ranby K. W. (2023). Is grace amazing or old wine in a new bottle? Psychometric development of the Perceptions and Experiences of Grace Scale (PEGS). Psychology of Religion and Spirituality, 15, 563–577. https://doi.org/10.1037/rel0000465
Schellekens T., Dillen A., Dewitte L., Dezutter J. (2021). A lay definition of grace: A quantitative and qualitative content analysis. The International Journal for the Psychology of Religion, 31, 79–101. https://doi-org.kuleuven.e-bronnen.be/10.1080/10508619.2020.1793593
Schellekens T., Dillen A., Dezutter J. (2020). Experiencing grace: A thematic network analysis of person-level narratives. Open Theology, 6(1), 360–373. https://doi.org/10.1515/opth-2020-0108
Schermelleh-Engel K., Moosbrugger H., Müller H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8(2), 23–74. http://www.mpr-online.de
Schillebeeckx E. (1977). Gerechtigheid en Liefde, Genade en Bevrijding/Justice and Love, Grace and Liberation. Bloemendaal.
Sells J. N., Beckenbach J., Patrick S. (2009). Pain and defense versus grace and justice: The relational conflict and restoration model. The Family Journal: Counseling and Therapy for Couples and Families, 17(3), 203–212. https://doi.org/10.1177/1066480709337802
Sisemore T. A., Arbuckle M., Killian M., Mortellaro E., Swanson M., Fisher R., McGinnis J. (2011). Grace and Christian Psychology-Part 1: Preliminary measurement, relationships, and implications for practice. Edification: The Transdisciplinary Journal of Christian Psychology, 4(2).
Snyder C. R., Lopez S. J. (Eds.). (2001). Handbook of positive psychology. Oxford university press.
Spradlin J. D. (2002). Shame, grace, and spirituality: A comparison of measures [Doctoral dissertation, George Fox University].
Sprecher S., Fehr B. (2005). Compassionate love for close others and humanity. Journal of Social and Personal Relationships, 22(5), 629–651. https://doi-org.kuleuven.e-bronnen.be/10.1177%2F0265407505056439
Toussaint L., Friedman P. (2009). Forgiveness, gratitude, and well-being: The mediating role of affect and beliefs. Journal of Happiness Studies, 10(6), 635–654. https://doi.org/10.1007/s10902-008-9111-8gr
Toussaint L. L., Worthington E. L. J., Williams D. R. (2015). Forgiveness and health. Springer Netherlands.
Van de Velde S., Levecque K., Bracke P. (2009). Measurement equivalence of the CES-D 8 in the general population in Belgium: A gender perspective. Archives of Public Health, 67(1), 15–29. https://doi.org/10.1186/0778-7367-67-1-15
Versteegen T. J. M. (2013). Geleefde genade: Een bijdrage aan de theologie van genade vanuit ervaringen van katholieke vrouwen [Doctoral dissertation, Narratio].
Wahking H. (1992). Spiritual growth through grace and forgiveness. Journal of Psychology and Christianity, 11, 198–206.
Ward K. (1998). Religion and human nature. Clarendon Press. https://doi.org/10.1093/acprof:oso/9780198269618.001.0001
Watson P. J., Chen Z., Sisemore T. A. (2011). Grace and Christian psychology—Pt. 2: Psychometric refinements and relationships with self-compassion, depression, beliefs about sin, and religious orientation. Edification: The Transdisciplinary Journal of Christian Psychology, 4, 64–72.
Watson P. J., Hood R. W. Jr., Morris R. J., Hall J. R. (1985). Religiosity, sin, and self-esteem. Journal of Psychology and Theology, 13, 116–128.
Watson P. J., Morris R. J., Hood R. W. Jr. (1988a). Sin and self-functioning, Pt. 1: Grace, guilt, and self-consciousness. Journal of Psychology and Theology, 16, 254–269.
Watson P. J., Morris R. J., Hood R. W. Jr. (1988b). Sin and self-functioning, Pt. 2: Grace, guilt, and psychological adjustment. Journal of Psychology and Theology, 16, 270–281.
Wood A. M., Froh J. J., Geraghty A. W. A. (2010). Gratitude and well-being: A review and theoretical integration. Clinical Psychology Review, 30, 890–905. https://doi-org.kuleuven.e-bronnen.be/10.1016/j.cpr.2010.03.005
Worthington R. L., Whittaker T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806–838. https://doi.org/10.1177%2F0011000006288127
Cite article
Cite article
Cite article
OR
Download to reference manager
If you have citation software installed, you can download article citation data to the citation manager of your choice
Information, rights and permissions
Information
Published In
Article first published online: February 28, 2024
Keywords
Data availability statement
Data is available for this article. View more information
Authors
Metrics and citations
Metrics
Journals metrics
This article was published in Archive for the Psychology of Religion.
VIEW ALL JOURNAL METRICSArticle usage*
Total views and downloads: 20
*Article usage tracking started in December 2016
Articles citing this one
Receive email alerts when this article is cited
Web of Science: 0
Crossref: 0
There are no citing articles to show.
Figures and tables
Figures & Media
Tables
View Options
Get access
Access options
If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:
loading institutional access options
IAPR members can access this journal content using society membership credentials.
IAPR members can access this journal content using society membership credentials.
Alternatively, view purchase options below:
Purchase 24 hour online access to view and download content.
Access journal content via a DeepDyve subscription or find out more about this option.
