Intersectionality in Quantitative Psychological Research: II. Methods and Techniques
Abstract
Intersectional approaches, which consider how simultaneous membership in multiple social categories characterize our experiences and are linked to power and privilege, have deep roots in feminist psychology. While an intersectional approach is well suited to a variety of research questions and topics, its application to date has chiefly been found with qualitative methods; when quantitative methods are used, components of the approach are used but not clearly framed as intersectional. Building upon our previous discussion and analysis of the theoretical and epistemological issues that arise when combining intersectionality and quantitative methods, this article articulates how quantitative researchers might incorporate an intersectional approach into their work. The techniques we describe are frequently used within quantitative methods, but they are infrequently used within an intersectional approach. Techniques include framing social categories (e.g., gender and ethnicity) as person variables or as stimulus variables, using a between-groups design to examine multiple locations at an intersection, stratified random sampling and purposive sampling, and examining how measures demonstrate conceptual equivalence and measurement invariance across groups. We also focus on data-analytic methods, which include examination of multiple main effects and interactions, moderators in meta-analysis, multilevel modeling, moderated mediation, and person-centered methods. These methods are insufficient without also including intersectional interpretations and framing with attention to inequalities and power relations. Online slides for instructors who want to use this article (and the related response articles) for teaching are available on PWQ's website at http://pwq.sagepub.com/supplemental
Get full access to this article
View all access and purchase options for this article.
References
Balsam K. F., Molina Y., Beadnell B., Simoni J., Walters K. (2011). Measuring multiple minority stress: The LGBT People of Color Microaggressions Scale. Cultural Diversity and Ethnic Minority Psychology, 17, 163–174. doi:10.1037/a0023244
Bauer G. R. (2014). Incorporating intersectionality theory in population health research methodology: Challenges and the potential to advance health equity. Social Science & Medicine, 110, 10–17. doi:10.1016/j.socscimed.2014.03.022
Beale F. (1970). Double jeopardy: To be Black and female. In Cade T. (Ed.), The Black woman: An anthology (pp. 90–100). New York, NY: New American Library.
Bem S. L. (1974). The measurement of psychological androgyny. Journal of Consulting and Clinical Psychology, 42, 155–162. doi:10.1037/h0036215
Bodenhausen G. V. (2010). Diversity in the person, diversity in the group: Challenges of identity complexity for social perception and social interaction. European Journal of Social Psychology, 40, 1–16. doi:10.1002/ejsp.647
Bogart L. M., Wagner G. J., Galvan F. H., Landrine H., Klein D. J., Sticklor L. A. (2011). Perceived discrimination and mental health symptoms among Black men with HIV. Cultural Diversity and Ethnic Minority Psychology, 17, 295–302. doi:10.1037/a0024056
Bowleg L. (2008). When Black + lesbian + woman ≠ Black lesbian woman: The methodological challenges of qualitative and quantitative intersectionality research. Sex Roles, 59, 312–325. doi:10.1007/s11199-008-9400-z
Bowleg L., English D., del Rio-Gonzalez A. M., Burkholder G. J., Teti M., Tschann J. M. (2016). Measuring the pros and cons of what it means to be a Black man: Development and validation of the Black Men’s Experiences Scale (BMES). Psychology of Men and Masculinity. Advance online publication. doi:10.1037/men0000026
Bowleg L., Teti M., Malebranche D. J., Tschann J. M. (2013). “It’s an uphill battle every day”: Intersectionality, low-income Black heterosexual men, and implications for HIV prevention research and interventions. Psychology of Men & Masculinity, 14, 25–34. doi:10.1037/a0028392
Brondolo E., Beatty D. L., Cubbin C., Pencille M., Saegart S., Wellington R.…Schwartz J. (2009). Sociodemographic variations in perceived racism in a community sample of Blacks and Latino(a)s. Journal of Applied Social Psychology, 39, 407–429. doi:10.1111/j.1559-1816.2008.00444.x
Brown L. S. (1994). Subversive dialogues. New York, NY: Basic Books.
Calasanti T., Pietilä I., Ojala H., King N. (2013). Men, bodily control, and health behaviors: The importance of age. Health Psychology, 32, 15–23. doi:10.1037/a0029300
Charmaraman L., Woo M., Quach A., Erkut S. (2014). How have researchers studied multiracial populations? A content and methodological review of 20 years of research. Cultural Diversity and Ethnic Minority Psychology, 20, 336–352. doi:10.1037/a0035437
Cheung G. W., Rensvold R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. doi:10.1207/S15328007SEM0902_5
Cho S., Crenshaw K. W., McCall L. (2013). Toward a field of intersectionality studies: Theory, applications, and praxis. Signs: Journal of Women in Culture and Society, 38, 785–810. doi:10.1086/669608
Choo H. Y., Ferree M. M. (2010). Practicing intersectionality in sociological research: A critical analysis of inclusions, interactions, and institutions in the study of inequalities. Sociological Theory, 28, 129–149. doi:10.2307/25746220
Cole E. R. (2009). Intersectionality and research in psychology. American Psychologist, 64, 170–180. doi:10.1037/a0014564
Cole E. R., Sabik N. J. (2009). Repairing a broken mirror: Intersectional approaches to diverse women’s perceptions of beauty and bodies. In Berger M. T., Guidroz K. (Eds.), The intersectional approach: Transforming the academy through race, class, & gender (pp. 173–192). Chapel Hill: University of North Carolina Press.
Constantine M. G. (2002). The intersection of race, ethnicity, gender, and social class in counseling: Examining selves in cultural contexts. Journal of Multicultural Counseling and Development, 30, 210–215. doi:10.1002/j.2161-1912.2002.tb00520.x
Corral I., Landrine H. (2010). Methodological and statistical issues in research with diverse samples: The problem of measurement equivalence. In Landrine H., Russo N. F. (Eds.), Handbook of diversity in feminist psychology (pp. 83–134). New York, NY: Springer.
Crenshaw K. (1991). Mapping the margins: Intersectionality, identity politics, and violence against women of color. Stanford Law Review, 43, 1241–1299. doi:10.2307/1229039
Crocker J., Major B. (1989). Social stigma and self-esteem: The self-protective properties of stigma. Psychological Review, 96, 608–630. doi:10.1037/0033-295X.96.4.608
Deaux K. (1984). From individual differences to social categories: Analysis of a decade’s research on gender. American Psychologist, 39, 105–116. doi:10.1037/0003-066X.39.2.105
Diamond L. M., Butterworth M. (2008). Questioning gender and sexual identity: Dynamic links over time. Sex Roles, 59, 365–376. doi:10.1007/s11199-008-9425-3
Downing R. A., LaVeist T. A., Bullock H. E. (2007). Intersections of ethnicity and social class in provider advice regarding reproductive health. American Journal of Public Health, 97, 1803–1807. doi:10.2105/AJPH.2006.092585
Elder G. H. J., Johnson M. K., Crosnoe R. (2003). The emergence and development of life course theory. In Mortimer J. T., Shanahan M. J. (Eds.), Handbook of the life course (pp. 3–19). New York, NY: Kluwer Academic/Plenum Publishers.
Else-Quest N. M., Hyde J. S. (2016). Intersectionality in quantitative psychological research: I. Theoretical and epistemological issues. Psychology of Women Quarterly, 40, 155–170. doi:10.1177/0361684316629797
Else-Quest N. M., Hyde J. S., Linn M. C. (2010). Cross-national patterns of gender differences in mathematics: A meta-analysis. Psychological Bulletin, 136, 103–127. doi:10.1037/a0018053
Else-Quest N. M., Mineo C. C., Higgins A. (2013). Math and science attitudes and achievement at the intersection of gender and ethnicity. Psychology of Women Quarterly, 37, 293–309. doi:10.1177/0361684313480694
Enns C. Z. (2010). Locational feminisms and feminist social identity analysis. Professional Psychology: Research and Practice, 41, 333–339. doi:10.1037/a0020260
Essed P. (1991). Understanding everyday racism: An interdisciplinary theory. Newbury Park, CA: Sage.
Fiske S. (1993). Controlling other people: The impact of power on stereotyping. American Psychologist, 48, 621–628. doi:10.1037/0003-066X.48.6.621
Garnett B. R., Masyn K. E., Austin S. B., Miller M., Williams D. R., Viswanath K. (2014). The intersectionality of discrimination attributes and bullying among youth: An applied latent class analysis. Journal of Youth and Adolescence, 43, 1225–1239. doi:10.1007/s10964-013-0073-8
Ghavami N., Peplau L. A. (2013). An intersectional analysis of gender and ethnic stereotypes: Testing three hypotheses. Psychology of Women Quarterly, 37, 113–127. doi:10.1177/0361684312464203
Goff P. A., Kahn K. B. (2013). How psychological science impedes intersectional thinking. Du Bois Review, 10, 365–384. doi:10.1017/S1742058X13000313
Grabe S., Grose R. G., Dutt A. (2015). Women’s land ownership and relationship power: A mixed methods approach to understanding structural inequities and violence against women. Psychology of Women Quarterly, 39, 7–19. doi:10.1177/0361684314533485
Greenwood R. M. (2008). Intersectional political consciousness: Appreciation for intragroup differences and solidarity in diverse groups. Psychology of Women Quarterly, 32, 36–47. doi:10.1111/j.1471-6402.2007.00405.x
Harackiewicz J. M., Canning E. A., Tibbetts Y., Priniski S. J., Hyde J. S. (2015). Closing achievement gaps with a utility-value intervention: Disentangling race and social class. Journal of Personality and Social Psychology. Advance online publication. doi:10.1037/pspp0000075
Harley D. A., Jolivette K., McCormick K., Tice K. (2002). Race, class, and gender: A constellation of positionalities with implications for counseling. Journal of Multicultural Counseling & Development, 30, 216–238. doi:10.1002/j.2161-1912.2002.tb00521.x
Humes K. R., Jones N. A., Ramirez R. R. (2011). Overview of race and Hispanic origin: 2010. Washington, DC: U.S. Census Bureau.
Hurtado A., Sinha M. (2008). More than men: Latino feminist masculinities and intersectionality. Sex Roles, 59, 337–349. doi:10.1007/s11199-008-9405-7
Hyde J. S. (2012). Nation-level indicators of gender equity in psychological research: Theoretical and methodological issues. Psychology of Women Quarterly, 36, 145–148. doi:10.1177/0361684312441448
Irvine J. J. (1985). Teacher communication patterns as related to the race and sex of the student. Journal of Educational Research, 78, 338–345. doi:10.1080/00220671.1985.10885627
Irvine J. J. (1986). Teacher-student interactions: Effects of student race, sex, and grade level. Journal of Educational Psychology, 78, 14–21. doi:10.1037/0022-0663.78.1.14
Johnson K. L., Freeman J. B., Pauker K. (2012). Race is gendered: How covarying phenotypes and stereotypes bias sex categorization. Journal of Personality and Social Psychology, 102, 116–131. doi:10.1037/a0025335
Kang S. K., Chasteen A. L. (2009). Beyond the double-jeopardy hypothesis: Assessing emotion on the faces of multiply-categorizable targets of prejudice. Journal of Experimental Social Psychology, 45, 1281–1285. doi:10.1016/j.esp.2009.07.002
Kling K. C., Hyde J. S., Showers C. J., Buswell B. N. (1999). Gender differences in self-esteem: A meta-analysis. Psychological Bulletin, 125, 470–500. doi:10.1037/a0013689
Klonoff E. A., Landrine H. (1995). The Schedule of Sexist Events: A measure of lifetime and recent sexist discrimination in women’s lives. Psychology of Women Quarterly, 19, 439–472. doi:10.1111/j.1471-6402.1995.tb00086.x
Landrine H., Klonoff E. A., Brown-Collins A. (1992). Cultural diversity and methodology in feminist psychology. Psychology of Women Quarterly, 16, 145–163. doi:10.1111/j.1471-6402.1992.tb00246.x
Lanza S. T., Cooper B. R. (2016). Latent class analysis for developmental research. Child Development Perspectives, 10, 59–64. doi:10.1111/cdep.12163
Lee D. L., Rosen A. D., Burns V. (2013). Over a half-century encapsulated: A multicultural content analysis of the Journal of Counseling Psychology, 1954-2009. Journal of Counseling Psychology, 60, 154–161. doi:10.1037/a0031002
Lewis J. A., Neville H. A. (2015). Construction and initial validation of the Gendered Racial Microaggressions Scale for Black Women. Journal of Counseling Psychology, 62, 289–302. doi:10.1037/cou0000062
Lipsey M. W., Wilson D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
Lott B., Bullock H. E. (2007). Psychology and economic injustice: Personal, professional, and political intersections. Washington, DC: American Psychological Association.
MacKinnon C. (2013). Intersectionality as method: A note. Signs: Journal of Women in Culture and Society, 38, 1019–1030. doi:10.1086/669570
May V. M. (2015). Pursuing intersectionality, unsettling dominant imaginaries. New York, NY: Routledge.
McCall L. (2005). The complexity of intersectionality. Signs: Journal of Women in Culture and Society, 30, 1771–1800. doi:10.1086/426800
McLachlan G., Peel D. (2000). Finite mixture models. New York, NY: Wiley.
Meredith W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525–543. doi:10.1007/BF02294825
Meyer I. H. (2003). Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: Conceptual issues and research evidence. Psychological Bulletin, 129, 674–697. doi:10.1037/0033- 2909.129.5.674
Nadal K. L. (2011). The Racial and Ethnic Microaggressions Scale (REMS): Construction, reliability, and validity. Journal of Counseling Psychology, 58, 470–480. doi:10.1037/a0025193
Operario D., Yang M., Reisner S. L., Iwamoto M., Nemoto T. (2014). Stigma and the syndemic of HIV-related health risk behaviors in a diverse sample of transgender women. Journal of Community Psychology, 42, 544–557. doi:10.1002/jcop.21636
Poteat V. P., Mereish E. H., DiGiovanni C. D., Koenig B. W. (2011). The effects of general and homophobic victimization on adolescents’ psychosocial and educational concerns: The importance of intersecting identities and parent support. Journal of Counseling Psychology, 58, 597–609. doi:10.1037/a0025095
Preacher K. J., Rucker D. D., Hayes A. F. (2007). Addressing moderated mediation hypotheses: Theory, methods, and prescriptions. Multivariate Behavioral Research, 42, 185–227. doi:10.1080/00273170701341316
Purdie-Vaughns V., Eibach R. P. (2008). Intersectional invisibility: The distinctive advantages and disadvantages of multiple subordinate-group identities. Sex Roles, 59, 377–391. doi:10.1007/s11199-008-9424-4
Roccas S., Brewer M. B. (2002). Social identity complexity. Personality and Social Psychology Review, 6, 88–106. doi:10.1207/S15327957PSPR0602_01
Roy A. L., Hughes D., Yoshikawa H. (2013). Intersections between nativity, ethnic density, and neighborhood SES: Using an ethnic enclave framework to explore variation in Puerto Ricans’ physical health. American Journal of Community Psychology, 51, 468–479. doi:10.1007/s10464-012-9564-0
Sandil R., Robinson M., Brewster M. E., Wong S., Geiger E. (2015). Negotiating multiple marginalizations: Experiences of South Asian LGBQ individuals. Cultural Diversity and Ethnic Minority Psychology, 21, 76–88. doi:10.1037/a0037070
Savin-Williams R. C. (2006). Who’s gay? Does it matter? Current Directions in Psychological Science, 15, 40–44. doi:10.1111/j.0963-7214.2006.00403.x
Savin-Williams R. C. (2014). An exploratory study of the categorical versus spectrum nature of sexual orientation. Journal of Sex Research, 51, 446–453. doi:10.1080/00224499.2013.871691
Seaton E. K., Caldwell C. H., Sellers R. M., Jackson J. S. (2010). An intersectional approach for understanding perceived discrimination and psychological well-being among African American and Caribbean Black youth. Developmental Psychology, 46, 1372–1379. doi:10.1037/a0019869
Sesko A. K., Biernat M. (2010). Prototypes of race and gender: The invisibility of Black women. Journal of Experimental Social Psychology, 46, 356–360. doi:10.1016/j.esp.2009.10.016
Settles I. H. (2006). Use of an intersectional framework to understand Black women’s racial and gender identities. Sex Roles, 54, 589–601. doi:10.1007/s11199-006-9029-8
Shadish W. R., Cook T. D., Campbell D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton-Mifflin.
Shaw L. R., Chan F., McMahon B. T. (2012). Intersectionality and disability harassment: The interactive effects of disability, race, age, and gender. Rehabilitation Counseling Bulletin, 55, 82–91. doi:10.1177/0034355211431167
Sidanius J., Pratto F. (1999). Social dominance: An intergroup theory of social hierarchy and oppression. New York, NY: Cambridge University Press.
Smith A., Stewart A. J. (1983). Approaches to studying racism and sexism in Black women’s lives. Journal of Social Issues, 39, 1–15. doi:10.1111/j.1540-4560.1983.tb00151.x
Snijders T. A. B., Bosker R. J. (2012). Multilevel analysis. Los Angeles, CA: Sage.
Sue S., Sue D. W. (2000). Conducting psychological research with the Asian American/Pacific Islander population. In Council of National Psychological Associations for the Advancement of Ethnic Minority Interests (Ed.), Guidelines for research in ethnic minority communities (pp. 2–4). Washington, DC: American Psychological Association.
Sulik M., Huerta S., Zerr A. A., Eisenberg N., Spinrad T. L., Valiente C.…Taylor H. B. (2010). The factor structure of effortful control and measurement invariance across ethnicity and sex in a high-risk sample. Journal of Psychopathology Behavioral Assessment, 32, 8–22. doi:10.1007/s10862-009-9164-y
Syed M. (2010). Disciplinarity and methodology in intersectionality theory and research. American Psychologist, 65, 61–62. doi:10.1037/a0017495
Szymanski D. M., Gupta A. (2009). Examining the relationship between multiple internalized oppressions and African American lesbian, gay, bisexual, and questioning persons’ self-esteem and psychological distress. Journal of Counseling Psychology, 56, 110–118. doi:10.1037/a0013317
Szymanski D. M., Henrichs-Beck C. (2014). Exploring sexual minority women’s experiences of external and internalized heterosexism and sexism and their links to coping and distress. Sex Roles, 70, 28–42. doi:10.1007/s11199-013-0329-5
Teddlie C., Yu F. (2007). Mixed methods sampling: A typology with examples. Journal of Mixed Methods Research, 1, 77–100. doi:10.1177/ 2345678906292430
Thomas A. J., Witherspoon K. M., Speight S. L. (2004). Toward the development of the Stereotypic Roles for Black Women Scale. Journal of Black Psychology, 30, 426–442. doi:10.1177/0095798404266061
Thomas E. L., Dovidio J. F., West T. V. (2014). Lost in the categorical shuffle: Evidence for the social non-prototypicality of Black women. Cultural Diversity and Ethnic Minority Psychology, 20, 370–376. doi:10.1037/a0035096
Tolhurst R., Leach B., Price J., Robinson J., Ettore E., Scott-Samuel A.…Theobald S. (2012). Intersectionality and gender mainstreaming in international health: Using a feminist participatory action research process to analyze voices and debates from the global south and north. Social Science and Medicine, 74, 1825–1832. doi:10.1016/j.socscimed.2011.08.025
Vandenberg R. J., Lance C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–70. doi:10.1177/109442810031002
Warner D. F., Brown T. H. (2011). Understanding how race/ethnicity and gender define age-trajectories of disability: An intersectionality approach. Social Science & Medicine, 72, 1236–1248. doi:10.1016/jsocscimed.2011.02.034
Warner L. R. (2008). A best practices guide to intersectional approaches in psychological research. Sex Roles, 59, 454–463. doi:10.1007/s11199-008-9504-5
West C., Zimmerman D. (1987). Doing gender. Gender and Society, 1, 125–151. doi:10.1177/0891243287001002002
Williams S. L., Fredrick E. G. (2015). One size may not fit all: The need for a more inclusive and intersectional psychological science on stigma. Sex Roles, 73, 384–390. doi:10.1007/s11199-015-0491-z
Woods K. C., Buchanan N. T., Settles I. H. (2009). Sexual harassment across the color line: Experiences and outcomes of cross- versus intraracial sexual harassment among Black women. Cultural Diversity and Ethnic Minority Psychology, 15, 67–76. doi:10.1037/a0013541
Zadnik E., Sabina C., Cuevas C. A. (2016). Violence against Latinas: The effects of undocumented status on rates of victimization and help-seeking. Journal of Interpersonal Violence, 31, 1141–1153. doi:10.1177/0886260514564062
