Eshwar Chandrasekharan
Anirudh Srinivasan
Skip Abstract Section
Abstract
In 2015, Reddit closed several subreddits-foremost among them r/fatpeoplehate and r/CoonTown-due to violations of Reddit's anti-harassment policy. However, the effectiveness of banning as a moderation approach remains unclear: banning might diminish hateful behavior, or it may relocate such behavior to different parts of the site. We study the ban of r/fatpeoplehate and r/CoonTown in terms of its effect on both participating users and affected subreddits. Working from over 100M Reddit posts and comments, we generate hate speech lexicons to examine variations in hate speech usage via causal inference methods. We find that the ban worked for Reddit. More accounts than expected discontinued using the site; those that stayed drastically decreased their hate speech usage-by at least 80%. Though many subreddits saw an influx of r/fatpeoplehate and r/CoonTown "migrants," those subreddits saw no significant changes in hate speech usage. In other words, other subreddits did not inherit the problem. We conclude by reflecting on the apparent success of the ban, discussing implications for online moderation, Reddit and internet communities more broadly.
- Alberto Abadie. 2005. Semiparametric difference-in-differences estimators. The Review of Economic Studies 72, 1 (2005), 1--19.Google Scholar
Cross Ref
- James Lopez Bernal, Steven Cummins, and Antonio Gasparrini. 2017. Interrupted time series regression for the evaluation of public health interventions: a tutorial. International journal of epidemiology 46, 1 (2017), 348--355.Google Scholar
- Michael S Bernstein, Andrés Monroy-hernández, Drew Harry, Paul André Katrina Panovich, and Greg Vargas. 2011. 4chan and/b: An Analysis of Anonymity and Ephemerality in a Large Online Community. In In Proc. Fifth International AAAI Conference on Weblogs and Social Media (ICWSM-11)Google Scholar
- Sam Biddle. 2015. Reddit (Finally) Bans CoonTown. http://gawker.com/reddit-finally-bans-coontown-1722332877. Gawker (2015).Google Scholar
- Peter Burnap and Matthew Leighton Williams. 2014. Hate speech, machine classification and statistical modelling of information flows on Twitter: Interpretation and communication for policy decision making. In Internet, Policy and Politics Conference, Oxford, United Kingdom.Google Scholar
- Stevie Chancellor, Zhiyuan Jerry Lin, and Munmun De Choudhury. 2016. "This Post Will Just Get Taken Down": Characterizing Removed Pro-Eating Disorder Social Media Content. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1157--1162. Google ScholarDigital Library
- Stevie Chancellor, Jessica Annette Pater, Trustin Clear, Eric Gilbert, and Munmun De Choudhury. 2016. # thyghgapp: Instagram Content Moderation and Lexical Variation in Pro-Eating Disorder Communities. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 1201--1213. Google ScholarDigital Library
- Eshwar Chandrasekharan, Mattia Samory, Anirudh Srinivasan, and Eric Gilbert. 2017. The Bag of Communities: Identifying Abusive Behavior Online with Preexisting Internet Data. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM. Google ScholarDigital Library
- Justin Cheng, Cristian Danescu-Niculescu-Mizil, and Jure Leskovec. 2014. How community feedback shapes user behavior. In Eighth International AAAI Conference on Web and Social Media.Google Scholar
- Justin Cheng, Cristian Danescu-Niculescu-Mizil, and Jure Leskovec. 2015. Antisocial Behavior in Online Discussion Communities. In Ninth International AAAI Conference on Web and Social Media.Google Scholar
- Tiago Oliveira Cunha, Ingmar Weber, Hamed Haddadi, and Gisele L Pappa. 2016. The Effect of Social Feedback in a Reddit Weight Loss Community. In Proceedings of the 6th International Conference on Digital Health Conference. ACM. Google ScholarDigital Library
- Munmun De Choudhury, Sanket Sharma, and Emre Kiciman. 2016. Characterizing dietary choices, nutrition, and language in food deserts via social media. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 1157--1170. Google ScholarDigital Library
- Venita DePuy, Vance W Berger, and YanYan Zhou. 2005. Wilcoxon--Mann--Whitney test. Encyclopedia of statistics in behavioral science (2005).Google Scholar
- Caitlin Dewey. June, 10, 2015. These are the 5 subreddits Reddit banned under its game-changing anti-harassment policy - and why it banned them. https://www.washingtonpost.com/news/the-intersect/wp/2015/06/10/these-arethe-5-subreddits-reddit-banned-under-its-game-changing-anti-harassment-policy-and-why-it-banned-them/. The Washington Post (June, 10, 2015).Google Scholar
- Karthik Dinakar, Roi Reichart, and Henry Lieberman. 2011. Modeling the detection of Textual Cyberbullying. In The Social Mobile Web. 11--17.Google Scholar
- Virgile Landeiro Dos Reis and Aron Culotta. 2015. Using matched samples to estimate the effects of exercise on mental health from Twitter. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence. 182--188. Google ScholarDigital Library
- Michelle Broder Van Dyke. 2015. Reddit Users Revolt After Site Bans "Fat People Hate" And Other Communities. https://www.buzzfeed.com/mbvd/reddit-users-revolt-after-site-bans-fat-people-hate-and-othe. Buzzfeed News (2015).Google Scholar
- Jacob Eisenstein, Amr Ahmed, and Eric P Xing. 2011. Sparse additive generative models of text. In Proceedings of the 28th International Conference on International Conference on Machine Learning. Omnipress, 1041--1048. Google ScholarDigital Library
- Constantine E Frangakis and Donald B Rubin. 2002. Principal stratification in causal inference. Biometrics 58, 1 (2002), 21--29.Google ScholarCross Ref
- Keegan Hankes. 2015. Black Hole. https://www.splcenter.org/fighting-hate/intelligence-report/2015/black-hole. SPLC Intelligence Report (2015).Google Scholar
- Sara Kiesler, Robert Kraut, Paul Resnick, and Aniket Kittur. 2012. Regulating behavior in online communities. Building Successful Online Communities: Evidence-Based Social Design. MIT Press, Cambridge, MA (2012). Google ScholarDigital Library
- Jason Koebler. June, 10, 2015. This Is the Site Redditors Are Migrating to Now That r/fatpeoplehate Is Banned. https://tinyurl.com/voat-fph. Motherboard (June, 10, 2015).Google Scholar
- Irene Kwok and Yuzhou Wang. 2013. Locate the hate: detecting tweets against blacks. In Proceedings of the TwentySeventh AAAI Conference on Artificial Intelligence. AAAI Press, 1621--1622. Google ScholarDigital Library
- Cliff Lampe and Paul Resnick. 2004. Slash (dot) and burn: distributed moderation in a large online conversation space. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 543--550. Google ScholarDigital Library
- Alex Leavitt. 2015. This is a throwaway account: Temporary technical identities and perceptions of anonymity in a massive online community. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 317--327. Google ScholarDigital Library
- J. N. Matias. 2015. What just happened on reddit? Understanding the moderator blackout. http://socialmediacollective.org/2015/07/09/what-justhappened-on-reddit-understanding-the-moderatorblackout/. The Washington Post (2015).Google Scholar
- Aiden R McGillicuddy, Jean-Gregoire Bernard, and Jocelyn Ann Cranefield. 2016. Controlling Bad Behavior in Online Communities: An Examination of Moderation Work. (2016).Google Scholar
- Justin Wm. Moyer. 2015. "Coontown": A noxious, racist corner of Reddit survives recent purge. https://www.washingtonpost.com/news/morning-mix/wp/2015/07/17/coontown-a-noxious-racist-corner-ofreddit-survives-recent-purge/. The Washington Post (2015).Google Scholar
- Edward Newell, David Jurgens, Haji Mohammad Saleem, Hardik Vala, Jad Sassine, Caitrin Armstrong, and Derek Ruths. 2016. User Migration in Online Social Networks: A Case Study on Reddit During a Period of Community Unrest. In Tenth International AAAI Conference on Web and Social Media.Google Scholar
- Chikashi Nobata, Joel Tetreault, Achint Thomas, Yashar Mehdad, and Yi Chang. 2016. Abusive Language Detection in Online User Content. In Proceedings of the 25th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 145--153. Google ScholarDigital Library
- Jessica Annette Pater, Yacin Nadji, Elizabeth D Mynatt, and Amy S Bruckman. 2014. Just awful enough: the functional dysfunction of the something awful forums. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 2407--2410. Google ScholarDigital Library
- J. Michael Paul and Mark Dredze. 2013. Drug Extraction from the Web: Summarizing Drug Experiences with MultiDimensional Topic Models. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, 168--178. http://aclweb.org/anthology/N13--1017Google Scholar
- Umashanthi Pavalanathan and Jacob Eisenstein. 2015. Confounds and Consequences in Geotagged Twitter Data. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2138--2148.Google ScholarCross Ref
- Amir H Razavi, Diana Inkpen, Sasha Uritsky, and Stan Matwin. 2010. Offensive language detection using multi-level classification. In Canadian Conference on Artificial Intelligence. Springer, 16--27. Google ScholarDigital Library
- Adi Robertson. 2015. Reddit announces new anti-harassment rules. http://www.theverge.com/2015/5/14/8606923/redditanti-harassment-policy. The Verge (2015).Google Scholar
- Adi Robertson. 2015. Reddit bans "Fat People Hat" and other subreddits under new harassment rules. http://www.theverge.com/2015/6/10/8761763/reddit-harassment-ban-fat-people-hate-subreddit. The Verge (2015).Google Scholar
- Daniel M Romero, Brian Uzzi, and Jon Kleinberg. 2016. Social Networks Under Stress. In Proceedings of the 25th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 9--20. Google ScholarDigital Library
- Paul R Rosenbaum. 2002. Observational studies. In Observational Studies. Springer, 1--17.Google Scholar
- Paul R Rosenbaum and Donald B Rubin. 1983. The central role of the propensity score in observational studies for causal effects. Biometrika 70, 1 (1983), 41--55.Google ScholarCross Ref
- Donald B Rubin and Elizabeth A Stuart. 2006. Affinely invariant matching methods with discriminant mixtures of proportional ellipsoidally symmetric distributions. The Annals of Statistics (2006), 1814--1826.Google ScholarCross Ref
- Joseph Seering, Robert Kraut, and Laura Dabbish. 2017. Shaping Pro and Anti-Social Behavior on Twitch Through Moderation and Example-Setting. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 111--125. Google ScholarDigital Library
- Yanchuan Sim, L. Brice D. Acree, H. Justin Gross, and A. Noah Smith. 2013. Measuring Ideological Proportions in Political Speeches. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 91--101. http://aclweb.org/anthology/D13--1010Google Scholar
- Sara Owsley Sood, Elizabeth F Churchill, and Judd Antin. 2012. Automatic identification of personal insults on social news sites. Journal of the American Society for Information Science and Technology 63, 2 (2012), 270--285. Google ScholarDigital Library
- Nabiha Syed Syed and Ben Smith. June, 2, 2016. A First Amendment For Social Platforms. https://medium.com/@BuzzFeed/a-first-amendment-for-social-platforms-202c0eab7054. Medium (June, 2, 2016).Google Scholar
- Voat. 2015. "This is the official r/CoonTown replacement". https://tinyurl.com/voat-ct-replacement. (2015).Google Scholar
- William Warner and Julia Hirschberg. 2012. Detecting hate speech on the world wide web. In Proceedings of the Second Workshop on Language in Social Media. Association for Computational Linguistics, 19--26. Google ScholarDigital Library
- Zeerak Waseem and Dirk Hovy. 2016. Hateful symbols or hateful people? predictive features for hate speech detection on twitter. In Proceedings of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT). 88--93.Google ScholarCross Ref
- Anne Weber. 2009. Manual on hate speech. Council of Europe.Google Scholar
- Jun-Ming Xu, Benjamin Burchfiel, Xiaojin Zhu, and Amy Bellmore. 2013. An Examination of Regret in Bullying Tweets. In Proceedings of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT). 697--702.Google Scholar
- Zhi Xu and Sencun Zhu. 2010. Filtering offensive language in online communities using grammatical relations. In Proceedings of the Seventh Annual Collaboration, Electronic Messaging, Anti-Abuse and Spam Conference. 1--10.Google Scholar
- George Kingsley Zipf. 1949. Human behavior and the principle of least effort. (1949).Google Scholar
Index Terms
-
You Can't Stay Here: The Efficacy of Reddit's 2015 Ban Examined Through Hate Speech
-
Recommendations
-
Hate begets Hate: A Temporal Study of Hate Speech
CSCWWith the ongoing debate on 'freedom of speech' vs. 'hate speech,' there is an urgent need to carefully understand the consequences of the inevitable culmination of the two, i.e., 'freedom of hate speech' over time. An ideal scenario to understand this ...
-
What is BitChute?: Characterizing the
HT '20: Proceedings of the 31st ACM Conference on Hypertext and Social MediaIn this paper, we characterize the content and discourse on BitChute, a social video-hosting platform. Launched in 2017 as an alternative to YouTube, BitChute joins an ecosystem of alternative, low content moderation platforms, including Gab, Voat, ...
-
What is Gab: A Bastion of Free Speech or an Alt-Right Echo Chamber
WWW '18: Companion Proceedings of the The Web Conference 2018Over the past few years, a number of new "fringe" communities, like 4chan or certain subreddits, have gained traction on the Web at a rapid pace. However, more often than not, little is known about how they evolve or what kind of activities they attract,...
Comments