skip to main content
research-article

Manipulation among the Arbiters of Collective Intelligence: How Wikipedia Administrators Mold Public Opinion

Published:24 December 2016Publication History
Skip Abstract Section

Abstract

Our reliance on networked, collectively built information is a vulnerability when the quality or reliability of this information is poor. Wikipedia, one such collectively built information source, is often our first stop for information on all kinds of topics; its quality has stood up to many tests, and it prides itself on having a “neutral point of view.” Enforcement of neutrality is in the hands of comparatively few, powerful administrators. In this article, we document that a surprisingly large number of editors change their behavior and begin focusing more on a particular controversial topic once they are promoted to administrator status. The conscious and unconscious biases of these few, but powerful, administrators may be shaping the information on many of the most sensitive topics on Wikipedia; some may even be explicitly infiltrating the ranks of administrators in order to promote their own points of view. In addition, we ask whether administrators who change their behavior in this suspicious manner can be identified in advance. Neither prior history nor vote counts during an administrator’s election are useful in doing so, but we find that an alternative measure, which gives more weight to influential voters, can successfully reject these suspicious candidates. This second result has important implications for how we harness collective intelligence: even if wisdom exists in a collective opinion (like a vote), that signal can be lost unless we carefully distinguish the true expert voter from the noisy or manipulative voter.

References

  1. Sinan Aral, Lev Muchnik, and Arun Sundararajan. 2009. Distinguishing influence-based contagion from homophily-driven diffusion in dynamic networks. Proceedings of the National Academy of Sciences 106, 51 (2009), 21544--21549. Google ScholarGoogle ScholarCross RefCross Ref
  2. David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet allocation. Journal of Machine Learning Research 3 (March 2003), 993--1022.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Moira Burke and Robert Kraut. 2008. Mopping up: Modeling Wikipedia promotion decisions. In Proceedings of the ACM Conference on Computer Supported Cooperative Work. 27--36. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. 2008. Candid CAMERA. Harper’s Magazine. July 2008. 23--24.Google ScholarGoogle Scholar
  5. Sanmay Das, Allen Lavoie, and Malik Magdon-Ismail. 2013. Manipulation among the arbiters of collective intelligence: How Wikipedia administrators mold public opinion. In Proceedings of the 22nd ACM Conference of Information and Knowledge Management (CIKM’13). 1097--1106. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Sanmay Das and Malik Magdon-Ismail. 2010. Collective wisdom: Information growth in wikis and blogs. In Proceedings of the ACM Conference on Electronic Commerce. 231--240. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Matthew Gentzkow and Jesse M. Shapiro. 2010. What drives media slant? Evidence from US daily newspapers. Econometrica 78, 1 (2010), 35--71. Google ScholarGoogle Scholar
  8. Arpita Ghosh, Satyen Kale, and Preston McAfee. 2011. Who moderates the moderators? Crowdsourcing abuse detection in user-generated content. In Proceedings of the ACM Conference on Electronic Commerce. ACM, New York, NY, 167--176. DOI:http://dx.doi.org/10.1145/1993574.1993599 Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Jim Giles. 2005. Internet encyclopaedias go head to head. Nature 438, 7070 (Dec. 2005), 900--901. Google ScholarGoogle ScholarCross RefCross Ref
  10. Thomas L. Griffiths and Mark Steyvers. 2004. Finding scientific topics. Proceedings of the National Academy of Sciences 101 (Apr 2004), 5228--5235. DOI:http://dx.doi.org/10.1073/pnas.0307752101 Google ScholarGoogle ScholarCross RefCross Ref
  11. R. Hanson. 2002. Decision markets. Entrepreneurial Economics: Bright Ideas from the Dismal Science (2002), 79.Google ScholarGoogle Scholar
  12. M. Hindman, K. Tsioutsiouliklis, and J. A. Johnson. 2003. Googlearchy: How a few heavily-linked sites dominate politics on the web. In Proceedings of the Annual Meeting of the Midwest Political Science Association, Vol. 4. 1--33.Google ScholarGoogle Scholar
  13. Gabriela Kalna and Desmond J. Higham. 2007. A clustering coefficient for weighted networks, with application to gene expression data. AI Communications 20, 4 (Dec. 2007), 263--271.Google ScholarGoogle Scholar
  14. Aniket Kittur, Bongwon Suh, Bryan A. Pendleton, and Ed H. Chi. 2007. He says, she says: Conflict and coordination in Wikipedia. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. D. Lazer, A. S. Pentland, L. Adamic, S. Aral, A. L. Barabasi, D. Brewer, N. Christakis, N. Contractor, J. Fowler, M. Gutmann, T. Jebara, G. King, M. Macy, D. Roy, and M. Van Alstyne. 2009. Life in the network: The coming age of computational social science. Science 323, 5915 (2009), 721.Google ScholarGoogle Scholar
  16. Chenliang Li, Anwitaman Datta, and Aixin Sun. 2012. Mining latent relations in peer-production environments: A case study with Wikipedia article similarity and controversy. Social Network Analysis and Mining 2, 3 (2012), 265--278. Google ScholarGoogle ScholarCross RefCross Ref
  17. Zhiyuan Liu, Yuzhou Zhang, Edward Y. Chang, and Maosong Sun. 2011. PLDA+: Parallel latent Dirichlet allocation with data placement and pipeline processing. ACM Transactions on Intelligent Systems and Technology (TIST) 2, 3 (2011), 26.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Rui Lopes and Luis Carriço. 2008. On the credibility of wikipedia: An accessibility perspective. In Proceedings of the 2nd ACM Workshop on Information Credibility on the Web (WICOW’08). ACM, New York, NY, 27--34. DOI:http://doi.acm.org/10.1145/1458527.1458536Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. F. Menczer, S. Fortunato, A. Flammini, and A. Vespignani. 2006. Googlearchy or Googlocracy? IEEE Spectrum Online (2006).Google ScholarGoogle Scholar
  20. M. Moyer. 2010. Manipulation of the crowd. Scientific American Magazine 303, 1 (2010), 26--28. Google ScholarGoogle ScholarCross RefCross Ref
  21. Martin Potthast, Benno Stein, and Robert Gerling. 2008. Automatic vandalism detection in Wikipedia. In Proceedings of the IR Research, 30th European Conference on Advances in Information Retrieval (ECIR’08). Springer, Berlin, 663--668. Google ScholarGoogle ScholarCross RefCross Ref
  22. P. Resnick and R. Sami. 2007. The influence limiter: Provably manipulation-resistant recommender systems. In Proceedings of the ACM Conference on Recommender Systems. ACM, 25--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Alastair Sloan. 2015. Manipulating Wikipedia to promote a bogus business school. Newsweek (March 24 2015).Google ScholarGoogle Scholar
  24. Koen Smets, Bart Goethals, and Brigitte Verdonk. 2008. Automatic vandalism detection in Wikipedia: Towards a machine learning approach. In Proceedings of the AAAI Workshop on Wikipedia and Artificial Intelligence.Google ScholarGoogle Scholar
  25. Anselm Spoerri. 2007. What is popular on Wikipedia and why? First Monday 12, 4 (April 2007). Google ScholarGoogle ScholarCross RefCross Ref
  26. Ba-Quy Vuong, Ee-Peng Lim, Aixin Sun, Minh-Tam Le, and Hady Wirawan Lauw. 2008. On ranking controversies in Wikipedia: Models and evaluation. In Proceedings of the International Conference on Web Search and Web Data Mining. 171--182. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Howard T. Welser, Dan Cosley, Gueorgi Kossinets, Austin Lin, Fedor Dokshin, Geri Gay, and Marc Smith. 2011. Finding social roles in Wikipedia. In Proceedings of the 2011 iConference (iConference’11). ACM, New York, NY, 122--129. DOI:http://dx.doi.org/10.1145/1940761.1940778 Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Dennis M. Wilkinson and Bernardo A. Huberman. 2007. Assessing the value of coooperation in Wikipedia. First Monday 12, 4 (Feb 2007). Google ScholarGoogle ScholarCross RefCross Ref
  29. Justin Wolfers and Eric Zitzewitz. 2004. Prediction markets. Journal of Economic Perspectives 18, 2 (2004), 107--126. Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Manipulation among the Arbiters of Collective Intelligence: How Wikipedia Administrators Mold Public Opinion

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on the Web
          ACM Transactions on the Web  Volume 10, Issue 4
          December 2016
          169 pages
          ISSN:1559-1131
          EISSN:1559-114X
          DOI:10.1145/3017848
          Issue’s Table of Contents

          Copyright © 2016 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 24 December 2016
          • Accepted: 1 September 2016
          • Revised: 1 April 2016
          • Received: 1 August 2015
          Published in tweb Volume 10, Issue 4

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader