skip to main content
10.1145/2505515.2505566acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

Manipulation among the arbiters of collective intelligence: how wikipedia administrators mold public opinion

Published:27 October 2013Publication History

ABSTRACT

Our reliance on networked, collectively built information is a vulnerability when the quality or reliability of this information is poor. Wikipedia, one such collectively built information source, is often our first stop for information on all kinds of topics; its quality has stood up to many tests, and it prides itself on having a "Neutral Point of View". Enforcement of neutrality is in the hands of comparatively few, powerful administrators. We find a surprisingly large number of editors who change their behavior and begin focusing more on a particular controversial topic once they are promoted to administrator status. The conscious and unconscious biases of these few, but powerful, administrators may be shaping the information on many of the most sensitive topics on Wikipedia; some may even be explicitly infiltrating the ranks of administrators in order to promote their own points of view. Neither prior history nor vote counts during an administrator's election can identify those editors most likely to change their behavior in this suspicious manner. We find that an alternative measure, which gives more weight to influential voters, can successfully reject these suspicious candidates. This has important implications for how we harness collective intelligence: even if wisdom exists in a collective opinion (like a vote), that signal can be lost unless we carefully distinguish the true expert voter from the noisy or manipulative voter.

References

  1. Candid CAMERA. Harper's Magazine, July 2008.Google ScholarGoogle Scholar
  2. D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent Dirichlet Allocation. Journal of Machine Learning Research, 3: 993--1022, Mar. 2003. ISSN 1532-4435. URL http://dl.acm.org/citation.cfm?id=944919.944937. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. M. Burke and R. Kraut. Mopping up: Modeling Wikipedia promotion decisions. In Proceedings of the ACM Conference on Computer Supported Cooperative Work, pages 27--36, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. S. Das and M. Magdon-Ismail. Collective wisdom: Information growth in wikis and blogs. In Proceedings of the ACM Conference on Electronic Commerce, pages 231--240, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. A. Ghosh, S. Kale, and P. McAfee. Who moderates the moderators? Crowdsourcing abuse detection in user-generated content. In Proceedings of the ACM Conference on Electronic Commerce, pages 167--176, New York, NY, USA, 2011. ACM. ISBN 978-1-4503-0261-6. 10.1145/1993574.1993599. URL http://doi.acm.org/10.1145/1993574.1993599. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. J. Giles. Internet encyclopaedias go head to head. phNature, 438 (7070): 900--901, December 2005. ISSN 0028-0836.Google ScholarGoogle Scholar
  7. T. L. Griffiths and M. Steyvers. Finding scientific topics. Proceedings of the National Academy of Sciences, 101: 5228--5235, Apr 2004. ISSN 0027-8424. 10.1073/pnas.0307752101. URL http://dx.doi.org/10.1073/pnas.0307752101.Google ScholarGoogle ScholarCross RefCross Ref
  8. R. Hanson. Decision markets. Entrepreneurial Economics: Bright Ideas from the Dismal Science, page 79, 2002.Google ScholarGoogle Scholar
  9. M. Hindman, K. Tsioutsiouliklis, and J. Johnson. Googlearchy: How a few heavily-linked sites dominate politics on the web. In Annual Meeting of the Midwest Political Science Association, volume 4, pages 1--33, 2003.Google ScholarGoogle Scholar
  10. G. Jeh and J. Widom. Simrank: a measure of structural-context similarity. In Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, KDD '02, pages 538--543, New York, NY, USA, 2002. ACM. ISBN 1-58113-567-X. http://doi.acm.org/10.1145/775047.775126. URL http://doi.acm.org/10.1145/775047.775126. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. G. Kalna and D. J. Higham. A clustering coefficient for weighted networks, with application to gene expression data. AI Communications, 20: 263--271, Dec 2007. ISSN 0921-7126. URL http://dl.acm.org/citation.cfm?id=1365534.1365536. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. A. Kittur, B. Suh, B. A. Pendleton, and E. H. Chi. He says, she says: Conflict and coordination in Wikipedia. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. D. Lazer, A. Pentland, L. Adamic, S. Aral, A. Barabasi, D. Brewer, N. Christakis, N. Contractor, J. Fowler, M. Gutmann, T. Jebara, G. King, M. Macy, D. Roy, and M. Van Alstyne. Life in the network: the coming age of computational social science. Science, 323 (5915): 721, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  14. C. Li, A. Datta, and A. Sun. Mining latent relations in peer-production environments: A case study with Wikipedia article similarity and controversy. Social Network Analysis and Mining, pages 1--14, 2011.Google ScholarGoogle Scholar
  15. Z. Liu, Y. Zhang, E. Y. Chang, and M. Sun. Plda+: Parallel latent Dirichlet allocation with data placement and pipeline processing. ACM Transactions on Intelligent Systems and Technology, special issue on Large Scale Machine Learning, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. R. Lopes and L. Carriço. On the credibility of Wikipedia: an accessibility perspective. In Proceedings of the 2nd ACM workshop on Information credibility on the web, WICOW '08, pages 27--34, New York, NY, USA, 2008. ACM. ISBN 978-1-60558-259-7. URL http://doi.acm.org/10.1145/1458527.1458536. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. F. Menczer, S. Fortunato, A. Flammini, and A. Vespignani. Googlearchy or Googlocracy? IEEE Spectrum Online, 2006.Google ScholarGoogle Scholar
  18. M. Moyer. Manipulation of the crowd. Scientific American Magazine, 303 (1): 26--28, 2010.Google ScholarGoogle ScholarCross RefCross Ref
  19. M. Potthast, B. Stein, and R. Gerling. Automatic vandalism detection in Wikipedia. In Proceedings of the IR research, 30th European conference on Advances in information retrieval, ECIR'08, pages 663--668, Berlin, Heidelberg, 2008. Springer. ISBN 3-540-78645-7, 978-3-540-78645-0. URL http://dl.acm.org/citation.cfm?id=1793274.1793363. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. P. Resnick and R. Sami. The influence limiter: Provably manipulation-resistant recommender systems. In Proceedings of the ACM Conference on Recommender Systems, pages 25--32. ACM, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. K. Smets, B. Goethals, and B. Verdonk. Automatic vandalism detection in Wikipedia: Towards a machine learning approach. In Proceedings of the AAAI Workshop on Wikipedia and Artificial Intelligence, 2008.Google ScholarGoogle Scholar
  22. A. Spoerri. What is popular on Wikipedia and why? First Monday, 12 (4), April 2007.Google ScholarGoogle Scholar
  23. B.-Q. Vuong, E.-P. Lim, A. Sun, M.-T. Le, and H. W. Lauw. On ranking controversies in Wikipedia: Models and evaluation. In Proceedings of the International Conference on Web Search and Web Data Mining, pages 171--182, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. H. T. Welser, D. Cosley, G. Kossinets, A. Lin, F. Dokshin, G. Gay, and M. Smith. Finding social roles in Wikipedia. In Proceedings of the 2011 iConference, iConference '11, pages 122--129, New York, NY, USA, 2011. ACM. ISBN 978-1-4503-0121-3. 10.1145/1940761.1940778. URL http://doi.acm.org/10.1145/1940761.1940778. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. D. M. Wilkinson and B. A. Huberman. Assessing the value of coooperation in Wikipedia. First Monday, 12 (4), Feb 2007.Google ScholarGoogle Scholar
  26. J. Wolfers and E. Zitzewitz. Prediction markets. Journal of Economic Perspectives, 18 (2): 107--126, 2004.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Manipulation among the arbiters of collective intelligence: how wikipedia administrators mold public opinion

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Conferences
          CIKM '13: Proceedings of the 22nd ACM international conference on Information & Knowledge Management
          October 2013
          2612 pages
          ISBN:9781450322638
          DOI:10.1145/2505515

          Copyright © 2013 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 27 October 2013

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          CIKM '13 Paper Acceptance Rate143of848submissions,17%Overall Acceptance Rate1,861of8,427submissions,22%

          Upcoming Conference

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader