ABSTRACT
Wikipedia's success is often attributed to the large numbers of contributors who improve the accuracy, completeness and clarity of articles while reducing bias. However, because of the coordination needed to write an article collaboratively, adding contributors is costly. We examined how the number of editors in Wikipedia and the coordination methods they use affect article quality. We distinguish between explicit coordination, in which editors plan the article through communication, and implicit coordination, in which a subset of editors structure the work by doing the majority of it. Adding more editors to an article improved article quality only when they used appropriate coordination techniques and was harmful when they did not. Implicit coordination through concentrating the work was more helpful when many editors contributed, but explicit coordination through communication was not. Both types of coordination improved quality more when an article was in a formative stage. These results demonstrate the critical importance of coordination in effectively harnessing the "wisdom of the crowd" in online production environments.
- Aiken, L. and West, S. Multiple regression: Testing and interpreting interactions. Sage, CA (1991).Google Scholar
- Atkinson, A. B. On the measurement of inequality. Journal of Economic Theory, 2 (1970), 244--263.Google ScholarCross Ref
- Berg, J. E., Forsythe, R., & Rietz, T. A. The Iowa electronic market. In Blackwell Encyclopedic Dictionary of Finance, Blackwell, Oxford UK (1997).Google Scholar
- Benkler, Y. Coase's penguin, or Linux and the nature of the firm. Yale Law Journal, 112 (2002), 367--445.Google ScholarCross Ref
- Brooks, F. P. The mythical man month. Addison-Wesley Longman Publishing Co., Inc. Boston, MA, USA (1975). Google ScholarDigital Library
- Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. Applied multiple regression/correlation analysis for the behavioral sciences. Lawrence Erlbaum Associates, Mahwah, New Jersey (2003).Google Scholar
- Galton, F. Vox populi. Nature, 75 (1907), 7.Google ScholarCross Ref
- Giles, G. Internet encyclopaedias go head to head. Nature, 438 (2005), 900--901.Google ScholarCross Ref
- Hadoop Project. http://lucene.apache.org/hadoop/.Google Scholar
- Heckman, J. Sample selection bias as a specification error. Econometrica, 47, 1 (1979), 153--162.Google ScholarCross Ref
- Hill, G. W. Group versus individual performance. Are n + 1 heads better than one? Psychological Bulletin, 91 (1982), 517--539.Google ScholarCross Ref
- Hinsz, V. B., Tindale, R. S., & Vollrath, D. A. The emerging conceptualization of groups as information processors. Psychological Bulletin, 121, 1 (1997), 43--64.Google ScholarCross Ref
- http://en.wikipedia.org/wiki/Category:Wikipedia_1.0_assessmentsGoogle Scholar
- http://en.wikipedia.org/wiki/Wikipedia:StubGoogle Scholar
- http://en.wikipedia.org/wiki/Wikipedia:Version_1.0_Editorial_Team/AssessmentGoogle Scholar
- http://en.wikipedia.org/wiki/Wikipedia:WIAFAGoogle Scholar
- Kanefsky, B., Barlow, N.G., & Gulick, V.C. Can Distributed Volunteers Accomplish Massive Data Analysis Tasks? Lunar and Planetary Science (2001).Google Scholar
- Katz, R., & Tushman, M. Communication patterns, project performance, and task characteristics: An empirical evaluation and integration in an R&D setting. Organizational Behavior and Human Decision Processes, 23, (1979) 139--162.Google ScholarCross Ref
- Kittur, A., Suh, B., Chi, E., & Pendleton, B. A. He says, she says: Conflict and coordination in Wikipedia. CHI 2007, ACM Press (2007), 453--462. Google ScholarDigital Library
- Kittur, A., Chi, E., & Suh, B. Crowdsourcing user studies with Mechanical Turk. CHI 2008, ACM Press (2008). Google ScholarDigital Library
- Kittur, A., Chi, E., Pendleton, B. A., Suh, B., & Mytkowicz, T. Power of the few vs. wisdom of the crowd: Wikipedia and the rise of the bourgeoisie. Alt.CHI, 2007, San Jose, CA (2007).Google Scholar
- Laughlin, P. R., VanderStoep, S. W., & Hollingshead, A. B. Collective versus individual induction: Recognition of truth, rejection of error, and collective information processing. Journal of Personality and Social Psychology, 61, 1 (1991), 50--67.Google ScholarCross Ref
- Leavitt, H. Some effects of certain communication patterns on group performance. Journal of Abnormal and Social Psychology, 46 (1951), 38--50.Google ScholarCross Ref
- Malone, T. W. Modeling coordination in organizations and markets. Management Science, 33, 10 (1987), 1317--1332. Google ScholarDigital Library
- March, J. G., & Simon, H. A. Organizations. New York: Wiley (1958).Google Scholar
- Mockus, A., Fielding, R. T., & Herbsleb, J. D. Two case studies of open source software development: Apache and mozilla. ACM Transactions on Software Engineering and Methodology, 11, 3 (2002), 309--346. Google ScholarDigital Library
- Priedhorsky, R., Chen, J., Lam, S., Panciera, K., Terveen, L., & Riedl, J. Creating, destroying, and restoring value in Wikipedia. Proc GROUP 2007, ACM Press (2007), 259--268. Google ScholarDigital Library
- Rouse, W.B., Cannon-Bowers, J. A., & Salas, E. The role of mental models in team performance in complex systems. IEEE Transactions on Systems, Man, and Cybernetics, 22 (1992) 1296--1308.Google ScholarCross Ref
- Shepperd, J. A. Productivity loss in performance groups: A motivation analysis. Psychological Bulletin, 113, 1 (1993), 67--81.Google ScholarCross Ref
- Steiner, I. D. Group process and productivity. New York: Academic Press (1972).Google Scholar
- Stvilia, B., Twidale, M. B., Smith, L. C., & Gasser, L. Assessing information quality of a community-based encyclopedia. In Proc. ICIQ (2005), 442--454.Google Scholar
- Surowiecki, J. The wisdom of crowds. New York: Doubleday (2005). Google ScholarDigital Library
- Thompson, J. Organizations in action. New York: McGraw-Hill (1967).Google Scholar
- Tushman, M. Work characteristics and subunit communication structure: A contingency analysis. Administrative Science Quarterly, 24, (1979), 82--98.Google ScholarCross Ref
- Van de Ven, A. H., Delbecq, A. L., & Koenig, R., Jr. Determinants of coordination modes within organizations. American Sociological Review, 41 (1967), 322--338.Google Scholar
- Viégas, F. B., Wattenberg M., & Dave, K. Studying cooperation and conflict between authors with history flow visualizations. CHI 2004, ACM Press (2004), 575--582. Google ScholarDigital Library
- Viégas, F. B., Wattenberg, M., Kriss, J., & van Ham, F. Talk before you type: Coordination in Wikipedia. HICSS (2007).Google Scholar
- Viégas, F. B., Wattenberg, M., & McKeon, M. M. The hidden order of Wikipedia. In HCII (2007).Google Scholar
- Wilkinson, D. M., & Huberman, B. A. Assessing the value of cooperation in Wikipedia. First Monday, 12, 4 (2007).Google ScholarCross Ref
- Wittenbaum, G. W., Vaughan, S. I., & Stasser, G. Coordination in task-performing groups. In Theory and research on small groups, Plenum Press, NY (1998).Google Scholar
Index Terms
-
Harnessing the wisdom of crowds in wikipedia: quality through coordination
-
Recommendations
-
He says, she says: conflict and coordination in Wikipedia
CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWikipedia, a wiki-based encyclopedia, has become one of the most successful experiments in collaborative knowledge building on the Internet. As Wikipedia continues to grow, the potential for conflict and the need for coordination increase as well. This ...
-
Beyond Wikipedia: coordination and conflict in online production groups
CSCW '10: Proceedings of the 2010 ACM conference on Computer supported cooperative workOnline production groups have the potential to transform the way that knowledge is produced and disseminated. One of the most widely used forms of online production is the wiki, which has been used in domains ranging from science to education to ...
-
Coordination in collective intelligence: the role of team structure and task interdependence
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThe success of Wikipedia has demonstrated the power of peer production in knowledge building. However, unlike many other examples of collective intelligence, tasks in Wikipedia can be deeply interdependent and may incur high coordination costs among ...
Comments