Hostname: page-component-76fb5796d-x4r87 Total loading time: 0 Render date: 2024-04-26T16:54:03.665Z Has data issue: false hasContentIssue false

Correlation Versus Interchangeability: The Limited Robustness of Empirical Findings on Democracy Using Highly Correlated Data Sets

Published online by Cambridge University Press:  04 January 2017

Gretchen Casper
Affiliation:
Department of Political Science, Pennsylvania State University, 107 Burrowes Building, University Park, PA 16802-6202. e-mail: gcasper@psu.edu
Claudiu Tufis
Affiliation:
Department of Political Science, Pennsylvania State University, 107 Burrowes Building, University Park, PA 16802-6202. e-mail: cdt130@psu.edu

Abstract

This article shows that highly correlated measures can produce different results. We identify a democratization model from the literature and test it in more than 120 countries from 1951 to 1992. Then, we check whether the results are robust regarding measures of democracy, time periods, and levels of development. The findings show that measures do matter: Whereas some of the findings are robust, most of them are not. This explains, in part, why the debates on democracy have continued rather than been resolved. More important, it underscores the need for more careful use of measures and further testing to increase confidence in the findings. Scholars in comparative politics are drawn increasingly to large-N statistical analyses, often using data sets collected by others. As in any field, we show how they must be careful in choosing the most appropriate measures for their studies, without assuming that any correlated measure will do.

Type
Replications and Extensions
Copyright
Copyright © Political Methodology Section of the American Political Science Association 2003 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Beck, Nathaniel, and Katz, Jonathan N. 1995. “What to Do (and Not to Do) with Time-Series Cross-Section Data.” American Political Science Review 89:634647.Google Scholar
Dahl, Robert A. 1971. Polyarchy: Participation and Opposition. New Haven, CT: Yale University Press.Google Scholar
House, Freedom. 2001. “Freedom House Country Ratings.” (Available from http://www.freedomhouse.org/ratings/index.htm.) Google Scholar
Huntington, Samuel P. 1991. The Third Wave. Norman, OK: University of Oklahoma Press.Google Scholar
Marshall, Monty G., and Jaggers, Keith. 2000. Polity IV Dataset and Users' Manual: Political Regime Characteristics and Transitions, 1800-1999. (Available from http://www.bsos.umd.edu/cidcm/polity.) Google Scholar
Vanhanen, Tatu. 2000. “The Polyarchy Dataset: Vanhanen's Index of Democracy.” (Available from http://www.svt.ntnu.no/iss/data/vanhanen.) Google Scholar