Briefing | Unreliable research

Trouble at the lab

Scientists like to think of science as self-correcting. To an alarming degree, it is not

“I SEE a train wreck looming,” warned Daniel Kahneman, an eminent psychologist, in an open letter last year. The premonition concerned research on a phenomenon known as “priming”. Priming studies suggest that decisions can be influenced by apparently irrelevant actions or events that took place just before the cusp of choice. They have been a boom area in psychology over the past decade, and some of their insights have already made it out of the lab and into the toolkits of policy wonks keen on “nudging” the populace.

Dr Kahneman and a growing number of his colleagues fear that a lot of this priming research is poorly founded. Over the past few years various researchers have made systematic attempts to replicate some of the more widely cited priming experiments. Many of these replications have failed. In April, for instance, a paper in PLoS ONE, a journal, reported that nine separate experiments had not managed to reproduce the results of a famous study from 1998 purporting to show that thinking about a professor before taking an intelligence test leads to a higher score than imagining a football hooligan.

This article appeared in the Briefing section of the print edition under the headline “Trouble at the lab”

How science goes wrong

From the October 19th 2013 edition

Discover stories from this section and more in the list of contents

Explore the edition

More from Briefing

The undoing of Roe v Wade has created a mighty political movement

The power of women with clipboards

Why this is South Africa’s most important election since 1994

It may force the country’s indecisive leader to make a fateful choice


Why America is vulnerable to a despot

Its democratic system is not as robust as it seems