Mother Jones
<!DOCTYPE html PUBLIC “-//W3C//DTD HTML 4.0 Transitional//EN” “http://www.w3.org/TR/REC-html40/loose.dtd”>
In 2014, I profiled Brian Wansink, a behavioral psychologist who studies how our surroundings affect our eating habits. Wansink runs Cornell University’s Food and Brand Lab, a prolific group known for its clever dining research—one widely cited study, for example, found that people who keep their breakfast cereal in a cabinet weighed 21 pounds less on average than those who keep it on the counter; another showed that diners who sit near a restaurant’s entrance are 73 percent less likely to order dessert than those who sit in the restaurant’s interior.
I wasn’t the only one who thought Wansink’s work was cool. His research—some 200 studies since 2005—regularly makes headlines. But in January, a team of researchers reanalyzed the data from four of the Food and Brand Lab’s studies about pizza and turned up what appear to be serious problems: The researchers spotted 150 data inconsistencies. As Columbia University statistician Andrew Gelman put it in a blog post: “Although the four papers were all based on the same data, they differed in all sorts of detail, which suggested that the authors opportunistically used data exclusion, data coding, and data analysis choices to obtain publishable (that is, p less than .05) results.”
In a blog post on Thursday, one of the researchers, University of Groningen Ph.D. student Nick Brown, pointed to what appear to be several incidences of self-plagiarism in Wansink’s writing. Brown also found that the data from two of Wansink’s studies—one from 2001 and another from 2003 “appear to be almost identical, despite purportedly reporting the results of two completely different studies.”
Wansink declined to comment on the accusations. Instead, he pointed to a statement on the lab’s website, where he writes, “We are currently conducting a full review of studies in question, preparing comprehensive data which will be shared and establishing new standards for future operations at the lab which will include how we respond to requests for research information.”
The statement also notes that Wansink has enlisted a Food and Brand lab member who wasn’t involved in the studies to reanalyze the data in question. This move has raised some eyebrows in the scientific community: Why not hire an independent researcher? Here’s how Wansink answered that question in a Q&A with the scientific integrity watchdog blog Retraction Watch:
That’s a great question, and we thought a lot about that. In the end, we want to do this as quickly and accurately as possible—get the scripts written up, state the rationale (i.e., why we made particular choices in the original paper), and post it on a public website. Also, because this same researcher will also be deidentifying the data, it’s important to keep everything corralled together until all of this gets done.
But before we post the data and scripts, we also plan on getting some other statisticians to look at the papers and the scripts. These will most likely be stats profs who are at Cornell but not in my lab. We’ve already requested one addition to the Institutional Review Board (IRB), so that’s speeding ahead.
But even though someone in my lab is doing the analyses, like I said, we’re going to post the deidentified data, the analysis scripts (as in, how everyone is coded), tables, and log files. That way everyone knows exactly how it’s analyzed and they can rerun it on different stats programs, like SPSS or STATA or SAS, or whatever. It will be open to anyone. I’m also going to use this data for some stat analysis exercises into one of my courses. Yet another reason to get it up as fast as possible—before the course is over.
In the same Q&A, Wansink defended his work on methodological grounds. “These sorts of studies are either first steps, or sometimes they’re real-world demonstrations of existing lab findings,” he said. “They aren’t intended to be the first and last word about a social science issue. Social science isn’t definitive like chemistry. Like Jim Morrison said, ‘People are strange.’ In a good way.”
Cornell has declined to intervene. In a statement to New York magazine, John J. Carberry, the university’s head of media relations, wrote, “While Cornell encourages transparent responses to scientific critique, we respect our faculty’s role as independent investigators to determine the most appropriate response to such requests, absent claims of misconduct or data sharing agreements.”
I’ll be tracking this story, and we will post updates as they occur.
Continued:
