Wikipedia

When Contact Changes Minds

"When Contact Changes Minds: An Experiment on Transmission of Support for Gay Equality" is a fraudulent article by then-UCLA political science graduate student Michael LaCour and Columbia University political science professor Donald Green. The article was published in the academic journal Science in December 2014, and retracted in May 2015 after it emerged that the data in the study had been forged by LaCour.[1] The article purported to demonstrate that people's minds on the issue of gay marriage could be changed by conversations with gay canvassers, but not with straight canvassers.

Study

edit

The authors claimed to have investigated whether gay or straight messengers were effective at encouraging voters to support same-sex marriage and whether attitude change persisted and spread to others in voters’ social networks. The purported results, measured by an unrelated panel survey, show that both gay and straight canvassers produced large effects initially, but only gay canvassers’ effects persisted in 3-week, 6-week, and 9-month follow-ups. LaCour and Green (2014) also found strong evidence of within-household transmission of opinion change, but only in the wake of conversations with gay canvassers.[2]

The article is ranked in the top 5% of all research output, as scored using Altmetrics.[3]

The purported findings made international headlines and received wide media attention including in The New York Times,[4] The Washington Post,[5] The Wall Street Journal,[6] The Economist, The Los Angeles Times, and on This American Life.[7] The study attracted widespread attention, in part because it seemed to challenge the conventional understanding of social persuasion that people tend not to change their point of view even when presented with contrasting information.[8]

The Yes Campaign in Ireland stated that LaCour and Green (2014) "provided a template" for campaigners to use one-to-one contact and first person accounts to reach out to more conservative voters, leading to the historic Irish referendum legalizing gay marriage on May 22, 2015.[9]

Falsified data

edit

The "When contact changes minds" study was discredited after a critique by David Broockman, Joshua Kalla, and Peter Aronow on May 19, 2015, titled "Irregularities in LaCour (2014)",[10] concluded that the data had been falsified and no data had been collected. The survey company that LaCour claimed to have used denied performing any work for the study and did not have an employee by the name LaCour listed as his contact with the company.[10] In addition, LaCour had claimed that participants were paid using outside funding, but no organization could be found that had provided the amount of money required to pay thousands of people.

The "Irregularities" paper also identified the likely method by which LaCour had forged the data. The baseline survey results appeared to have been taken from an earlier dataset called the Cooperative Campaign Analysis Project (CCAP), to which LaCour had access. The later sets of data appeared to have been simulated from the first using statistical methods to shift the results and by adding normally distributed noise.[10][11] In addition, the paper noted that canvasser identifiers were missing from the results, making it impossible to verify whether different canvassers produced different results as the original study claimed.

Additional evidence of the study's fictitiousness later emerged, such as evidence that LaCour had tried to retroactively claim that the study had been pre-registered using falsified documents.[12]

LaCour's coauthor, Donald Green, subsequently requested that the paper be retracted because of “irregularities” in the paper's data and LaCour's failure to give him the raw data on which the paper was based.[13] Yet Green, as senior author on the Science paper, certified that he had examined the raw/original data on his Science/AAAS Authorship Form and Statement of Conflicts of Interest.[14] The Science terms include, prominently, the following statement: “The senior author from each group is required to have examined the raw data their group has produced.”[15]

In his letter to the journal, Green wrote: "I am deeply embarrassed by this turn of events and apologize to the editors, reviewers, and readers of Science."[16] Andrew Gelman, a professor of statistics and political science at Columbia University, wrote in The Washington Post that Donald Green had accepted LaCour's data "on faith".[1] On May 28, 2015, the study was retracted by Science,[17] on the basis that incentives to participate in the survey on which the study was based had been misrepresented, that sponsors had been falsely identified, that the authors could not produce the original data, and (citing the findings of Broockman et al.) that there were "statistical irregularities."[18]

On May 29, 2015, LaCour uploaded a response to the criticisms.[19] LaCour admitted to some false statements and apologized for "misrepresenting survey incentives and funding", but denied intentionally falsifying the data itself (though he stated that he could not rule out the possibility that he had "mistakenly mixed up" hypothetical data with collected data). He disputed the timeline of events presented in Broockman et al. (2015). He argued that the failure of Broockman et al. to replicate LaCour and Green (2014) was likely the result of a failure to follow the respondent-driven sampling procedure used in LaCour and Green (2014). He stated that Broockman et al. had selected the "incorrect variable" from CCAP (2012) and then manipulated that variable to make the distribution look more like that in LaCour and Green (2014). LaCour claimed that when the "correct" variable is used, the distributions between the CCAP thermometer and the LaCour and Green (2014) thermometer are statistically distinguishable. LaCour said, "selecting the incorrect variable may have been an oversight, but further manipulating that variable to make the distribution look more like LaCour and Green (2014) is a curious and possibly intentional 'error.'" LaCour also claimed that an independent replication supported the main finding reported in LaCour and Green (2014).

In the New York Times article, LaCour said the study erred in methods, not results.[20] A subsequent article published by Science indicated that LaCour's response was lacking, failing to address a number of issues while raising new questions about his conduct.[21] A blog post published by Discover stated that LaCour's rebuttal arguments were "very weak" and failed to refute a central criticism of the Broockman paper.[22]

After the retraction, the Carnegie Corporation of New York rescinded Donald Green's 2015 Andrew Carnegie Fellowship, revoking a $200,000 award to support Donald Green's research,[23] and Princeton University rescinded an assistant professorship that had been offered to LaCour.[24]

The journal Science retracted the article with the concurrence of Green while LaCour did not agree to the retraction.[18]

edit

While Green, David Broockman, and Joshua Kalla conducted numerous interviews with reporters outlining their version of events, LaCour refrained from talking to the media with the exception of a single interview with The New York Times.[25] Various opinions were advanced in the popular media regarding the implications of the scandal and the motivations of the parties involved.[26][27][28][29]

The editorial page of The Wall Street Journal speculated that LaCour's argument originally gained acceptance in the scientific community because it "flattered the ideological sensibilities of liberals, who tend to believe that resistance to gay marriage can only be the artifact of ignorance or prejudice, not moral or religious conviction. Mr. LaCour's findings let them claim that science had proved them right." The Journal editorial further argued that the paper and its acceptance reflected a broader phenomenon in the social sciences in which liberals, according to the editorial, "recast stubborn political debates about philosophy and values as disputes over facts that can be resolved by science".[26] New York Magazine columnist Jesse Singal dismissed the Wall Street Journal editorial, arguing that it was silly and uninformed, and suggested instead that the main reason for the article's publication was its contradiction of prior research.[30] Gelman, referring to LaCour's study, said that the journal Science is sometimes called a tabloid "because of its pattern of publishing dramatic but fishy claims (at least in social science)".[1] Conservative pro-gay-marriage columnist S.E. Cupp wrote that, "The doctored study will only encourage the perception that advocates are going too far."[29]

As to what motivated LaCour's behavior in the first place, his co-author, Donald Green, has expressed bafflement.[27] New York Magazine points to the pressure that social scientists are under to publish scholarly articles, while stating that "profound pressure to publish certainly can’t explain LaCour’s deception on its own".[28] A New York magazine opinion piece by sociology doctoral candidate Drew Foster argued that the study exposed problems with the culture of political science research and supervision given to junior academics, along with a competitive culture caused by overproduction of PhD students relative to available political science academic positions.[31]

Follow-up study

edit

Following their debunking of When Contact Changes Minds, Broockman and Kalla (2016) conducted an experiment like the one purported to have been conducted by LaCour and Green.[32][33] Households in Florida were sent a survey on social attitudes and were later visited by canvassers to discuss either recycling or transphobia and transgender rights, with the change in the householders' opinions tracked by follow-up surveys. The study found that extended conversations with canvassers did in fact reduce anti-transgender prejudice and were more effective long-term than attack ads.[34] However, contrary to one of LaCour's claims, the identity of the canvasser did not seem to matter; both transgender and cisgender canvassers had a similar effect.[34]

See also

edit

References

edit
Notes
  1. ^ a b c Gelman, Andrew (May 20, 2015). "Fake study on changing attitudes: Sometimes a claim that is too good to be true, isn't". The Washington Post. Archived from the original on June 9, 2015. Retrieved June 7, 2015. Not to spoil the suspense or anything, but what really happened was that the data were faked by first author LaCour. Co-author Green (my colleague at Columbia) had taken his collaborator's data on faith; once he found out, he firmly retracted the article. Details at Retraction Watch.
  2. ^ LaCour, Michael J.; Green, Donald P. (2014). "When contact changes minds: An experiment on transmission of support for gay equality". Science. 346 (6215): 1366–9. Bibcode:2014Sci...346.1366L. doi:10.1126/science.1256151. PMID 25504721. S2CID 6322609. (Retracted, see doi:10.1126/science.aac6638, PMID 26022417,  Retraction Watch)
  3. ^ "Altmetric – When contact changes minds: An experiment on transmission of support for gay equality". www.altmetric.com. Retrieved June 5, 2024.
  4. ^ Carey, Benedict (11 December 2014). "Gay advocates can shift same-sex marriage views". New York Times. Archived from the original on 30 May 2015. Retrieved 31 May 2015.
  5. ^ Somashekhar, Sandhya (11 December 2014). "One conversation can change minds on same-sex marriage, study finds". Post Nation. The Washington Post. Archived from the original on 3 June 2015. Retrieved 31 May 2015.
  6. ^ Sapolsky, Robert M. (25 February 2015). "Gay marriage: How to change minds". Mind and Matter. The Wall Street Journal. Archived from the original on 31 May 2015. Retrieved 31 May 2015.
  7. ^ "The incredible rarity of changing your mind". This American Life. 25 April 2015. Archived from the original on 3 June 2015. Retrieved 31 May 2015.
  8. ^ Barbash, Fred (20 May 2015). "Co-author disavows highly publicized study on public opinion and same-sex marriage". Morning Mix. The Washington Post. Archived from the original on 31 May 2015. Retrieved 2 June 2015.
  9. ^ "Personal route to reach public central to Yes campaign". The Irish Times. 14 May 2015. Archived from the original on 2 March 2019. Retrieved 20 February 2020.
  10. ^ a b c Broockman, David; Kalla, Joshua; Aronow, Peter (19 May 2015), Irregularities in LaCour (2014), CiteSeerX 10.1.1.691.8951, archived from the original on 20 November 2022, retrieved 20 November 2022
  11. ^ "Neuroskeptic blog – The Problem With Michael LaCour's Rebuttal". Discover Magazine. Archived from the original on 12 June 2015. Retrieved 8 April 2016.
  12. ^ Singal, Jesse (June 2015). "Michael LaCour Probably Fabricated a Document About Research Integrity". Science of Us. NY Magazine. Archived from the original on 26 March 2016. Retrieved 8 April 2016.
  13. ^ Barbash, Fred (May 20, 2015), "Co-author disavows highly publicized study on public opinion and same-sex marriage", Morning Mix, Washington Post, archived from the original on September 15, 2017, retrieved September 18, 2017
  14. ^ "AAAS" (PDF). Archived (PDF) from the original on 2022-06-21. Retrieved 2022-06-30.
  15. ^ ""If you think it's rude to ask to look at your co-authors' data, you're not doing science": Guest post". Retraction Watch. 18 June 2015. Archived from the original on 3 July 2015. Retrieved 2 July 2015.
  16. ^ Schupak, Amanda (May 29, 2015). "Journal retracts controversial gay marriage study". CBS News. Archived from the original on June 9, 2015. Retrieved June 7, 2015. But after two researchers raised serious questions about a lack of data and funding details outlined in the study, Green wrote to Science asking that it be retracted. "Michael LaCour's failure to produce the raw data coupled with the other concerns noted above undermines the credibility of the findings," he wrote. "I am deeply embarrassed by this turn of events and apologize to the editors, reviewers, and readers of Science.
  17. ^ Carey, Benedict (28 May 2015). "Journal retracts study on changing attitudes on same-sex marriage". New York Times. Archived from the original on 28 May 2015. Retrieved 28 May 2015.
  18. ^ a b McNutt, M. (28 May 2015). "Editorial retraction". Science. 348 (6239): 1100. Bibcode:2015Sci...348R1100M. doi:10.1126/science.aac6638. PMID 26022417.
  19. ^ LaCour, Michael (29 May 2015). "Journal retracts response to irregularities in LaCour and Green (2014)" (PDF). Archived (PDF) from the original on 30 May 2015. Retrieved 30 May 2015.
  20. ^ Carey, Benedict (29 May 2015). "Study using gay canvassers erred in methods, not results, author says". The New York Times. Archived from the original on 31 May 2015. Retrieved 31 May 2015.
  21. ^ Malakoff, David (May 30, 2015). "Gay marriage study author LaCour issues defense, but critics aren't budging". news.sciencemag.org/. Science. Archived from the original on December 26, 2022. Retrieved June 9, 2015. LaCour's response does not, however, directly answer a number of other questions surrounding the study—and it raises new issues.
  22. ^ Neuroskeptic (June 1, 2015). "The Problem With Michael LaCour's Rebuttal". blogs.discovermagazine.com. Discover. Archived from the original on June 12, 2015. Retrieved June 9, 2015.
  23. ^ "Andrew Carnegie Fellows 2015". Carnegie Corporation of New York. Archived from the original on 2015-04-28. Retrieved 2015-07-08.
  24. ^ "U. revokes hire offer after allegations of publishing falsified data". Daily Princetonian. Archived from the original on 2021-01-25. Retrieved 2021-01-02.
  25. ^ Carey, Benedict (2015-05-29). "Study Using Gay Canvassers Erred in Methods, Not Results, Author Says". The New York Times. ISSN 0362-4331. Archived from the original on 2015-11-15. Retrieved 2015-11-19.
  26. ^ a b "Scientific Fraud and Politics". Wall Street Journal. New York, NY. June 6, 2015. Archived from the original on March 14, 2017. Retrieved March 12, 2017.
  27. ^ a b Gambino, Lauren and Devlin, Hannah. "Study of attitudes to same-sex marriage retracted over 'fake data'" Archived 2017-03-12 at the Wayback Machine, The Guardian (May 20, 2015).
  28. ^ a b Foster, Drew. "Will Academia Waste the Michael LaCour Scandal?" Archived 2017-04-24 at the Wayback Machine, New York Magazine (June 5, 2015).
  29. ^ a b Cupp, S.E. "Key to changing hearts and minds on gay marriage: Don’t lie or bully; As a supporter of gay marriage, I can attest that too often other supporters go too far." Archived 2015-09-24 at the Wayback Machine, Seattle Times (May 25, 2014).
  30. ^ Singal, Jesse. "Is Social Science a Giant Liberal Conspiracy?" Archived 2016-06-17 at the Wayback Machine, New York Magazine (June 8, 2015).
  31. ^ Foster, Drew (5 June 2015). "Will Academia Waste the Michael LaCour Scandal?". Science of Us – New York magazine. Archived from the original on 26 March 2016. Retrieved 8 April 2016.
  32. ^ Ed Yong (7 April 2016). "No, Wait, Short Conversations Really Can Reduce Prejudice". The Atlantic. Archived from the original on 7 April 2016. Retrieved 8 April 2016.
  33. ^ Bohannon, John (7 April 2016). "For real this time: Talking to people about gay and transgender issues can change their prejudices". Science. doi:10.1126/science.aaf9890.  
  34. ^ a b Broockman, David; Kalla, Joshua (28 April 2016). "Durably reducing transphobia: A field experiment on door-to-door canvassing". Science. 352 (6282): 220–224. Bibcode:2016Sci...352..220B. doi:10.1126/science.aad9713. PMID 27124458.
Bibliography

Archived 2015-05-31 at the Wayback Machine. In Annual Meeting of the Midwest Political Science Association.


edit
Retrieved from "https://en.wikipedia.org/w/index.php?title=When_Contact_Changes_Minds&oldid=1242810680"