![\"\"](\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/03\/Oransky_Article.png?resize=583%2C379&ssl=1\")
<\/p>\n<\/p>\n
Ivan Oransky has been at the forefront of efforts to highlight research integrity issues for over a decade, co-founding Retraction Watch<\/a> in 2010 to track and publicise retractions in the scientific literature. Following his presentation<\/a> at the 2020 European Medical Writers Association (EMWA) symposium, we spoke to him about retractions during the COVID-19 pandemic and steps he believes should be taken to tackle research integrity challenges in the future.<\/p>\n First of all, COVID-19 is having a huge, ongoing impact on our daily lives and on scientific research \u2013 reflected in the huge number of COVID-19-related publications<\/a>. At the same time, Retraction Watch\u2019s list of retracted COVID-19 papers<\/a> continues to grow. Which of the COVID-19-related retractions to date do you think have been the most notable, and what do these cases tell us about current practice in scientific publishing?<\/strong><\/p>\n \u201cI don\u2019t know that I would choose any particular COVID-19-related retraction as most notable \u2013 I suppose that\u2019s like asking which of your children is your favourite. There are certainly the ones that gained the most attention \u2013 if I had to pick one, it would be the Lancet<\/em> paper about hydroxychloroquine<\/a> that was based on a very questionable (at best) dataset from a company called Surgisphere. I think that paper captured the most attention, and close behind it was a New England Journal of Medicine<\/em> (NEJM<\/em>) paper<\/a> that was also based on those alleged data, but wasn\u2019t about hydroxychloroquine so didn\u2019t capture quite so many eyeballs. Those are the retractions where I think a lot of people had a Casablanca \u201cshocked, shocked!\u201d moment, with the idea that, somehow, this was completely different from anything that\u2019s ever happened in science before. And that\u2019s just nonsense \u2013 complete revisionist history.<\/p>\n I think it\u2019s more important, or useful in a way, to look at the whole pattern. I wouldn\u2019t call these data so much, but there have been 87 retractions of COVID-19-related papers<\/a> to date. That number isn\u2019t all that different from what you would expect<\/a> to see given the number of papers \u2013 and preprints \u2013 that have been published.<\/p>\n There have been 87 retractions of COVID-19-related papers to date. That number isn\u2019t all that different from what you would expect to see given the number of papers \u2013 and preprints \u2013 that have been published.<\/p>\n However, 10 of these retractions were because Elsevier published manuscripts twice that authors had only submitted once. What that speaks to is the rush, or the fast pace, of publishing in the COVID-19 era. The fast pace isn\u2019t so bad, but the system of peer review and publication hasn\u2019t really adapted well enough to it over the years \u2013 although I would argue that there have been some strides in that direction.<\/p>\n The fast pace of publishing in the COVID-19 era\u2026isn\u2019t so bad, but the system of peer review and publication hasn\u2019t really adapted well enough to it over the years.<\/p>\n<\/blockquote>\n To me, it\u2019s not a particular retraction that\u2019s important \u2013 rather the phenomenon that everyone\u2019s rushing and there\u2019s a lot of sloppiness. If anything, I\u2019d say that the proportion of retractions due to misconduct is much lower than you might see in a typical dataset of retractions. I don\u2019t know what to make of that yet, and it could be that people just haven\u2019t found the cases of misconduct so far, but I think that that\u2019s worth paying attention to. It really speaks more to sloppiness and rushing rather than out-and-out fraud accounting for COVID-19-related retractions.\u201d<\/p>\n The proportion of retractions due to misconduct is much lower than you might see in a typical dataset\u2026it really speaks more to sloppiness and rushing rather than out-and-out fraud accounting for COVID-19-related retractions.<\/p>\n<\/blockquote>\n While journals have acted quickly to retract some COVID-19-related publications, in general, the pace of investigation and retraction is very slow<\/a>. However, you\u2019ve recently highlighted a \u201cdouble-standard<\/a>\u201d involving rapid retraction when papers draw negative attention on social media. How should journals prioritise their investigations to address allegations in a timely way?<\/strong><\/p>\n \u201cWell, I think that what journals and publishers should do is actually prioritise investigations. Although some argue that the problem is certain papers being retracted before<\/em> other papers, the problem is that not enough papers are being retracted, full-stop. There are countless papers being flagged \u2013 whether that\u2019s on PubPeer<\/a>, through correspondence with journals or by scientific sleuths like Elisabeth Bik<\/a> \u2013 where journals are doing nothing. Maybe they\u2019re investigating the cases and it\u2019s just taking them a long time \u2013 but why<\/em> is it taking them so long?<\/p>\n One positive development over the past few years is that some journals are actually hiring entire staffs to look at allegations and to try to catch issues that might lead to retraction before articles are published. Those are the journals and publishers that I think everyone should emulate, such as the Journal of Biological Chemistry<\/a><\/em>, PLOS ONE<\/a><\/em> and FEBS PRESS<\/a><\/em>.<\/p>\n Some journals are actually hiring entire staffs to look at allegations and to try to catch issues\u2026before articles are published. Those are the journals and publishers that I think everyone should emulate.<\/p>\n<\/blockquote>\n So, to me, the issue is not so much whether we should retract some papers before others. The more important question is \u2018why are journals not prioritising investigations, full-stop?\u2019 If there has to be some prioritisation, then we should retract papers with fatal flaws that seem to be doing harm, or have the potential for doing harm, first. The problem is that then nobody will do anything about all of the other papers. I really hesitate to talk about prioritising certain \u2018retractable offences\u2019 over others as I know what will happen \u2013 I\u2019ve been watching journals ignore problems for a decade. If you give journals and publishers an excuse, or a rationalisation for why they\u2019re not getting to something they should be getting to, you\u2019re creating more of an issue, and journals know that.\u201d<\/p>\n I really hesitate to talk about prioritising certain \u2018retractable offences\u2019 over others as I know what will happen \u2013 I\u2019ve been watching journals ignore problems for a decade.<\/p>\n<\/blockquote>\n Recently, Retraction Watch discussed<\/a> a Scientific Reports<\/em> article retracted<\/a> following a post-publication peer review round requested by the Editor. Are changes to peer review processes needed to avoid this kind of retraction? Do you think increasing adoption of post-publication and open peer review processes will impact retraction rates?<\/strong><\/p>\n \u201cI think whether changes are needed to peer review processes depends on what your goal is. Is your goal to prevent retractions, or is it to actually have a transparent publication process that reflects how science works instead of having papers be the be all and end all in terms of promotions, tenure, and so on? I think you have to decide what your goals are, and once you\u2019ve decided this, you can create a system that makes sense.<\/p>\n Part of what always puzzles me is why journals can\u2019t just be honest all the time about how much gets through peer review that shouldn\u2019t.<\/p>\n<\/blockquote>\n Part of what always puzzles me is why journals can\u2019t just be honest all the time about how much gets through peer review that shouldn\u2019t. In my opinion, journals have never done a good job of answering this. I hope that one of the illuminating things about the Lancet<\/a><\/em> and NEJM<\/a><\/em> COVID-19-related retractions is that the editors were really forced to admit that their peer review systems were not well-equipped for those papers, although the journals approached this in different ways<\/a>. These lessons are a good thing, but it\u2019s not as if these issues with peer review only happen when there\u2019s a retraction that catches everyone\u2019s attention.<\/p>\n I hope that one of the illuminating things about the Lancet and NEJM COVID-19-related retractions is that the Editors were really forced to admit that their peer review systems were not well-equipped for those papers.<\/p>\n<\/blockquote>\n The paper in Scientific Reports<\/em><\/a> caught everyone\u2019s attention because of what it\u2019s about and the conclusions [the paper made links between obesity and dishonesty]<\/em>, but papers are slipping through like this all the time. Journals need to acknowledge this and provide their peer review reports. I do think that, even if it\u2019s anonymised, publishing peer review comments is a good idea so you can have some faith in the process, see what happened, and believe what happened. I\u2019m not sure that there\u2019s an alternative to journals acknowledging the limitations of peer review processes \u2013 I think that they just have to be honest. At this point, every single time a retraction happens, everyone says it was an anomaly and finds a reason for why it was unique. We\u2019re now cataloguing close to 2,000 retractions per year, suggesting that this is not true, and these cases are not unique.\u201d<\/p>\n At this point, every single time a retraction happens, everyone says it was an anomaly and finds a reason for why it was unique. We\u2019re now cataloguing close to 2,000 retractions per year, suggesting that this is not true.<\/p>\n Retractions can occur for any number of reasons<\/a>, but retraction notices (if they appear at all<\/a>) can be vague about the underlying cause. How should a retraction \u2018ideally\u2019 be conveyed? Is a nomenclature needed, particularly to help protect authors when the retraction is due to honest error?<\/strong><\/p>\n \u201cOver the years, I\u2019ve actually grown to be increasingly opposed to a nomenclature for various \u2018types\u2019 of retraction. I think that in every case I\u2019ve seen where nomenclature is involved, either journals make category errors or they use nomenclature as weasel words. Elsevier have used \u2018withdrawn\u2019 in certain cases (and other publishers have followed suit in some ways), and really this is an excuse or rationale not to include any information about why the paper was withdrawn or retracted. That\u2019s a step way backwards. We all make category errors \u2013 I make category errors probably every day, but I hope I correct them. For whatever reason, the notion that what we really need is a better taxonomy has persisted \u2013 but how that is going to solve the problem of lawyers getting involved in the process and obfuscating reality, or journals not including reliable information in retraction notices, I don\u2019t understand. It won\u2019t help anyone if you still don\u2019t know what actually happened.<\/p>\n What should actually happen \u2013 and this is borne out in the economics literature<\/a> \u2013 is that retraction notices should state as clearly as possible what occurred, or state frankly if it\u2019s unclear, as sometimes people have muddied the waters. If that\u2019s the case, then say so: \u2018we don\u2019t know what\u2019s happened here because lawyers on either side have been bickering for a year about this \u2013 but we feel we should tell readers anyway\u2019. That\u2019s a pretty honest way to go, unlike the approach of not saying anything.<\/p>\n Retraction notices should state as clearly as possible what occurred, or state frankly if it\u2019s unclear.<\/p>\n<\/blockquote>\n For individual researchers, it\u2019s very clear that if you retract a paper for fraud, dishonesty or misconduct, you have a retraction penalty<\/a>, and your citations decline. Maybe your whole subfield\u2019s citations decline as you bring everyone down with you. When you retract a paper due to honest error and the retraction notice very clearly explains this, you don\u2019t see that decline. One study<\/a> says you might even see a bump, although that hasn\u2019t been replicated.<\/p>\n So, clarity in retraction notices is what\u2019s needed. I think the notion that we can classify everything with a set of words \u2013 that will be argued about forever anyway \u2013 is the wrong way to go.\u201d<\/p>\n Even after retraction, papers continue to be cited<\/a>. Do journals need to do more to publicise retractions, and how can authors make sure they don\u2019t fall into this trap? <\/strong><\/p>\n \u201cAgain, it depends what journals want. Do they want to be upfront and help scientists be more efficient, make new discoveries and build knowledge, or are they more interested in protecting their reputations and hiding the fact that something has been retracted? I go by the old adage \u2018never ascribe to malice that which is adequately explained by incompetence\u2019, so I\u2019m willing to acknowledge that the lack of action from journals may be due to incompetence rather than being intentional.<\/p>\n Do they [journals] want to be upfront and help scientists be more efficient, make new discoveries and build knowledge, or are they more interested in protecting their reputations and hiding the fact that something has been retracted?<\/p>\n There are now countless studies, conducted by librarians and bibliometrics and scientometrics scholars, showing that it can be very difficult to find that an article has been retracted<\/a>. Journals and publishers are not transmitting the metadata to where they should (whether this is PubMed, Web of Science, etc) and sometimes they transmit the wrong metadata (eg they call something a correction when it\u2019s a retraction). Even on the journal\u2019s own pages or on the PDFs, articles often don\u2019t show up as retracted. Journals should do more, as they\u2019re the ones who end up publishing papers citing retracted work.<\/p>\n Journals should do more, as they\u2019re the ones who end up publishing papers citing retracted work.<\/p>\n<\/blockquote>\n So, how can authors make sure they don\u2019t fall into this trap? We created a database<\/a> that is primarily for tracking retractions and we\u2019re more comprehensive than any database of or containing retractions. At the moment, there are close to 25,000 retractions in our database \u2013 that\u2019s almost twice as many as you\u2019ll find in any other similar database. Authors can search for articles one-by-one using our database, if they want, or they can sign up for software suites and bibliographic management software packages that are working with Retraction Watch\u2019s database. If you use Zotero<\/a> for example, you\u2019ll get an automatic flag<\/a> every time a paper in your library is retracted. We get notes about this on Twitter all the time from people who didn\u2019t know it existed and find it really helpful \u2013 we\u2019re thrilled with that. We\u2019d love the Retraction Watch database to be incorporated into more software packages too. Without automated flagging, which publishers just aren\u2019t doing at this point, I just don\u2019t see how authors can avoid citing retracted work \u2013 but these automated processes have become pretty easy to do.\u201d<\/p>\n Without automated flagging, which publishers just aren\u2019t doing at this point, I just don\u2019t see how authors can avoid citing retracted work.<\/p>\n<\/blockquote>\n The extent and sophistication of journal targeting by paper mills<\/a> and scams<\/a> is ever-increasing. From your perspective, what can be done to tackle this problem and future-proof publishing processes against these attacks? \u00a0<\/strong><\/p>\n \u201cTo me, this really takes a two-pronged approach. One prong is to tackle what we know is out there that no-one has seen fit to tackle yet. iThenticate<\/a> and other software that looks for plagiarism and duplication follow this model: journals and publishers realised there was a lot of plagiarism, someone developed some software, and now everyone uses it. The same could be done with our database of retractions. Right now, we don\u2019t have a good set of software tools that can detect image manipulation or image duplication, for example. We have individuals including Elisabeth Bik who are doing amazing work, but that\u2019s not really scalable and we need a scalable solution. However, these solutions are only looking to fight yesterday\u2019s battles. Meanwhile, the people who came up with these bad practices are coming up with more \u2018clever\u2019 approaches and we won\u2019t know what those are until they explode. So, all of this fits into one prong \u2013 rooting out problems once we know they exist.<\/p>\n We also need to take a step back and move upstream to what the real issue is, which is the incentive structure<\/a>. If we really want to de-incentivise bad (arguably, sometimes criminal) behaviours of misconduct and fraud, we need to decouple every career-affecting decision in academia from publishing papers in top journals. If you remove that incentive, then nobody\u2019s going to feel a particular need to fake papers, go to a paper mill, or anything else.<\/p>\n If we really want to de-incentivise bad (arguably, sometimes criminal) behaviours of misconduct and fraud, we need to decouple every career-affecting decision in academia from publishing papers in top journals.<\/p>\n It\u2019s probably no accident that paper mills tend to be concentrated in places, particularly China<\/a>, where the incentive structure has been completely warped towards papers for so many years. If we don\u2019t look at these incentive structures, every year or so, another scam will come out.<\/p>\n If we don\u2019t look at these incentive structures, every year or so, another scam will come out.<\/p>\n<\/blockquote>\n We wrote about fake peer review<\/a> back in 2012 \u2013 it turns out this hasn\u2019t been eradicated, although it is now easier to detect and has been cut down. We broke a story about selling authorship in Russia<\/a>, we\u2019ve reported on paper mills<\/a> \u2013 there\u2019s just always something, and there\u2019s always going to be something else. I don\u2019t have the kind of mind to think up what will be next, although I can often find it once it happens thanks to sources like the scientific sleuths. None, or very little, of this will happen if we remove the very pervasive and poisonous incentive structures we have at the moment.\u201d<\/p>\n As noted in the 10 takeaways from 10 years at Retraction Watch<\/a>, pharma-funded publications account for a low proportion of retractions. You\u2019ve noted that this is unsurprising<\/a> given the increased scrutiny in pharma versus academia \u2013 what changes should academia make to reduce retraction rates?\u00a0 <\/strong><\/p>\n \u201cMaybe this is controversial, but I don\u2019t know that we should (certainly in the short or medium term) push to reduce retraction rates. If we mean reduce retraction rates as a proxy for reducing \u2018bad behaviour\u2019 \u2013 sloppiness or even misconduct \u2013 then yes, we should take measures to try to prevent that or to detect it better. There are still a lot of papers that should be retracted but haven\u2019t been, so I don\u2019t think we\u2019ve reached the peak of retractions yet. Just like any other metric, if you suddenly decide that we need to cut down on retractions, that will make things worse. I do think that there are lots of steps that academia can take to try to cut down on these bad behaviours \u2013 this goes back to incentives, in a large part.<\/p>\n I don\u2019t think we\u2019ve reached the peak of retractions yet. Just like any other metric, if you suddenly decide that we need to cut down on retractions, that will make things worse.<\/p>\n<\/blockquote>\n On the flipside, I don\u2019t think that we should absolve<\/em> pharma-funded publications of bad behaviour or misconduct. For those sorts of papers, studies can be set up in such a way to get the desired results, but this is not something that would be considered misconduct or would be a \u2018retractable offence\u2019. There are gatekeepers and hoops that studies need to jump through (like Institutional Review Boards), but we shouldn\u2019t assume that those systems are perfect.<\/p>\n Both settings have a lot of work to do \u2013 in academia you see behaviours that are \u2018retractable offences\u2019 while in pharma, that\u2019s not the case, but research practices can have other negative effects. If universities are interested in lowering the rates of misconduct in their ranks, they need to look inwardly and examine whether they\u2019ve created incentive structures that reward good or bad behaviour.\u201d<\/p>\n Finally, in your opinion, what is the biggest challenge to research integrity right now, and how can this be overcome? <\/strong><\/p>\n \u201cI\u2019m going to sound like a broken record, but I do think that incentives are my main concern and the thing that needs the most attention. That being said, one of the things that worries me is the significant tribalism in science, which has been amplified and made more visible by COVID-19.<\/p>\n One of the things that worries me is the significant tribalism in science, which has been amplified and made more visible by COVID-19.<\/p>\n You want constructive criticisms and critiques in science \u2013 you don\u2019t want them to be ad hominem attacks. The critiques should help move the science and the evidence to a better place. Often, the most critical peer reviews are not necessarily of the papers that are most problematic (or frankly those that shouldn\u2019t have been considered for publication in the first place), but are of papers that disagree with your point of view. I guess there\u2019s a tribalism that cuts in every which way, whether it\u2019s scientific, political, or due to the family tree of where and who you trained with. You end up with a lot of people shouting at each other and \u2018creating heat without shedding a lot of light\u2019. In the same way, social media has amplified and exacerbated a lot of issues in terms of politics, world events, conspiracy theories and what have you. Sometimes the loudest voices in science don\u2019t have the evidence on their side, but their rhetorical approach is better.<\/p>\n Sometimes the loudest voices in science don\u2019t have the evidence on their side, but their rhetorical approach is better.<\/p>\n<\/blockquote>\n I\u2019m all for free speech \u2013 I think everyone should feel free to speak their mind and I encourage that, even when they disagree with me \u2013 but if we don\u2019t figure out how to get away from this tribalism, we\u2019re just going to polarise science even more. If we couple that with all the issues science is facing, whether it\u2019s a real lack of funding, or publish-or-perish incentives, it\u2019s not going to go well.\u201d<\/p>\n Ivan Oransky is Editor in Chief of Spectrum<\/a><\/em>, Distinguished Writer In Residence at New York University\u2019s Carter Journalism Institute<\/a>, and President of the Association of Health Care Journalists<\/a>. He is also co-founder of Retraction Watch<\/a>, which can be followed on Twitter @RetractionWatch<\/a>. You can contact Ivan at team@retractionwatch.com and follow him on Twitter @ivanoransky<\/a>.<\/p>\n\n
![\"\"](\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/03\/COVID-19-retraction-ivan-oransky.jpg?resize=724%2C483&ssl=1\")
<\/p>\n<\/blockquote>\n\n
\n
![\"\"](\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/03\/slow-pace-of-retractions.jpg?resize=724%2C483&ssl=1\")
<\/p>\n\n
\n
\n
![\"\"](\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/03\/journals-telling-truth-about-retractions.jpg?resize=724%2C483&ssl=1\")
<\/p>\n\n
\n
![\"\"](\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/03\/retraction-anomaly.jpg?resize=726%2C481&ssl=1\")
<\/p>\n<\/blockquote>\n![\"\"](\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/03\/questions-about-retraction-circumstances.jpg?resize=724%2C483&ssl=1\")
<\/p>\n\n
\n
![\"\"](\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/03\/journals-protecting-reputation.jpg?resize=752%2C465&ssl=1\")
<\/p>\n<\/blockquote>\n\n
\n
\n
![\"\"](\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/03\/career-decisions-incentive-structures.jpg?resize=724%2C483&ssl=1\")
<\/p>\n<\/blockquote>\n\n
\n
\n
![\"\"](\"https:\/\/i0.wp.com\/thepublicationplan.com\/wp-content\/uploads\/2021\/03\/science-tribalism-divisive.jpg?resize=724%2C483&ssl=1\")
<\/p>\n<\/blockquote>\n\n