‘The situation has become appalling’: fake scientific papers push research credibility to crisis point
‘The situation has become appalling’: fake scientific papers push research credibility to crisis point
Last year, 10,000 sham papers had to be retracted by academic journals, but experts think this is just the tip of the iceberg
Last year the annual number of papers retracted by research journals topped 10,000 for the first time. Most analysts believe the figure is only the tip of an iceberg of scientific fraud.
“The situation has become appalling,” said Professor Dorothy Bishop of Oxford University. “The level of publishing of fraudulent papers is creating serious problems for science. In many fields it is becoming difficult to build up a cumulative approach to a subject, because we lack a solid foundation of trustworthy findings. And it’s getting worse and worse.”
The startling rise in the publication of sham science papers has its roots in China, where young doctors and scientists seeking promotion were required to have published scientific papers. Shadow organisations – known as “paper mills” – began to supply fabricated work for publication in journals there.
The practice has since spread to India, Iran, Russia, former Soviet Union states and eastern Europe, with paper mills supplying fabricated studies to more and more journals as increasing numbers of young scientists try to boost their careers by claiming false research experience. In some cases, journal editors have been bribed to accept articles, while paper mills have managed to establish their own agents as guest editors who then allow reams of falsified work to be published.
In my experience, people don't pay much attention to anything from those countries unless there's some special reason to take it seriously.
I had a near panic like shit, 10,000 retractions is a huge thing. Especially after all the incidents between 2010-2018 where we were hitting 1000 retractions a year
But then I read China and yeah, okay. They're probably going through their own shake up.
Ya I generally avoid any paper that's from China unless I really need the information it provides and then I need to go down a super tedious rabbit hole to make sure I can actually trust that it's true.
Yeah, I've come across one or two papers of questionable origin presenting performance metrics nowhere near what I could replicate.
Needless to say, I could only replicate the results when I introduced a very mundane procedure error nobody reputable would make. So yeah, lots of garbage out there
And that's not even fraudulent, just incompetent...
FYI, posted to !science@mander.xyz two days ago: https://mander.xyz/post/9244238
Ya I generally avoid any paper that's from China unless I really need the information it provides and then I need to go down a super tedious rabbit hole to make sure I can actually trust that it's true.
Freakonomics has a couple of interesting podcasts on academic fraud, where they discuss what motivates it and some suggestions for mitigating the problem:
https://freakonomics.com/podcast/why-is-there-so-much-fraud-in-academia/
https://freakonomics.com/podcast/can-academic-fraud-be-stopped/
Want to save us 79 minutes and summarize what the motivation is? I'm assuming it's agenda propaganda. Is that right?
What is "agenda propaganda"?
The motivation is mainly just the extreme pressure put on academics to publish relentlessly, combined with a publishing culture that favours "interesting" results. When you set out to test a hypothesis with an experiment, the results could turn out to be more or less remarkable. if the results are unremarkable it's still a valid result and useful data, but it's difficult to report that in a paper and get it published, because the journals favour "interesting" results. So a lot of perfectly valid and useful science can't get published. This creates a big temptation to massage results to create something that looks more striking and will get published. This may start with selectively omitting data or selectively analyzing the data, but it's a bit of a slippery slope towards changing data points that don't support the paper's thesis.
They mention one mitigation scheme in particular that is interesting: in this scheme scientists submit the question their experiment is supposed to answer to the journal before they do the experiment. The journal editors decide whether they want to publish it before they see the experimental results. If they commit to publish, they publish the paper no matter what the experimental results turn out to be. This removes an incentive to massage the data to get published.
There's also the way funding and jobs are allocated: you have to have a real stack of publications to your name and constantly be publishing to keep your job or get your research program funded. This creates an incentive for scientists to pay to be included in the author list of papers they didn't actually work on. And there's the phenomenon of professors putting their name to research by their students where they haven't examined the data in detail, and the fact that there are too many papers for anyone to thoroughly peer review, both of which make it easier to slip manipulated or faked data into publications.
They talk about many things, but the one that stands out is incentives. There is a lot of competition in academia, publish or perish, with big prizes, so some people are taking shortcuts.
These were great, really enjoyed them, especially the coverage of the Data Colada story
Isn't this just fraud and should be prosecuted?
Prosecuting scientists for publishing unheard of ideas in a manner that hasn't been sanctioned by an established scholarly/religious institutions....
The solution to bad science is science.
Well if you put it like that :D
I'm not sure you're right now. Fight fire with water, but what if you only have a teacup full of water? Meaning there could be an immense potential of energy on one side, and a small on the other. On one side you have money for careers and whatnot, on the other you have... nerds who believe
lovescience conquers all :D
Unfortunately Chinese papers in my field have a reputation for being less trustworthy than historical scientific powerhouses like Europe, the UK, the US and Canada. Countries like Iran aren't even on the map.
Ya I generally avoid any paper that's from China unless I really need the information it provides and then I need to go down a super tedious rabbit hole to make sure I can actually trust that it's true.
you know, i tend to blame this kind of shit on capitalism, thinking that the drive for profit creates an imperative to deliver published papers, and then i see that china is doing this shit and i just can't help but to think there is no economic model that produces good results and that the entire idea of an 'economic model' is flawed.
please let AI run this shit. humans are just going to endlessly make the same mistakes over and over.
China is de facto a State Capitalist country, so...
fun fact: there are much more powerful private economy entities in China than in the socialist republic i lived in and deem a state capitalism.