Distracting from the peer-review problem

From an article entitled ‘The risks of swiftly spreading coronavirus research‘ published by Reuters:

A Reuters analysis found that at least 153 studies – including epidemiological papers, genetic analyses and clinical reports – examining every aspect of the disease, now called COVID-19 – have been posted or published since the start of the outbreak. These involved 675 researchers from around the globe. …

Richard Horton, editor-in-chief of The Lancet group of science and medical journals, says he’s instituted “surge capacity” staffing to sift through a flood of 30 to 40 submissions of scientific research a day to his group alone.

… much of [this work] is raw. With most fresh science being posted online without being peer-reviewed, some of the material lacks scientific rigour, experts say, and some has already been exposed as flawed, or plain wrong, and has been withdrawn.

“The public will not benefit from early findings if they are flawed or hyped,” said Tom Sheldon, a science communications specialist at Britain’s non-profit Science Media Centre. …

Preprints allow their authors to contribute to the scientific debate and can foster collaboration, but they can also bring researchers almost instant, international media and public attention.

“Some of the material that’s been put out – on pre-print servers for example – clearly has been… unhelpful,” said The Lancet’s Horton.

“Whether it’s fake news or misinformation or rumour-mongering, it’s certainly contributed to fear and panic.” …

Magdalena Skipper, editor-in-chief of Nature, said her group of journals, like The Lancet’s, was working hard to “select and filter” submitted manuscripts. “We will never compromise the rigour of our peer review, and papers will only be accepted once … they have been thoroughly assessed,” she said.

When Horton or Sheldon say some of the preprints have been “unhelpful” and that they cause panic among the people – which people do they mean? No non-expert person is hitting up bioRxiv looking for COVID-19 papers. They mean some lazy journalists and some irresponsible scientists are spreading misinformation, and frankly their habits represent a more responsible problem to solve instead of pointing fingers at preprints.

The Reuters analysis also says nothing about how well preprint repositories as well as scientists on social media platforms are conducting open peer-review, instead cherry-picking reasons to compose a lopsided argument against greater transparency in the knowledge economy. Indeed, crisis situations like the COVID-19 outbreak often seem to become ground zero for contemplating the need for preprints but really, no one seems to want to discuss “peer-reviewed” disasters like the one recently publicised by Elisabeth Bik. To quote from The Wire (emphasis added),

[Elisabeth] Bik, @SmutClyde, @mortenoxe and @TigerBB8 (all Twitter handles of unidentified persons), report – as written by Bik in a blog post – that “the Western blot bands in all 400+ papers are all very regularly spaced and have a smooth appearance in the shape of a dumbbell or tadpole, without any of the usual smudges or stains. All bands are placed on similar looking backgrounds, suggesting they were copy-pasted from other sources or computer generated.”

Bik also notes that most of the papers, though not all, were published in only six journals: Artificial Cells Nanomedicine and BiotechnologyJournal of Cellular BiochemistryBiomedicine & PharmacotherapyExperimental and Molecular PathologyJournal of Cellular Physiology, and Cellular Physiology and Biochemistry, all maintained reputed publishers and – importantly – all of them peer-reviewed.

Do your bit, broaden your science menu

If you think a story was not covered by the media, it’s quite likely that that story didn’t feature in your limited news menu, and that it was actually covered by an outlet you haven’t discovered yet. In the same vein, saying the entirety of India’s science media is crap is in itself crap. I’ve heard this say from two people today (and some others on Twitter). I’ll concede that the bulk of it is useless but there are still quite a few good players. And not reading what they are writing is a travesty on your part if you consider yourself interested in science news. Why I think so is a long story; to cut it short: given what the prevailing distribution mechanisms as well as business models are, newsrooms can only do so much to ensure they’re visible to the right people. You’ve got to do your bit as well. So if you haven’t found the better players, shame on you. You don’t get to judge the best of us after having read only the worst of us.

And I like to think The Wire is among the best of us (but I can’t be the final judge). Here are some of the others:

  1. The Telegraph – Among the best in the country. They seldom undertake longer pieces but what they publish is crisp and authoritative. Watch out for G.S. Mudur.
  2. Scroll – Doesn’t cover a lot of sciencey science but what they do cover, they tend to get right.
  3. The Hindu – The Big Daddy. Has been covering science for a long time. My only issue with it is that many of its pieces, in an effort to come across as being unafraid of the technicalities, are flush with jargon.
  4. Fountain Ink – Only long-form and does a fab job of the science + society stories.
  5. Reuters India – Plain Jane non-partisan reportage all round.

I’m sure there are other publishers of good science journalism in India. The five I’ve listed here are the ones that came quickest to mind and I just wanted illustrate my point and quickly get this post out.

Note: This is the article the reactions to which prompted this post.

Featured image credit: Hans/pixabay.