Tuesday, February 16, 2016

Those who can, publish. Those who can’t, blog

What’s your view on social media and science? For example, the role of science blogs in critiquing published papers? "Those who can, publish. Those who can’t, blog," says Jingmai O'Connor.

According to Cell.com, Dr. O’Connor is a professor at the Institute of Vertebrate Paleontology and Paleoanthropology of the Chinese Academy of Sciences, and her comment was part of an interview published last month.

Dr. O'Connor says, "It often seems those who criticize or spend large amounts of time blogging are also those who don’t generate much [sic] publications themselves." She thinks comments should be peer-reviewed and published only in journals. She worries about the public who may not realize "a published paper passed rigorous review by experts, which carries more validity than the opinion of some disgruntled scientist or amateur on the internet." She adds, "criticism in social media is damaging to science, as it is to most aspects of our culture."

Apparently she isn't aware that peer review is under fire from a number of respectable sources.

"If peer review was a drug it would never be allowed onto the market," said Drummond Rennie, a contributing deputy editor of JAMA. Richard Smith, former editor of the BMJ agrees "because we have no convincing evidence of its benefits but a lot of evidence of its flaws."

In 2015, 107 scientific papers were retracted by several journals because their authors, nearly all of whom were Chinese academics, had performed fraudulent peer review by creating fictitious names and email addresses of suggested reviewers so they could write glowing reviews of their own work. Some of these charlatans are from Beijing, where Dr. O'Connor is based.

Australian bloggers found an error that had somehow been missed during "rigorous review by experts" regarding the number needed to treat in a New England Journal of Medicine paper on targeted vs. universal decolonization to prevent ICU infection. They contacted the paper's corresponding author who acknowledged the mistake within 11 days. It took five months for a correction to appear online in the journal.

Whether Dr. O'Connor likes it or not, the future will involve more immediate feedback about research papers. For example, PubMed and PubPeer already allow comments, and the BMJ also has a section for online rapid responses.

Blogger Marc Bellemare, an associate professor of economics at the University of Minnesota, cites David McKenzie, an economist/blogger at the World Bank who thinks that blogs play an important role in disseminating information to the public and "raise the profile of bloggers and their institution."

But Bellemare feels blogging might not be for every academic He quotes Tyler Cowen of George Mason University, who when asked why don't more economists blog replied, "I believe it is because they can’t, at least not without embarrassing themselves rather quickly, even if they are smart and very good economists. It’s simply a different set of skills."

Maybe Dr. O'Connor doesn't have the skill set to blog. I say, "Those who can, blog. Those who can't, insult those who can."

20 comments:

Chris said...

Clearly there are some things rotten in the peer review system, so I don't think peer reviewed publications are what they used to be. The quote you cited from Dr O'Connor sounds mostly like sour grapes from an elite whose domain is being encroached upon by the commoners.

That said, being able to throw shade like that would actually make her a pretty good blogger!

Skeptical Scalpel said...

Chris, good point. She got my attention with her outrageous statement. I think she's capable of more. Maybe she should blog.

frankbill said...

My guess is more people read blogs then read peer reviewed publications.

Skeptical Scalpel said...

Your guess is correct and certainly true in my case. See this post: http://skepticalscalpel.blogspot.com/2014/08/a-paper-of-mine-was-published-did.html

A post of mine on appendicitis has had >57,500 page views. Here's the link if you are interested http://skepticalscalpel.blogspot.com/2010/08/appendicitis-diagnosis-ct-scans-and.html

Les said...

@frankbill, that may be because most peer reviewed articles are behind a pay wall. Most articles are $35 a pop for readers who aren't affiliated with a university. Blogs are ideal because they are accessible for most readers.

O'Connor's description of blogger reeks of snobbery. What would she say about Jill Viles, a muscular dystrophy patient, who doesn't hold a Ph.D., who helped identify a gene mutation related to both muscular dystrophy and athleticism. I suppose monks who study pea plants would be excluded by O'Connor's criterion as well.

Skeptical Scalpel said...

Les, good points. I think most scientific papers will be free to readers soon. There's no way to stop them from being posted.

I agree it's snobbery -- plus a lack of awareness that things are changing.

Greg Bryson said...

W Edwards Deming once said "“Without data you’re just another person with an opinion.” And that kinda sums up the blogosphere. At their best blogs and other such posts are thoughtful commentary, but remain unsullied by data. Sure, posts may reference other data sources and illuminate those findings, but new, original data is rare.
Don't get me wrong, there is plenty to criticize in with both academic publishing and peer review; however one does not have to look very hard for equally shoddy internet comment. Food Babe, anyone?
I treat blogs as I do editorials or review articles. Thought-provoking, insightful, opinion. Like we find right here at Skeptical Scalpel.
I think blogging and traditional publishing complement each other. There's plenty of room for both.
Keep up the good work Skep.

Skeptical Scalpel said...

Greg, thanks for the comments. I don't think you will be seeing original data on many blogs. Some of us have published in real journals before we started blogging.

As you well know, I have even published an article in the Canadian Journal of Anesthesia under my pseudonym. I think that makes me credible even in the eyes of Dr. O'Connor.

artiger said...

I wonder what the Chinese translation of "butt-hurt" would be.

frankbill said...

Greg

Depends on whose data. As Skeptical pointed out this postings shows one has a lot of data to think about.

http://skepticalscalpel.blogspot.com/2010/08/appendicitis-diagnosis-ct-scans-and.html

Chris said...

It's worth noting that blogs may actually serve an important academic role as secondary sources. I doubt Dr O'Connor would suggest that textbooks, review articles, or meta-analyses are not useful sources. Bloggers (serious ones anyway) could fill a similar niche in the publishing heirarchy by comparing and integrating results from multiple different primary studies.

Anyone who has read the work of John Ioannides should understand that any individual study is nearly as likely as not to be proven wrong in the future. Some critical analysis of those results (by bloggers and others) might even facilitate good science.

Skeptical Scalpel said...

Chris, well said.

It's possible that Dr. O'Connor is a troll. If so, she has done a remarkably good job of annoying everyone, myself included.

In my relatively serious posts, I try to incorporate information from a few different sources in hopes of achieving what you suggest in your first paragraph.

Ioannides is famous for critiquing the literature and calling BS when needed.

Skeptical Scalpel said...

Art and Frank, thanks for contributing. I appreciate your reference to my post about appendicitis.

artiger said...

Speaking of appendicitis, earlier this week I had my second treatment failure of antibiotics for appendicitis this month, this time in a 10 year old. She initially responded well, becoming pain free, afebrile, and eating well less than 48 hours after metronidazole and sulfa were started. (CT scan did indicate uncomplicated appendicitis.) 24 hours after being discharged, which would have been day 3 of treatment, she experienced recurrence of pain and low grade fever, so off to the OR for an outpatient lap appendectomy. The appendix was not perforated but appeared mildly edematous, and the patient looked great postop. Pain gone.

Another treatment failure? I'm not sure. Path showed the appendix was full of pinworms. What do you make of that one?

Sorry to highjack, but I wanted comment on a fresh thread.

The Doctor Isn't In said...

Had the same issue about 2 months back when attempting to "recruit" a team of "research types" to study a never thought of relationship between a compound and cardiac valve elasticity. I was asking around and stumbled on a fellow from a major University in the UK (no names need be used) and basically the shear fact that I was looking to take the final results and use them for the basis of building a for profit entity they popped a gasket and then started the same type of discussion. I being from the clinical world as opposed to they being in the "university" had no concept of the value of research and publication and the like. Even though I have spent 30 years with commercial PharmaCos and Surgical Supply Cos with the FDA I apparently have disgraced the industry by not being "pure." The fact that I approached the EXACT area that they were studying from a commercial standpoint rather then their didactic approach assumed to them that I was inappropriate. Couple it with the fact that they were seeking $250K for a PhD student and other costs to continue their research was somehow acceptable but the net was that no realistic financial gain was acceptable. Interesting that "profit" is bad but "income" is good.
When they "publish" at their annual salary or perish that is considered but when you "blog" at no compensation other then shear enjoyment that is unacceptable.
Dr D

William Reichert said...

The internet has increased the freedom of information and ideas. Tremendously.
I frequently spend more time reading the comments to articles in the NYT than I do reading the newspaper. Similarly, I am amazed at the quality of reviews of books on Amazon. There are a lot of people in the world who know something that contributes to the discussion who are not associated with any recognized news or university organization. Like skeptical, for example. This is good.

Skeptical Scalpel said...

Artiger, pinworms in the appendix have been reported many times. See http://ispub.com/IJS/30/3/2985 for example. If you google or PubMed search, you will find a lot of papers. Don't forget to look for anal pinworms in your patient and maybe treat the family too.

Doctor, good story. Academic types can be officious. That could be the problem with Dr. O'Connor. As you noted, they may also have their heads in the sand and not recognize the potential that something they are working on might actually be useful.

William, excellent point. The exchange of information is better than it has ever been and some smart people out there can contribute a lot even if they are not professors.

Anonymous said...

The problem is that we tend to scare the crap out of doctors or they hate us with a passion. For the life of me, I can't see why. Think about it: they will have hundreds to thousands of patients, a possible family, & MOC (for starters). We can spend the time to research and hook up with other "patient experts" that are the 180 degree opposite of Dr. Oz.

If someone else is helping to solve the problem, why not consider that a blessing.

artiger said...

Scalpel, I've seen pinworms in the appendix more than once. I guess my question (which I didn't really make clear) is, would you consider this case to be a treatment failure for antibiotics?

Apologies again for being off topic.

Skeptical Scalpel said...

I understand now. Yes, the intention-to-treat principle means that regardless of cause, your case is a failure of antibiotic therapy.

Post a Comment