What does Jersey City have that New York City doesn’t? Two hospitals with Leapfrog Group “A” safety grades

Leapfrog just released its semi-annual hospital safety grades. Incongruities identified in my previous blog posts [here and here] appeared again.

New York City had no A grade hospitals, only four got Bs, and nationally known hospitals such as New York Presbyterian (Columbia and Cornell), New York University, and Mount Sinai received C grades.

Residents of New York City are in luck because several A-rated hospitals are located just across the Hudson River. Four of them—Jersey City’s CarePoint Health-Christ Hospital, Jersey City Medical Center, CarePoint Health-Bayonne Medical Center, and CarePoint Health-Hoboken University Medical Center—aren’t exactly household names, but they scored better on safety than their New York neighbors.

CarePoint has figured out how to achieve a top rating but can’t compare to the numbers of California Kaiser Foundation Hospitals scoring well on multiple Leapfrog evaluations. The current rankings show 19 of 26 Kaiser hospitals in California were A rated.

Lean methodology and patient safety

A recent story in U.S. News & World Report described how a Seattle hospital is taking a systems approach in improving healthcare quality and cutting costs. It said, "Virginia Mason Health System...has looked to adopt many of the much-admired and often-emulated business philosophies from Toyota."

The best-known of those philosophies is the so-called "lean methodology" which is based on eliminating waste and focusing on things that add value.

Attempts to incorporate lean into healthcare have met with varying degrees of success. I blogged about this six years ago and pointed out that a literature review done back then found "significant gaps in the [lean and six sigma] health care quality improvement literature and very weak evidence that [lean and six sigma] improve health care quality."

Randomized prospective trials of lean in medicine are lacking. A recent paper from the Journal of the American College of Radiology found only seven studies on the use of lean in radiology and they showed "high rates of systematic bias and imprecision." The authors concluded there was "a pressing need to conduct high quality studies in order to realize the true potential of these quality improvement methodologies [lean and six sigma] in healthcare and radiology."

In addition to the debatable evidence that lean actually works and the cost and time to develop and implement lean measures, the use of Toyota as a model for quality is also highly questionable.

In 2010, Toyota had recalled more than 9 million vehicles for various defects. Nothing has improved. So far this year Toyota has recalled over 11,654,000 vehicles. The problems included exploding airbags, brake failure, fuel tank defects, and minivan doors opening while cars were in motion.

Having adopted lean methodology in 2002, Virginia Mason is not really a new story. How is it doing?

About as well as Toyota.

In May of this year, the Joint Commission paid a surprise visit to Virginia Mason Medical Center and found 29 instances where the hospital was out of compliance with standards. The Seattle Times wrote that among the problems were not having an adequate infection prevention and control plan, failure to store medication safely, and failure to provide a "care, treatment, services and an environment that pose[d] no risk of an immediate threat to health or safety."

On September 17, Virginia Mason regained full Joint Commission accreditation status, and 6 weeks later the hospital announced that it received an "A" grade for patient safety from the Leapfrog Group.

A hospital that failed a Joint Commission site visit because of multiple safety issues gets an "A" for patient safety in the same year? I discussed problems with the Leapfrog patient safety rankings in a previous post.

And if lean works so well in healthcare, can anyone tell me how does a hospital that has been practicing lean methodology for 14 years achieve 29 Joint Commission citations?

Why hospital rankings are bogus

At the end of 2015, The Leapfrog Group announced its annual list of America’s top hospitals for quality and safety; 98 hospitals receiving the honor.

Unlike some other hospital rating schemes, Leapfrog’s does not factor in reputation. You won’t find any of the usual suspects on Leapfrog’s list. Instead, Leapfrog uses surveys of hospitals and publicly available quality and safety data.

Leapfrog’s top 98 included 62 urban, 24 rural, and 12 children’s hospitals. Of the 86 urban and rural hospitals, only three were university hospitals—University of California Davis Medical Center, University of California Irvine Medical Center, and University of Tennessee Medical Center.

New York managed to place only one hospital on the Leapfrog list.

Other interesting anomalies are that for several states such as Connecticut, Indiana, and Maryland, no hospitals made the list, and of the 21 California hospitals that did, 17 are Kaiser-affiliated. Looks like Kaiser knows how to play the game.

The ultimate hospital rating system

Finding out which hospitals are best is like "a riddle, wrapped in a mystery, inside an enigma."

Are you tired of seeing conflicting ratings from such once respected sources as Leapfrog, Medicare Compare, HealthGrades and Yelp?

Does it confuse you when a hospital is ranked in the top 10 by US News and World Report, but is "god-awful" according to Consumer Reports?

The Skeptical Scalpel Institute for Advanced Outcomes Research is proud to unveil a new rating system for hospitals.

Advanced metrics and creative statistics are linked with secret Bayesian methodologies, patient surveys and publically available databases to yield the most powerful and accurate hospital ratings ever imagined.

Just kidding.

Based on word of mouth, innuendo and rumors that have come to our attention through the back channels of the Internets, Skeptical Scalpel Ratings Plus offers unparalleled accuracy in hospital ratings.

For the low, low price of only $29.99, you will receive the Skeptical Scalpel Hospital Ratings Guide.

But wait, there's more. Here's the plus. At no extra charge, we will send you information about a weird trick that will enable you to undergo open heart surgery for just $8.00. Insurance companies are furious.

That's not all. The first 127 people to buy the guide will get a set of the sharpest kitchen knives known to mankind as our gift.

Are you a hospital administrator? Be advised of some special features of our ratings just for you.

If your hospital's ranking is not what you think it deserves, don't do what all the others do and waste time with in-house task forces or ad hoc committees. And don't claim we used bad data. Since we don't use data, that won't work.

Instead, try an on-site consultation from the Skeptical Scalpel Institute. We can show you ways to improve your standing without the need for expensive new patient safety programs.

If you are pleased with your ranking and want to advertise your Skeptical Scalpel designation, you must first contract with us. We sell banners, plaques and lobby displays. Call to discuss details. Operators are standing by.

Fee schedules for consultation and advertising will be provided upon request.

Dial MY-RATINGS.