Tag Archives: Hospitals

Getting the Right Benchmarks for Stroke Care

Late last week, thanks to Liz Kowalczyk (@globeLizK) of the Boston Globe, I discovered the statewide report on quality of stroke care in Massachusetts.  It’s a plain document, mostly in black and white, much of what you might expect from a state government report.  Yet, this 4-page document is a reminder of how we have come to accept mediocrity as the standard in our healthcare delivery system.

The report is about 1,082 men and women in Massachusetts unfortunate enough to have a stroke but lucky (or vigilant) enough to get to one of the 69 Massachusetts hospitals designated as Primary Stroke Service (PSS) in a timely fashion. Indeed, all these patients arrived within 2 hours of onset of symptoms and none had a contradiction to IV-tPA, a powerful “clot busting” drug that has been known to dramatically improve outcomes in patients with ischemic stroke, a condition in which a blood clot is cutting off blood supply to the brain.  For many patients, t-PA is the difference between living a highly functional life versus being debilitated and spending the rest of their lives in a nursing home.  There are very few things we do in medicine where minutes count – and tPA for stroke is one of them.

So what does this report tell us?  That during 2009-2010, patients who showed up to the ER in time to get this life-altering drug received in 83.3% of the time.  Most of us who study “quality of care” look at that number and think – well, that’s pretty good.  It surely could have been worse.

Pretty good?  Could have been worse?  Take a step back for a moment:  if your parent or spouse was having a stroke (horrible clot lodged in brain, killing brain cells by the minute) – you recognized it right away, called 911, and got your loved one to a Primary Stroke Service hospital in a fabulously short period of time, are you happy with a 1 in 5 chance that they won’t get the one life-altering drug we know works?  Only 1 in 5 chance that they might spend their life in a nursing home instead of coming home?  Is “pretty good” good enough for your loved one?

The Massachusetts Department of Health has put substantial effort in this area and the numbers have steadily improved.  By many accounts, this is a success story (the number was 66% in 2008, rising to 83.5% in 2011).  But this level of performance is not nearly good enough.

There are plenty of hospitals that seem to get it right.  I counted 14 that were at 100% and another dozen or so that might have missed it on one patient.  But here’s the problem.  From a clinical perspective, so few patients with stroke ever show up in the magic window of less than 4.5 hours of the onset of symptoms (that’s the cut-off for using t-PA) that the average hospital in Massachusetts sees about 8 such patients per year (less than one a month).  If you were unfortunate enough to end up at Lowell General, there was nearly a 40% chance (depending on which campus) that you won’t get tPA.  At Milton hospital, there was a 60% chance that you wouldn’t get tPA.  These numbers may be getting better slowly, but that’s cold comfort to those permanently disabled because hospitals haven’t yet put in the systems needed to reliably provide a therapy we’ve known is effective since 1995.

So what might state and federal policymakers do if they wanted to get serious about improving these rates?  There are lots of potential solutions, including greater training, more oversight, even robust pay-for-performance.  I have a simpler request:

Stop setting the benchmark at the state average.

In this report (like almost every other report card), you are judged against the “average”.  So, if your state is lousy, a lot of mediocre hospitals can look fine.  Instead, set a goal for what you want to achieve.  In this case, the goal is 100%.  Period.  Tell me which hospitals were “statistically” worse than 100%.  That’s a lot more meaningful than which hospitals were “statistically” worse than average.

In this report, 64 out of 69 hospitals were labeled “equal” because they weren’t statistically worse than average, including South Shore Hospital, which failed to provide t-PA to 8 of their 31 patients (26% failure rate).  Lucky for them, that’s not statistically worse than the state average of 17% failure – but perhaps not so lucky for those 8 patients.  For the 64 hospitals that are labeled as “equal”, such as South Shore, there is little motivation to improve.  Yet, I’m confident that South Shore would be having a very different set of internal discussions if the benchmark was 100%.

If we’re going to use transparency to improve, we need to choose the right benchmarks.  In situations in which strong, evidence-based processes are involved (like providing a life-saving drug), the benchmark should be 100%.  Benchmarking to the average is benchmarking to a “C”.  We spend a LOT of money on healthcare – we deserve better, and our hospitals can do better.  With all the knowledge and expertise in the medical field, we don’t have to settle for a “C”.  We should demand that our hospitals provide “A” care consistently and reliably to all their patients.

The Stage 2 Meaningful Use of EHRs Final Rules: Still No Surprises but Important Steps Forward

Six months to the day after the Centers for Medicare and Medicaid Services (CMS) released the “preliminary rules” for Meaningful Use, the final rules are in.  For clinicians and policymakers who want to see Electronic Health Records (EHRs) play a key role in driving improvements in the healthcare system, there’s a lot to like here.

For the Office of the National Coordinator (ONC), the agency that oversees the federal health information technology incentive program, the Meaningful Use rules are a balancing act. On one hand, ONC wants to get as many clinicians and hospitals on board with simply adopting EHRs (and thus, the need to set a low bar). On the other hand, they want to ensure that once people start using EHRs, they are using them in a “meaningful” way to drive improvements in care (and thus, the need to set a high bar).  I think ONC got that balance just about right.

Let me begin with a little background.  In 2009, Congress passed the Health Information Technology for Economic and Clinical Health (HITECH) Act, setting aside about $30 billion for incentives for ambulatory care providers and acute-care hospitals to adopt and “meaningfully use” EHRs.  Congress specified that the executive branch would define Meaningful Use (MU) and would do so in three stages.  The first stage was finalized in 2010 and its goals were simple – start getting doctors and hospitals on board with the use of EHRs.  By most metrics, stage 1 was quite successful.  The proportion of doctors and hospitals using EHRs jumped in 2011, and all signs suggested continued progress in 2012.  Through July 2012, approximately 117,000 eligible professionals and 3,600 hospitals have received some sort of incentive payment.

When Stage 2 preliminary rules were released in March 2012, I blogged that there were no surprises.  ONC had foreshadowed many of the additions: that a majority of prescriptions be written electronically, that quality measures be generated from the EHR, and that there be a greater demonstration of health information exchange.  These additions remain in the final rules.  Yet, as I skimmed through the 600+ pages of federal register that answer all the comments and describe the final rules, I was struck by the importance of Stage 2 – an importance that can be lost in the details.

A gentle start at shifting the way doctors use EHRs.  Most experts will view Stage 2 as simply building on Stage 1 (e.g. more data in electronic format, etc.)  This is true, but it’s not really what’s interesting here.  What I think is so important is that Stage 2 begins, gently at first, to get doctors to start using EHRs differently. Six months ago, I said that CMS would likely drop the requirement that patients actually engage with the EHR to download or otherwise share their data.  Holding doctors and hospitals accountable for what their patients do seemed untenable to me.  I’m happy to say that I was wrong. ONC set the bar very low:  providers only have to show that 5 percent of their patients are doing it.  It’s a small number but it’s really important.  The new rule holds providers accountable for what their patients do, and that’s a fundamental shift.

There are other important shifts, such as getting providers to actually start sharing data with other providers.  Provider organizations have guarded clinical data jealously, seeing it as a tool to keep their patients coming back.  This begins to change in Stage 2.  Finally, automating clinical quality measures is the holy grail of quality measurement and improvement.  Having EHRs automatically generate quality measures can facilitate larger efforts geared toward payment and delivery system reform.  The Stage 2 rules move us forward.

Some providers are still left out and others are lagging.  There are challenges ahead to be sure, many of which have to do with the broader incentive program.  HITECH leaves thousands of providers out of the incentive program altogether – nursing homes, rehabilitation facilities, and psychiatric facilities are just some of the institutions that will not be getting financial resources for using EHRs.  As we have written previously in Health Affairs, these providers are starting off from a miserable baseline of adoption and are likely falling further behind.  Given that so many of the sickest, costliest patients end up at these institutions, not having their clinical data available in electronic format will make care improvement much, much harder.  There are others that seem to be falling off as well:  small, rural hospitals, for instance, are struggling, as are providers in small practices.  Regional Extension Centers are supposed to be helping these entities, but early evidence of their impact is not as encouraging as it could be.

It is worth remembering that the point of Meaningful Use, at least as I see it, is to be the infrastructure for broader healthcare reform.  EHRs unto themselves may not be a panacea for the cost and quality problems that plague our healthcare system, but they are fundamentally important to addressing those problems.  Want to run an Accountable Care Organization without using interoperable EHRs?  Good luck.  What Stage 2 does is subtle but important:  it slows down the on-ramp enough to give doctors and hospitals a chance to get on board.  But, it also shifts the focus so that providers start using EHRs in ways that engage their patients, share their data, and measure quality in a robust way.

Will it work?  Given my track record on predictions, I’d rather not say.  But if CMS and other payers can do their job of creating the right incentives for broader payment and delivery system changes, ONC can claim credit for having created the infrastructure necessary to make it work.

Ashish K.Jha, MD, MPH, The Stage 2 Meaningful Use of EHRs Final Rules: Still No Surprises but Important Steps Forward, Health Affairs Blog, 24 August 2012, Copyright ©2012 Health Affairs by Project HOPE – The People-to-People Health Foundation, Inc.

Profits, Quality, and U.S. Hospitals

The recent articles in the New York Times about the Hospital Corporation of America (HCA) have once again raised important questions about the role of for-profit hospitals in the U.S. healthcare system.  For-profits make up about 20% of all hospitals and many of them are part of large chains (such as HCA). Critics of for-profit hospitals have argued that these institutions sacrifice good patient care in their search for better financial returns.  Supporters argue that there is little evidence that their behavior differs substantially from non-profit institutions or that their care is meaningfully worse.

To me, this is essentially an empirical question. Yet, as I read through the articles, I was struck by the dearth of data provided on the quality of care at these hospitals.  Based on the comments that followed the stories, it was clear that many readers came away thinking that these hospitals had sacrificed quality in order to maximize profits.  Here, I thought an ounce of evidence might be helpful.

Measuring quality:

There is no perfect way to measure the quality of a hospital.  However, the science of quality measurement has made huge progress over the past decade.  There is increasing consensus around a set of metrics, many of which are now publicly reported by the government and even are part of pay-for-performance schemes.  While one can criticize every one of these metrics as imperfect, taken together, they paint a relatively good, broad picture of the quality of care in an institution.  We focused on five metrics with widespread acceptance:

  1. Patient experience (as measured by HCAHPS, the national metric for grading hospitals)
  2. Process quality (whether hospitals are adherent to evidence-based guidelines)
  3. Mortality rates (Proportion of people who die within 30 days of hospitalization, taking into account the “sickness” of the patient)
  4. Readmission rates (Proportion of people who are readmitted within 30 days of discharge, taking into account the “sickness” of the patient)
  5. Hospital Safety Score (a measure of how effective a hospital likely is at preventing medically-induced harm to patients).

An important caveat: The NY Times article highlighted terrible, unethical practices by some physicians at HCA hospitals who appear to put in cardiac stents when there was no clinical indication.  We don’t have the data to examine whether this practice occurs more often at HCA hospitals than at other institutions. Therefore, I’ve decided to focus more broadly at hospital quality.  Most of the metrics above have been approved by the National Quality Forum, are widely regarded by “experts” as being good, and are used by Medicare to judge and pay for quality.

How we analyzed the data:

We examined all U.S. hospitals in four groups:  Privately-owned non-profit hospitals, government-owned public hospitals, for-profit hospitals that were not part of the HCA chain, and HCA hospitals.  In our analysis we “adjusted” for characteristics that are beyond the hospital’s control such as size, teaching status, urban versus rural location, and region of the country (adjusting is important:  imagine that all the for-profit hospitals were large and large hospitals generally had better quality.  Without adjustment, we’d say for-profit hospitals were better and therefore, we should encourage more for-profit hospitals.  With adjustment, we’d be able to hold size differences constant and examine the actual relationship between quality and the profit status of the hospital).

What we found:

In the table below, we use “non-profit” hospitals as the reference group because it’s the largest group of hospitals.  All the scores that are statistically different (at p-value <0.05) are highlighted either in red if they are significantly worse or in green if they are significantly better.


The best part of looking at data is that you get to draw your own conclusions.  Here are mine. Public hospitals are struggling on nearly every metric. For-profit hospitals outside of the HCA are a mixed bag – they do worse on patient experience (as we’ve found before), better on processes measures, and somewhat worse on mortality and readmission rates.  They are about average on the Leapfrog safety score.

However, HCA hospitals look pretty good. They tend to have good patient experience scores, really excellent process quality (adherence to guidelines) and are average or above average on mortality and readmissions (pneumonia mortality does appear to be high, though not statistically significant). They do very well on the Leapfrog safety score* (nearly half got an “A”).

My takeaway is that although which hospital you go to has a profound impact on whether you live or die, whether the hospital is “for-profit” or “not for profit” has very little to do with it.  What really matters is leadership, focus on quality, and a dedication to improvement.  That appears to happen equally well (or badly, depending on your perspective) in both for-profit and non-profit hospitals.

So, when it comes to quality, it’s time to stop thinking about it as an issue of “for-profit versus non-profit” hospitals.  Instead, it’s time to start talking about the large number of relatively poor performing hospitals where patients are being hurt or killed un-necessarily.  Those hospitals come in all sizes, shapes, and yes, ownership structures, and we have to figure out how to make them better.

Finally, these analyses were run by Sidney T. Le, a terrific young analyst in our group.  You should follow him on twitter (@sidtle) although his love of Stanford sports can be a challenge. Consider yourself warned.

*The Leapfrog safety score was developed by a group of experts (full disclosure:  I was on that panel – but don’t worry, there were many people much smarter than me on the panel).