Teaching Hospital Comparisons Benefit from Context

By Joanne Conroy, MD

The Dartmouth Atlas Project released a study on October 30, 2012, entitled, “What Kind of Physician Will You Be? Variation in Health Care and Its Importance for Residency Training.” The data, and the conclusions of the report’s authors, bear closer examination.

The data set focuses on the differences in the intensity of services that Medicare patients receive, and highlights the academic medical centers rated by U.S. News and World Report as the best hospitals for clinical excellence in 2012-13. The 24-page report, authored by two Geisel Medical School students, was issued to inform medical students about the practices at teaching hospitals where they may receive further training.

All data is helpful, but it only begins the conversation. The authors hold underlying assumptions and perpetrate inconsistencies in their analysis that should be addressed. I don’t suggest dismissing their findings, but rather proceeding with caution.

First, the authors include publicly available information from Hospital Compare , but don’t highlight patient mortality as a quality indicator. Of the seven hospitals in the United States that have attained four successive “Better than U.S. National Rate” ratings for all three 30-day death measures on heart attack, heart failure, and pneumonia patients, several are prominently displayed at the top of the “intensity of care” list.

These hospitals, and their rank on the Dartmouth list, are:

What does it mean to be on that list? For the 2012 update, to achieve even a single “Better than U.S. National Rate” rating, a hospital must be in the top 2 to 4 percent. There are 22 facilities that achieved all three “Better” ratings — about 0.45 percent of nearly 5,000 hospitals reporting. These seven hospitals are better than 99.85 percent of the reporting hospitals — an extremely difficult achievement! (The data cited here is courtesy of Alein Chun, PhD, IQCP Manager, Data Quality Management Unit (DQMU), Cedars-Sinai.)

This begs the question, does a greater intensity of care lead to decrease in mortality in complex patients?

Context for the data is extremely important — and enlightening. New York’s Mount Sinai scores very low on the metric reflecting the percentage of patients referred to hospice in the last six months of life. However, Mount Sinai has one of the premier palliative care programs in the country. The inpatient surgical rate for knee replacement was highest in Salt Lake City, Utah. Does that data reflect a population that self-selects, because many 65-year-old ski bums have winter homes in the Wasatch Mountains?

Data is critical for generating the information we need to identify problems and create solutions, to better manage the health of populations and best deploy our resources. But data is not, in itself, knowledge. It must be analyzed, put into context, and thoughtfully debated to become information, which is then deployed to knowledge. The release of the Dartmouth Atlas Project report creates a great opportunity for all teaching hospitals to reflect on how they are delivering care; and to begin the important conversations about the differences in regional and population utilization.

—Joanne Conroy, MD, is Chief Health Care Officer at the Association of American Medical Colleges in Washington, DC. She blogs at Wing of Zock and can be reached at jconroy@aamc.org. Follow her on Twitter @joanneconroymd.   



This entry was posted in Commentary, Leadership, Newsroom, Quality Reporting. Bookmark the permalink.

8 Responses to Teaching Hospital Comparisons Benefit from Context

  1. James E. Lewis, Ph.D. says:

    Everyone should read and heed Dr. Conroy’s post. The environmental context within which hospitals attempt to carry out their mission, the philosophy and training of their medical staffs, and the determinants of “intensity of care” in each hospital are only a few of the central factors in understanding and interpreting any dataset on the nature of hospitals, especially as sites for residency training. Data are just that, they are not an understanding.

    James E. Lewis, PhD

  2. When I originally commented I clicked the “Notify me when new comments are added” checkbox and now each time a comment is added I get four emails with the same comment.
    Is there any way you can remove people from that service?
    Bless you!

  3. I was suggested this web site by my cousin. I’m not sure whether this post is written by him as no one else know such detailed about my trouble. You’re wonderful!

  4. Excellent items from you, man. I have take into account your stuff prior to
    and you are just extremely wonderful. I really like what
    you have received right here, really like what you are saying and the way wherein you assert it.
    You make it enjoyable and you still care for to stay
    it sensible. I can not wait to learn much more from you.
    That is actually a great site.

  5. blog says:

    It’s best to get all the information about insurance companies, get multiple quotes from different companies
    and also be updated about latest insurance news before going to any insurance agent.
    This was exactly in the 6th day of august, in 1990; which marked the fourth day after their
    Iraqi invasion of Kuwait. Its weight is 122 grams and casing measures 111 x 51 x 13.

    Hello, just wanted to say, I liked this article. It was helpful.
    Keep on posting!

  6. Generally loans will include extra fees in addition with interest charged.
    A lot of times something could be kept as guarantee with the loan company whenever enormous amounts will be handed.
    Although at this stage his wage is relatively much less however he has good future prospects.

  7. mobile games says:

    When I initially commented I clicked the “Notify me when new comments are added” checkbox and now each time a comment is added I
    get three e-mails with the same comment. Is there any way you can remove me from that
    service? Thank you!

  8. This is really interesting, You’re a very skilled blogger. I have joined your feed and look forward to seeking more of your fantastic
    post. Also, I have shared your site in my social networks!

What do you think?

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s