Welcome to NQMC. Skip directly to: Search Box, Navigation, Content.
Expert Resources > Expert Commentary
Expert Commentary |
|
Have Comments? E-mail them to us. |
| Perspective |
National Quality Measurement Systems for Assessment of Nursing Home Care
By: Ning Jackie Zhang, MD, PhD
Evidence-based quality assessment and resulting improvement in nursing homes relies heavily on administrative and resident assessment data. There are two major national systems that routinely collect nursing home quality information required by the Centers for Medicare and Medicaid Services (CMS) based on the Omnibus Budget Reconciliation Act of 1987: the Minimum Data Set (MDS) and the Online Survey Certification and Reporting (OSCAR) systems. MDS collects nursing home quality information at the resident level while OSCAR collects information at the facility level. Both federal and state governments rely on these systems to regulate nursing home compliance with quality standards and to reimburse their operations. This commentary briefly introduces these two administrative databases and their current applications, as well as their potential utility and future development for quality improvement.
Introduction to MDS and OSCAR Databases
Both MDS and OSCAR were mandated as government endeavors to improve the quality of care in nursing homes. MDS includes not only demographic and health condition variables, but also a broad array of clinical measures that are collected through resident assessments by nurses at admission, quarterly and yearly assessments. Some important categories of measures include cognitive patterns, psychosocial well-being, physical functioning, disease diagnoses, medications, and special treatment. The reliability and validity of MDS has been deemed acceptable by John Morris and the MDS development team (1) and many other researchers. (2) Instruments that were developed using variables in MDS, such as the Cognitive Performance Scale (CPS), Pain Scale (PS), Depression Rating Scale (DRS) and Social Engagement Scale have been validated. (3) On the other hand, OSCAR contains data regarding state inspection deficiencies, nursing home self-reported facility characteristics, nurse staffing, and aggregate resident clinical measures. Although the general reliability of OSCAR has not been systematically evaluated, the reliability of its clinical measures was deemed good after comparison with similar MDS clinical variables. (3) The validity of an OSCAR-based forty-indicator quality measure was found to be adequate. (4) Since both MDS variables and OSCAR clinical measures are self-reported but not audited (5), their utility in research and quality measures is disputable. The accuracy of MDS has been questioned (6), and variations in interstate and intersurvey or deficiency citations have been identified in OSCAR. (7)
Current Applications of MDS and OSCAR
Since MDS and OSCAR are the two largest sources of national nursing home administrative data, they have been used to design major quality measurements. These include CMS Quality Measures (QMs) developed by Drs. John Morris, Vince Mor, and their research team; Quality Indicators (QIs) developed by Center for Health Systems Research and Analysis (CHSRA) of the University of Wisconsin-Madison; and the forty-indicator OSCAR-based quality measure developed by Dr. Charlene Harrington and colleagues. CMS QMs currently include 19 resident-level clinical outcome measures (previously there were 15) based on variables of MDS data, five of which are for short-stay residents and six of which have resident-level adjustments. A second set of measures, CMS QIs consist of 24 clinical and psychosocial measures based on the MDS database. Although the computation and numbers of indicators are different, these two systems of measurement both focus on clinical measures and quality of care. The OSCAR-based quality measure is comprised of 40 deficiency measures that are given by trained government surveyors to facilities with substandard quality of care or those that lack compliance with federal quality standards during yearly inspections.
MDS and OSCAR have also been increasingly used in a number of government and public reports. (5,7) Most importantly, based on these two administrative databases, CMS has launched three public reporting systems to guide the public in selecting nursing homes: "Nursing Home Compare" (http://www.Medicare.gov/NHCompare), "Five Star Quality Rating" (http://www.cms.hhs.gov/Certificationandcomplianc/13_FSQRS.asp), and "Special Focus Facility" (http://www.cms.hhs.gov/CertificationandComplianc/Downloads/SFFList.pdf). "Nursing Home Compare" represents a newer generation of quality measurement for nursing home care since it represents a multi-dimensional and multi-level measurement system that incorporates CMS QMs, nurse staffing, and inspection deficiency measures at both resident and facility levels. The latter two measures are derived from OSCAR data. "Nursing Home Compare" contains the most comprehensive nursing home quality measures and includes facility structure (staffing), process (deficiencies), and outcome (QM) measures. It has become the foundation for the CMS "Five Star Rating System." Although both "Nursing Home Compare" and "Five Star Rating System" are associated with nursing home quality, they have not been systemically evaluated in terms of reliability and validity. In an effort to formulate a single dimension scorecard based on "Nursing Home Compare," the "Five Star Quality Rating" system was developed to represent a comprehensive ranking for nursing homes similar to the hotel business. "Special Focus Facility," on the other hand, annually publishes a list of facilities with persistent deficiencies and life-threatening citations documented in OSCAR data. In recent years, consumers have been able to choose desirable nursing homes for themselves or family members as a result of the public online information derived from these two data systems. In addition, policy makers and nursing home advocates have made decisions and influenced policies in light of the evidence presented in these data systems.
A large body of literature has included clinical outcome measures from these two databases. Measures from MDS include the quality measures (QM) in the CMS "Nursing Home Compare"; MDS quality indicators (QIs); pressure sores and urinary tract infections; visual acuity, continence, and depression. Measures from OSCAR include surveyor-reported deficiencies, pressure ulcers, physical restraints, and catheters, as well as contractures and psychoactive drug use. (8-14)
Potential Utility of MDS and OSCAR
The future development of nursing home quality measures still depends primarily on these two administrative databases. A more consistent and accurate collection of OSCAR and MDS data is desirable. MDS version 3 is under development, and its first draft is scheduled to be published at the end of 2009. This updated version will provide better measures for quality of resident life at the resident level through enhanced resident interviews regarding items such as cognitive patterns, mood, and pain. Quality assessment and resulting improvement depend on high quality measurement instruments as well as high quality administrative databases. The current data and quality measures have paved the way for a pay-for-performance (P4P) approach in the nursing home industry. Accurate, accountable, and fair quality measurement is the key to development of the P4P mechanism, which can be used to stimulate quality improvement in nursing homes via financial incentives and lead to improvements in quality based on best practices.
Future Development
In my opinion, the current quality assessment tools could be improved by the following: 1) Risk-adjusting the nurse staffing and deficiency measures in "Nursing Home Compare," because the current measures do not account for the differences between nurse education and experience, as these are not available in OSCAR. Persistent and severe, including life-threatening, deficiencies should be reflected in the deficiency measures. Although "Five Star Rating System" incorporated risk adjustments in its ratings, the ratings and the methods of risk adjustments may need further validation based on additional outcome measures, such as hospitalization rate; 2) Including non-clinical measures such as leadership, management, resident satisfaction and quality of life, especially for long-stay residents in nursing homes, as nursing home quality is a comprehensive construct; 3) Establishing a multilevel (resident and facility) risk-adjusted measurement model of nursing home quality that captures the variations of quality differences and allows for identifying factors associated with best practices in nursing home outcomes; 4) Testing best practice models identified in direction 3) with randomized trials and business cases to validate the generalizability and utility of the best practice models; and 5) Learning from international experiences and enriching our understanding of nursing home quality and its measurement through translational research.
Author
Ning Jackie Zhang, MD, PhD
University of Central Florida, Orlando, Florida
Disclaimer
The views and opinions expressed are those of the author and do not necessarily state or reflect those of the National Quality Measures Clearinghouse™ (NQMC), the Agency for Healthcare Research and Quality (AHRQ), or its contractor ECRI Institute.
Potential Conflicts of Interest
Dr. Zhang states no conflicts of interest.
NQMC Resources
| What's New
| Feedback
| Accessibility
| NQMC Disclaimer
| Privacy Policy Notice
| USA.gov
| Adobe Reader
Date Modified: 11/16/2009
