Stability of Performance of Activities of Daily Living Using the MDS

The Gerontologist Vol. 40, No. 5, 582 586 Copyright 2000 by The Gerontological Society of America Stability of Performance of Activities of Daily Living Using the MDS Marshall J. Graney 1 and Veronica F. Engle 2 The Minimum Data Set (MDS) requires assessment of performance of activities of daily living (ADLs) by newly admitted nursing home residents over all shifts for a 7-day period, for a total of 21 assessments. This study evaluated within-subject equivalence of multiple assessments of 42 residents admission MDS ADL performance. Friedman twoway analysis of variance for ranks documented no significant within-subject differences among repeated measurements for all 13 MDS ADL variables. Thus, fewer than 21 assessments may accurately assess ADL performance. Key Words: Nursing home, Functional health, Assessment The Omnibus Budget Reconciliation Act (OBRA) of 1987 specified development of a uniform nursing home resident assessment instrument as part of a larger initiative to improve the quality of nursing home care. The Resident Assessment Instrument, including both the Minimum Data Set (MDS) for resident assessment and Resident Assessment Profiles (RAPs) for standardized care planning that are triggered by selected MDS items, were developed in response to that legislation. The MDS and its RAPs were implemented nationwide in 1989 for every nursing home resident in the United States receiving care reimbursed by Medicare or Medicaid. Since 1989, the uses of the MDS have expanded substantially beyond its original purpose of uniform resident assessment and care planning to include quality indicators and prospective reimbursement for care. Concurrently, issues regarding implementation of the MDS in the clinical setting, psychometric properties of the MDS, and refinement of the MDS are being addressed both by the researchers who developed the MDS and by independent researchers who were not involved in the development of the MDS. As part of the current ongoing refinement of the MDS by independent researchers, the purpose of this study was This study was supported, in part, by a grant from the NIH National Institute for Nursing Research (1 RO1 NR04299). We also thank the residents, staff, and administrators of the nursing homes for their support of this study. Address correspondence to Dr. Marshall J. Graney, Department of Preventive Medicine, University of Tennessee, Memphis, 66 North Pauline Street, Suite 633, Memphis, TN 38163. E-mail: mgraney@utmem.edu 1 Department of Preventive Medicine, University of Tennessee, Memphis. 2 College of Nursing, University of Tennessee, Memphis. to determine whether any single assessment of a resident s ADL performance may accurately evaluate the resident s performance compared with multiple and repeated assessments. Twenty-one repeated assessments within a 1-week period of time including all three shifts are recommended by the MDS directions, but research support for this recommendation was not documented by the MDS developers. The MDS is a complex and often time-consuming instrument for staff to complete. The version of the MDS that is completed on admission contains approximately 450 items, and the MDS completed quarterly (every 3 months) contains approximately 250 items, with about half of the items used to trigger RAPs for care planning. These MDS data are supposed to be based on multiple assessments across time, ranging from 7 days to 90 days, and from multiple sources such as staff, consultants, family members, and residents. It takes approximately 1 10 hours to complete the MDS (Teresi & Holmes, 1992), and the task may be delegated to nursing home staff directly involved in patient care (Teresi & Holmes, 1992), to supervisory nursing home staff (Teresi & Holmes, 1992), or to an MDS nurse, whose sole responsibility is to perform MDS assessments (Ouslander, 1997). The massive amounts of paperwork and staff time committed to the MDS are caused by the number of required MDS assessments throughout the year, the number of nursing home residents assessed, and the amount of time needed to complete each MDS assessment. Consequently, the MDS may often be viewed as unnecessary paperwork by nursing home staff (Ouslander, 1994), as just another form to complete (Zulkowski, 1999). To the average floor nurse filling out the MDS it is just one task among many crying out to be done simultaneously (Brooks, 1996, p. 45). An MDS nurse may take the responsibility for paper compliance with federal regulations to decrease the burden on staff (Crooks, Schnelle, Ouslander, & McNees, 1995) and to help assure few or no citations by regulators for deficiencies of incomplete MDS assessments. In an article by Brooks (1996) on the use of the MDS in the clinical setting, researcher A. Morse asked, Are you better off with fewer items with more validity or more items with no 582 The Gerontologist

validity? (p. 46) and computer systems manager C. Kowalski stated, One of the biggest concerns is the value of all of this labor. We may be finding we could actually use 30% of data (p. 46). Therefore, nursing home staff may be finding creative ways to minimize their time spent completing the MDS, such as completing all MDS items using data obtained at one point in time from one source (rather than from the multiple and possibly redundant and uninformative reassessments required by the MDS) or not scoring MDS items as positive that may trigger a RAP for care planning. Thus, accuracy of the MDS assessments, the appropriateness of subsequent care planning activities, and reimbursement for care may all be compromised. Burdensome assessments may compete for time with delivery of resident care, and assessments completed quickly instead of accurately may adversely affect quality of care, defeating the intent of OBRA. Studies subsequent to the nationwide implementation of the MDS suggested that refinements of the MDS may be needed. For example, there was no reliable association found between research staff wet checks for incontinence and nursing home staff MDS incontinence assessments (Crooks et al., 1995). Some residents were observed by research staff as wearing glasses, but were coded as not wearing glasses on the MDS (Swanson, 1995). Further, the number of dental visits has been found to be inversely related to MDS dental items (Thai, Shuman, & Davidson, 1997), and Arvidson-Berjano, Blank, and Yellowitz (1996) suggested condensing two of the MDS oral hygiene items into a single item. Brandeis, Berlowitz, Hossain, and Morris (1995) found that only 14 of 22 MDS items triggering the pressure ulcer RAP were reliably associated with Stage II to IV pressure ulcers, whereas Zulkowski (1999) found that 18 other MDS items not identified as RAP triggers were correlated with pressure ulcers. Thus, some MDS data inaccurately represent a resident s status, and fewer MDS items may be needed to assess some domains and appropriately trigger RAPs. Revisions of the MDS to address these issues may result in a shorter but more clinically feasible resident assessment, decreasing nursing home staff burden while at the same time improving accuracy of the MDS and thereby enhancing care planning. Additional training of nursing home staff for MDS assessments (Lawton et al., 1998) and competency testing of MDS evaluators may also be necessary, such as that already required for use of the Functional Independence Measure (FIM), an established instrument used extensively in rehabilitation settings (Williams, Li, Fries, & Warren, 1997). Assessment of ADLs is of critical importance in the nursing home setting, because functional abilities of residents are directly related to cost of care provided by nursing assistants (Smith, Hogan, & Rohrer, 1987). Research evaluating a MDS composite indice of ADLs, using data collected by nursing home staff rather than by research staff, indicated that the validity of ADL assessments was good (Lawton et al., 1998). However, it is unknown whether staff actually used the required number of 21 observations to obtain ADL data for their MDS assessments, because nursing home staff may not follow MDS protocols (Morris et al., 1994). We believe that, because of time constraints, nursing home staff are generally using fewer than 21 observations. We were unable to identify any studies related to the development of the MDS that supported using either 7 days of assessments or observations during all three shifts each day. Generally, the MDS and FIM are used to measure changes in status over longer periods of time, such as 3 months. Theoretically, it might be necessary to assess ADLs for 7 days because a resident s status may change over time, and it might be necessary to assess ADLs across all three shifts because residents may be fatigued at the end of the day. However, previous research on stability of 55 White residents ADLs on the day shift documented stability of 10 ADLs during a 4-day period of time following nursing home admission using Scaled Outcome Criteria (Engle, 1985). The day shift was chosen for study because the majority of ADLs occur during the day shift. In another study of 647 Black and White nursing home residents, hygiene, grooming, dressing, and transferring improved during a 2-week period, whereas feeding, ambulation, urination, and defecation were stable across three assessments (Day 1, Day 8, Day 15) following admission (Engle & Graney, 1993). As regards the stability of ADLs across all three shifts, Ouslander, Schnelle, Simmons, Bates- Jensen, and Zeitlin (1993) found that residents were consistently incontinent day and night. Thus, several studies have established that most resident ADLs may be stable during 1- and 2-week periods when assessed on different shifts. This prospective longitudinal study evaluated the equivalence of multiple assessments of ADL performance over a 7-day period within the required 14 days following nursing home admission using the MDS, with data collected during the day shift on 3 different days. The purpose of the study was to determine if any single assessment may evaluate ADL performance as accurately as multiple, repeated assessments. Methods Design As part of a larger study, residents were evaluated three times during the day shift over a 7-day period, per MDS directions, within the first 14 days following nursing home admission, in accordance with federal regulations. Trained interviewers evaluated resident ADLs using the MDS by interviewing the nursing home assistant who provided direct care for the resident on the day of data collection, and they recorded the resident assessments they obtained on a prepared form. This procedure was chosen because nursing assistants can accurately assess residents function (Hartig, Engle, & Graney, 1997), nursing assistants have Vol. 40, No. 5, 2000 583

the most accurate resident ADL data (Morris et al., 1990), and nursing staff complete the MDS by obtaining data from nursing assistants. Nursing assistants were blind to the purpose of the study. Site Residents enrolled in the study were newly admitted or readmitted to either of two large countyfinanced nursing homes, managed by a for-profit corporation, that have historically provided care to indigent Black and White older adults. The nursing homes were dually certified for skilled and intermediate care and had 450 and 314 beds, respectively. Sample Residents enrolled in the study met the criteria of (a) being a new admission or readmitted to the nursing home, (b) remaining in the nursing home during the first 14 days following admission, and (c) not refusing to participate in the study. A waiver for consent was granted by the University of Tennessee Health Science Center s Institutional Review Board because this study s data were similar to data routinely collected in a nursing home for planning care. Both residents able and unable to give consent were asked to participate. Residents were not included in the study if they and/or their family expressly declined participation. Residents in the first half of the sample were enrolled in the study as sequentially admitted to either of the two participating nursing homes. However, the three assessments placed a burden on the nursing staff. Consequently, to not jeopardize conduct of the larger study, residents in the second half of the sample were selected ad libitum from the series of later admissions. Sample Size A power analysis was accomplished at the time of study design to estimate the number of participants needed in a repeated measures study to obtain statistically significant evidence of the average within-subject ADL effect sizes previously documented in studies using non-mds data. That statistical power analysis determined that a sample size of 54 or more residents would provide power of 0.80 or better to reject a false null hypothesis of no within-subject difference between measurements. This estimate assumed use of a two-tailed test at the.05 level of statistical significance, and was based on the average two-week within-subject effect size of 0.24 documented in non-mds ADL measures showing significant change in previous research (Engle & Graney, 1993). Because of the burden to nursing assistants, data collection was ended when a sample size of 42 completed data collection protocols was attained. This shortfall in recruitment numbers reduced the power of the study to 0.70 under the original set of assumptions. Measurement Demographics. Demographic data were obtained from the MDS for gender (MDS question AA2), birthdate (MDS question AA3), and race/ethnicity (MDS question AA4). ADL Performance. Residents performance of ADLs was evaluated using MDS questions from Section G. Physical Functioning and Structural Problems (G1a to G1j, G2) and Section H. Continence in [the] Last 14 Days (H1a, H1b). Included in this set of assessments were two measures of continence bowel and bladder; six measures of mobility bed mobility, mobility off unit, mobility on unit, transferring, walking in corridor, and walking in room; and five measures of personal care bathing, dressing, eating, hygiene, and toileting. MDS ADL performance is assigned scores ranging from independent (scored 0) to total dependence (scored 4) for MDS questions G1a to G1j, G2, H1a, and H1b. If the activity did not occur during the entire 7 days, the activity was scored 8. We recoded this lowest level of performance from 8 to 5, so ADL performance was scored on a 0 to 5 scale. This recoding affects only the descriptive statistics presented; it has no effect on the inferential statistics presented in this study. Statistical Analysis Resident scores were concentrated at the most impaired performance levels for most ADLs measured. Consequently, a nonparametric data analysis strategy was adopted because data conformed neither to assumptions of scale continuity nor to those of normal distributions. Statistical analysis of clinical series data was accomplished using the Friedman two-way analysis of variance for ranks (Siegel, 1956), a nonparametric repeated measures analysis of variance in which several measurements of an ADL for each participant were evaluated for evidence of within-subject difference. This analysis determined if there was reliable evidence to say that there was at least one significant difference among the several within-subject measurements. Computations of test statistics were accomplished in accordance with Siegel (1956), and p values were obtained using SAS for Windows version 6.12 (SAS Institute, Inc., 1990). A p value of.05 or less was the criterion for rejection of a null hypothesis. Results Completed data collection protocols were available for analysis for the 42 newly admitted residents from two nursing homes who were enrolled in the study. The mean age for the sample was 67.8 17.5 (mean SD) years old, with a predominance of men (59%) and Black (71%) residents. Descriptive statistics for demographic data and baseline ADL data are shown in Table 1. Statistical inference analyses for the three admission MDS assessments for 13 ADL variables are doc- 584 The Gerontologist

Table 1. Sample Descriptive Characteristics at First Observation (N = 42) Variable Mean SD or % (n) Age (years) 67.8 17.5 Gender Male 59% (25) Female 41% (17) Race Black 71% (30) White 29% (12) Continence Bladder 1.1 1.8 Bowel 1.7 2.0 Mobility Bed 1.4 1.6 Off unit 4.2 1.8 On unit 3.0 2.2 Transferring 2.0 2.0 Walk corridor 3.6 2.2 Walk room 3.2 2.3 Personal Care Bathing 3.1 1.6 Dressing 3.2 1.9 Eating 1.1 1.7 Hygiene 2.5 1.8 Toileting 2.5 2.4 umented in Table 2. Within-subject equivalence of the three assessments was analyzed separately for each ADL using the Friedman two-way analysis of variance by ranks. Findings from these statistical inference analyses documented that ADL performance was stable over a 7-day period during the day shift. No statistically significant within-subject difference among the three assessments of ADL performance was found for any of the 13 ADL measures, nor did any differences approach statistical significance. Discussion Federal regulations require MDS ADL performance to be assessed over all three shifts during a 7-day period. This study evaluated equivalence of three assessments of 13 MDS ADL items for 42 residents during the day shift for 7 days within 14 days of admission. These ADL assessments were obtained by trained data collectors who interviewed the nursing assistants who provided direct care for the residents. There was no significant within-subject difference among repeated measurements for any of the 13 ADL items, in general agreement with previous research (Engle, 1985; Engle & Graney, 1993). Some ADLs showed changes in previous research, but there are two reasons why these changes were not detected using MDS data in the present study. First, earlier research (Engle & Graney, 1993) used a 2-week period, twice as long as the stipulated 7-day MDS observation period, allowing more time for change to take place. Second, MDS ADL data were less sensitive to change because of their psychometric properties. Although the MDS (current study) and the Scaled Outcome Criteria (SOC; Engle, 1985; Engle & Graney, 1993, 1995) both use 6-point scales, MDS calibrations are the same for all ADLs, whereas SOC calibrations are specific to each ADL assessed. The SOC calibrations also make finer distinctions of performance among more impaired residents, whereas the MDS calibrations are coarser in that they group impaired residents together in fewer scale values representing the worst ADL performance. Consequently, the MDS ADL data for nursing home residents were highly skewed. Time demands placed on nursing home staff by only three assessments in this study reflected just part of the far greater demands required by following MDS directions for 21 ADL assessments. To comply Table 2. Mean Within-Subject Differences From Subject s Mean MDS ADL Scores (N = 42) Within-Subject Difference a MDS Variable Observation 1 Observation 2 Observation 3 p Value b Continence Bladder 0.16 0.11 0.17 0.09 0.01 0.10.838 Bowel 0.09 0.13 0.02 0.11 0.07 0.12.918 Mobility Bed 0.10 0.09 0.06 0.08 0.04 0.08.730 Off unit 0.03 0.09 0.02 0.09 0.01 0.10.996 On unit 0.07 0.16 0.09 0.17 0.02 0.12.916 Transferring 0.05 0.14 0.07 0.08 0.12 0.12.849 Walk corridor 0.23 0.11 0.25 0.12 0.02 0.07.305 Walk room 0.11 0.13 0.04 0.11 0.15 0.13.889 Personal Care Bathing 0.18 0.09 0.16 0.09 0.34 0.12.550 Dressing 0.13 0.10 0.22 0.08 0.09 0.11.582 Eating 0.02 0.08 0.01 0.06 0.01 0.08.996 Hygiene 0.16 0.10 0.06 0.06 0.10 0.09.463 Toileting 0.02 0.07 0.06 0.08 0.08 0.11.935 Notes: MDS Minimum Data Set; ADL activity of daily living. a Mean SE difference from average of three measurements. b Friedman two-way analysis of variance by ranks. Vol. 40, No. 5, 2000 585

with these greater demands, nursing home staff may disregard MDS directions, or they may document the 21 ADL assessments with flow sheets. However, nursing assistants often complete flow sheets hastily at the end of the shift, with emphasis on speed rather than on accuracy. Thus, nursing home staff may emphasize completeness, to avoid citations, instead of accuracy and may also avoid scoring MDS items that would trigger RAPs. Requirements for redundant assessments may focus staff efforts on paperwork, whereas fewer required assessments may allow staff to focus on accuracy, quality of care, and completeness of assessments. Additional research is needed to evaluate accuracy versus completeness of MDS assessments and to consider the cost of staff time required for completing MDS assessments relative to resident outcomes and quality of care. The study sample was comprised of newly admitted or newly readmitted residents, and therefore younger residents, male residents, and Black residents were overrepresented in comparison to the general long-term care population. Research is needed to identify possible cognitive impairment (Phillips, Chu, Morris, & Hawes, 1993), gender, race, and age differences in the stability of ADLs. In addition to research to identify characteristics of residents whose ADLs are unstable, and who will require more than three assessments, additional research is needed to document stability or change in ADLs across three shifts and to document the impact of multiple assessments on RAPs and care planning. In summary, this study documented stability of three assessments of MDS ADLs during the day shift over a 7-day period. According to this study s results, fewer than the required 21 assessments may be used for accurate evaluation of residents ADL performance using the MDS. References Arvidson-Bufano, U. B., Blank, L., & Yellowitz, J. (1996). Nurses oral health assessments of nursing home residents pre- and post-training: A pilot study. Special Care in Dentistry, 16, 58 64. Brandeis, G. H., Berlowitz, D. R., Hossain, M., & Morris, J. N. (1995). Pressure ulcers: The Minimum Data Set and the Resident Assessment Protocol. Advances in Wound Care, 8, 18 25. Brooks, S. (1996). What s wrong with the MDS (Minimum Data Set)? Contemporary Long Term Care, 19, 41, 43, 45 47. Crooks, V., Schnelle, J., Ouslander, J., & McNees, M. (1995). Use of the Minimum Data Set to rate incontinence severity. Journal of the American Geriatrics Society, 43, 1363 1369. Engle, V. F. (1985). Mental status and functional health 4 days following relocation to a nursing home. Research in Nursing and Health, 8, 355 361. Engle, V. F., & Graney, M. J. (1993). Stability and improvement of health after nursing home admission. Journal of Gerontology: Social Sciences, 48, S17 S23. Engle, V. F., & Graney, M. J. (1995). Black and White female nursing home residents: Does health status differ? Journal of Gerontology: Medical Sciences, 50A, M190 M195. Hartig, M. T., Engle, V. F., & Graney, M. J. (1997). Accuracy of nurse aides functional health assessments of nursing home residents. Journal of Gerontology: Medical Sciences, 52A, M142 M148. Lawton, M. P., Castin, R., Parmelee, P. A., Van Haitsma, K., Corn, J., & Kleban, M. H. (1998). Psychometric characteristics of the Minimum Data Set II: Validity. Journal of the American Geriatrics Society, 46, 736 744. Morris, J. N., Fries, B. E., Mehr, D. R., Hawes, C., Phillips, C., Mor, V., & Lipsitz, L. A. (1994). MDS Cognitive Performance Scale. Journal of Gerontology: Medical Sciences, 49, M174 M182. Morris, J. N., Hawes, C., Fries, B. E., Phillips, C. D., Mor, V., Katz, S., Murphy, K., Drugovich, M. L., & Friedlob, A. S. (1990). Designing the national Resident Assessment Instrument for nursing homes. The Gerontologist, 30, 293 307. Ouslander, J. G. (1994). Maximizing the Minimum Data Set. Journal of the American Geriatrics Society, 42, 1212 1213. Ouslander, J. G. (1997). The Resident Assessment Instrument (RAI): Promise and pitfalls. Journal of the American Geriatrics Society, 45, 975 976. Ouslander, J., Schnelle, J., Simmons, S., Bates-Jensen, B., & Zeitlin, M. (1993). The dark side of incontinence: Nighttime incontinence in nursing home residents. Journal of the American Geriatrics Society, 41, 371 376. Phillips, C. D., Chu, C. W., Morris, J. N., & Hawes, C. (1993). Effects of cognitive impairment on the reliability of geriatric assessments in nursing homes. Journal of the American Geriatrics Society, 41, 136 142. SAS Institute, Inc. (1990). SAS Language: Reference, Version 6. (1st ed.) Cary, NC: Author. Siegel, S. (1956). Nonparametric statistics for the behavioral sciences. New York: McGraw-Hill. Smith, D. W., Hogan, A. J., & Rohrer, J. E. (1987). Activities of daily living as quantitative indicators of nursing effort. Medical Care, 25, 120 130. Swanson, M. W. (1995). Care plan assessment of visual status and evaluated vision among nursing home residents. Optometry and Vision Science, 72, 151 154. Teresi, J. A., & Holmes, D. (1992). Should MDS data be used for research? The Gerontologist, 32, 148 149. Thai, P. H., Shuman, S. K., & Davidson, J. (1997). Nurses dental assessments and subsequent care in Minnesota nursing homes. Special Care in Dentistry, 17, 13 18. Williams, B. C., Li, Y., Fries, B. E., & Warren, R. L. (1997). Predicting patient scores between the Functional Independence Measure and the Minimum Data Set: Development and performance of a FIM-MDS crosswalk. Archives of Physical Medicine and Rehabilitation, 78, 48 54. Zulkowski, K. (1999). MDS+ items not contained in the pressure ulcer RAP associated with pressure ulcer prevalence in newly institutionalized elderly. Ostomy/Wound Management, 45, 24 33. Received February 8, 1999 Accepted February 22, 2000 Decision Editor: Vernon L. Greene, PhD 586 The Gerontologist