|
|
||||||||
1 Center for Applied Research on Aging and Health (CARAH)
2 Biostatistics Section, Division of Clinical Pharmacology, Department of Medicine, Thomas Jefferson University, Philadelphia, Pennsylvania.
Address correspondence to Dr. Laura N. Gitlin,130 S. 9th Street, Suite 513, Philadelphia, PA 19107. E-mail: laura.gitlin{at}jefferson.edu
| Abstract |
|---|
|
|
|---|
Methods. A randomized two-group design was implemented with three assessment points: baseline, 6 months, and 12 months. Caregivers were randomly assigned to a usual care control group or intervention that consisted of six occupational therapy sessions to help families modify the environment to support daily function of the person with dementia and reduce caregiver burden. Following 6-month active treatment, a maintenance phase consisted of one home and three brief telephone sessions to reinforce strategy use and obtain closure. Noninferiority statistical analysis was used to evaluate whether intervention caregivers maintained treatment benefits from 6 to 12 months in comparison to controls.
Results. For the sample of 127 at 6 months, caregivers in intervention reported improved skills (p =.028), less need for help providing assistance (p =.043), and fewer behavioral occurrences (p =.019) compared to caregivers in control. At 12 months, caregiver affect improved (p =.033), and there was a trend for maintenance of skills and reduced behavioral occurrences, but not for other outcome measures.
Conclusion. An in-home skills training program helps sustain caregiver affect for those enrolled for more than 1 year. More frequent professional contact and ongoing skills training may be necessary to maintain other clinically important outcomes such as reduced upset with behaviors.
The Home Environmental Skill-building Program (ESP) was a randomized clinical trial of the National Institutes of Health Resources for Enhancing Alzheimer's Caregiver Health (REACH) initiative. In the ESP, occupational therapists provide caregivers with education, problem-solving and technical skills (task simplification, communication), and simple home modifications. The goal is to help caregivers modify the environment to support care recipient physical functioning and reduce behavioral occurrences as well as to reduce caregiver burden. Active treatment, consisting of five 90-minute home visits and one telephone session, occurs over 6 months. Maintenance, consisting of one home visit and three brief telephone sessions to reinforce strategy use and obtain closure, occurs over the subsequent 6 months (8).
As reported elsewhere, at 6 months, treatment effects for 190 caregivers included reduced upset with behaviors, receiving less help with daily care, and improved affect. Also found was a trend for greater use of effective management strategies and fewer behavioral occurrences, but these were not statistically significant (911).
This article reports the maintenance of these main treatment effects at 12 months. To evaluate maintenance, we use noninferiority testing, a statistical approach used in pharmacological and medical clinical trials. The non-inferiority hypothesis is the one-sided hypothesis that the experimental therapy is either similar to or better than standard therapy (12, and see other articles in the same journal issue). In noninferiority testing, "similar" means not importantly worse and not importantly better. Thus, we define maintenance in two ways: as no important loss of 6-month treatment effects at 12 months (e.g., "similar"); or as improvement from 6 to 12 months. We seek to evaluate whether caregivers in intervention retain an important portion of 6-month effects or improve from 6 to 12 months in comparison to controls. This approach is in contrast to traditional methodologies that seek to evaluate significant change in caregiver scores from baseline to 12 months. Rather, here we are interested in evaluating "maintenance" or whether the effects achieved at 6 months are retained at 12 months.
| METHODS |
|---|
|
|
|---|
At 12 months, data were available for 127 caregivers representing 33% attrition (n = 63) from the 190 caregivers with 6-month data. Reasons for dropout included nursing home placement (23 caregivers), bereavement (20 caregivers), and discontinuance (20 caregivers). A comparison of caregivers with and without 12-month data revealed that more white (n = 38) than minority caregivers (n = 25; X2(1) = 9.26, p =.002) and more caregivers of persons with greater dependence in activities of daily living (ADLs, Z = 2.01, p =.044) dropped out.
Measures
We examined five outcome measures for which large or statistically significant main treatment effects were found at 6 months for the 190 caregivers. Measures included occurrence of seven memory-related behaviors using the REACH modified Revised Memory and Problem Behavior Checklist (15,16), the single REACH vigilance item, Days Receiving ADL Help ("How many days in a week have other family members or friends not being paid provided help?"; 17), caregiver upset with the seven behaviors, the 19-item Task Management Strategy Index to assess skill enhancement (18), and a five-item index to assess affect (
=.86). For this measure, caregivers rated each of five items (feeling calm, upset, overwhelmed, angry, things going your way) as to whether the affective item had become much worse, somewhat worse, stayed the same, improved somewhat, or improved a lot over the last month.
Data Analysis
Using chi-square and Wilcoxon rank-sum tests, we examined differences between caregivers with and without 12-month data and between treatment and control conditions. Six-month treatment effects for the 127-caregivers were examined by calculating adjusted mean differences for each outcome variable using as covariates the baseline value of the outcome measure, design variables (race and relationship), and care recipient age given a statistically significant difference between experimentals and controls in the 127 caregivers for this variable. The normality assumption for each dependent measure was examined using the distribution of residuals. For Days Receiving ADL Help, the residual distribution was skewed, and normality improved with a logarithmic transformation. Transformed results were converted to the original scale for reporting purposes.
To evaluate maintenance of 6-month treatment effects, we compared intervention and control groups on adjusted mean differences from 6 to 12 months for each outcome variable using the same procedures as for analyses of 6-month data, but without adjusting for baseline values of the outcome measures. We initially defined maintenance as no important change of effect from 6 to 12 months. Although no change is normally stated as the null hypothesis, in our case it must be part of the statistical alternative hypothesis given that we want to conclude no change in effect. Because statistical methods do not apply to an alternative hypothesis of a single value (zero change) with a null hypothesis of any nonzero change, we initially define the maintenance of effect hypothesis to be "no important change in effect." For example, if at 12 months we retain 80% of the 6-month intervention effect, we would consider this as no important change and conclude maintenance.
It is also possible that intervention effects continue to increase from 6 to 12 months. If so, a test of no important change in treatment effect might fail to reject the null hypothesis. Because the "no important change" hypothesis is two-sided, this might penalize the intervention for delayed effects. Thus, we reformulated maintenance as one-sided and consider maintenance to be no important loss of effect. The statistical null hypothesis is that the loss of effect is important; the statistical alternative hypothesis is that the effect increases or stays the same, or that the loss of effect is not important.
To test the one-sided hypothesis of maintenance, we present 95% one-sided confidence bounds (one of the bounds of 90% two-sided intervals). For measures where larger values are positive, if the lower confidence bound was above the boundary of no important loss of effect, we could claim maintenance at the 5% level. Suppose we had a treatment effect (intervention-control difference) of 1.0 at 6 months. We might consider any change from 6 to 12 months of no more than a loss of 0.25 to be unimportant. We would then compute the lower confidence bound for the change from 6 to 12 months. If that lower bound was larger than 0.25, we could conclude maintenance. For measures where smaller values are positive, this is reversed. We would need to consider 95% upper confidence bounds and determine whether the confidence bound was below the boundary of no important loss of effect. Table 1<--?1-->lists which of the upper and lower bounds is appropriate. Maintenance of change in the affect measure was analyzed differently (see Results) given its response categories.
|
| RESULTS |
|---|
|
|
|---|
Maintenance of Treatment Effects
For Days Receiving ADL Help (Table 1), we found a statistically significant effect at 6 months, with the mean number of days receiving help in the intervention group being 77% that of the mean number for controls (p =.043). Comparing 12- to 6-month results, intervention and control group scores move closer, representing a loss of intervention effect (Figure 1). Our upper confidence bound is 1.52; that is, a 52% increase over the 6-month ratio of 0.77. This corresponds to an intervention/control ratio of more than 1.0, a reversal of the initial 6-month intervention, and thus maintenance cannot be concluded.
|
|
|
|
|
| DISCUSSION |
|---|
|
|
|---|
Given the lack of empirically derived cutoff points or consensus as to what constitutes meaningful change scores in caregiver measures, the determination of an important loss of treatment effect is necessarily qualitative and based on professional judgment (19). We would contend that the maintenance of effect in the experimental group compared to controls is clinically significant. Considering the negative health consequences of caregiver distress, even slight improvement in one affective item may represent a meaningful benefit.
Although we are unable to conclude maintenance in this study for other outcomes, the trend for experimental caregivers compared to controls to maintain a portion of their 6-month skill level and report reduced behavioral occurrences may be clinically meaningful. The trend suggests that experimental caregivers continued to use simplification strategies that are designed to support care recipient daily functioning. Also, previous research has shown that behavioral occurrences can trigger nursing home placement. Thus, maintaining a reduction in behavioral occurrences over 12 months is important. One explanation for these outcomes may be that by enhancing skills, caregivers achieved a sense of personal control and feeling less overwhelmed (improved affect). Also, use of environmental and task-simplification skills to address problematic behaviors may have translated into fewer behavioral occurrences. Nevertheless, given the wide confidence intervals for strategy use and behavioral occurrence, caution is called for in interpreting maintenance, and more research is certainly warranted. It may be that for these two variables the reduced sample size resulted in loss of power to detect maintenance and a Type II error.
We did not find maintenance of effects for two outcomes, days receiving help and upset with behaviors. Most of the immediate benefits shown at 6 months had dissipated, and experimental and control caregivers showed similar declines for these variables.
The overall pattern of results is not straightforward or clear cut and raises critical issues for caregiver intervention research. For this sample of 127 caregivers, we see statistically significant intervention benefits at 6 months (e.g., reduced behavioral occurrences and skill enhancement) that were not found in the initial 190-caregiver sample, and we find support for maintenance for one outcome (affect) and a trend for two other outcomes (skill enhancement and behaviors). The modest maintenance of effects identified here are consistent with previous research. A recent meta-analytic review of 78 caregiver interventions (20) similarly found very modest effects for numerous outcomes in studies of dementia caregivers, with these studies reporting far fewer benefits than in studies of nondementia caregivers. Other research suggests that caregivers may require ongoing intense professional contact for benefits to be sustained over time (7).
There may be several reasons for our findings. First, the brief maintenance phase of the ESP may not be of sufficient intensity to maintain treatment gains in all domains. Second, effects may be context specific and of short duration. That is, ESP strategies (e.g., simplifying bathing routine) are customized to address specific concerns (e.g., resistance to bathing). A strategy may solve the presenting concern providing immediate caregiver relief. Nevertheless, a specific strategy may not be transferable to subsequent problems; thus beneficial outcomes may not be sustained in all areas. Alternately, there may be an adaptive mechanism such that caregivers derive immediate relief but, with time, return to previous upset levels as new problems emerge.
One recommendation based on this pattern of results is that interventions be developed and tested that enable long-term provider-caregiver contact of sufficient intensity to afford the support caregivers need with disease progression. This would require a flexible intervention and reimbursement approach to address new caregiver problems as they emerge over time with disease progression. Correspondingly, short-term interventions, such as the ESP, that are designed to address specific and immediate concerns at each point along the trajectory of caregiving might continue to have an important role in alleviating acute upset or burden associated with a specific stage of caregiving.
Another implication of these findings is that more attention needs to be given to sampling and selection issues in caregiver intervention research. In this study, 50% of the initial 255 caregivers enrolled at baseline were unavailable at 12 months. An important impact of the attrition is that all of our confidence intervals are wider than they otherwise would be. This corresponds to a loss of power to conclude maintenance at 12 months, particularly for the two outcomes for which there is a trend (skill enhancement and behavior occurrence). In addition, dropouts were more often caring for highly dependent persons. Our previous research suggests that caregivers of persons at the mild to moderate stage benefit from home environmental strategies more so than do caregivers of highly dependent persons, possibly accounting for their dropping out. To maximize benefits, study inclusion criteria should be tailored to match sample characteristics with interventions.
There was also a selection issue for three outcomes. We found a statistically significant 6-month effect for skill enhancement and behavioral occurrences for the 127 caregivers, but not for the initial 190 caregivers. For affect, we found a statistically significant 6-month effect for the 190 caregivers but not for the 127-caregiver sample. This suggests that those caregivers with only 6-month data may be different from those with 12-month data, posing a concern for generalizability. Those caregivers not available at 12 months were mostly white caregivers and those caring for highly dependent persons.
Finally, this study presents the non-inferiority model, which uses the concept of no important loss of effect to evaluate whether significant benefits are sustained over time. The application of this approach is dependent on consensus as to what constitutes clinical significance and maintenance of benefits that have practical, real-life consequences (21,22). Given that traditional caregiver measures lack empirically derived scores indicative of clinical significance, this approach is necessarily based on professional judgment as to what constitutes clinically significant sustained effects. Developing consensus as to what constitutes clinical significance and using statistical procedures such as non-inferiority testing to examine retention represent the next critical steps for advancing caregiver intervention research.
| Acknowledgments |
|---|
| Footnotes |
|---|
Received July 23, 2003
Accepted November 13, 2003
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
M. Devor and M. Renvall An Educational Intervention to Support Caregivers of Elders With Dementia American Journal of Alzheimer's Disease and Other Dementias, June 1, 2008; 23(3): 233 - 241. [Abstract] [PDF] |
||||
![]() |
M. J L Graff, E. M M Adang, M. J M Vernooij-Dassen, J. Dekker, L Jonsson, M. Thijssen, W. H L Hoefnagels, and M. G M O. Rikkert Community occupational therapy for older patients with dementia and their care givers: cost effectiveness study BMJ, January 19, 2008; 336(7636): 134 - 138. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. J. L. Graff, M. J. M. Vernooij-Dassen, M. Thijssen, J. Dekker, W. H. L. Hoefnagels, and M. G. M. OldeRikkert Effects of Community Occupational Therapy on Quality of Life, Mood, and Health Status in Dementia Patients and Their Caregivers: A Randomized Controlled Trial J. Gerontol. A Biol. Sci. Med. Sci., September 1, 2007; 62(9): 1002 - 1009. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|---|
| All GSA journals | The Gerontologist |
| Journals of Gerontology Series B: Psychological Sciences and Social Sciences | |