Veterans for Common Sense et al v. Nicholson et al

Filing 123

Veterans for Common Sense et al v. Nicholson et al

Doc. 123 Att. 5

Ar tic le

Mental Health Service Delivery and Suicide Risk: The Role of Individual Patient and Facility Factors
Rani A. Desai, Ph.D., M.P.H. David J. Dausey, Ph.D. Robert A. Rosenheck, M.D.
Objective: This study explores suicide rates as a quality measure and identifies risk factors for suicide among psychiatric inpatie n ts . Method: Data from a prospective mortality study of psychiatric inpatients from 128 U.S. Department of Veterans Affairs ho s p i t a l s throughout the United States were utilized to examine the relationship of death by suicide to patient-level sociodemographic, clinical, and mental health service delivery characteristics, as well as to facility-level measures of service deliver y. Data were collected on all patients d i s c h a r g e d with a diagnosis of schizophrenia, major depression, posttraumatic st re s s disorder, or bipolar disorder (N= 121,933) between 1994 and 1998. Results: There were 481 suicides in the study sample. Several variables were associated with higher risk for suicide risk, including length of stay less than 14 days, poorer continuity of care, and lack of rea dm i ssio n within 6 months. These variables were significant even after adjustment for state suicide rates, the proportion of members of racial minority groups in the state population, and state-level social capital. Conclusions: Suicide rates are not likely to be a useful indicator of the quality of mental health care because of the instability of suicide rates, difficulty collecting data, and the lack of association between su i c i d e and facility quality of care. The lack of association with facility-level variab le s suggests that systemic changes in t he se performance measures would be u n l i ke l y to significantly reduce suicide rates. (Am J Psychiatry 2005; 162:311­318)

R

isk-adjusted mortality has been successfully used to assess the quality of inpatient medical and surgical care (1, 2). Although report cards have been developed for the assessment of mental health care (3­5), mortality has not been used as an indicator of the quality of mental health care, perhaps because there are few instances in which the delivery of mental health care can be directly linked to the death of a patient. One clear exception, and the focus of this paper, is the rate of death by suicide. Suicide rates after discharge from inpatient care can be hypothesized to be associated with the quality of mental health care. The literature suggests that suicide rates are highest immediately after discharge from hospital treatmen t (6­8), that inadequate medication regimens may contribute to suicide risk (9, 10), that most patients who c om mi t suicide have had recent contact with a health professional (11, 12), and that inadequate follow-up care or discharge planning may put people at greater risk for suicide (13). Although these findings have received relatively limited empirical study thus far, they suggest that m en tal health service delivery may be associated with suicide risk. This paper explores the potential value of using suicide rates as a measure of quality in large mental health care systems. First, we determine, after adjustment for case mix, whether significant variation in suicide rates exists

across facilities in a large national network of hospitals (the U.S. Department of Veterans Affairs [VA]). Second, we e xplore the relationship of patients' sociodemographic and diagnostic characteristics, as well as individual patterns of mental health service use, to the risk for suicide. Third, we explore whether facility-level measures of mental health care delivery or other facility characteristics (e.g., size, academic affiliation) are related to suicide risk after adjustment for several social environment factors, including the population suicide rate in the state, mean i n c o me in the state, the proportion of racial minority group members in the state population, and state-level measures of social capital. Although the VA health care system is a national system, it is not centrally administered. Therefore, facility directors and mental health care line managers in VA facilities have discretion over facility-level policies on admissions, length of stay, and methods of aftercare. We hypothesized that shorter lengths of stay, poorer aftercare, and readmission to inpatient units would be associated with a higher risk of suicide, both at the individual level and at the facility level. Because social environment variables, such as state suicide rates, have been found to be correlated with suicide risk at the population level, we adjusted for those factors in facility-level analyses. This paper thus examines the association of suicide and factors
http://ajp.psychiatryonline.org

Am J Psychiatry 162:2, February 2005

311

Dockets.Justia.com

SERVICE DELIVERY AND SUICIDE RISK

from three domains: 1) individual patient characteristics and mental health care utilization (e.g., age, diagnosis, individual length of stay), 2) facility-level measures of delivery of mental health care (e.g., facility average length of stay), and 3) other facility characteristics (e.g., size and academic affiliation).

o f the nearest VA hospital and was used as a measure of geographic proximity to VA care. It should be noted that, for this sample, no administrative data were available on history of suicide attempts, on whether the reason for admission was suicidal ideation, and on inpatient or outpatient medication regimens.

Delivery-of-Care Variables
Six variables reflected the delivery of mental health care: length of stay of the index hospitalization; readmission within 14, 30, or 180 days after discharge; whether the patient had an outpatient visit within 30 days after discharge; the total number of outpatient visits in the 6 months after discharge; the total number of inpatient days in the 6 months after discharge; and a measure of continuity of outpatient care after discharge--the number of 2month periods in the 6 months after discharge in which the patient had at least two outpatient visits for his or her primary discharge diagnosis (range=0­3). The Patient Treatment File and the Outpatient Care File, a database of all VA outpatient care, were used to construct these variables.

Method
Sample
The sample included all patients discharged with a diagnosis of major affective disorder, bipolar affective disorder, posttraumatic stress disorder (PTSD), or schizophrenia from psychiatric inpatien t units in the VA health care system over the 4-year period from January 1, 1994, to December 31, 1998. The VA system is the largest health care system in the world, treating poor and disabled American military veterans for a complete array of medical and psychiatric illnesses. The four disorders we considered were chosen for their severity and prevalence within the VA inpatient syst e m . Together, schizophrenia, other psychoses, and PTSD account for about 60% of VA inpatient stays (14). Because as many as 80% of VA inpatient substance abuse beds were closed starting in 1996, we did not include patients discharged from substance abuse beds in these data. However, the majority of patients with both psychiatric and substance abuse diagnoses are discharged from general psychiatry beds (not substance abuse beds) (14) and were thus eligible for inclusion in the sample. Acute care inpatient psychiatric units were defined by VA bed section codes 70­ 71, 75­79, 89, and 91­93. Observations were unduplicated by including only the first discharge for each patient. The Patient Treatment File, a VA administrative database of all episodes of inpatient care delivered within the VA system, was used to identify the sample and unduplicate the data. The final sample consisted of 121,933 unique individuals. Because this was a secondary data analysis, informed consent w a s not obtained; however, the project was reviewed and approved by a human investigations committee.

Facility-Level Variables
Facility-level measures included mean values for the deliveryof-care variables described in the previous section, for example, the average length of stay of all psychiatric patients or the proportion of psychiatric patients who were readmitted within 14 days. In addition to examining facility-level measures of service delivery, we also explored other facility-level characteristics, including the proportion of the mental health budget spent on research and education (a measure of academic affiliation), the number of patients treated (a measure of facility size), and the proportion of budget spent on inpatient care (a measure of the emphasis on inpatient versus outpatient care).

Social Environment Variables
Four measures of social environment were included as potential confounders: 1) the statewide age-adjusted suicide rate (determined from Centers for Disease Control and Prevention mort a li t y reports) (16), 2) the statewide per capita income, 3) the percentage of racial minority group members in the population (from Census Bureau statistics) (17), and 4) the statewide social capital index, a measure of social cohesion and trust in the community (18). Social capital is not a new concept, but it has been re c on c e pt u a li ze d by Robert Putnam (18) in a way that allows m e asure me nt of the level of social cohesiveness and trust in a community. Putnam's concept of social capital encompasses seve ral domains: community organizational life (e.g., the level of membership in local organizations), engagement in public affairs (e.g., voting rates), community volunteerism, informal sociability (e.g., social contacts with neighbors), and social trust (i.e., the belief that other people are trustworthy). He combined measures of t h es e domains into a single social capital index that has been shown to be strongly associated at the state level with a number of public health measures (18­21). We used this index in our statistical models.

Identification of Deaths
Once the sample was identified, Social Security numbers were used to merge data into the National Death Index to determine whether a patient was deceased within 1 year of discharge. Previous work with the National Death Index and VA data indicated that the Social Security number was the most valid matching criterion and that its use resulted in low false positive rates (15). The cause of death was coded as suicide if it fell into the range of ICD9 codes 950­959 (deaths before 1999) or ICD-10 codes X60-X84 (deaths in 1999).

Individual Risk Factors
Administrative data available from the Patient Treatment File were used to identify the sociodemographic and clinical characteristics of the sample, including age, race, marital status, serviceconnected disability status (none, <50%, >50%), year of inpatient discharge, whether discharge was to the community or to another institution, distance from home residence to the nearest VA hospital, and psychiatric diagnoses. Diagnoses, which were nonexclusive to allow for comorbidity, included PTSD, major depression, bipolar disorder, and schizophrenia (all subjects had at least one of those four diagnoses), as well as drug abuse/dependence, alcohol abuse/dependence, and other diagnoses (primarily other anxiety disorders and personality disorders). The measure of distan ce was determined as the distance between the geographic center of a subject's home zip code and the center of the zip code

Statistical Analyses
Analyses were conducted in two stages. First we calculated the suicide rate for each facility. Facilities were then compared to look for outliers by using methods described in detail by Selim and colleagues (22). Expected mortality rates were calculated by using a multivariate logistic regression model that adjusted for age, gender, race, disability, distance to the VA, year of discharge, diagnosis, and discharge to the community. Outliers were identified as those facilities whose observed suicide rate was more than two s tandard deviations away from the case-mix-adjusted (i.e., exAm J Psychiatry 162:2, February 2005

312

http://ajp.psychiatryonline.org

DESAI, DAUSEY, AND ROSENHECK p e c t e d ) rate. Suicide rates were analyzed by collapsing data across all 5 years of the study period. The second set of analyses examined the relationship of individual, facility, and social environment factors to the risk of suicide. First, we fit multivariate Poisson models to determine which individual characteristics (e.g., sociodemographic characteristics, diagnosis) were statistically significant predictors of suicide r i s k . Poisson models were used to more accurately model the nonuniform distribution of deaths across the 1-year follow-up. This nonuniformity of deaths over time is not reflected in logistic regression, which is more commonly used for these types of analyses but which sums all events without consideration of time to event (22). In addition to fitting Poisson regression models, we used generalized estimated equations procedures (23) to cluster data for patients within the same facility, in order to account for the reduction in intersubject variation within facilities and to allow for the analysis of facility- and state-level measures. We next examined the association of suicide and patient-level measures of service delivery. Multivariate Poisson models were fit s e pa rat e ly for each delivery-of-care variable, for two reasons. First, a number of factors were highly correlated with each other and could not be included in the models together. Second, differe nt variables were observed over different lengths of time, depending on how they were calculated. For example, the measure of whether a patient received an outpatient visit within 30 days of dis charge could only be calculated among those patients who sur vived at least 30 days. Therefore, we fit models for such variables only among subjects who had survived long enough for the delivery-of-care variable to be an informative predictor. After exploring individual measures of delivery of care, we explored facility-level measures of delivery of care and other facility characteristics such as size and academic affiliation while controlling for social environment measures. Analyses proceeded as described earlier, with each variable adjusted for important indicators of case mix. Generalized estimated equations models were u s e d to adjust for the high correlation of observations within states.

significantly higher-than-expected rates, given their patients' characteristics.

Service Delivery and Suicide
Table 1 summarizes the characteristics of the sample and the bivariate associations between demographic varia bles, diagnostic variables, and suicide mortality. The mean age of the sample was 48.17 years (SD=11.68), and the average distance between subjects' homes and the nearest VA hospital was 12.96 miles (SD=17.32) (data not shown). The diagnostic variables listed in Table 1 are not mutually exclusive, and patients with more than one diagn o s i s are represented. Suicide rates were significantly higher among white patients and those for whom data on race were missing or unknown (p<0.0001) and significantly l ow e r among those with service-connected disability (p<0.005) (Table 1). Rates were higher with increasing age (F=8.81, df=1, 120579, p<0.005) and increasing distance f ro m the VA (F=7.89, df=1, 120579, p<0.005) (data not shown). There was no association with marital status or discharge to the community. Suicide rates were significantly lower among those with a diagnosis of drug abuse/ dependence, schizophrenia, and PTSD, compared to patients without those disorders, but significantly higher among those with unipolar depression. The relationship of year of discharge and suicide was not significant (p=0.08). Table 2 presents the distribution of categorical deliveryof-care variables. Unadjusted mortality rates indicate that patients with lengths of stay less than 14 days and those with poor continuity of care were at significantly higher r is k for suicide, and those who were readmitted within the first 6 months after discharge were at significantly lower risk. Table 3 presents data for the delivery-of-care variables adjusted for case-mix variables such as age, race, gender, discharge to the community, diagnosis, distance to the nearest VA, and year of discharge. Even after this adjustment, several delivery-of-care variables were significantly associated with suicide: patients with shorter lengths of s tay were at higher risk, patients who were readmitted w ithin 6 months of discharge were at lower risk, larger numbers of inpatient days in the 6 months after discharge were associated with lower risk, and patients who had at least two outpatient visits in only one of three 2-month periods in the first 6 months after discharge were at higher risk. Table 4 presents the results of multivariate models of facility-level characteristics adjusted for case-mix and social environment variables. No facility-level characteristics were significantly associated with suicide risk. However, suicide risk was lower in states that had higher social capital and in states where the percentage of minority group m e mb er s in the populations was higher. Suicide rates were significantly higher in states with higher general statewide suicide rates.
http://ajp.psychiatryonline.org

Results
Of 121,933 unique patients included in the sample, 3,588 (2.9%) died within 1 year of discharge. Of those, 481 (0.4% of the total sample, 13.4% of deaths) died of suicide. Suicide deaths were concentrated in the first 6 months after discharge, with 46% in the first 3 months, 18.3% in months 4­6, 20.4% in months 6­9, and 15.4% in months 9­12.

Comparisons of Facilities
The sample was derived from a total of 128 VA facilities. Facilities were compared on the suicide rates of patients treated over all 5 years of the study period. The average observed rate across facilities was 44.53 suicide deaths per 10,000 person-years (SD=31.99). When we ranked facilities separately based on the obser ved and case-mix-adjusted mortality rates, ranking changed dramatically from the observed to the adjusted rates, indicating that adjustment for case mix significantly altered rankings (only 16 facilities retained their rank from one method to the other). In addition, investigations for outliers yielded significant variation in suicide rates across facilities: 15 facilities (10.1%) had rates that were significantly lower than expected, and 20 facilities (13.5%) had
Am J Psychiatry 162:2, February 2005

313

SERVICE DELIVERY AND SUICIDE RISK TABLE 1. Characteristics of Patients Who Died by Suicide Among All Patients Discharged From U.S. Department of Veterans Affairs Inpatient Psychiatric Programs, 1994­1998 All Patients (N=121,933) Characteristic Gender M al e Female R ac e White B l ac k Hispanic Other Missing/unknown Marital status Married Previously marrieda Never married Disability Service connected <50% Service connected >50% Not service connected Alcoholism Yes No Substance abuse Yes No Schizophrenia Yes No Bipolar depression Yes No Major depression Yes No Posttraumatic stress disorder Yes No Discharged to community Yes No Year of discharge 1994 1995 1996 1997 1998
a

Patients Who Died by Suicide (N=481) N 463 18 410 38 19 2 12 152 222 103 85 115 281 105 376 40 441 141 340 101 380 192 289 101 380 96 385 155 107 74 78 67 Row % 0.40 0.26 0.80 0.13 0.28 0.19 0.50 0.41 0.41 0.34 0.39 0.31 0.45 0.34 0.41 0.28 0.41 0.30 0.45 0.43 0.39 0.59 0.32 0.29 0.44 0.45 0.38 0.36 0.41 0.35 0.43 0.52

N 115,105 6,828 82,610 29,136 6,706 1,078 2,403 36,678 54,183 30,133 21,782 37,099 63,052 30,949 90,984 14,531 1,502 46,233 75,700 23,492 98,441 32,508 89,425 34,916 87,017 21,267 100,666 43,418 26,411 21,142 18,055 12,907

Column % 94.40 5.60 67.75 23.90 5.50 0.88 1.97 30.08 44.44 24.71 17.86 30.43 51.71 25.38 74.62 11.92 1.23 37.92 62.08 19.27 80.73 26.66 73.34 28.64 71.36 17.44 82.56 35.61 21.66 17.34 14.81 10.59

Suicide Rate per 10,000 Person-Years 40.93 26.58

Analysis 2 3.15 77.48 df 1 4 p 0.08 <0.0001

50.61 13.18 28.67 18.77 50.53 10.18 42.10 40.27 39.26 10.96 39.51 31.58 45.34 3.22 34.37 42.08 5.97 27.81 41.79 15.18 31.05 45.64 0.93 43.78 39.24 43.4 60.18 32.84 13.78 29.20 44.54 2.12 38.76 46.65 8.44 36.25 41.16 35.61 44.02 52.97 4 0.08 1 0.15 1 0.0002 1 <0.0001 1 0.33 1 <0.0001 1 <0.02 1 0.07 2 <0.005 2 0.07

Includes divorced, separated, and widowed.

Discussion
Suicide Rates as a Quality Indicator
We identified a number of disadvantages to using suicide rates as a quality-of-care indicator. First, to use these rates for this purpose, death data are required for patients who may no longer be receiving care in the system. Unlike in-hospital mortality rates, which can be calculated by using administrative data, mortality rates for discharged patients must be determined by means of longer-term follow- up with National Death Index data and cannot be calculated in a timely fashion. Second, the rates of suicide are quite low, even within this highly vulnerable patient population. As such, the rates are unstable and subject to large variation with small changes in numbers. Suicide rates in a single year are thus not likely to be a useful qual-

ity indicator except in systems with many very large facilities. The third disadvantage is that risk adjustment is imperfect; even with the large numbers of predictors in the risk-adjusted models, R2 corollary measures in these data never rose above 5%. Comparisons of rates across facilities may be impeded because so much variation in individual risk is left unexplained by administrative risk adjustment. Des pite the disadvantages of using suicide rates as a routine quality-of-care indicator, the 5-year suicide rates across facilities in the VA system showed significant variation, and we proceeded to explore institutional and facility-level characteristics that increased the risk of suicide.

Case-Mix Variables and Suicide Risk
In observing variation across facilities as well as the associations between service delivery and suicide risk, it was
Am J Psychiatry 162:2, February 2005

314

http://ajp.psychiatryonline.org

DESAI, DAUSEY, AND ROSENHECK TABLE 2. Quality-of-Care Measures Associated With Suicide Mortality Among Patients Discharged From U.S. Department of Veterans Affairs Inpatient Psychiatric Programs, 1994­1998 All Patients (N=121,933) Measure Length of stay of index inpatient stay (days) 1 >1­7 >7­14 >14­30 >30 Time to readmission (days) 14a Yes No 30b Yes No 180c Yes No Outpatient visit within 30 daysb Yes No Continuity of carec,d 0 1 2 3
a Calculated b Calculated c Calculated d Continuity

Patients Who Died by Suicide (N=481) N 19 95 146 112 109 34 361 51 312 76 96 205 155 19 42 34 76 Ro w % 0.37 0.47 0.45 0.36 0.33 0.39 0.32 0.36 0.29 0.2 0.12 0.30 0.29 0.14 0.21 0.13 0.13

N 5,127 20,026 32,737 31,013 33,030 8,817 112,708 14,144 107,212 37,145 82,854 67,615 52,589 13,656 20,311 26,144 58,761

Column % 4.20 16.42 26.85 25.43 27.09 7.26 92.74 11.65 88.35 30.95 69.05 55.72 43.33 11.38 16.93 21.79 48.97

Suicide Rate per 10,000 Person-Years 37.92 48.11 45.26 36.69 33.73 40.30 40.10 37.25 40.49 37.48 41.29 34.34 46.92 102.42 73.24 34.79 15.87

Analysis z -- 2.27 2.41 0.58 -- ­0.03 -- ­1.49 -- ­4.18 -- ­0.02 -- 0.27 2.27 0.03 -- p -- <0.03 <0.02 0.56 -- 0.98 -- 0.14 -- 0.0001 -- 0.84 -- 0.79 <0.03 0.97 --

only among subjects who survived at least 14 days (N=121,525). only among subjects who survived at least 30 days (N=121,356). only among subjects who survived at least 180 days (N=119,999). of care defined as the number of 2-month periods with at least two visits in first 6 months after discharge. TABLE 3. Quality-of-Care Measures Associated With Suicide M or tality Among Patients Discharged From U.S. Departm en t of Veterans Affairs (VA) Inpatient Psychiatric Programs, 1994­1998 (N=121,933), Adjusted for Case Mixa Measure Length of stay of index inpatient stay (days) (reference: >30 days) <7 7­14 14­30 Time to readmission (days) 14b 30c 180d Inpatient days in 6 monthsd Outpatient visit within 30 daysc Outpatient visits in 6 monthsd Continuity of care (reference: 3)d,e 0 1 2
a

important to adjust for case-mix variables. In these analyses, the sociodemographic characteristics found to significantly predict suicide were similar to those identified in other studies: risk increases with age, compared to risk in those age 40­60 years (24, 25), and is higher among males (26) and patients who are white (27, 28). In general, patterns of risk across diagnostic groups were in the expected directions, with the highest risk groups being those with unipolar and bipolar depression and the lowest risk groups being those with PTSD and substance use disorders. One interesting variable that was significant in all of the multivariate models was the distance between a veteran's home and the nearest VA hospital. This finding could possibly reflect variation in access to mental health care: veterans who lived farther from a VA facility may be at higher risk because of poorer access to outpatient care, difficulty getting to the VA in a crisis, or greater social isolation. Distance to the nearest VA hospital could also be a social environment variable that reflects the degree to which the patient lives in a rural environment, a factor that has been associated with suicide risk (29).

R ate Ratio

z

p

1.41 1.33 1.11 0.81 0.79 0.55 1.01 1.04 1.00 1.06 1.59 1.01

2.14 2.29 0.71 ­1.12 ­1.81 ­4.37 3.9 0.32 ­0.9 0.2 2.18 0.03

<0.04 <0.03 0.48 0.26 0.13 0.0001 0.0001 0.75 0.37 0.84 <0.03 0.97

Individual-Level Delivery of Care and Suicide Risk
For suicide rates to be a meaningful quality indicator, they must not only distinguish providers from one another, but should also be related to variation in service delivery. We found that ready access to mental health care is associated with a reduced risk of suicide at the individual
Am J Psychiatry 162:2, February 2005

All models adjusted for age, gender, race, discharge to the community, diagnosis, distance to nearest VA medical center, and year of discharge. b Calculated only among subjects who survived at least 14 days (N= 121,525). c Calculated only among subjects who survived at least 30 days (N= 121,356). d Calculated only among subjects who survived at least 180 days (N= 119,999). e Continuity of care defined as the number of 2-month periods with at least two visits in first 6 months after discharge.

patient level. The data suggest that patients with inpatient stays shorter than 14 days were at higher risk for suicide, perhaps because they were prematurely discharged, alhttp://ajp.psychiatryonline.org

315

SERVICE DELIVERY AND SUICIDE RISK TABLE 4. Facility-Level and Social Environment Variables Associated With Suicide Mortality Among Patients Discharged from U.S. Department of Veterans Affairs (VA) Inpatient Psychiatric Programs, 1994­1998a Measure Facility-level variables Length of stay (days) (reference: >30 days) 1­7 7­14 14­30 Continuity of care Outpatient visit within 30 days Time to readmission 2 weeks 4 weeks 6 months Research and education budget as a percentage of mental health budget Inpatient budget as a percentage of mental health budget Number of patients treated (quartiles) <800 800­1,178 1,179­1,728 1,729 Social environment variables State per capita income Percentage of minority group members in state population State social capital State suicide rate
a

Rate Ratio

95% CI

z

p

1.21 0.93 1.03 0.78 0.73 5.18 9.71 1.95 0.38 1.43 1.22 1.04 1.04 1.00 0.98 0.81 1.05

0.78­2.18 0.71­2.03 0.82­2.28 0.46­1.59 0.21­1.23 0.08­1.08 0.45­1.57 0.63­1.89 0.01­1.01 0.67­1.95 0.93­2.52 0.78­2.19 0.78­2.18 1.00­2.72 0.97­0.99 0.68­0.97 1.01­1.09

0.85 ­0.51 0.23 ­0.92 ­0.48 0.76 1.45 1.17 ­0.57 0.92 1.41 0.28 0.25 ­0.18 ­2.22 ­2.28 2.34

0.40 0.61 0.82 0.36 0.63 0.44 0.15 0.24 0.57 0.36 0.16 0.78 0.80 0.86 <0.03 <0.03 <0.02

All models were adjusted for age, gender, race, discharge to the community, diagnosis, distance to nearest VA medical center, year of discharge, social environment variables, and, where appropriate, patient-level measures of quality of care. Social environment variables were additionally adjusted for each other.

though a second possible explanation is that some patients may leave programs against medical advice because they intend to commit suicide. Although this hypothesis cannot be tested with these data, it implies that only careful patient assessment and use of involuntary commitment to prevent high-risk patients from leaving prematurely could prevent such ill-timed discharges. Un e x p e c t e d l y, we found that readmission within 6 months was protective against suicide risk. Although this finding may seem counterintuitive, because readmission is often considered an adverse outcome, it is likely to reflect successful identification and inpatient treatment of persistent suicidality. Finally, we found that poor continuity of care was associated with higher suicide risk. It should be noted that those who had no follow-up visits were at equal risk to those who had more than two visits; however, the patients with no follow-up may have left the VA system and sought treatment elsewhere. Those at highest risk were veterans who had two or more visits in only one 2-month period during the first 6 months after discharge. Such a level of care is clearly inadequate for recently discharged inpat i e n t s , even for routine monitoring of symptoms and quality of life. We cannot determine from these data if patients were given appointments that they never kept, or whe ther there was a breakdown in communication between inpatient and outpatient providers. However, it is possible that facilities could reduce risk with more effective communication and active follow-up of patients who miss appointments.

Facility-Level Delivery of Care and Suicide Risk
Facto rs that reflected facility-level practice patterns showed no association with suicide risk. In addition, neither the size of the facility nor the level of academic affiliation was significantly related to suicide mortality. These nonsignificant findings imply that the most important risk factors are operating at the individual level and that systemic changes in these facility-level measures may not significantly reduce the risk of suicide. It should be noted that there are two variables missing from these data that are likely to be associated with suicide risk: a past history of suicide attempts and medication use. The inability to adjust for these factors may leave some residual confounding in the facility-level analyses, as both t he proportion of patients with past attempts and the medication prescribing patterns could differ over facilities. However, although these variables would likely be significant predictors on their own, it is unlikely that the ability to adjust for these variables would reveal significant associations between facility-level delivery-of-care variables and suicide rates.

Social Environment Variables and Suicide Risk
A number of studies indicated that social environment plays an important role in the risk for suicide (30, 31). In addition, recent work from our group showed that social capital is associated with continuity of mental health care (32). Therefore, although these factors are not easily modifiable or particularly clinically relevant, it is important to note that analyses of suicide rates at a macro level (e.g., across facilities or systems) should adjust for these environmental variables as important potential confounders.
Am J Psychiatry 162:2, February 2005

316

http://ajp.psychiatryonline.org

DESAI, DAUSEY, AND ROSENHECK

Conclusions and Clinical Implications
This is the first study, to our knowledge, to examine the association between delivery-of-care measures and the risk for suicide in a large health care system. The data sugg e s t , first, that although there is significant variation across facilities, suicide data do not lend themselves to being used as a quality measure for mental health care: suicide rates are too unstable, the data are difficult to collect, and there is no association of suicide rates with facility-level quality-of-care variables. Second, some aspects of the delivery of mental health care at the patient level are associated with higher suicide risk. However, variations in patterns of service delivery at the system level are not significantly associated with suicide risk, suggesting that individual-level measures do not reflect variation in overall quality of care but rather variation in individual propensity to commit suicide. Finally, the social environment, particularly the quality of social capital, is a strong predictor of suicide risk, even above individual and facility characteristics, and should be adjusted for in models of population suicide risk. These data do not suggest that cases of suicide should not be systematically investigated as sentinel events that potentially could have been avoided with more effective identification and intervention. These data confirm that the postdischarge period is the time of greatest risk, that patients require careful predischarge assessment, and that ap propr iate follow-up care in an outpatient setting, as well as rehospitalization when necessary, may help reduce the risk for individual patients.
Re c ei ved March 24, 2003; revisions received Oct. 1, 2003, and March 31, 2004; accepted April 23, 2004. From the U.S. Department of Veterans Affairs (VA) Northeast Program Evaluation Center; the Departments of Psychiatry and Public Health, Yale University School of Medicine, New Haven, Conn.; RAND Health Services Division, Pittsburgh; and the VA New England Mental Illness Research, Education and Clinical Center, New Haven, Conn. Address correspondence and reprint requests to Dr. Desai, Northeast Program Evaluation Center/ 182, 950 Campbell Ave., West Haven, CT 06516; [e-mail] (e-mail). Support ed in part by VA Health Services Research and Development Merit Award grant LOIIIR20043-1.

References
1. Sivak ED, Rogers MA: Assessing quality of care using in-hospital mortalit y: does it yield informed choices? (editorial). Chest 1999; 115:613­614 2. Thomas J, Holloway J, Guire K: Validating risk-adjusted mortality as an indicator for quality of care. Inquiry 1993; 30:6­22 3. Rosenheck R, Cicchetti D: A mental health program report card: a multidimensional approach to performance monitoring in public sector programs. Community Ment Health J 1998; 34 :85­ 106 4. Druss BG, Miller CL, Rosenheck RA, Shih SC, Bost JE: Mental health care quality under managed care in the United States: a v i e w from the Health Employer Data and Information Set (HEDIS). Am J Psychiatry 2002; 159:860­862

5. Mencke NM, Alley LG, Etchason J: Application of HEDIS measures within a Veterans Affairs medical center. Am J Manag Care 2000; 6:661­668 6. Appleby L, Shaw J, Amos T, McDonnell R, Harris C, McCann K, Kier nan K, Davies S, Bickley H, Parsons R: Suicide within 12 months of contact with mental health services: national clinical survey. BMJ 1999; 318:1235­1239 7. Geddes JR, Juszczak E: Period trends in rate of suicide in first 28 d ay s after discharge from psychiatric hospital in Scotland, 1968­92. BMJ 1995; 311:357­360 8. Geddes JR, Juszczak E, O'Brien F, Kendrick S: Suicide in the 12 months after discharge from psychiatric inpatient care, Scotland 1968­92. J Epidemiol Community Health 1997; 51:430­ 4 34 9. Kallner G, Lindelius R, Petterson U, Stockman O, Tham A: Mortality in 497 patients with affective disorders attending a lithium clinic or after having left it. Pharmacopsychiatry 2000; 33: 8­13 10. Maris RW, Berman AL, Silverman MM: Treatment and prevention of suicide, in Comprehensive Textbook of Suicidology. Edited by Maris RW, Berman AL, Silverman MM. New York, Guilford, 2000, pp 509­535 11. Goldacre M, Seagroatt V, Hawton K: Suicide after discharge from psychiatric inpatient care. Lancet 1993; 342:283­286 12. Hyden LC: Care utilization and the incidence of suicide: suicide victims ' contacts with primary health care and psychiatry in six psychiatric districts in the Country of Stockholm from 1979 to 1990. Acta Psychiatr Scand 1996; 93:442­446 13. Oquendo MA, Kamali M, Ellis SP, Grunebaum MF, Malone KM, Brodsky BS, Sackeim HA, Mann JJ: Adequacy of antidepressant treatment after discharge and the occurrence of suicidal acts i n major depression: a prospective study. Am J Psychiatry 2002; 159:1746­1751 14. Rosenheck R: National Mental Health Program Performance Monitoring System: Fiscal Year 1997 Report. West Haven, Conn, Northeast Program Evaluation Center, 1998 15. Sernyak MJ, Desai R, Stolar M, Rosenheck R: Impact of clozapine on completed suicide. Am J Psychiatry 2001; 158:931­937 16. Hoyert DL, Arias E, Smith BL, Murphy SL, Kochanek KD: Deaths: Final Data for 1999. National Vital Statistics Report, Vol . 49, No. 8. Hyattsville, Md, National Center for Health S tatisti c s , 2001. http://www.cdc.gov/nchs/data/nvsr/nvsr49/ n v s r 4 9 _ 0 8. p d f 17. US Census Bureau: United States Census 2000. http://www.census.gov/main/www/cen2000.html 18. Putnam R: Bowling Alone: The Collapse and Revival of American Community. New York, Simon & Schuster, 2000 19. Welin L, Tibblin G, Svardsudd K, Tibblin B, Ander-Peciva S, Larsson B, Wilhelmsen L: Prospective study of social influences on m or tality: the study of men born in 1913 and 1923. Lancet 1985; 20:915­918 20. Kawachi I, Kennedy BP, Glass R: Social capital and self-rated h ealth : a contextual analysis. Am J Public Health 1999; 89: 1 187­1 193 21. Rosenheck R, Morrissey J, Lam J, Calloway M, Stolar M, Johnsen M, Randolph F, Blasinsky M, Goldman H: Service delivery and com munity : social capital, service systems integration, and outcomes among homeless persons with severe mental illness. Health Serv Res 2001; 36:691­710 22. Selim AJ, Berlowitz DR, Fincke G, Rosen AK, Ren XS, Christiansen CL, Cong Z, Lee A, Kazis L: Risk-adjusted mortality rates as a potential outcome indicator for outpatient quality assessments. Med Care 2002; 40:237­245 23. Liang K-Y, Zeger S: Regression analysis for correlated data. Annu Rev Public Health 1993; 14:43­68 24. Amaddeo F, Bisoffi G, Bonizzato P, Micciolo R, Tansella M: Mortality among patients with psychiatric illness: a ten-year case

Am J Psychiatry 162:2, February 2005

http://ajp.psychiatryonline.org

317

SERVICE DELIVERY AND SUICIDE RISK
register study in an area with a community-based system of care. Br J Psychiatry 1995; 166:783­788 Buckley NA, Dawson AH, Whyte IM, Hazell P, Meza A, Britt H: An analysis of age and gender influences on the relative risk for suicide and psychotropic drug self-poisoning. Acta Psychiatr Scand 1996; 93:168­171 Black DW: Iowa record-linkage study: death rates in psychiatric patients. J Affect Disord 1998; 50:277­282 King E: Suicide in the mentally ill: an epidemiological sample and implications for clinicians. Br J Psychiatry 1994; 165:658­663 Schwartz RC, Cohen BN: Psychosocial correlates of suicidal inten t among patients with schizophrenia. Compr Psychiatry 2001; 42:118­123 29. Singh GK, Siahpush M: Increasing rural-urban gradients in US sui cid e mortality, 1970­1997. Am J Public Health 2002; 92: 1 161­1 167 30. Zimmerman S: States' public welfare expenditures as predictors of state suicide rates. Suicide Life Threat Behav 1987; 17: 2 71­28 7 31. Garlow SJ, D'Orio B, Purselle DC: The relationship of restrictions on state hospitalization and suicides among emergency psychiatric patients. Psychiatr Serv 2002; 53:1297­1300 32. Greenberg GA, Rosenheck RA: Managerial and environmental factors in the continuity of mental health care across institutions. Psychiatr Serv 2003; 54:529­534

25.

26. 27. 28.

318

http://ajp.psychiatryonline.org

Am J Psychiatry 162:2, February 2005