The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Published Online:https://doi.org/10.1176/foc.3.3.450

Abstract

This study sought to investigate the coherence of changes observed in diagnostic criteria for borderline, schizotypal, obsessive-compulsive, and avoidant personality disorders. Five hundred, forty-nine patients were independently evaluated 2 years apart, and correlations of observed changes in each diagnostic criterion with changes in other criteria were examined to determine if there was withinsyndrome consistency in these changes. The observed changes in criteria were consistent within syndrome (median α=0.72 across 4 disorders), and reasonably specific to that syndrome relative to the other disorders. The results support the validity of these criterion sets as representing coherent syndromes.

The diagnostic validation of many personality disorders is at a relatively early stage. Although some validating factors (Blashfield, Sprock, & Fuller, 1990) such as specific etiologies or interventions remain to be demonstrated, others have received support, such as diagnostic reliability and syndromal status. Blashfield et al (1990) describe a “syndrome” as a group of co-occurring symptoms. For the most part internal consistency studies (Grilo et al., 2001) have supported the cross-sectional co-occurrence of specific personality disorder indicators. Our study employs a novel strategy to determine the syndromal status of four personality disorders, examining whether these indicators covary longitudinally—in other words, whether changes in these criteria are interrelated, and if they are syndrome-specific or simply markers of more global change. To address this issue, we examined the pattern of changes in the DSM-IV criteria as manifested over a 2-year period.

Method

Subjects

Participants were part of a prospective longitudinal study (Gunderson et al., 2000) of borderline (BPD), schizotypal (STPD), avoidant (AVPD), and obsessive-compulsive personality disorder (OCPD). Also included in the study was a comparison group meeting criteria for major depressive disorder but with no personality disorder. Participants aged 18 to 45 years were recruited primarily from patients seeking treatment at clinical services affiliated with each of the four recruitment sites of the study; patients with active psychosis, acute substance intoxication or withdrawal, a history of schizophrenia-spectrum psychosis, or organicity were excluded. All participants provided written informed consent prior to participating in any study procedures. The current report is based on 549 subjects (82% of the intake sample) for whom complete data through 24 months of follow-up were obtained. No significant differences in diagnostic assignments were observed between retained subjects and those lost to follow-up at the 24 month evaluation (chi-square (4)=5.77, ns).

Procedures

All consenting participants were interviewed in person by experienced and trained interviewers who were monitored and received regular ongoing supervision. Individual DSM-IV criteria were assessed by the Diagnostic Interview for DSM-IV Personality Disorders (DIPD-IV), a semi-structured interview assessing criteria on a 3-point scale (0=not present; 1=present but of uncertain clinical significance; 2=present and clinically significant). Interrater reliability (based on 84 pairs of raters) kappa coefficients for the 4 study PDs ranged from .68 (BPD) to .73 (AVPD); test-retest kappas (based on 52 cases) ranged from .69 (BPD) to .74 (OCPD); while median reliability (Zanarini et al., 2000) correlations for criteria scores ranged from .79 to .91 (interrater) and .65 to .84 (test-retest). Participants were re-interviewed with the DIPD-IV at 24 months by an interviewer who was blind to all results from the baseline and follow-along assessments.

Data analyses

To evaluate the consistency of changes in criteria, standardized residualized change scores (Cronbach, 1970) for each criterion were calculated, using the baseline score for the criterion as the covariate. The change scores for criteria associated with a given disorder were then summed to create a total change score for that disorder. Changes in the individual criteria were correlated with these four summed scores to determine the association of change in specific criteria with changes in these four syndromes. Also, the internal consistency of these four sets of change scores was described using coefficient α (Cronbach, 1951).

Results

Table 1 presents data summarizing the intercorrelation of the residualized change scores for the individual DSM criteria across the 2-year period of the study. For example, changes in the first criterion for BPD, “intense anger,” correlated more highly with changes in the remaining BPD criteria (correlation of .52) than with changes observed in the other three disorders (correlations ranging from .20–.31). This result indicates that change in this feature was specifically consistent with changes in other indicators of BPD, rather than reflecting more general increases or decreases in symptomatology that would be evident across different disorders. Finally, Table 1 also presents the coefficient alphas as summary descriptions of the internal consistency of the change scores for the criteria within a disorder.

Discussion

The results of this study indicate considerable consistency among the changes in criteria for these disorders, and also suggest that these changes are relatively disorder-specific, in contrast to relatively nonspecific changes that would be expected if this relatively pathological sample were simply “regressing to the mean” in the general direction of psychological health. For the 33 criteria examined for these 4 disorders, there was a positive association between change in criterion and change in syndrome, and in 28 of 33 instances this association exceeded .30. Furthermore, change in a criterion was more highly associated with change in the parent syndrome than with changes in other syndromes, with one exception: for the STPD criterion “no close friends,” changes were more related to changes in AVPD than to STPD. Although this was the only instance where greater association across disorders was noted, a few other criteria also appeared to be relatively nonspecific. For example, the STPD criterion “paranoid ideation” was particularly related to the status of BPD and AVPD, while changes in the “miserly” and “pack rat” behavior of the OCPD did not appear to cohere particularly well with changes in any of the four disorders.

These results support the syndromal status of these four disorders, as there was considerable temporal coherence in changes among the indicators for each disorder. To illustrate, Grilo and colleagues (2001) found that the internal consistency of the criteria for these disorders at baseline ranged from .69 (OCPD) to .83 (AVPD). The comparable values of .66 to .78 obtained here suggest that the pattern of changes observed in these criteria over a 2-year period are nearly as coherent as the cross-sectional associations among the criteria themselves, which could serve as a theoretical upper limit to any observed longitudinal associations. While these findings support the nosological status of these four disorders, they also identify some potentially problematic criteria that do not appear to covary over time with other disorder indicators and can thus inform future revisions of the diagnostic criteria.

Table 1. Internal Consistency and Discriminant Validity of Criterion Change Scores Over a 2-Year Period
 BorderlineObsessive-CompulsiveAvoidantSchizotypal
BPD Criteria
    Intense anger0.520.310.280.20
    Affective instability0.520.280.170.12
    Chronic emptiness0.420.190.160.21
    Identity disturbance0.430.150.100.17
    Stress-related paranoia0.450.260.280.25
    Avoids abandonment0.420.130.290.20
    Self-injury0.310.08−0.040.06
    Impulsivity0.350.180.050.11
    Unstable relationships0.460.200.130.13
OCPD Criteria
    Rigid and stubborn0.270.410.140.20
    Miserly0.050.190.080.05
    Pack rat0.200.210.140.16
    Perfectionism0.250.510.180.20
    Rules and details0.200.420.210.20
    Reluctant to delegate0.260.490.150.17
    Inflexible about morality0.170.400.010.19
    Workaholic0.110.350.100.12
AVPD Criteria
    Views self as inept0.270.190.500.19
    Preoccupied w/rejection0.290.200.580.26
    Needs to be liked first0.260.180.510.26
    Feels inadequate0.310.170.570.25
    Fears being ridiculed0.210.100.390.20
    Avoids social jobs0.210.140.440.17
    Avoids taking risks0.230.080.510.09
STPD Criteria
    Social anxiety0.080.190.230.29
    No close friends0.060.010.320.18
    Odd beliefs0.170.220.290.35
    Unusual experiences0.200.180.330.39
    Paranoid ideation0.340.200.330.35
    Ideas of reference0.200.230.180.31
    Odd behavior0.130.080.100.36
    Odd thinking/speech0.090.120.090.52
    Constricted affect0.050.080.170.27
Alpha0.750.680.780.66

Note. n = 548; any correlation >.11 is significant at p <.01.

Table 1. Internal Consistency and Discriminant Validity of Criterion Change Scores Over a 2-Year Period
Enlarge table

(Reprinted with permission from the Journal of Personality Disorders 2004; 18, 394–398. Copyright 2004, The Guilford Press)

References

Blashfield, R.K., Sprock, J., & Fuller, A.K. (1990). Suggested guidelines for including or excluding categories in the DSM-IV. Comprehensive Psychiatry, 31, 15–19.CrossrefGoogle Scholar

Cronbach, L.J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.CrossrefGoogle Scholar

Cronbach, L.J. (1970). How we should measure change—or should we. Psychological Bulletin, 74, 68–80CrossrefGoogle Scholar

Grilo, C.M., McGlashan, T.H., Morey, L.C., Gunderson, J.G., Skodol, A.E., Shea, M.T., Sanislow, C.A., Zanarini, M.C., Bender, D., Oldham, J.M., Dyck, I., & Stout, R.L. (2001). Internal consistency, intercriterion overlap and diagnostic efficiency of criteria sets for DSM-IV schizotypal, borderline, avoidant, and obsessive-compulsive personality disorders. Acta Psychiatrica Scandinavica, 104, 264–272CrossrefGoogle Scholar

Gunderson, J.G., Shea, M.T., Skodol, A.E., McGlashan, T.H., Morey, L.C., Stout, R.L., Zanarini, M.C., Grilo, C.M., Oldham, J.M., & Kelle,r M.B. (2000). The Collaborative Longitudinal Personality Disorders Study: Development, aims, design, and sample characteristics. Journal of Personality Disorders, 14, 300–315.CrossrefGoogle Scholar

Zanarini, M.C., Skodol, A.E., Bender, D., Dolan, R., Sanislow, C.A., Morey, L.C., Grilo, C.M., Shea, M.T., McGlashan, T.H., & Gunderson, J.G. (2000). The Collaborative Longitudinal Personality Disorders Study: II. Reliability of Axis I and Axis II diagnosis. Journal of Personality Disorders, 14, 291–299.CrossrefGoogle Scholar