Zum Hauptinhalt springen

Predicting aggression in acute inpatient psychiatric setting using BVC, DASA, and HCR-20 Clinical scale

CHI MENG, CHU ; DAFFERN, Michael ; et al.
In: The Journal of forensic psychiatry & psychology (Print), Jg. 24 (2013), Heft 2, S. 269-285
Online academicJournal - print; 17; 2 p

Predicting aggression in acute inpatient psychiatric setting using BVC, DASA, and HCR-20 Clinical scale. 

The assessment and prevention of aggressive behavior are critical components of contemporary psychiatric inpatient care, treatment, and management. This prospective study compared the predictive validity of three dynamic violence risk assessment measures (i.e. Brøset Violence Checklist (BVC), Dynamic Appraisal of Situational Aggression (DASA), and HCR-20 Clinical scale) for imminent aggression (within the next 24 h). The DASA and BVC were developed specifically to assess imminent violence within psychiatric hospitals, whereas the HCR-20 is a 'general' violence risk assessment measure that can also be used for this purpose. Daily risk ratings were completed for 70 psychiatric inpatients; a total of 3449 ratings for each risk assessment measure were obtained. Results showed that the DASA and BVC were acceptable to outstanding predictive validity and were more accurate than the HCR-20 Clinical scale for predicting inpatient aggression. Actuarial and structured professional ratings were similar for the prediction of verbal threats, but actuarial ratings were more accurate for predicting interpersonal violence. Overall, these findings support the use of structured dynamic risk assessment measures to aid in the prediction of imminent aggression within inpatient psychiatric settings.

Keywords: actuarial; forensic psychiatric patients; gender; mental illness; structured professional judgment; violence risk assessment

Introduction

In recent years, a number of studies have revealed an association between mental illness and violence; specifically, a small but clinically important relationship exists between psychosis and violence (Douglas, Guy, & Hart, [8]; Fazel, Långström, Hjern, Grann, & Lichtenstein, [14]; Skeem et al., [30]; Swanson et al., [32]). The assessment of risk of violence in those individuals with mental illness is, therefore, a prominent issue in all areas of mental health care (Mullen, [23]) and not just for correctional or forensic psychiatric settings. Unsurprisingly, the prevention of aggressive behavior is a critical aspect of contemporary psychiatric inpatient care, treatment, and management since much violence occurs in this context and patients are often at their most unwell during hospitalization. Prevention efforts are predicated on accurate identification of patients who pose a high risk of imminent aggression and subsequently, the implementation of effective interventions. It is important to accurately assess and manage inpatient aggression as this will not only improve clinicians' understanding of the interaction between static and dynamic risk factors associated with inpatient aggression, but it will help to improve safety, for both staff and patients, within forensic psychiatric institutions. Specifically, more focused preventive strategies can be implemented to avert possible aggressive situations with better understanding of the risk factors. This paper focuses on the predictive validity of three measures used for identifying patients at heightened risk of imminent aggression within an inpatient setting.

Static and dynamic risk factors for violence

Static and dynamic violence risk factors are differentiated in accordance with their relative changeability within specified time frames (Douglas & Skeem, [12]; Heilbrun, [18]). A static risk factor for violence (e.g. early onset of violence, and history of violence) is a historical event or variable that is not amenable to change through planned intervention over time, whereas a dynamic risk factor for violence (e.g. active psychotic symptoms, antisocial attitudes, and negative affect) is a variable that is proximally associated with violence, and can fluctuate with time and circumstances (Douglas & Skeem, [12]). In contrast with the static risk factor, which is unlikely to be ameliorated to manage the risk or to reduce the risk of violence over time, dynamic variables can be changed as a result of deliberate intervention (Webster, Douglas, Belfrage, & Link, [33]), thereby reducing the level of risk for violence. With regard to the utility of these risk factors for violence risk assessment, it has been argued that measures comprising static variables may be more suited for longer term predictions such as whether a prisoner will reoffend on parole (Quinsey, Harris, Rice, & Cormier, [29]), whereas measures comprising dynamic variables may play an important role in predicting violence in the short term (Chu, Thomas, Ogloff, & Daffern, [5]; Daffern, [6]; Douglas & Skeem, [12]; Douglas, Ogloff, Nicholls, & Grant, [10]; McNiel, Gregory, Lam, Binder, & Sullivan, [22]).

Acute dynamic risk assessment measures

Although the prediction of violence is fraught with conceptual difficulties and debates about the accuracy of different approaches (particularly, the relative predictive validity of structured vs. actuarial measures), research studies have overwhelmingly shown that structured violence risk assessment methods are not only more accurate than unstructured clinical judgment but are also preferred because of their increased transparency and reliability (Fazel, Singh, Doll, & Grann, [15]; see also Heilbrun, Yasuhara, & Shah, [19] for a review). Several dynamic risk assessment measures have been developed to assess the risk of inpatient aggression; some of these measures include the Brøset Violence Checklist (BVC; Almvik, Woods, & Rasmussen, [1]), the Violence Screening Checklist (McNiel & Binder, [21]), and the Dynamic Appraisal of Situational Aggression (DASA; Ogloff & Daffern, [26]). The BVC and DASA comprise dynamic variables (see method) that are sensitive to change and easy to consider and score, allowing regular efficient appraisals of risk so that day-to-day treatment and management decisions that are affected by the likelihood of violence can be facilitated (e.g. Does the patient require additional interventions-biological, social, and psychological today? What level of supervision is required for this patient today?). The Clinical scale of the Historical, Clinical and Risk Management – 20 Factors (HCR-20 Clinical scale; Webster, Douglas, Eaves, & Hart, [34]) has also been used to study risk for imminent aggression (Ogloff & Daffern, [27]).

In general, these dynamic risk assessment measures have been shown to be predictive of inpatient aggression in the short term (see Chu et al., [5]; Daffern, [6] for reviews). For example, the BVC's reported predictive validity, as measured by the Area Under the Curve (AUC), for inpatient violence is.69–.82 in the next 24 h; the DASA's is.65–.82; and the HCR-20 Clinical scale is.63–.73 (see Chu et al., [5]). The inter-rater reliability for the HCR-20 Clinical scale and BVC ranged from.55–.95 (20 studies) (see Douglas & Reeves, [11] for a review) and.48–1.00 (Almvik et al., [1]), respectively. Unfortunately, none of the published peer-reviewed papers or the DASA manual has reported any information on the inter-rater reliability. In spite of the growing interest in the utility of dynamic risk assessment measures in the psychiatric hospital context, there are very few published studies that have directly compared these dynamic risk assessment measures (McNiel et al., [22]; Nicholls, Ogloff, & Douglas, [25]; Ogloff & Daffern, [27]).

There is also considerable debate about the utility and predictive accuracy of purely actuarial vs. Structured Professional Judgment (SPJ) ratings in the field of violence risk assessment (the latter incorporating clinical judgment based on a review of prescribed empirically and rationally derived risk factors). Although proponents of actuarial methods assert the predictive superiority of their approach and warn against structured methods primarily because these methods introduce (allegedly flawed) clinical judgments, spoiling the empirically derived calculation of risk probability (Quinsey et al., [28]), Heilbrun et al. ([19]) have argued that the evidence suggests the two approaches are comparable. In a review of four studies which have directly tested the predictive validity of HCR-20 ratings using 'numeric scores,' (i.e. totaling the 20 risk factors) and 'summary scores' (i.e. the HCR-20 was totaled but clinicians were able to modify the overall level of risk using their clinical judgment after considering all of the information available arriving at ratings of high, moderate or low risk), multivariate analyses showed that the summary ratings added incrementally to the numeric use of the instrument (Guy, [16]). Nevertheless, the relative superiority of SPJ ratings vs. actuarial using instruments designed to assist appraisal of risk for aggression in psychiatric inpatients has not yet been examined.

Present study

The present study sought to extend the comparisons conducted in Ogloff and Daffern's ([27]) previous study on the predictive validity of three dynamic risk assessment measures (i.e. the BVC, the DASA, and the Clinical scale of the HCR-20) for interpersonal violence. The present study examined: (a) the predictive validity of the measures for different types of inpatient aggression (interpersonal violence and verbal threat as well as any inpatient aggression); (b) the predictive validity of actuarial vs. SPJ ratings; and (c) the incremental validity of using actuarial and SPJ ratings together. Furthermore, the classification accuracy of the three measures was studied.

Method

Source sample

Seventy patients (55 males and 15 females) who were present at the start of the study period (1 June 2002) or admitted into the acute units (two 15-bed male units and one 10-bed female unit) of the Thomas Embling Hospital (TEH) between 1 June 2002 and 31 October 2002 were included in the study. The TEH is a high-security forensic mental health hospital that provides psychiatric assessment and treatment for men and women in Victoria, Australia. More than three quarters of the sample (55/70, 78.6%) were Caucasian; 8.6% (6/70) were Asian, 5.7% (6/70) were of Aboriginal or Torres Straits Islander descent, 5.7% (6/70) were of Middle Eastern descent, and 1.4% (1/70) was Maori. During their hospitalizations at the TEH, the patients received involuntary pharmacological intervention as well as a range of other interventions including psychological, physiological, nursing, and social welfare support.

Measures

Brøset violence checklist

The BVC is a six-item violence risk assessment instrument that assesses changes in six behaviors (i.e. confusion, irritability, boisterousness, physical threats, verbal threats, and attacks on objects) that commonly precipitate inpatient violence (Almvik et al., [1]). The BVC can be rated quickly and easily (using '1' for presence of behavior or '0' for the absence), and is intended for predicting inpatient violence within 24 h. The total score is derived from the summation of the individual item scores.

DASA

The DASA is a seven-item violence risk assessment instrument that comprises strictly dynamic violence risk factors (Ogloff & Daffern, [26]). The seven items are: negative attitudes, impulsivity, irritability, verbal threats, sensitive to perceived provocation, easily angered when requests are denied, and unwillingness to follow directions. Daily assessments using the DASA involve scoring each of the seven items for its presence or absence (i.e. '1' or '0') in the 24 h prior to assessment. The total score of the DASA (i.e. actuarial rating) is derived from the summation of the item scores. The SPJ rating involves the consideration of the seven items and an assessor then giving a rating of Low, Moderate, or High depending on these seven items and other expert clinical considerations (e.g. the presence of other idiosyncratic risk and individual and situational protective factors).

Historical, clinical, risk management: 20 factors

The HCR-20 is a 20-item structured risk assessment instrument that is used to assess the risk of violence in forensic and psychiatric settings (Webster et al., [34]). The HCR-20 items are grouped into three scales: Historical (ten items), Clinical (five items), and Risk Management (five items). Although the HCR-20 was intended as a SPJ risk assessment measure when used clinically, scores have been summed actuarially for research purposes. For the purpose of this study, the Clinical scale, which contains five dynamic risk factors (i.e. lack of insight, negative attitudes, active symptoms of mental illness, impulsivity, and unresponsive to treatment) that reflect risk relevant aspects of current mental state, was rated daily for each patient. The HCR-20 items are coded on a three-point scale in accordance with the presence of risk factors (0: definitely absent or does not apply; 1: possibly or partially present; and 2: definitely or clearly present). For this study, the total score involved the summation of these item scores.

Procedure

Ethical approval for the study was obtained from Monash University and permission to conduct the study was granted by Forensicare. Unit nursing staff completed the BVC, DASA, and HCR-20 Clinical scale for each patient at 1300 h daily (which was the end of the morning shift). Although inter-rater reliability analyses were not conducted, the second and third author trained the nurses in the use and rating of the BVC, DASA, and HCR-20.[1] Moreover, they continued to provide onsite consultations to the nurses during the period of the study and the second author visited the units three times per week to provide support and clarification of scoring procedures if required. Furthermore, second and third authors had instructed the nurses (during the training session and study) that they should follow the hospital's standard operating procedures with regard to the management of inpatient aggression, and not to be influenced by these risk assessment ratings in their clinical practice. It should also be highlighted that the nursing staff were qualified and registered psychiatric nurses.

With regard to the order of coding for the measures/items, the nurses coded the HCR-20 items (with three-point scale) first, then the unique items on the DASA (i.e. sensitive to perceived provocation, easily angered when requests are denied, and unwillingness to follow directions – absence/present rating), and lastly, the BVC (absence/present rating). As mentioned earlier, the DASA has an overlap of two items with the BVC and an overlap of another two items with the HCR-20 Clinical scale. These overlap items were not rated again, rather they were incorporated into the tabulation of the total score for the DASA. For purpose of scoring the DASA, the rating scale for the overlap items on the HCR-20 Clinical scale was converted into a dichotomous scale of absence (0) and presence (1). In particular, definitely absent or does not apply (score of 0) on the HCR-20 Clinical scale was changed to absent (score of 0) on the DASA, whereas possibly or partially present (score of 1) and definitely or clearly present (score of 2) on the HCR-20 Clinical scale were changed to present (score of 1) on the DASA.

Aggressive behaviors were recorded on a modified version of the Overt Aggression Scale (OAS) (acts of self-harm that were not recorded, as this was not a topic of inquiry in this study and the main goal of this study was to examine violence perpetuated against other persons). Standard hospital untoward incident forms were also reviewed to identify any other acts of aggressive behavior that was not recorded on these untoward incident forms. The risk assessment ratings were then matched with the OAS (Yudofsky, Silver, Jackson, Endicott, & Williams, [35]) and incident form data (for the 24 h following each set of ratings); this data was used to assess each measure's predictive validity. Acts of aggression were classified as either verbal threats (threats to kill or cause bodily harm to others) or interpersonal violence (biting, hitting, kicking, punching, and throwing objects intending to injure). These definitions are similar to the definitions adopted by Steadman et al. ([31]). Any inpatient aggression referred to the presence of interpersonal violence and/or verbal threat.

The potential for criterion contamination using this procedure was deemed to be low as the ratings were conducted at the end of the second shift (i.e. 1300 h), and the nurses conducting the ratings were not involved in preparing incident reports for aggressive incidents in at least two of the following three shifts during the follow-up 24 h. These ratings were documented daily and the nursing staff could not change these ratings subsequently even if they continued to work in the next shift. Incident reports were further reviewed by the authors to supplement the nursing staff's daily records of inpatient aggression to ensure that all the aggressive behaviors were recorded accurately. Lastly, the first author coded the patients' sociodemographic information and diagnoses from clinical case files.

Statistical analyses

The sample was first characterized using descriptive statistics, with categorical data reported as numbers and percentages, and continuous data presented in relation to the mean, median, standard deviation, and range. The predictive validity of the measures was assessed using the AUC of the Receiver Operating Characteristic (ROC); the ROC is less dependent on the base rate of violence than traditional measures of predictive accuracy (Douglas & Webster, [13]). Benjamini and Hochberg False Discovery Rate corrections were also conducted to control for Type I error that may arise from multiple comparisons of AUCs; specifically, it is a less conservative but more powerful statistical approach than Bonferroni-type adjustments (Benjamini & Hochberg, [3]).

The AUCs of the ROC Curve, which range from 0 (perfect negative prediction) to 1.0 (perfect positive prediction), are often considered indices of overall predictive validity. As a general rule, AUCs of more than.90 are considered as outstanding discrimination,.80–.89 are excellent, and.70–.79 are considered acceptable (Hosmer & Lemeshow, [20], p. 162). AUCs between.60 and.69 are generally considered to be modest in terms of predictive validity, and.50 is equal to chance (i.e. the false positive rate is equal to the true positive rate). The current analyses used each daily risk assessment rating as a unit of analysis, which is an acceptable and appropriate comparison method in this area of study (e.g. Almvik et al., [1]; Barry-Walsh, Daffern, Duncan, & Ogloff, [2]; Desmarais, Nicholls, Read, & Brink, [7]). The three assessment measures examine dynamic risk states; individuals' mental state fluctuates and these measures are sensitive to change. Hence, the daily ratings can be used as separate units of analysis (i.e. each individual clinical state is used to predict the subsequent behavior in the next 24 h). Assuming that α = .05 and β = .20, the sample needed for the ROC analyses is 100.

In addition, the AUCs for the different measures were compared using z-tests for dependent groups (Hanley & McNeil, [17]). The predictive accuracy of the various cut-off scores for each measure was examined, and classification accuracy statistics (e.g. sensitivity, specificity, as well as positive and negative prediction values [PPV and NPV respectively]) were also generated to provide information on the predictive power of the measures. Moreover, the d index, which is the distance between the ROC curve and the top of left plot, is calculated when to assist with identifying the optimal cut-off for predicting different types of inpatient aggression (based on the minimization of misclassification). Furthermore, block logistic regression analyses were conducted to evaluate the incremental validity of the DASA total score over the clinical ratings and vice versa. Analyses were conducted using SPSS version 19.

Results

Sample characteristics

The mean age of the overall sample at the point of assessment was 34.33 years (Mdn= 32.00; SD= 12.91; range = 17–83). With regard to the age at the first psychiatric hospitalization, the mean was 30.47 years (SD= 12.42). With its distribution being positively skewed, the median was 27.18 years, and the age at the first psychiatric hospitalization ranged from 13 to 76 years. The mean number of daily assessments conducted for each patient was 49.27 (Mdn= 46.50, SD= 33.47, range = 1–91).

More than a third of the sample (40%; 28/70) had multiple comorbid diagnoses recorded by their respective psychiatrists; notably, 80% (56/70) presented with psychotic disorders, 74.3% had substance abuse/dependence, 20% (14/70) had personality disorders, and 11.4% (8/70) had mood disorders. More than two-thirds (50/70, 71.4%) of the participants had an index violent offense, and more than half (39/70, 55.7%) were convicted of a past violent offense. However, 28.6% (20/70) did not have a past offense history. As shown in Table 1, assault, property damage, and theft/fraud were the most common forms of index offenses. In spite of the high prevalence rate of substance abuse/dependence diagnoses in this sample (52/70, 74.3%), comparatively fewer participants (8/70, 11.4%) were convicted of drug-related offenses.

Table 1. Type of past and index offenses.

Type of offensePast (N = 70)Index (N = 70)
n%n%
Arson22.900.0
Assault2738.63144.3
Breach of court orders2332.9811.4
Burglary/criminal trespass1825.7710.0
Murder/manslaughter34.31217.1
Possession/use of drugs1825.7811.4
Possession/use of weapons1014.31115.7
Property damage1724.31318.6
Resist arrest68.657.1
Robbery1014.3811.4
Sexual-related57.134.3
Stalking-related11.422.9
Theft/fraud-related3448.61825.7
Threats to kill811.41014.3
Traffic-related1622.9811.4
Others2434.31217.1
Note: Many participants had more than one type of offense; therefore, the numbers add up to >70. Although some of the patients were found not guilty by reason of mental illness for their offenses (i.e. the forensic patients), these offenses were included in this tabulation to illustrate the offense characteristics of the source sample. Examples of 'other' offenses included begging for alms, drunk and disorderly behavior, prostitution, and use of indecent language.

Risk assessment measures

A total of 3449 daily risk ratings were completed for each risk assessment measure (i.e. the BVC, DASA, and HCR-20 Clinical scale). Mean scores for the BVC, DASA, and HCR-20 Clinical scale were 0.41 (SD= 1.00), 1.90 (SD= 2.21), and 3.55 (SD= 2.73), respectively. In addition, there were 2485 (72.0%) ratings of low risk on the DASA, 735 (21.3%) ratings of medium risk, and 198 (5.7%) ratings of high risk. Table 2 reveals that all three dynamic risk assessment measures were significant correlated with each other. There were a total of 90 incidents of inpatient aggression: 42 (46.7%) involved interpersonal violence and 73 (81.1%) involved verbal threat; moreover, 22.9% (16/70) of the sample engaged in interpersonal violence and 14.3% (10/70) in verbal threat.

Table 2. Correlation between the acute dynamic violence risk assessment measures.

MeasureDASA Total ScoreBVC Total ScoreHCR-20 'C' Total Score
DASA Total Score.67∗∗∗.73∗∗∗
BVC Total Score.67∗∗∗.43∗∗∗
HCR-20 'C' Total Score.73∗∗∗.43∗∗∗
∗∗∗p < .001

Table 3 shows the predictive validity of the BVC, the DASA, and the HCR-20 Clinical scale for inpatient aggression (24-h follow-up). In general, the DASA and the BVC showed acceptable to excellent (see Hosmer & Lemeshow, [20], for a classification of AUCs) predictive validity for inpatient aggression. Notably, the DASA and the BVC had significantly better predictive validity for interpersonal violence, verbal threat, and any inpatient aggression than the HCR-20 Clinical scale. Although the DASA total score was more predictive than the DASA clinical rating for interpersonal violence, the difference was statistically nonsignificant when they were used to predict verbal threat (see Table 3).

Table 3. Predictive validity of BVC, DASA, and HCR-20 Clinical scale for inpatient aggression (24 h follow-up).

Inpatient aggressionAUC (SE)95% CI
Any Inpatient Aggression
HCR-20 'C' Scale score.68 (.03)∗∗∗ab.62–.73
DASA total score.76 (.03)∗∗∗a.71–.82
BVC total score.77 (.03)∗∗∗b.71–.82
Interpersonal Violence
HCR-20 'C' Scale score.72 (.04)∗∗∗cd.65–.79
DASA total score.83 (.03)∗∗∗ce.77–.90
DASA clinical rating.75 (.04)∗∗∗ef.67–.83
BVC total score.83 (.04)∗∗∗df.76–.91
Verbal Threat
HCR-20 'C' Scale score.68 (.03)∗∗∗ghi.62–.75
DASA total score.77 (.03)∗∗∗g.71–.83
DASA clinical rating.75 (.03)∗∗∗h.69–.82
BVC total score.77 (.03)∗∗∗i.70–.84
Note: ∗∗p < .01; ∗∗∗p < .001. All AUCs remained statistically significant after Benjamini and Hochberg False Discovery Rate corrections.Pairs of these subscripts a, b, c, d, e, f, g, h, I, j, k, l denote significant differences when comparing the AUCs within the same column (i.e. |z|⩾ 1.96). For example, the AUC for HCR-20 'C' scale differs significantly with those AUCs for the DASA and BVC total scores when predicting any inpatient aggression.

Table 4 shows the classification accuracy indices of the three measures for inpatient aggression. The measures generally have high negative predictive values, but rather low positive predictive values across the range of cut-off scores. However, the low scores on the measures appear to have fairly high sensitivity indices. Table 5 shows the incremental validity for the DASA total score and clinical rating when used together. It was noted that the DASA clinical rating did not add incremental validity when used with the DASA total score to predict interpersonal violence. Moreover, the incremental validity was also mediocre when the DASA clinical rating was used with DASA total score to predict verbal threat.

Table 4. Classification accuracy indices of the cut-off scores for the BVC, DASA, and HCR-20 Clinical scale.

Cut-off ScoreAny inpatient aggressionInterpersonal violenceVerbal threat
PPVNPVSens.Spec.dPPVNPVSens.Spec.dPPVNPVSens.Spec.d
BVC
1.08.99.67.80.39.051.00.79.80.29.07.99.68.80.38
2.14.99.53.91.48.091.00.69.91.32.11.99.52.91.49
3.19.98.38.96.62.12.99.52.95.48.15.99.37.95.63
4.21.98.24.98.76.13.99.33.97.67.13.98.22.97.78
5.20.98.12.99.88.12.99.12.99.88.19.98.14.99.86
6.03.97.03.97.97.20.99.071.00.93.13.98.031.00.97
DASA
1.04.99.87.42.59.021.00.93.42.58.03.99.86.42.60
2.05.99.77.59.47.021.00.86.59.43.04.99.78.59.47
3.06.99.73.69.41.031.00.83.69.35.05.99.75.69.40
4.07.99.69.76.39.041.00.81.76.31.06.99.70.76.38
5.08.99.61.76.43.051.00.76.82.30.07.99.60.82.44
6.12.98.46.91.55.07.99.57.91.44.10.99.48.91.53
7.15.98.23.96.77.08.99.26.96.74.13.98.25.96.75
HCR-20 Clinical scale
1.03.99.93.18.82.011.00.98.18.82.02.99.92.18.82
2.03.99.87.29.72.021.00.95.29.71.03.99.85.29.73
3.04.99.82.41.62.021.00.88.41.60.03.99.82.41.62
4.04.99.73.52.55.021.00.81.52.52.03.99.74.52.55
5.04.98.61.64.53.02.99.67.64.49.04.99.63.64.52
6.05.98.51.76.55.03.99.57.76.49.05.99.55.76.51
7.05.98.51.82.66.03.99.36.84.66.05.98.38.85.64
8.05.98.26.88.75.03.99.24.90.77.06.98.27.90.74
9.07.98.13.95.87.03.99.12.95.88.07.98.15.95.85
10.06.97.04.98.96.03.99.05.98.95.05.98.04.98.96

Table 5. Incremental validity of DASA total score and clinical rating for interpersonal violence and verbal threat.

PredictorsBSEWaldpExp(B)95% CIΔR2
Interpersonal violence
Step 1
 Total Score0.57.0854.66<.0011.771.52–2.05
 Clinical Rating1.26.2041.85<.0013.532.41–5.16
Step 2
 Total Score(1) – Clinical Rating(2)(1)0.52.0931.16<.0011.681.40–2.01
(2)0.25.260.95ns1.290.77–2.15<.01
Clinical Rating(1) − Total Score(2)(1)0.25.260.95ns1.290.77–2.15
(2)
0.52.0931.16<.0011.681.40–2.01.08
Verbal threat
Step 1
 Total Score0.46.0574.60<.0011.581.42–1.75
 Clinical Rating1.43.1589.11<.0014.173.10–5.61
Step 2
 Total Score(1) – Clinical Rating(2)(1)0.28.0715.63<.0011.331.15–1.53
(2)0.79.2212.76<.0012.191.43–3.38.02
 Clinical Rating(1) − Total Score(2)(1)0.79.2212.76<.0012.191.43–3.38
(2)0.28.0715.63<.0011.331.15–1.53.02

Discussion

This study examined the relationship between three dynamic violence risk assessment measures (i.e. the BVC, the DASA, and the HCR-20 Clinical scale), compared their predictive validity within a forensic acute psychiatric inpatient setting, and tested actuarial vs. SPJ ratings for the DASA. An examination of the items in the BVC, the DASA, and the HCR-20 Clinical scale reveals much similarity; the DASA shares two items with the BVC and two with the HCR-20 Clinical scale. Therefore, it is unsurprising that the three measures' total scores were significantly correlated with each other. It is likely that each measures a similar construct, evidenced by the similarity of each measure's predictive validity (in terms of AUC) for the various types of inpatient aggression. Although the nature of this construct/state remains to be uncovered, emotional dysregulation could play a significant role in the perpetuation of violence in these forensic patients (e.g. Newhill, Eack, & Mulvey, [24]). Notwithstanding that the BVC and the DASA generally performed better than the HCR-20 Clinical scale, the present study showed that all three measures had modest to excellent predictive validity for inpatient aggression during a 24-h follow-up. As such, all could be used confidently to assist staff (e.g. nurses, psychiatrists, psychologists, social workers, and other allied health staff) appraise risk for aggression in inpatient psychiatric hospitals. In fact, for services that already use the HCR-20, it may be beneficial to use the Clinical scale to inform the management of imminent inpatient aggression for consistency and parsimony sake (Daffern, [6]).

Regarding actuarial vs. SPJ ratings, the predictive validity of the DASA actuarial rating for interpersonal violence was significantly better than the DASA SPJ ratings, and the former added more unique variance when used with the latter to predict any inpatient aggression. However, it should be noted that the additional unique variance was relatively modest. The difference in the predictive validity for verbal threats was statistically nonsignificant.

Further to the AUC analyses, a review of traditional indices of test accuracy provides important information on how these three instruments may be used in clinical practice. Across most cut-off scores, the sensitivity of the DASA appears slightly better than that of the BVC and HCR-20 Clinical Scale, particularly for interpersonal violence, but also for verbal threats and any inpatient aggression. The very low scores on the HCR-20 Clinical scale were the exception, although this corresponds with the very low specificity scores for these HCR-20 cut-off scores. The BVC showed high specificity scores for all types of aggression for all cut-off scores; for the HCR-20, the specificity scores were weak when low cut-off scores were employed although they increased, following a linear trend, as higher cut-off scores were used. Sensitivity decreased for all instruments as cut-off scores increased; for all scales, this decrease followed a linear trend.

The low PPVs and high sensitivity values associated with the lower cut-off scores across all instruments suggest that any score above the indicated cut-off is itself relatively poor at confirming imminent inpatient aggression (low PPV) and that further investigation must be undertaken (to eliminate the false positives, which in clinical terms may mean unnecessarily restrictive management). This conclusion is consistent with Fazel and colleagues' ([15]) recent systematic review and meta-analysis of the use of risk assessments instruments to predict violence and antisocial behavior; they had concluded:

Our review suggests that risk assessment tools in their current form can only be used to roughly classify individuals at the group level, and not to safely determine criminal prognosis in an individual case. This approach is mostly used in forensic psychiatry in the UK and other western countries, where they form part of a wider clinical assessment process. (p. 5)

Fazel and colleagues' ([15]) review did not include risk assessment studies using measures designed to appraise risk in psychiatric hospitals. Instruments like the BVC and DASA seem to have stronger predictive accuracy compared with risk assessment instruments designed to predict violence in the community in the medium to long term. Nevertheless, the indices of traditional predictive accuracy reported in this study reinforce Fazel and colleagues' conclusions and suggest structured risk assessments should be used in conjunction with a broader clinical appraisal of the individual's treatment and management needs.

The low PPV and sensitivity is likely due to the fact that this study was conducted in the acute units of a high secure psychiatric setting where high-risk patients could well have been assertively managed by unit staff, rendering the high-risk score inaccurate, when in fact, if the patient had been left alone, they may have behaved aggressively. Though this is an issue with much violence risk assessment research, it is particularly important in inpatient settings where intervention following risk assessment is likely. Further, the low PPVs are likely a consequence of the small number of aggressive episodes in relation to the number of assessments undertaken during the study (2.6%). Finally, it is important to note that each instrument did correctly identify a large proportion of the aggressive incidents (high sensitivity), particularly for low cut-off scores.

Given that the ultimate goal of violence risk assessment is the prevention of violence (Douglas & Kropp, [9]), it is useful for a risk assessment measures to correctly identify patients in a high-risk state, so that hospital staff can quickly investigate and implement biopsychosocial strategies to meet the treatment needs of the individual patient and to prevent violence. An additional important goal is to identify patients who do not pose a risk of violence so that they are not subjected to unnecessarily restrictive interventions. The high specificity scores on all three instruments suggest that the measures are capable of accurately identifying patients who are unlikely to behave aggressively (i.e. high NPV) and who, therefore, do not require extraordinary intervention and who, therefore, can be managed in the least restrictive manner.

Finally, some diagnostic tests employ fixed cut-off scores to provide clinicians with guidance on when to intervene. Focusing on interpersonal violence, because this is the form of aggressive behavior that is of most interest to hospital staff, the present results suggest that acceptable sensitivity and specificity as well as least misclassification can be obtained with a cut-off score of 4/5 for the DASA, 1 for the BVC and 5/6 for the HCR-20 Clinical Scale. Finally, the relatively weak PPV for each instrument suggests that these cut-off scores should be used cautiously. There were certainly occasions when patients were assessed as being 'high-risk' (using these cut-off scores) when they did not proceed to behave aggressively. A high score on any of these instruments should not be used to justify any particular intervention, particularly when it restricts the patient's access to treatment opportunities. These instruments should be used to provide a systematic approach to daily violence risk considerations and to assist staff appraisals.

Limitations and future research

Inter-rater reliability indices were not obtained for the various measures in this study and this limitation should be addressed in future research. Moreover, we must caution that our sample is relatively small, even though the number of ratings was substantial. We recognized that the sample comprised a small portion of females, but it was not possible to separate the female subgroup for analyses given the small numbers. Future research could address this issue. An additional limitation is that each assessment was considered a separate unit of analysis. This was justified on the basis that patients' mental state changes rapidly within the context of acute symptomatology and environmental (hospital) demands. It must be noted, however, that the daily assessments are not purely discrete (i.e. a patient's behavior on one day may be affected by their experiences on previous days). Replication of this study with larger samples that allow for multi-level modeling analysis will give more confidence to these findings and the generalizability of these results.

Finally, like much violence risk assessment research, the predictive validity of the three measures may have been artificially lowered by hospital staff's identification and diffusion of instances of potentially violent behavior in high-risk state individuals via psychological (e.g. counseling or relaxation), biological (e.g. medication), and/or social (e.g. social or sporting activities) interventions. As part of the hospital's standard operating procedures, these strategies were likely to have reduced the frequency of the inpatient aggression that were exhibited by the participants; therefore, attenuating the predictive accuracy of the risk assessment instruments. Notwithstanding the authors' instructions, the nursing staff might have reacted to the risk assessment ratings and had subsequently implemented some of these strategies to prevent the occurrence of aggressive incidents. Future research should examine the predictive validity of these dynamic measures across gender and age, and with different (e.g. youth, elderly, and nonWestern) samples and in different settings (e.g. civil psychiatric). In addition, we must also identify the core features of the construct/state that contributes to violent behavior in these forensic patients and also whether there are important differences in these features across gender.

Conclusion

Overall, these findings reveal the predictive validity of the DASA, BVC, and HCR-20 Clinical Scale, thereby providing support for their use to assist identification of patients at risk of imminent aggression within forensic psychiatric inpatient settings. The instruments tested here are quick and easy to use; they provide staff with important information about each patient's risk state and propensity for aggression within the coming 24 h, allowing staff to implement biopsychosocial interventions and preventive strategies to avert aggression and to make decisions about care and management that are informed by violence risk state.

Declaration of interest

None.

Notes Footnotes 1 1. In a similar training session conducted for institutional staff, the inter-reliability for the DASA ratings appeared to be high (intraclass correlation coefficient =.91); specifically, the staff rated a series of case vignettes that included mostly behavioral observations (Chu, Daffern, Hoo, & Tan, [4]). References Almvik, R., Woods, P. and Rasmussen, K.2000. The brøset violent checklist: Sensitivity, specificity, and interrater reliability. Journal of Interpersonal Violence, 15: 1284–1296. 2 Barry-Walsh, J., Daffern, M., Duncan, S. and Ogloff, J.R.P.2009. A test of the dynamic appraisal of situational aggression in a NZ forensic psychiatric service. Australasian Psychiatry, 17: 493–496. 3 Benjamini, Y. and Hochberg, Y.1995. Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Methodological), 57: 289–300. 4 Chu, C.M., Hoo, E., Daffern, M. and Tan, J.2012. Assessing imminent risk of aggression in institutionalized youth offenders with the dynamic appraisal of situational aggression. Journal of Forensic Psychiatry and Psychology, 23: 168–183. 5 Chu, C.M., Thomas, S.D.M., Ogloff, J.R.P., & Daffern, D. (in press). The short- to medium-term predictive accuracy of static and dynamic risk assessment measures in a secure forensic hospital. Assessment. doi: 10.1177/1073191111418298. 6 Daffern, D.2007. The predictive validity and practical utility of structured schemes used to assess risk for aggression in psychiatric inpatient settings. Aggression and Violent Behavior, 12: 116–130. 7 Desmarais, S.L., Nicholls, T.L., Read, J.D. and Brink, J.2010. Confidence and accuracy in assessments of short-term risks presented by forensic psychiatric patients. Journal of Forensic Psychiatry and Psychology, 21: 1–22. 8 Douglas, K.S., Guy, L.S. and Hart, S.D.2009. Psychosis as a risk factor for violence to others: A meta-analysis. Psychological Bulletin, 135: 679–706. 9 Douglas, K.S. and Kropp, P.R.2002. A prevention-based paradigm for violence risk assessment: Clinical and research applications. Criminal Justice and Behavior, 29: 617–658. Douglas, K.S., Ogloff, J.R.P., Nicholls, T.L. and Grant, I.1999. Assessing risk for violence among psychiatric patients: The HCR-20 violence risk assessment scheme and the psychopathy checklist: Screening version. Journal of Consulting and Clinical Psychology, 67: 917–930. Douglas, K.S. and Reeves, K.A.2010. "Historical-Clinical-Risk Management -20 (HCR-20) violence risk assessment scheme: Rationale, application, and empirical overview". In Handbook of violence risk assessment, Edited by: Otto, R.K. and Douglas, K.S.147–185. New York, NY: Taylor and Francis Group. Douglas, K.S. and Skeem, J.L.2005. Violence risk assessment: Getting specific about dynamic. Psychology, Public Policy and Law, 11: 347–383. Douglas, K.S. and Webster, C.D.1999. "Predicting violence in mentally and personality disordered individuals". In Psychology and law: The state of the discipline, Edited by: Roesch, R., Hart, S.D. and Ogloff, J.R.P.175–239. New York, NY: Plenum. Fazel, S., Långström, N., Hjern, A., Grann, M. and Lichtenstein, P.2009. Schizophrenia, substance abuse and violent crime. Journal of the American Medical Association, 301: 2016–2023. Fazel, S., Singh, J.P., Doll, H. and Grann, M.2012. Use of risk assessment instruments to predict violence and antisocial behavior in 73 samples involving 24827 people: Systematic review and meta analysis. British Medical Journal, 345: e4692 Guy L.S. (2008). Performance indicators of the structured professional judgment approach for assessing risk for violence to others: A meta-analytic survey (Unpublished dissertation) Simon Fraser University, Burnaby, British Columbia, Canada. Hanley, J.A. and McNeil, B.J.1983. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology, 148: 839–843. Heilbrun, K.1997. Prediction versus management models relevant to risk assessment: Importance of legal decision-making context. Law and Human Behavior, 21: 347–359. Heilbrun, K., Yasuhara, K. and Shah, S.2010. "Violence risk assessment tools: Overview and critical analysis". In Handbook of violence risk assessment, Edited by: Otto, R.K. and Douglas, K.S.1–17. New York, NY: Routledge. Hosmer, D.W. and Lemeshow, S.2000. Applied logistic regression, 2nd ed., New York, NY: Wiley Interscience. McNiel, D. and Binder, R.1994. Screening for risk of inpatient violence: Validation of actuarial tool. Law and Human Behavior, 18: 579–586. McNiel, D.E., Gregory, A.L., Lam, J.N., Binder, R.L. and Sullivan, G.R.2003. Utility of decision support tools for assessing acute risk of violence. Journal of Consulting and Clinical Psychology, 71: 945–953. Mullen, P.E. (2000). Dangerousness, risk, and the prediction of probability. In M.G. Gelder, J.J. Lopez-Ibor, & N. Andreasen (Eds.), New Oxford textbook of psychiatry (Vol. 2) (pp. 2066–2078). Oxford: Oxford University Press. Newhill, C.E., Eack, S.M. and Mulvey, E.P.2012. A growth curve analysis of emotion dysregulation as a mediator for violence in individuals with and without borderline personality disorder. Journal of Personality Disorders, 26: 452–467. Nicholls, T.L., Ogloff, J.R.P. and Douglas, K.S.2004. Assessing risk of violence among male and female civil psychiatric patients: The HCR-20, PCL:SV, and VSC. Behavioral Sciences and Law, 22: 127–158. Ogloff, J. and Daffern, M.2002. Dynamic appraisal of situational aggression: Inpatient version, Melbourne: Monash University and Forensicare. Ogloff, J.R.P. and Daffern, M.2006. The dynamic appraisal of situational aggression: An instrument to assess risk of inpatient aggression in psychiatric inpatients. Behavioral Sciences and Law, 24: 799–813. Quinsey, V.L., Harris, G.T., Rice, M.E. and Cormier, C.A.1998. Violent offenders: Appraising and managing risk, Washington, DC: American Psychological Association. Quinsey, V.L., Harris, G.T., Rice, M.E. and Cormier, C.A.2006. Violent offenders: Appraising and managing risk, 2nd ed., Washington, DC: American Psychological Association. Skeem, J.L., Schubert, C., Odgers, C., Mulvey, E.P., Gardner, W. and Lidz, C.2006. Psychiatric symptoms and community violence among high-risk patients: A test of the relationship at the weekly level. Journal of Consulting and Clinical Psychology, 74: 967–979. Steadman, H.J., Mulvey, E.P., Monahan, J., Robbins, P.C., Appelbaum, P.S., Grisso, T., ... and Silver, H.1998. Violence by people discharged from acute psychiatric inpatient facilities and by others in the same neighborhoods. Archives of General Psychiatry, 55: 393–401. Swanson, J.W., Swartz, M.S., van Dorn, R.A., Elbogen, E.B., Wagner, H.R., Rosenheck, R.A., ... and Lieberman, J.A.2006. A national study of violent behavior in persons with schizophrenia. Archives of General Psychiatry, 63: 490–499. Webster, C.D., Douglas, K.S., Belfrage, H. and Link, B.2000. "Capturing change: An approach to managing violence and improving mental health". In Violence among the mentally ill, Edited by: Hodgins, S. and Müller-Isberner, R.119–144. Dordrecht: Kluwer/Academic. Webster, C.D., Douglas, K.S., Eaves, D. and Hart, S.D.1997. HCR-20: Assessing risk of violence (Version 2), Burnaby: Mental Health, Law and Policy Institute, & Simon Fraser University. Yudofsky, S.M., Silver, J.M., Jackson, W., Endicott, J. and Williams, D.1986. The overt aggression scale for the objective rating of verbal and physical aggression. American Journal of Psychiatry, 143: 35–39.

By Chi Meng Chu; Michael Daffern and James R.P. Ogloff

Reported by Author; Author; Author

Titel:
Predicting aggression in acute inpatient psychiatric setting using BVC, DASA, and HCR-20 Clinical scale
Autor/in / Beteiligte Person: CHI MENG, CHU ; DAFFERN, Michael ; OGLOFF, James R. P
Link:
Zeitschrift: The Journal of forensic psychiatry & psychology (Print), Jg. 24 (2013), Heft 2, S. 269-285
Veröffentlichung: Colchester: Taylor & Francis, 2013
Medientyp: academicJournal
Umfang: print; 17; 2 p
ISSN: 1478-9949 (print)
Schlagwort:
  • Trouble du comportement social
  • Social behavior disorder
  • Trastorno comportamiento social
  • Agression
  • Aggression
  • Agresión
  • Aigu
  • Acute
  • Agudo
  • Délinquance
  • Delinquency
  • Delincuencia
  • Facteur risque
  • Risk factor
  • Factor riesgo
  • Homme
  • Human
  • Hombre
  • Jugement
  • Judgment
  • Juicio
  • Psychométrie
  • Psychometrics
  • Psicometría
  • Sexe
  • Sex
  • Sexo
  • Trouble psychiatrique
  • Mental disorder
  • Trastorno psiquiátrico
  • Violence
  • Violencia
  • Evaluation du risque
  • Genre
  • Gender
  • Género
  • actuarial
  • forensic psychiatric patients
  • gender
  • mental illness
  • structured professional judgment
  • violence risk assessment
  • Sciences biologiques et medicales
  • Biological and medical sciences
  • Sciences medicales
  • Medical sciences
  • Psychopathologie. Psychiatrie
  • Psychopathology. Psychiatry
  • Techniques et méthodes
  • Techniques and methods
  • Psychométrie. Systèmes d'aide au diagnostic
  • Psychometrics. Diagnostic aid systems
  • Etude clinique de l'adulte et de l'adolescent
  • Adult and adolescent clinical studies
  • Troubles du comportement social. Comportement criminel. Délinquance
  • Social behavior disorders. Criminal behavior. Delinquency
  • Psychiatrie médicolégale
  • Forensic psychiatry
  • Psychologie. Psychanalyse. Psychiatrie
  • Psychology. Psychoanalysis. Psychiatry
  • PSYCHOPATHOLOGIE. PSYCHIATRIE
  • Psychology, psychopathology, psychiatry
  • Psychologie, psychopathologie, psychiatrie
Sonstiges:
  • Nachgewiesen in: FRANCIS Archive
  • Sprachen: English
  • Original Material: INIST-CNRS
  • Document Type: Article
  • File Description: text
  • Language: English
  • Author Affiliations: Clinical and Forensic Psychology Branch, Ministry of Social and Family Development, Singapore, Singapore ; Centre for Forensic Behavioural Science, Monash University, Melbourne, Australia ; Victorian Institute of Forensic Mental Health, Melbourne, Australia
  • Rights: Copyright 2015 INIST-CNRS ; CC BY 4.0 ; Sauf mention contraire ci-dessus, le contenu de cette notice bibliographique peut être utilisé dans le cadre d’une licence CC BY 4.0 Inist-CNRS / Unless otherwise stated above, the content of this bibliographic record may be used under a CC BY 4.0 licence by Inist-CNRS / A menos que se haya señalado antes, el contenido de este registro bibliográfico puede ser utilizado al amparo de una licencia CC BY 4.0 Inist-CNRS

Klicken Sie ein Format an und speichern Sie dann die Daten oder geben Sie eine Empfänger-Adresse ein und lassen Sie sich per Email zusenden.

oder
oder

Wählen Sie das für Sie passende Zitationsformat und kopieren Sie es dann in die Zwischenablage, lassen es sich per Mail zusenden oder speichern es als PDF-Datei.

oder
oder

Bitte prüfen Sie, ob die Zitation formal korrekt ist, bevor Sie sie in einer Arbeit verwenden. Benutzen Sie gegebenenfalls den "Exportieren"-Dialog, wenn Sie ein Literaturverwaltungsprogramm verwenden und die Zitat-Angaben selbst formatieren wollen.

xs 0 - 576
sm 576 - 768
md 768 - 992
lg 992 - 1200
xl 1200 - 1366
xxl 1366 -