Professional Documents
Culture Documents
DOI 10.1007/s10802-012-9614-y
Abstract Analyses of convergent validity and group assignment using self-report, caregiver-report and interview-based
measures of adolescent psychopathy were conducted in a
sample of 160 incarcerated adolescents. Results reveal significant convergent validity between caregiver-report measures
of adolescent psychopathy, significant convergent validity
between self-report measures of adolescent psychopathy and
an interviewer rating scale, but not between the caregiverreport measures and their corresponding self-report measures
nor between the caregiver-report measures and the interviewer
rating scale. Analyses of group assignment were also
poorer than expected among all the measures with none
evidencing significant agreement with the expert-rated
device (Hare Psychopathy Checklist-Youth Version; PCLYV), the most common forensic instrument used in clinical
practice. Part of the poor agreement may be related to the poor
psychometric performance of the callous-unemotional
972
1998, 2003). Moreover, previous studies have shown psychopathic traits in youth are predictive of violent offending in
adulthood (Corrado et al. 2004; Gretton et al. 2004; Vincent et
al. 2008) which suggests the potential utility of the construct
above and beyond the assessment of conduct problems in
understanding aggressive and antisocial youth (Farrington
2005; Frick 2007; Lynam 1997).
Early psychometric studies of adolescent psychopathy
employed a modified version of the PCL-R which omitted
or altered items not applicable to juveniles and found significant associations between the adolescent modified PCLR scores and conduct problems in adolescents (Brandt et al.
1997; Forth et al. 1990; Myers et al. 1995; Rogers et al.
1997). Based on this work, Forth and colleagues developed
a youth version of the Psychopathy Checklist (PCL-YV;
Forth et al. 2003). Like the PCL-R, the PCL-YV is a semistructured interview augmented by file-based review rating
scale, but is developed for use with male and female
offenders aged 12 to 18. The current literature suggests that
the PCL-YV successfully captures adolescent features of the
adult psychopathy construct (Forth and Burke 1998; Kosson
et al. 2002). A review of 19 studies found that like in adults,
scores on the PCL-YV vary as a function of setting with
incarcerated adolescents scoring higher than adolescents on
probation and adolescents on probation scoring higher than
adolescents in the community (Forth et al. 2003).
Early factor analysis of the PCL-YV revealed a twofactor model similar to that found in adults (Harpur et
al. 1989; Neumann et al. 2006), isolating psychopathic
personality features from antisocial behaviors (Frick et
al. 1994). Frick (1995) described this distinction as callousunemotional (CU) behavior versus an impulsive/antisocial
(I/A) behavioral pattern. The initial finding of the twofactor model in adolescents sparked a flurry of research
into the callous-unemotional behavior exhibited by these
youth (Barry et al. 2000; Christian et al. 1997; Dadds et
al. 2005; Jones and Viding 2007). Some of these findings
include youth with callous-unemotional traits exhibiting
worse conduct problems, but not experiencing poorer quality of parenting than youth who exhibit conduct problems
alone (Edens et al. 2008; Wootton et al. 1997). Also, the
conduct problems of youth exhibiting callous-unemotional
traits appear less influenced by environmental factors, such
as low socio-economic status, school and neighborhood
influences (Viding et al. 2005; Viding and Jones 2008),
and have a more stable pattern of severe conduct problems
(Frick et al. 2003, 2005).
Researchers argued, however, that the two-factor model
did not adequately capture the construct of adolescent psychopathy and that three or four-factor models would be more
descriptive and appropriate (Cooke and Michie 2001). Subsequent studies have found that three and four factor models
were, indeed, better fits for adolescent data than the two factor
model (Neumann et al. 2006; Salekin et al. 2006). For example, studies comparing the PCL-YV and a self-report measure
of psychopathy, the Youth Psychopathic traits Inventory (YPI;
Andershed et al. 2002), have reported somewhat conflicting
results. Dolan and Rennie (2006) found that YPI scores correlated with the behavioral factor of the PCL-YV while Skeem
and Cauffman (2003) found that the YPI correlated more
strongly with the interpersonal factor of the PCL-YV. Similarly mixed results have been found in the predictive and
incremental validity of the PCL-YV and the Child Psychopathy Scale (CPS-S; Lynam 1997) and the Antisocial Process
Screening Device - Youth Version (APSD-Y; Frick and Hare
2001; Falkenbach et al. 2003; Murrie and Cornell 2002).
Other investigators have found that PCL-YV scores were
more strongly correlated with a violent offense history than
a caregiver version of the APSD scores (Murrie et al. 2004;
Salekin 2008). In contrast, an examination of a modified form
of the CPS-S, APSD-P and the PCL-YV found that the selfreport measures more strongly related to institutional infractions and the days required to progress in treatment than the
PCL-YV (Spain et al. 2004).
With the increased consideration of psychopathic features
in antisocial youth, debate over the validity of the use of
such a construct with youth has ensued (Hart et al. 2002;
Petrila and Skeem 2003). Some contend that the relative
malleability of the youth personality and the negative consequences of false positive psychopathy classifications in
juvenile courts warrant careful consideration of the construct and the measures used to assess it (Seagrave and
Grisso 2002; Sharp and Kine 2008). For example, Edens
et al. (2001) argue that behaviors such as the need for
stimulation, impulsivity, lack of realistic long-term goals,
and irresponsibility are features of adolescence, itself, and
measurement of them using psychopathy measures could be
inappropriately inflate the presence of these behaviors in
youth with conduct problems. Counter-arguments support
the use of such measures because in doing so, high-risk
youth have the potential to be identified for more intensive
treatment interventions (Forth et al. 2003), thus staving off
negative outcomes, such as substance abuse and continued
criminal behavior, in adulthood. Regardless of the argument
made for or against the use of this construct in youth, close
inspection of the performance of these youth psychopathy
measures is necessary to avoid false-positive identification
and the potential negative outcomes associated with such an
incorrect identification (Frick 2002).
Current Study
Because of conflicting results in the discriminate validity of
these measures, the convergent validity of these assessments
remains in question. Also in question is the convergent
972
1998, 2003). Moreover, previous studies have shown psychopathic traits in youth are predictive of violent offending in
adulthood (Corrado et al. 2004; Gretton et al. 2004; Vincent et
al. 2008) which suggests the potential utility of the construct
above and beyond the assessment of conduct problems in
understanding aggressive and antisocial youth (Farrington
2005; Frick 2007; Lynam 1997).
Early psychometric studies of adolescent psychopathy
employed a modified version of the PCL-R which omitted
or altered items not applicable to juveniles and found significant associations between the adolescent modified PCLR scores and conduct problems in adolescents (Brandt et al.
1997; Forth et al. 1990; Myers et al. 1995; Rogers et al.
1997). Based on this work, Forth and colleagues developed
a youth version of the Psychopathy Checklist (PCL-YV;
Forth et al. 2003). Like the PCL-R, the PCL-YV is a semistructured interview augmented by file-based review rating
scale, but is developed for use with male and female
offenders aged 12 to 18. The current literature suggests that
the PCL-YV successfully captures adolescent features of the
adult psychopathy construct (Forth and Burke 1998; Kosson
et al. 2002). A review of 19 studies found that like in adults,
scores on the PCL-YV vary as a function of setting with
incarcerated adolescents scoring higher than adolescents on
probation and adolescents on probation scoring higher than
adolescents in the community (Forth et al. 2003).
Early factor analysis of the PCL-YV revealed a twofactor model similar to that found in adults (Harpur et
al. 1989; Neumann et al. 2006), isolating psychopathic
personality features from antisocial behaviors (Frick et
al. 1994). Frick (1995) described this distinction as callousunemotional (CU) behavior versus an impulsive/antisocial
(I/A) behavioral pattern. The initial finding of the twofactor model in adolescents sparked a flurry of research
into the callous-unemotional behavior exhibited by these
youth (Barry et al. 2000; Christian et al. 1997; Dadds et
al. 2005; Jones and Viding 2007). Some of these findings
include youth with callous-unemotional traits exhibiting
worse conduct problems, but not experiencing poorer quality of parenting than youth who exhibit conduct problems
alone (Edens et al. 2008; Wootton et al. 1997). Also, the
conduct problems of youth exhibiting callous-unemotional
traits appear less influenced by environmental factors, such
as low socio-economic status, school and neighborhood
influences (Viding et al. 2005; Viding and Jones 2008),
and have a more stable pattern of severe conduct problems
(Frick et al. 2003, 2005).
Researchers argued, however, that the two-factor model
did not adequately capture the construct of adolescent psychopathy and that three or four-factor models would be more
descriptive and appropriate (Cooke and Michie 2001). Subsequent studies have found that three and four factor models
were, indeed, better fits for adolescent data than the two factor
model (Neumann et al. 2006; Salekin et al. 2006). For example, studies comparing the PCL-YV and a self-report measure
of psychopathy, the Youth Psychopathic traits Inventory (YPI;
Andershed et al. 2002), have reported somewhat conflicting
results. Dolan and Rennie (2006) found that YPI scores correlated with the behavioral factor of the PCL-YV while Skeem
and Cauffman (2003) found that the YPI correlated more
strongly with the interpersonal factor of the PCL-YV. Similarly mixed results have been found in the predictive and
incremental validity of the PCL-YV and the Child Psychopathy Scale (CPS-S; Lynam 1997) and the Antisocial Process
Screening Device - Youth Version (APSD-Y; Frick and Hare
2001; Falkenbach et al. 2003; Murrie and Cornell 2002).
Other investigators have found that PCL-YV scores were
more strongly correlated with a violent offense history than
a caregiver version of the APSD scores (Murrie et al. 2004;
Salekin 2008). In contrast, an examination of a modified form
of the CPS-S, APSD-P and the PCL-YV found that the selfreport measures more strongly related to institutional infractions and the days required to progress in treatment than the
PCL-YV (Spain et al. 2004).
With the increased consideration of psychopathic features
in antisocial youth, debate over the validity of the use of
such a construct with youth has ensued (Hart et al. 2002;
Petrila and Skeem 2003). Some contend that the relative
malleability of the youth personality and the negative consequences of false positive psychopathy classifications in
juvenile courts warrant careful consideration of the construct and the measures used to assess it (Seagrave and
Grisso 2002; Sharp and Kine 2008). For example, Edens
et al. (2001) argue that behaviors such as the need for
stimulation, impulsivity, lack of realistic long-term goals,
and irresponsibility are features of adolescence, itself, and
measurement of them using psychopathy measures could be
inappropriately inflate the presence of these behaviors in
youth with conduct problems. Counter-arguments support
the use of such measures because in doing so, high-risk
youth have the potential to be identified for more intensive
treatment interventions (Forth et al. 2003), thus staving off
negative outcomes, such as substance abuse and continued
criminal behavior, in adulthood. Regardless of the argument
made for or against the use of this construct in youth, close
inspection of the performance of these youth psychopathy
measures is necessary to avoid false-positive identification
and the potential negative outcomes associated with such an
incorrect identification (Frick 2002).
Current Study
Because of conflicting results in the discriminate validity of
these measures, the convergent validity of these assessments
remains in question. Also in question is the convergent
Method
Participants
Participants were 190 adolescents (22.5% female) incarcerated at a southwestern US juvenile maximum-security detention facility and were part of a larger functional
neuroimaging study investigating the neurocognition of callous conduct disordered youth (NIMH R01 MH071896).
Participants were incarcerated for crimes that included murder, attempted murder, manslaughter, armed robbery, assault, domestic assault, rape, arson, weapons possession,
burglary, theft, fraud, drug possession/distribution, probation/parole violations and criminal mischief. The mean age
of the sample participants was 17 (SD01.00, range 1419)
years of age at the time of assessment. Thirty adolescent
participants withdrew from the study. Nine of these participants were transferred to another juvenile facility, 17 of
these participants were excluded for fMRI safety reasons
and four stated that they no longer wished to participate
973
974
Assessment Materials
Antisocial Process Screening Device - Youth Version
(APSD-Y) The APSD (Frick and Hare 2001) is a 20item
self-report scale developed to assess behavior in youth ages
nine to 18 that is similar to the adult construct of psychopathy and assessed by the Psychopathic Checklist Revised
(PCL-R; Hare 1991). Each item is scored either 0 (not at
all), 1 (sometimes true), or 2 (definitely true). Factor analyses reveal three dimensions: Narcissism, Impulsivity and
Callous-Unemotional (Frick et al. 2000). The total ASPDY has shown adequate internal consistency reliability of
0.780.81, however, the internal consistency reliability for
the subscales is more moderate, ranging from 0.50 to 0.68
(Munoz and Frick 2007). In the current study, the Cronbach
alpha for the Total scale was 0.75, 0.71 for the Narcissism
subscale, 0.57 for the Impulsivity subscale, but only 0.32 for
the Callous-Unemotional. For scales that yield poor reliability (usually less than 0.70), especially if the scale consists of
fewer than 10 items, it is recommended that mean inter-item
correlation and the range of the values be inspected and
reported (Cortina 1993; Pallant 2007). Values below 0.3
on these indices indicate that the items are not correlating
well with the total scale and that the item may be measuring
something different from the scale as a whole. The interitem correlations for the Impulsivity subscales were below
what is generally considered acceptable (mean 0.21; range
0.02 to 0.38), and the mean inter-item correlation for the
Callous-Unemotional subscale were largely within unacceptable ranges (mean 0.08, range 0.29 to 0.47).
Antisocial Process Screening Device - Parent Version
(APSD-P) The APSD-P (Frick and Hare 2001) is a 20item scale directly translated from the APSD-Y to be completed by a parent or other guardian for youth ages nine to
18. In the current study, the Cronbach alpha for the Total
Scale was 0.89, 0.80 for the Narcissism dimension, 0.65 for
the Impulsivity dimension, and 0.63 for the CallousUnemotional traits dimension. The inter-item correlation
values somewhat low for the Impulsivity and CallousUnemotional dimensions (mean 0.28, range 0.06 to 0.44;
0.23, range 0.02 to 0.55, respectively).
Child Psychopathy Scale - Self-Report Version (CPS-S) The
CPS-S (Lynam 1997) is a 50-item self-report measure adapted for youth ages 12 to 18 to directly assess the 13 of the 20
items measured by the PCL-R (glibness, untruthfulness,
boredom susceptibility, manipulation, lack of guilt, poverty
of affect, callousness, parasitic lifestyle, behavioral dyscontrol, lack of planning, impulsiveness, unreliability, and failure to accept responsibility). Each item is scored 0 (No) or 1
(Yes) and reflect the respondents personal style of doing
things as well as manner in which he or she gets along with
975
Results
Group Classification
Statistical Package for the Social Sciences 16.0 (SPSS) was
used to perform the statistical analyses of the data for this
study. To increase the ecological validity of the study, all
convergent validity and group classification analyses were
conducted on the published subscales of the measures. The
0.45
n037
1. APSD-P
0.68*
n031
0.38
n027
3
0.41
n034
0.78*
n089
0.29
n026
n0100
0.35
n031
0.47*
n0114
n0111
0.16
n032
n031
0.25
n034
0.62*
n0115
0.22
n025
0.67*
0.28
n035
0.62*
n0131
0.21
n027
0.65*
0.74*
n040
0.32
n033
0.65*
n029
0.47
0.15
0.05
0.03
n0121
0.32
0.10
0.02
0.04
0.29
0.10
0.06
0.15
0.21
0.10
0.11
0.00
0.95*
0.14
0.05
0.06
0.00
0.07
0.00
0.06
0.03
0.03
11
0.14
10
0.09
0.27*
n0140
0.35*
n040
n0122
0.04
0.11
n044
0.36*
n0145
0.06
n032
0.44*
5.95
1.56
7.67
22.74
119.64
26.68
29.85
20.69
24.44
15.17
17.64
6.34
2.19
6.74
5.48
21.00
8.40
10.49
7.38
7.56
4.57
7.03
SD
0 data not applicable. APSD-P Antisocial Process Screening Device (Parent Version) (APSD-P; Frick and Hare 2001); APSD-Y Antisocial Process Screening Device (Youth Version) (APSD-Y;
Frick and Hare 2001); CPS-C Child Psychopathy Scale (Caregiver Version) (CPS-C; Lynam 1997); CPS-S Child Psychopathy Scale (Self-report Version) (CPS-S; Lynam 1997); ICU-P Inventory of
Callous-Unemotional Traits (Parent Version) (ICU-P; Frick 2003); ICU-Y Inventory of Callous-Unemotional Traits (Youth Version) (ICU-Y; Frick 2003); PCL-YV Psychopathy Checklist - Youth
Version (PCL-YV; Forth et al. 2003); YPI Youth Psychopathic Traits Inventory (YPI; Andershed et al. 2002). The Bonferroni procedure was used to hold the familywise (FW) Type 1 error rate at
pFW 00.05; the Type 1 error rate per individual test was set at pT 0pFW/2800.0018. pFW is based on the familywise Type 1 error rate; pT is based on the Type 1 error rate per measurement procedure test.
* pFW <0.05; pT <0.0018. Correlation coefficients in bold denote relationship significant at p<0.05
9. Total Convictions
8. PCL-YV
7. YPI
6. ICU-Y
5. ICU-P
4. CPS-S
3. CPS-C
2. APSD-Y
Measure
Table 1 Intercorrelations, means and standard deviation of total scale youth psychopathy assessment measures
976
J Abnorm Child Psychol (2012) 40:971986
0.48*
0.19
0.12
0.53*
0.50*
0.52*
0.51*
0.35*
0.61*
0.43*
0.38*
0.60*
0.45*
0.44*
0.41*
0.36*
0.43*
0.53*
0.21
0.16
0.65*
0.12
0.27
0.12
0.27
0.13
0.15
0.31*
0.42*
0.10
0.04
0.22
0.53*
0.60*
0.34*
0.05
0.51*
0.42*
0.12
0.13
0.54*
0.60*
0.38*
0.48*
0.21
10
0.17
0.27
0.12
0.04
0.03
0.10
0.03
0.21
0.22
0.16
0.08
12
0.55*
0.60*
0.57*
0.33*
0.14
0.39*
0.45*
0.34*
0.40*
0.32*
11
0.37*
0.07
0.18
0.32*
0.23
0.40*
0.10
0.29
0.40*
0.14
0.06
0.45*
13
0.31*
0.45*
0.16
0.28
0.22
0.24
0.15
0.02
0.32*
0.21
0.18
0.26
0.28*
14
0.26
0.52*
0.48*
0.13
0.27
0.25
0.12
0.34*
0.12
0.44*
0.25
0.11
0.28*
0.39*
15
0.15
0.06
0.16
0.20
0.10
0.09
0.00
0.04
0.08
0.06
0.02
0.03
0.06
0.00
0.03
16
0.05
0.03
0.13
0.09
0.04
0.14
0.06
0.09
0.03
0.09
0.09
0.09
0.05
0.12
0.06
17
0.15
0.06
0.13
0.19
0.12
0.13
0.03
0.01
0.10
0.03
0.00
0.07
0.04
0.05
0.02
18
0 data not applicable. CU 0 Callous-Unemotional. The Bonferroni procedure was used to hold the familywise (FW) Type 1 error rate to the same as that for the Total Scale, pFW 00.05; the Type 1
error rate per individual test was set at pT 0pFW/2800.0018. pFW is based on the familywise Type 1 error rate; pT is based on the Type 1 error rate per measurement procedure test. * pFW <0.05; pT <
0.0018. Correlation coefficients in bold denote relationship significant at p<0.05
15. Anti-social
16. Total Convictions
17. Violent Convictions
12. Interpersonal
13. Affective
14. Lifestyle
11. CU
PCL-YV
YPI
9. Grandiosity
10. Impulsivity
ICU-Y
6. Callous
7. Uncaring
8. Unemotional
4. Behavioral
5. CU
APSD-Y
1. Narcissism
2. Impulsivity
3. CU
CPS-S
Measure
Table 2 Intercorrelations of Youth Psychopathy Self-Report and PCL-YV Assessment Measures Subscales/Facets
0.76*
0.56*
0.53*
0.70*
0.46
0.33
0.59*
0.50
0.67*
0.41
0.52*
0.32
0.40
0.34
0.53*
0.43
0.61*
0.43
0.56*
0.50*
0.54*
0.12
0.45
0.34
0.24
0.51*
0.47
0.32
0.27
0.34
0.09
0.24
0.11
0.31
0.21
0.19
0.55*
0.32
0.24
0.05
0.21
0.06
0.10
0.04
0.26
10
0.51*
0.58*
0.29
0.08
0.03
0.16
0.27
0.32
0.07
0.25
11
0.27
0.12
0.17
0.16
0.08
0.03
0.06
0.19
0.06
0.14
0.15
12
0.31*
0.45*
0.16
0.28
0.22
0.08
0.15
0.07
0.26
0.13
0.03
0.14
0.16
14
0.37*
0.07
0.18
0.32*
0.04
0.18
0.15
0.17
0.19
0.18
0.06
0.09
13
0.52*
0.48*
0.26
0.13
0.27
0.25
0.19
0.18
0.00
0.41
0.36
0.32
0.37
0.19
15
0.13
0.09
0.05
0.03
0.04
0.14
0.06
0.31
0.25
0.07
0.24
0.01
0.11
0.15
0.06
17
0.16
0.20
0.15
0.06
0.10
0.09
0.00
0.10
0.09
0.12
0.03
0.09
0.12
0.06
0.05
16
0.13
0.19
0.15
0.06
0.12
0.13
0.03
0.05
0.05
0.07
0.20
0.12
0.09
0.18
0.02
18
0 data not applicable. CU 0 Callous-Unemotional. The Bonferroni procedure was used to hold the familywise (FW) Type 1 error rate to the same as that for the Total Scale, pFW 00.05; the Type 1
error rate per individual test was set at pT 0pFW/2800.0018. pFW is based on the familywise Type 1 error rate; pT is based on the Type 1 error rate per measurement procedure test. * pFW <0.05; pT <
0.0018. Correlation coefficients in bold denote relationship significant at p<0.05
13. Affective
14. Lifestyle
15. Anti-social
PCL-YV
12. Interpersonal
9. Grandiosity
10. Impulsivity
11. CU
ICU-P
6. Callous
7. Uncaring
8. Unemotional
YPI
4. Behavioral
5. CU
APSD-P
1. Narcissism
2. Impulsivity
3. CU
CPS-C
Measure
Table 3 Intercorrelations of youth psychopathy caregiver-report, YPI and PCL-YV assessment measures subscales/facets
978
J Abnorm Child Psychol (2012) 40:971986
0.76*
0.56*
0.53*
0.70*
0.46
0.33
0.59*
0.50
0.67*
0.41
0.61*
0.43
0.43
0.56*
0.50*
0.54*
0.52*
0.32
0.40
0.34
0.53*
0.19
0.12
0.48*
0.02
0.18
0.16
0.10
0.02
0.12
0.20
0.23
0.17
0.23
11
0.05
0.30
0.20
0.07
0.25
0.25
0.25
10
0.26
0.30
0.34
0.27
0.47
0.46
0.33
0.12
0.45
0.34
0.24
0.51*
0.47
0.32
0.50*
0.52*
0.51*
0.53*
0.14
0.40
0.24
0.18
0.25
0.40
0.23
0.20
13
0.61*
0.43*
0.35*
0.17
0.30
0.49
0.35
0.13
0.35
0.46
0.25
12
0.43*
0.53*
0.36*
0.16
0.65*
0.21
0.18
0.21
0.09
0.08
0.13
0.31
0.15
0.11
15
0.38*
0.60*
0.44*
0.41*
0.45*
0.11
0.14
0.06
0.12
0.14
0.33
0.24
0.09
14
0.11
0.27
0.12
0.26
0.15
0.31*
0.13
0.05
0.05
0.17
0.09
0.19
0.27
0.15
0.22
16
0 data not applicable. CU 0 Callous-Unemotional. The Bonferroni procedure was used to hold the familywise (FW) Type 1 error rate to the same as that for the Total Scale, pFW 00.05; the Type 1
error rate per individual test was set at pT 0pFW/2800.0018. pFW is based on the familywise Type 1 error rate; pT is based on the Type 1 error rate per measurement procedure test. * pFW <0.05; pT <
0.0018. Correlation coefficients in bold denote relationship significant at p<0.05
14. Callous
15. Uncaring
16. Unemotional
12. Behavioral
13. CU
ICU-Y
10. Impulsivity
11. CU
CPS-S
9. Narcissism
8. Unemotional
APSD-Y
APSD-P
1. Narcissism
2. Impulsivity
3. CU
CPS-C
4. Behavioral
5. CU
ICU-P
6. Callous
7. Uncaring
Measure
Table 4 Intercorrelations between caregiver-report and corresponding self-report assessment measures subscales
980
Discussion
The current study sought to examine the convergent validity
and extent to which psychopathy self-report, care-giver
report and interview-based assessment procedures agreed
in their classification of offender youth as well as criminal
convictions. The findings of the study generally did not
support the hypothesis that these measures of adolescent
psychopathy would have good convergent validity. Although the self-report measures (APSD-Y, CPS-S, ICU-Y,
and YPI) had good convergent validity with the interviewbased PCL-YV, the caregiver-report versions of these measures were not significantly correlated with their corresponding
self-report versions nor were they significantly correlated with
the PCL-YV. More surprising is that none of the scales were
significantly correlated with the number of total criminal
convictions, violent convictions or nonviolent convictions. It must be noted, however, that the lack of convergent validity between the caregiver-report versions
and the other measure versions may be the result of the
low number of caregiver-report versions included in the
study. Although, the intercorrelations between the caregiverreport measures were significant, such a low response rate
suggests that there may be bias in this group of respondents
ICC
2. APSD-Y
3. CPS-C
ICC
8. PCL-YV
1
0.52
0.54
n017
2
0.57
0.59
n012
1.00*
1.00*
n010
0.73
n07
0.80*
0.81*
n052
0.06
1.00*
n012
0.76*
0.76*
n017
0.48
n011
0.40
n013
0.10
0.66
n011
0.42*
0.75*
n050
0.70
1.00*
1.00*
n018
0.67
0.62*
n017
1.00*
0.41
0.42
n017
0.83*
0.83*
n058
0.46
0.57*
n046
0.41
n016
0.57*
n053
0.39
0.36
n08
0.81*
0.81*
0.04
0.09
n017
0.77*
0.77*
n054
0.33
n033
0.06
0.06
n047
n053
0.08
0.08
n070
n056
n034
0.08
0.08
n064
0.08
0.08
n056
0.32
0.32
n053
n-40
0.17
0.13
n049
0.13
0.03
0.18
n08
0.02
0.00
0.22
n010
0.10
0.11
0.10
n014
0.10
0.10
n043
0.25
0.19
n07
0.12
0.09
0.06
0.22
n013
0.16
0.03
n041
0.24
11
n041
0.20
0.42
n07
0.05
0.05
0.07
0.07
n011
0.17
0.17
n038
0.40
10
0.12
n018
0.32
0.19
n055
0.08
0.00
n08
0.02
0.02
0.10
n012
0.32
0.32
n058
0.11
0.21
0.25
n017
0.03
0.03
n060
0.00
0.22
0.23
n018
0.28
0.29
n060
0.09
0 data not applicable. 0 Kappa Coefficient of Agreement. ICC 0 Intraclass Correlation Coefficient. The Bonferroni procedure was used to hold the familywise (FW) Type 1 error rate at pFW 0
0.05; the Type 1 error rate per individual test was set at pT 0pFW/2800.0018. pFW is based on the familywise Type 1 error rate; pT is based on the Type 1 error rate per measurement procedure test.
* pFW <0.05; pT <0.0018
9. Total Convictions
10. Violent Convictions
ICC
ICC
7. YPI
6. ICU-Y
5. ICU-P
ICC
ICC
4. CPS-S
ICC
ICC
1. APSD-P
Measure
Table 5 Kappa coefficients of agreement and intraclass correlation coefficients between high- and low-psychopathy groups defined by each measurement procedure
ICC
ICC
ICC
ICC
ICC
ICC
ICC
2. APSD-Y
3. CPS-C
4. CPS-S
5. ICU-P
6. ICU-Y
7. YPI
8. PCL-YV
n031
0.32
0.33
n027
n037
0.35
0.36
0.25
0.25
0.23
0.24
n026
0.36*
0.37*
n0117
n034
0.24
0.24
0.29
0.30
n031
0.38
0.39
n029
0.37
0.38
n033
n040
0.65*
0.66*
5
0.10
0.10
0.06
0.06
n032
0.46*
0.46*
n0111
0.04
0.04
n027
0.42*
0.42*
n0131
n035
0.33
0.34*
n0114
0.24
0.25
n031
0.34*
0.35*
n0100
0.08
0.08
n025
0.56*
0.57*
n0115
n034
0.02
0.02
7
0.14
0.14
n0150
n0151
n0150
0.06
0.06
n0116
0.07
0.07
n0131
0.03
0.03
0.06
0.08
n035
0.04
0.05
n0115
n028
0.02
0.02
0.04
0.05
n0136
n039
0.01
0.02
11
0.21
0.22
n0116
0.12
0.13
n0132
0.04
0.04
0.11
0.13
n035
0.03
0.03
n0116
0.14
0.14
n028
0.00
0.00
n0137
n039
0.07
0.09
10
0.08
0.08
n0116
n0121
0.09
0.09
n0131
0.03
0.03
0.00
0.00
n035
0.04
0.04
n0115
0.06
0.06
n028
0.05
0.05
n036
n039
0.07
0.07
0.11
0.11
n0140
0.26
0.26
0.06
0.06
n040
0.16
0.15
n0122
0.19
0.19
n032
0.16
0.16
n0145
n044
0 data not applicable. 0 Kappa Coefficient of Agreement. ICC 0 Intraclass Correlation Coefficient. The Bonferroni procedure was used to hold the familywise (FW) Type 1 error rate at pFW 0
0.05; the Type 1 error rate per individual test was set at pT 0pFW/2800.0018. pFW is based on the familywise Type 1 error rate; pT is based on the Type 1 error rate per measurement procedure test.
* pFW <0.05; pT <0.0018
9. Total
Convictions
10. Violent
Convictions
11. Nonviolent
Convictions
ICC
1. APSD-P
Measure
Table 6 Kappa coefficients of agreement and intraclass correlation coefficients between median-split low- and high- psychopathy groups defined by each measurement procedure
982
J Abnorm Child Psychol (2012) 40:971986
983
were significantly correlated with the PCL-YV, an instrument of different methodology. Secondly, the PCL-YV was
conducted at a different setting which is a procedural
strength guarding against common method variance
(Podsakoff et al. 2003; Reio 2010). Lastly, common method
variance is of greatest concern when the same method is
used to measure different traits. This is not the case in
this study and instruments measuring the same construct
should be correlated.
Although, there may be several reasons for the lack of
convergent validity and group classification agreement
between the various methods assessing adolescent psychopathy, the lack of convergent validity and group classification
agreement between the various measures and criminal convictions remains distressing, however. One possible explanation is that there may be restricted range in criminal conviction
data because this is an incarcerated sample. The restricted
range in criminal conviction data may obfuscate the relationship with the assessment methods. Regardless of the reasons
for the lack of convergent validity or group agreement, this
finding is important when considering the forensic utility
of these instruments for future placement or adjudication
of these youth.
Study Limitations
Several limitations of this study should be considered in
evaluating the generalizability of these findings. The first
limitation is the low number of caregiver-report measures
that were obtained from parents or caregivers in this study.
Although a greater range of these measures would certainly
have improved agreement, our study highlights a potential
difficulty with using caregiver-report measures of psychopathy (or other caregiver-report measures of disruptive
behavior) with incarcerated youth simply from a pragmatic
perspective. As discussed above, measuring psychopathy
by caregiver-report in an incarcerated sample is an unrealistic method given the level of distress in many of these
families.
A second factor affecting the generalizability of the findings is poor psychometric performance of the callousunemotional subscales. The internal consistency of the
callous-unemotional traits subscales of the self-report and
caregiver-report measures, except the YPI, were below commonly accepted levels (e.g., below 0.70; Pallant 2007). In
addition, inspections of corrected item-total correlations
were low (e.g., less than 0.30; Pallant 2007) suggesting that
many of the items of these subscales are measuring something different from the scale as a whole, warranting the
consideration of further refinement of the measurement of
callous-unemotional traits. It is possible that these subscales
tapped other psychopathology exhibited by these youth and
future studies should investigate other psychopathologies
984
References
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/
adolescent behavioral and emotional problems: implications of
985
and retrospective validity of self-reported delinquency. Criminal
Behaviour and Mental Health, 13, 179197.
Jones, A. P., & Viding, E. (2007). Psychopathic traits in young children. Netherlands Journal of Psychology, 63, 117125.
Kamphaus, R. W., & Frick, P. J. (2002). Clinical assessment of child
and adolescent personality and behavior (2nd ed.). Boston: Allyn
and Bacon.
Kimonis, E. R., Frick, P. J., Munoz, L. C., & Aucoin, K. J. (2008).
Callous-unemotional traits and the emotional processing of distress cues in detained boys: testing the moderating role of aggression, exposure to community violence, and histories of abuse.
Development and Psychopathy, 20, 569589.
Kimonis, E. R., Frick, P. J., Skeem, J. L., Marsee, M. A., Cruise, K.,
Munoz, L. C., et al. (2008). Assessing callous-unemotional traits
in adolescent offenders: validation of the inventory of callousunemotional traits. International Journal of Law and Psychiatry,
31, 241252.
Kosson, D. S., Cyterski, T. D., Steuerwald, B. L., Neumann, C. S., &
Walker-Matthews, S. (2002). The reliability and validity of the
Psychopathy Checklist: Youth Version (PCL:YV) in nonincarcerated adolescent males. Psychological Assessment, 14, 97109.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer
agreement for categorical data. Biometrics, 33, 159174.
Loney, B. R., Frick, P. J., Clements, C. B., Ellis, M. L., & Kerlin, K.
(2003). Callous-unemotional traits, impulsivity, and emotional
processing in adolescents with antisocial behavior problems.
Journal of Clinical Child and Adolescent Psychology, 32, 6680.
Lynam, D. R. (1997). Pursuing the psychopath: capturing the fledgling
psychopath in a nomological net. Journal of Abnormal Psychology, 106, 425438.
Munoz, L. C., & Frick, P. J. (2007). The reliability, stability, and
predictive utility of the self-report version of the Antisocial Process Screening Device. Scandinavian Journal of Psychology, 48,
299312.
Murrie, D. C., & Cornell, D. G. (2002). Psychopathy screening of
incarcerated juveniles: a comparison of measures. Psychological
Assessment, 14, 390396.
Murrie, D. C., Cornell, D. G., Kaplan, S., McConville, D., & Levy-Elkon,
A. (2004). Psychopathy scores and violence among juvenile
offenders: a multi-measure study. Behavioral Sciences & the Law,
22, 4967.
Myers, W. C., Burket, R. C., & Harris, H. E. (1995). Adolescent
psychopathy in relation to delinquent behaviors, conduct disorder,
and personality disorders. Journal of Forensic Sciences, 40, 435
439.
Neumann, C. S., Kosson, D. S., Forth, A. E., & Hare, R. D. (2006).
Factor structure of the Hare Psychopathy Checklist: Youth Version
(PCL:YV) in incarcerated adolescents. Psychological Assessment,
18, 142154.
Pallant, J. (2007). SPSS survival manual (3rd ed.). Berkshire: Open
University Press.
Peat, J. (2001). Health science research: A handbook of quantitative
methods. Sydney: Allen and Unwin.
Petrila, J., & Skeem, J. L. (2003). An introduction to the special issues
on juvenile psychopathy and some reflections on the current
debate: juvenile psychopathy: the debate. Behavioral Sciences
and the Law, 21, 689694.
Podsakoff, P. M., MacKenzie, S. B., Lee, J., & Podsakoff, N. P. (2003).
Common method biases in behavioral research: A critical review
of the literature and recommended remedies. Journal of Applied
Psychology, 88, 879903.
Reio, T. G. (2010). The threat of common method variance bias to
theory building. Human Resource Development Review, 9, 405
411.
Rogers, R., Johansen, J., Chang, J. J., & Salekin, R. T. (1997). Predictors of adolescent psychopathy: oppositional and conduct-
986
disordered symptoms. Journal of the American Academy of Psychiatry and the Law, 25, 261271.
Salekin, R. T. (2008). Psychopathy and recidivism from midadolescence to young adulthood: cumulating legal problems and
limiting life opportunities. Journal of Abnormal Psychology, 117,
386395.
Salekin, R. T., Brannen, D. N., Zalot, A. A., Leistico, A., & Neumann.
(2006). Psychopathy in youth: testing the applicability of the new
four-factor model. Criminal Justice and Behavior, 33, 135157.
Seagrave, D., & Grisso, T. (2002). Adolescent development and the
measurement of juvenile psychopathy. Law and Human Behavior,
26, 219239.
Sharp, C., & Kine, S. (2008). The assessment of juvenile psychopathy:
strengths and weaknesses of currently used questionnaire measures. Child and Adolescent Mental Health, 13, 8595.
Skeem, J. L., & Cauffman, E. (2003). Views of the downward extension: comparing the youth version of the psychopathy checklist
with the youth psychopathic traits inventory. Behavioral Sciences
& the Law, 21, 737770.
Spain, S. E., Douglas, K. S., Poythress, N. G., & Epstein, M. (2004). The
relationship between psychopathic features, violence and treatment
outcome: the comparison of three youth measures of psychopathic
features. Behavioral Sciences & the Law, 22, 85102.