Professional Documents
Culture Documents
The purpose of this study is to demonstrate adolescent children from four grade levels.
the application of confirmatory factor analysis These data were collected to test Shavelson's
(CFA) in testing first and higher order factor model of self-concept (Shavelson & Bolus,
models and their invariance across indepen- 1982; Shavelson et al., 1976). The model
dent groups. These analyses were performed provides a theoretical definition of self-con-
within the LISREL (linear structural relations) cept, a plausible set of self-concept facets
framework developed by Joreskog and Sor- (based on a review of empirical and theoretical
bom (Joreskog, 1969, 1970, 1971, 1981; Jo- research), and a hierarchical model describing
reskog & Sorbom, 1983). LISREL is a statistical how these facets are arranged. For our pur-
tool for analyzing covariance matrices ac- poses, the most important aspects of Shavel-
cording to systems of structural equations. A son's model are that self-concept is multidi-
number of introductory level descriptions of mensional, that the different facets are hier-
the LISREL analytic paradigm (Bagozzi, 1980; archically arranged, and that the facets of
Bentler, 1980; Long, 1983a, 1983b; Maruy- self-concept become more distinct with age.
ama & McGarvey, 1980) are available. A The self-concept dimensions, as well as their
convenient compendium of previously pub- hypothesized structure, proposed in Shavel-
lished articles by Joreskog and Sorbom is son's model are heuristic and plausible, but
also available (Joreskog & Sorbom, 1979). they have not been empirically demonstrated.
Despite the assumption of multidimension-
Substantive Issues and Data Base ality of self-concept which is explicit in the
In the present example, the data represent Shavelson model and implicit in much re-
multidimensional self-concept ratings by pre- search, factor analyses of responses to the
most commonly used instruments typically
The authors gratefully acknowledge the assistance of fail to identify a consistent and theoretically
Bengt Muthan in the parameterization of LISREL models. defensible factor structure. Some researchers
They also acknowledge the helpful comments of three in self-concept argue that self-concept is so
anonymous reviewers. heavily dominated by a general factor that
Requests for reprints should be sent to Dr. Dennis
Hocevar, School of Education, Psychology and Technology, different factors of self-concept cannot be
University of Southern California, Los Angeles, California differentiated (an issue similar to the debate
90089-031. about the large general factor in cognitive
562
CONFIRMATORY FACTOR ANALYSIS 563
ability research). The strongest support for the General School factor and the other aca-
the Shavelson model has come from research demic dimensions and among the nonaca-
conducted with the Self-Description Ques- demic dimensions. Despite the similarity in
tionnaire (SDQ; Marsh, Parker, & Smith, this pattern of correlations for different age
1983; Marsh, Relich, & Smith, 1983; Marsh, groups, the size of the average correlation
Smith, & Barnes, 1983; Marsh, Smith, Barnes, among the factors declined as age increased.
& Butler, 1983). The SDQ is designed to The median correlation among the factors
measure four nonacademic aspects—Physical was larger for the younger children (.27 in
Ability, Physical Appearance, Relations with Grade 2 and .19 in Grade 3) than that for
Peers, Relations with Parents—and three ac- the older children (.18 in Grade 4 and .14 in
ademic aspects—Reading, Mathematics, and Grade 5) even though the internal consisten-
General School—of self-concept. cies for the factors were somewhat higher for
The data base for the present application the older children. Taken together, these find-
is a study conducted by Marsh, Barnes, ings support the following conclusions: First,
Cairns, and Tidman (1984). These authors self-concept factors derived from the Shavel-
examined the factor structure of the SDQ I son model were identified at each of the four
separately for 658 children in Grades 2, 3, 4 grade levels. Second, the self-concept factors,
and 5 in Sydney, Australia. The present study judging from the correlations among the fac-
is based on 56 SDQ items in which students tors, appeared to become more distinct with
respond to a statement (e.g., I am good at age. Third, the correlations among the differ-
sports) on a five-point scale varying from ent factors suggested a hierarchical ordering
false to true. Readers are referred to the among the self-concept dimensions.
original study for a more detailed account of
the methodology. For purposes of their anal-
ysis, Marsh et al. represented each of the LISREL Approach to CFA
seven SDQ factors by four variables, each
being the total response to two items designed Although Marsh et al.'s (1984) conclusions
to measure the same SDQ dimension. Thus, are intuitively reasonable, the application of
their analysis involved a total of 28 subscales. LISREL (Joreskog, 1969, 1971; Joreskog &
Means and standard deviations for the 28 Sorbom, 1983) allows a more rigorous test
subscales are given in Table A1 of Appendix of hypotheses derived from the Shavelson
A. Subscales are ordered and segregated in model. Briefly, the LISREL framework involves
terms of the seven SDQ factors (Physical two conceptually distinct models. First, a
Ability, Physical Appearance, and so on). measurement model that relates observed
Interscale correlations for each of the four (i.e., measured) variables to unmeasured con-
grade levels are given in Table A2 of Appendix structs (i.e., factors) is specified and estimated.
A. Of interest here are the results that Marsh Second, a linear structural equation model
et al. (1984) reported for factor analyses that relates unobserved (i.e., latent) variables
performed separately for responses by chil- to each other is specified and estimated.
dren from each of the four grade levels. The LISREL fits the observed covariance matrix to
general pattern of results identified the seven the structure implied by these two models
hypothesized SDQ factors at each grade level. and provides indexes of how well the re-
Factor loadings for each variable were consis- searcher's hypothesized model fits the data.
tently high on the factor which it was designed Thus, alternative a priori theoretical models
to measure and low on other factors. The can be subjectively and statistically compared
factors were particularly well defined for in a systematic fashion. The advantages of
Grades 4 and 5, whereas the separation among LISREL in testing first-order factor models are
the various academic factors was less clear well known, and numerous applications have
for Grades 2 and 3. The pattern of correlations been published. Thus, first-order confirmatory
among the seven oblique factors offered sup- factor analysis is not the major focus of the
port for higher order hypotheses from the present expository analyses. Rather, we focus
Shavelson model. At each grade level, the on the analyses of higher order factor models
highest correlations tended to occur between and first- and higher order factorial invariance.
564 HERBERT W. MARSH AND DENNIS HOCEVAR
There are a variety of procedures available (Cattell & Baggaley, 1960; Kaiser, Hunka, &
that can be classified under this rubric (Ah- Bianchini, 1971; Wrigley & Newhouse, 1955).
mavaara, 1954; Brokken, 1983; Browne & For comparative reviews of these indexes, see
Kristof, 1969; Cliff, 1966; Meredith, 1964; Cattell (1978, pp. 251-270), Gorsuch (1974,
Mulaik, 1972; Please, 1973; Taylor, 1967). pp. 253-257), Harman (1967, pp. 269-271),
Concrete examples of these techniques are Levine (1977, pp. 42-53), Pinneau and New-
rare, possibly due to their inherent complexity house (1964), and Rummel (1970, 449-463).
and to the general lack of widely available Generally, factor comparison indexes are
software that can be used to carry out the concerned with quantifying and assessing the
analyses. Short reviews of these techniques similarity between the pattern and magnitude
are available (Levine, 1977, pp. 48-52; and loadings obtained from two or more indepen-
Rummel, 1970, pp. 463-471). It is important dent factor analyses.
to note that one or more of these techniques Joreskog and Sorbom's confirmatory factor
have been or can be criticized because: (a) analytic approach to factorial invariance has
congruent fits have been found with random several advantages over the more widely use
numbers (Nesselroade & Baltes, 1970); (b) exploratory factor analytic (EFA) techniques.
factor patterns that maximize congruency are First, EFA is typically conducted with corre-
not necessarily the most meaningful in a lation matrices, which makes comparing
substantive sense; (c) standardization across the parameters across samples problematic,
samples is required; (d) different sources of whereas CFA is performed on covariance
invariance are confounded, particularly in- matrices. Second, CFA provides a chi-square
variance in the factor pattern and invariance test and goodness-of-fit indicators of the abil-
in the factor variances; (e) established signif- ity of the same factor solution to fit data
icance tests are unavailable; and (f) hypothesis from different samples; no such test is avail-
testing is extremely difficult in that the re- able for EFA. Third, CFA allows the re-
searcher cannot define the factors on an a searcher to formulate a specific model and
priori basis. Although Joreskog and Sorbom's test the invariance of specific parameters in
approach (Joreskog, 1971; Joreskog & Sor- the factor solution, whereas the researcher
bom, 1983) effectively deals with all of these has relatively little control over the model to
criticisms, these techniques generally repre- be tested in EFA.
sent important predecessors to Joreskog and
Sorbom's formulations for analyzing factorial LISREL Analysis of CFA Models
invariance.
A second and more widely used approach The results of two sets of LISREL CFA
to factorial invariance involves the compari- analyses are described next. In the first set of
son of exploratory factor analytic results from analyses, we test the ability of hypothesized
two independent analyses. Although these first- and second-order models to fit data
methods are widely used, there is considerable from each of four grade levels. In the second
debate as to their overall usefulness. For set, we perform tests of the invariance of
example, Alwin and Jackson (1981) argued these models across the grade levels. The
that "the use of exploratory factor analysis analysis of first-order factors is an application
in its conventional form to examine issues of of LISREL'S measurement model, whereas the
factorial invariance is of limited utility" (p. analysis of second-order factors is an appli-
253). One method of comparison is to com- cation of LISREL'S structural equation model.
pute factor scores using the two different
factor score regressions and then to correlate First-Order Factor Models
the two sets of scores in a new sample Specification of the basic first-order factor
(Gorsuch, 1970, pp. 251-252). Another model. In LISREL, the specification of the
method determines the degree of similarity first-order factor model is accomplished by
between two studies by quantifying the sim- fixing or constraining elements in three ma-
ilarity between factor pattern matrices and trices that are conceptually similar to those
vectors. For the latter method, several factor resulting from a common factor analysis.
comparison indexes are presently available These are: (a) The factor loading matrix
566 HERBERT W. MARSH AND DENNIS HOCEVAR
that most of the factor loadings in lambda A number of alternative indexes or indi-
are set to be zero, and each measured variable cations of fit have been developed to help
is allowed to load on only one factor. In evaluate LISREL models. The most commonly
common factor analysis, all the parameters used alternative is the ratio of the chi-square
are estimated, but the model is not identified to the degrees of freedom. The degrees of
and unique parameter estimates cannot be freedom for a LISREL problem is the difference
obtained (i.e., the solution is indeterminant). between the number of elements in the co-
Model 1, which is more restrictive than the variance matrix and the number of parame-
common factor analysis solution, represents ters to be estimated. Problems based on a
an ideal simple-structure solution. This sim- large number of variables will tend to have
ple-structure specification is the most widely large chi-square values and many degrees of
used in CFA, but it is not necessary to freedom, so taking a ratio of the two provides
require that each variable load on only one a more meaningful summary. For a given
factor in order for the model to be identified.2 problem (i.e., a given covariance matrix) when
Goodness-of-fit indexes. The LISREL pro- more parameters are estimated, the chi-square
gram provides an overall chi-square goodness- will tend to be smaller, and there will be
of-fit test. In contrast to traditional signifi- fewer degrees of freedom. Here again, the
cance testing, the researcher usually prefers a ratio of the two provides a more meaningful
nonsignificant chi-square. Such a finding in- summary. However, because the degrees of
dicates that the predicted model is congruent freedom for a LISREL problem do not reflect
with the observed data. There are, however, the sample size, the chi-square/degree of free-
problems with this test. First, it is highly dom ratio is as dependent on sample size as
sensitive to departures from multivariate nor- the chi-square statistic itself. Thus, the re-
mality (Joreskog & Sorbom, 1983, pp. 1.39). searcher is still left with the problem of trying
Second, in large, complex problems (i.e., to interpret what ratio represents an adequate
problems in which there are many variables fit. Perhaps as a consequence of this depen-
and degrees of freedom), the observed chi- dency on sample size, different researchers
square will nearly always be statistically sig- have recommended using ratios as low as 2
nificant, even when there is a reasonably or as high as 5 to indicate a reasonable fit.
good fit to the data. A third problem with Other indexes that are not directly related
the chi-square test is that it is strongly influ- to sample size have been developed. We find
enced by sample size. A poor fit based on a the average absolute difference between the
small sample size may result in a nonsignifi- original and reproduced matrices intuitively
cant chi-square, whereas a good fit based on appealing and easy to understand when the
a large sample size will result in a significant
chi-square. Thus, most applications of con- 2
Some caution needs to be exercised when dealing
firmatory factor analysis require a subjective with complex factor models (i.e., models that include
evaluation of whether or not a statistically variables that load on more than one factor). First,
significant chi-square is small enough to con- complex factor models are more prone to identification
stitute an adequate fit. problems. Second, LISREL'S routine for generating starting
The most recent version of LISREL (i.e., values for the iteration process requires that measured
variables load on only one factor. Thus, researchers
Version VI) provides an additional index that interested in complex factor models must override this
can be used to evaluate a given model further routine and set their own starting values. Multitrait—
(Joreskog & Sorbom, 1983, pp. I.40-I.42). multimethod (MTMM) examples of problems that include
This is called a modification index (MI), and complex factors are given in Marsh and Hocevar (1983).
3
Statistically, the critical value of the chi-square with
it is provided for all parameters that are 1 degree of freedom is 3.84. Thus, the Joreskog and
either fixed or constrained. The index is a Sorbom cut-off is somewhat conservative. However, be-
lower bound estimate of the expected chi- cause there are problems associated with multiple signif-
square decrease that would result when a icance tests on the same sample (Long, 1983a, pp. 68),
particular parameter is left unconstrained. we have adopted the more conservative approach in the
present article. In addition, because the modification
Joreskog suggested that a modification index index is dependent on sample size, it is possible that
should be at least five before the researcher trivial differences may lead to significant modification
considers modifying the hypothesized model.3 indexes in large sample problems.
568 HERBERT W. MARSH AND DENNIS HOCEVAR
Table 3
Goodness-of-Fit Indexes for First-Order Models
Note. T = target coefficient. For all models, n = 170, 103, 134, and 251 for Grades 2, 3, 4, and 5, respectively. Model
1: For each grade, df= 329; total df= 1316. Model 2: For each grade, df= 343; total df= 1372. Model 3: For each
grade, df= 342; total df= 1368. Model 4: For each grade, df= 341; total df= 1364. Model 5: For each grade, df=
337; total df= 1348. Model 6: For each grade, df '= 340; total df '= 1360. Model 1 (target model) was statistically
contrasted with Models 2-6. Comparisons indicated that Model 1 was superior (p < .05) to Model 2, x2(56) = 432;
Model 3, x2(52) =191; Model 4, X2(48) = 163; Model 5, x2(32) = 48; and Model 6, x2(44) = 78. Chi-square/d/
ratios were 7.71, 3.67, 3.40, 1.50, 1.77, for contrasts 2-6, respectively.
* Coefficient deltas were computed using a null model that specifies zero correlations among the measured variables.
Chi-squares for the null models (df= 350) were 3063, 1606, 2603, and 4382 for Grades 2-5, respectively. The total
chi-square for an unconstrained analysis of the four grade levels was 11654 (df= 1400).
b
Four nonacademic factors on one, 3 academic factors on the other.
c
Same as Model 3 but with Parents on both factors.
d
Four factors were Parents, Math/Academic, Reading/Academic and Nonacademic.
constraints, analyzing the correlation matrix fit of the model across the four grade levels
would have produced the same goodness-of- is given by the sum of the four chi-square
fit (Long, 1983a, pp. 77-79). However, when values and the sum of their degrees of free-
there are invariance constraints, analysis of dom. The chi-square/degree of freedom ratio
the different matrices results in different chi- for the total sample (2430/1316 = 1.85) is
square indexes. When looking at invariance small and reflects a good fit to the data. The
between groups, most researchers choose to ratios for each grade level are also given in
analyze a covariance matrix. A detailed ex- Table 3. Although complicated by differences
amination of this issue, other than to indicate in sample size, all four are also small and
that it is a potential concern, is beyond the indicate a reasonable fit for Model 1 at each
scope of this article, and the reader is referred grade level.
to Browne (1982), Joreskog (1971), and Mer- Factor loadings and the variance/covari-
edith (1964). ances matrix for Grade 5 are given in Tables
In the first analysis, the basic model shown 4 and 5, respectively. An inspection of the
in Tables 1 and 2 (Model 1) was fit to data Grade-5 factor loadings in Table 4 and the
from each of the four grade levels separately. factor loadings for the remaining grades (not
Here, we are testing the ability of the model shown) indicated that all the estimated pa-
to fit the data for each grade level without rameters were significant and large, varying
specifying that any of the parameter estimates between 3 and 25 times the size of their
be the same across the grade levels. The standard errors. (The ratio is distributed as a
goodness-of-fit indexes for Model 1 analyses t statistic so that anything greater than 1.96
are summarized at the top of Table 3. The is significant in this instance.)
Table 4
Factor Loading Matrix (Lambda Y): Model 1 (Grade 5)
Factors loadings
First-order
Factors Model 2 Models Model 4 Models Models
Phys. Abil.
Appearance
Peers
Parents
Reading
Mathematics
Gen. School
chi-square of the first-order model to the chi- their ability to fit the data is summarized in
square of the more restrictive model. As with Table 3.
other indexes such as coefficient delta, the In Model 2, one general factor (i.e., a
target coefficient has an upper limit of 1, General Self) is hypothesized to explain the
which would only be possible if the relations covariances among the first-order factors. This
among the first-order factors could be totally model does not provide an adequate fit across
accounted for in terms of the more restrictive the four age groups, nor within any one of
model. The application of the target coeffi- the age groups, and thus is not considered
cient has the advantage of separating lack of further. Model 3 proposes two correlated
fit due to the second-order structure from second-order factors which are defined by the
lack of fit in the definition of first-order four nonacademic factors and the three aca-
factors. Thus, for example, it is possible to demic factors. Model 3 fits the data substan-
have a target coefficient that approaches unity tially better than Model 2, but not as well as
even when the overall fit of the first-order the target model. In Model 4, we examine
model is only modest. This would indicate the observation that the Parents factor is
that the lack of fit occurs in the definition of related to both academic and nonacademic
the first-order factors (i.e., measurement components of self-concept by allowing this
model) rather than the specification of the first-order factor to load on both second-order
second-order factors. Although this index will factors. Models 3 and 4 differ by only 1
be useful for studies that examine higher degree of freedom for each age level (4 degrees
order factor models, it is important to note of freedom for the total sample), but the
that target coefficient will generally be higher improvement is statistically significant and
as the number of parameters estimated in the supports the earlier observations about the
higher order model increases. Finally, like Parent factor.
many other fit indexes (e.g., coefficient delta), Thus far we have only examined models
the distributional properties of the target with one or two second-order factors. Even
coefficient are unknown. when the two second-order factors are cor-
Higher order models. Models 2 to 6 are
designed to test whether or not various higher 5
order models provide an adequate fit to data When one model is a subset of another larger model,
the difference between two models can be tested by
from each different grade level. For this rea- subtracting the two chi-square values and testing this
son, the higher order factor models are tested value against the critical value associated with the differ-
separately for each grade level, the chi-square ence in degrees of freedom (Bentler & Bonett, 1980;
values are compared with those based on Joreskog & Sorbom, 1983; Long, 1983a, pp. 65-78).
Model I5, and the chi-square value from Although progressive model testing can clearly aid theory
building, it is generally recognized that some caution
Model 1 is used to compute the target coef- should be exercised when using the results of one analysis
ficient. The higher order factor structures for as a basis for subsequent analyses (cf. Cliff, 1983; Long,
the models are illustrated in Figure 1, and 1983a, pp. 68).
572 HERBERT W. MARSH AND DENNIS HOCEVAR
is much more restrictive than Model 1 and modification index (MI) to further evaluate
normally considered to be the initial step in a model. For Model 7, only two of the 84
testing factorial invariance (see Alwin & ( 2 1 X 4 ) Mis for the constrained factor load-
Jackson, 1981; Joreskog, 1971; Joreskog & ings in the four grade levels exceeded the
Sorbom, 1983, pp. V.1-V.15). As shown in minimum value of 5, suggesting that the lack
the footnote of Table 6, the difference in chi- of invariance is probably trivial from practical
squares between Models 1 and 7 is statistically and substantive perspectives,
significant, indicating that it is unlikely that Several additional approaches were also
each factor loading for each measured variable used to evaluate the practical significance of
is identical in the four grade levels. An im- the lack of invariance in Model 7. The target
portant issue is whether this lack of invariance coefficient described earlier as an indication
has practical or substantive importance. As of goodness-of-fit for higher order solutions
Joreskog and Sorbom and others pointed out, can also be used. Here, the chi-square for a
a model cannot be evaluated solely on the model with no invariance constraints (i.e.,
basis of its chi-square value (Joreskog, 1971, Model 1) provides a target or optimum fit for
pp. 421; Joreskog & Sorbom (1983, pp. 1.36- nested models where different invariance
1.42). As mentioned earlier, Joreskog and constraints are imposed (i.e., Models 7-13).
Sorbom (1983, pp. I.40-I.42) described a As before, the target coefficient has an upper
Table 6
Goodness-of-Fit Indexes for Invariance Models
Note. T = target coefficient. Model 1: df'= 1316; Model 7: df = 1379; Model 8: df'= 1463; Model 9: df= 1463;
Model 10: df = 1442; Model 11: df= 1411; Model 12: df= 1471; Model 13: df= 1450. The fit of Model 1 is better
(p < .05) than Model 7, x2 (63) = 135, x 2 A#"= 2.14. The fit of Model 7 is better than Model 8, x2 (84) = 396,
X2/df= 4.71, and Model 9, x 2 (84) = 237, \2/df= 2.82. The fit of Model 11 is better than the fit of Model 12,
X 2 (60) = 205, x 2 / d f = 3.42, and Model 13, x 2 (39) = 125, x2/df = 3.21.
574 HERBERT W. MARSH AND DENNIS HOCEVAR
limit of 1.0, which can only be realized if all Models 1 or 7. Moreover, inspection of the
the parameters in the unconstrained model unconstrained error/uniquenesses in Model
are exactly equal across groups, and it is 1 indicated a plausible trend, with lower
subject to the limitations described earlier. error/uniquenesses in Grades 4 and 5. Thus,
The high target coefficient for Model 7 (0.95) on a substantive level, we concluded that
further supports the suggestion that the lack there was evidence that error/uniquenesses
of invariance for Model 7 is of little practical were not invariant across grade levels.
importance. Further support for this conclu- Invariance of variance/covariance. Shav-
sion comes from the finding that the chi- elson proposed that factors become more
square/degree of freedom ratio for Model 7 distinct with age and Marsh et al. (1984)
is less than two, and that the chi-square/ translated this to mean that the factors be-
degree of freedom ratio for Model 7 versus come less correlated with age. This type of
Model 1 is only 2.14 (see bottom of Ta- hypothesis is common in developmental data,
ble 6). and the formulation of an adequate test of
Our interpretation of the results for Model such a hypothesis has broad generality. A
7 is that while the factor loadings are not typical first step is to examine the invariance
invariant in a strict statistical sense, the chi- of the psi matrix which contains estimates of
square test is so powerful that trivial differ- factor variances and factor covariances (Alwin
ences may lead to significant chi-square val- & Jackson, 1981; Joreskog, 1971; Joreskog
ues. We suspect that this will typically be the & Sorbom, 1983, pp. V.I-V.I 5; McGaw &
case, and so we have suggested some alter- Joreskog, 1971). In Model 9, invariance in
native ways of assessing the goodness-of fit of PSI is examined by holding both lambda Y
invariance constraints. On the basis of these and psi invariant across groups. When this
alternative perspectives, and to justify the model is statistically compared with Model 7
further analyses that we want to illustrate, we using the chi-square difference test, it is sig-
conclude that from a practical perspective the nificantly poorer, and 10 modification indexes
factor loadings are invariant. Nevertheless, exceeded 5. Thus, invariance in the psi matrix
the tentativeness of this conclusion again is not supported. Had invariance been sup-
illustrates that there is no fully acceptable ported, one could conclude that the factor
procedure of determining how substantial the correlations were also invariant. However, in
lack of fit in a hypothesized model must be the present example invariance was not sup-
before it needs to be considered practically ported, and the interpretation is ambiguous.
important, and this problem represents an This is because factor correlations are a func-
important shortcoming in the application of tion of both factor variances and factor Co-
covariance structure modeling. variances (i.e., the correlation is computed
Invariance of error/uniquenesses. In Model by dividing each factor covariance by the
8, invariance in the error/uniquenesses was product of the respective factor standard de-
examined. This was accomplished by requir- viations), and it is still possible that factor
ing that estimated elements in both the correlations are invariant even when factor
lambda Y and the diagonal of the theta covariances are not invariant.
matrix be invariant across the four age levels. Invariance of factor correlations. As de-
(Factor loadings are constrained along with scribed in the previous section, the invariance
error/uniquenesses to guarantee that each of factor correlations cannot always be ex-
factor is the same across the four groups.) amined by simply holding the psi matrix
When compared with Model 7, the chi-square invariant. When the variance/covariance ma-
increase caused by this constraint was again trix is found to be invariant, one can conclude
significant. More important, this particular that the correlations are also invariant. How-
constraint had a markedly large effect. In the ever, when invariance in the variance/covari-
first place, in contrast to the earlier modifi- ance matrix is rejected, a meaningful conclu-
cation indexes, a substantial number of mod- sion about the invariance of correlations is
ification indexes exceeded five (26). Second, not possible, and additional analyses are re-
subjective indicators of goodness-of-fit in Ta- quired. To investigate this problem further,
ble 6 for Model 8 are each poorer than for Model 10 was formulated where factor vari-
CONFIRMATORY FACTOR ANALYSIS 575
ances were estimated in the diagonal of one is hypothesized to be invariant (as in Model
matrix, and factor correlations were estimated 7), whereas the higher order factor loadings
in the off-diagonals of a different matrix.6 and the factor variances are not invariant (as
Thus, for Model 10, the relations among the in Model 5). Although Model 11 is not a test
factors are specified in terms of factor cor- of higher order invariance, its rejection would
relations. The results (see Table 6) show that make dubious the testing of further, more
holding factor correlations to be invariant restrictive models. Thus, although the results
(Model 10) results in a significantly poorer in Table 6 indicate a reasonable fit for Model
model when compared with Model 7 in 11, the major reason for including this model
terms of both the chi-square difference test is to provide a justification for testing the
and the number of modification indexes that invariance of more restrictive models and a
exceed five (14). Inspection of the four con- basis for comparison for further models.
strained correlation matrices obtained in In Model 12 all estimated parameters ex-
Model 7 demonstrated that the lack of in- cept the uniquenesses are hypothesized to be
variance was due to large and systematic age invariant.7 Regardless of which criteria are
differences, such that factors were more used to evaluate the model, Model 12 per-
strongly correlated in the younger samples. forms more poorly than Models 1, 5, or 11.
In addition, it provided support for the Shav- However, the interpretation is ambiguous,
elson model which the data are designed to because the lack of invariance in Model 12
test. This demonstration of how to make tests is possibly due to a lack of invariance in the
of correlations is important, because most first-order factor variances or the higher order
hypotheses are formulated in terms of factor factor structure. (The problem here is anal-
correlations. ogous to the problem described in our dis-
Invariance of higher order models. In- cussion of the invariance of the first-order
spection of the higher order structures hy- factor variance/covariance matrix.) Again, the
pothesized in Models 2 to 6 indicated that solution is to allow first-order factor variances
Model 5 provided the best fit for each grade to vary across grade levels when testing the
level, considered separately, and across the tenability of a higher order factor structure.
four grade levels. Consequently, this model Hence, in Model 13 the seven first-order
was selected for the analysis of the invariance
of the higher order structure across grade
levels. However, a number of methodological- ' In Model 10 factor variances (or more accurately
factor standard deviations) were estimated in one matrix,
theoretical issues must be considered before and correlations were estimated in a second matrix. In
invariance can be tested for the higher order the actual LISREL model, we specified 28 y variables
models. First, tests of higher order invariance (NY = 28), seven factors on the y side (ME = 7), and
only make sense when there is reasonable seven factors on the x side (NK = 7). Lambda Y was
invariance among first-order factors. Second, specified as in Table 1, gamma was a 7 X 7 diagonal
matrix used to estimate factor standard deviations. Phi
the tests of higher order invariance are anal- was a 7 X 7 matrix with ones in the diagonal and factor
ogous to tests of the invariance of the factor correlations in the off-diagonals. Theta epsilon was a
variance/covariance matrix considered earlier 28 X 28 diagonal matrix containing the error/uniqueness
where the distinction between the invariance components. Finally, lambda X was an identity matrix
and psi, beta, and theta delta were zero matrices.
of factor correlations and factor covariances 7
In the actual LISREL specification, 11 y-side (NE =
was discussed, and this distinction is relevant 11) and 11 x-side factors (NK = 1 1 ) were defined. Factors
here as well. Finally, the conclusion in the 1 to 7 were first-order factors, Factors 8 to 10 were
present investigation that correlations among second-order factors, and Factor 11 was a third-order
factor. Lambda X was an identity matrix, and lambda Y
the first-order factors vary systematically with was a matrix of first-order factor loadings. Theta delta
grade level (see discussion of Model 10) sug- was a zero matrix, and theta epsilon was a diagonal
gests that the invariance of the higher order matrix of error/uniqueness components. Gamma was a
structure is unlikely. Nevertheless, tests of 1 1 X 1 1 diagonal matrix used to estimate factor residuals.
factorial invariance of the higher order struc- Finally, psi was a zero matrix, phi was an identity matrix,
and the second-order factor loadings were estimated in
ture are formulated and tested for demon- the 11 X 11 beta matrix. In specifying Model 12, with
stration purposes. the exception of the theta epsilon matrix, all parameter
In Model 11, the first-order factor structure matrices were constrained to equality across groups.
576 HERBERT W. MARSH AND DENNIS HOCEVAR
factor variances are not constrained to be variant, unless factor variances are also held
invariant, and the higher order factors are invariant. This is a problem, because most
denned to explain invariant correlations researchers would prefer not to hold factor
among first-order factors.8 As shown in Table variances invariant in a multigroup analysis.
6, regardless of the criteria, Model 13 still The resolution of the problem requires an
performs more poorly than Models 1,5, and alternative formulation where factor correla-
11 and provides strong evidence that higher tions are estimated in a second matrix. Here,
order factorial invariance does not exist. In tests about correlations among the first-order
summary, as was anticipated from the findings factors are possible. In the present application,
of first-order models, the higher order tests hypotheses about relations among the first-
of invariance do not support the hypothesis order factors were specified in terms of cor-
that the four grade levels have the same relations. Consequently, the usual procedures
higher order structure. for analyzing factor covariances needed to be
modified. This distinction will be common
Summary and Discussion in other applications where researchers will
generally want to test hypotheses about cor-
Initial findings indicated that the basic relations, not covariances.
factor model hypothesized to underlie the Another difference between our approach
SDQ questionnaire provided a good fit to the and that of Joreskog and Sorbom is that we
data across four age groups. A series of higher do not rely on a rigid set of sequential
order models were proposed on the basis of statistical tests. To illustrate, Joreskog and
theory and previous research. Model 5 (see Sorbom (Joreskog, 1971; Joreskog & Sorbom,
Figure 1) was found to provide the best fit 1983) suggested the following series of anal-
for data from each of the different age groups. yses when examining invariance: (a) Test the
Constraining factor loadings to invariance unrestricted hypothesized factor model; (b)
across age groups also resulted in a reasonable test for invariance of the factor loadings; (c)
fit to the data (on a subjective rather than test for simultaneous invariance in the factor
statistical level). However, the invariance of loadings and error/uniquenesses; and (d) test
error/uniquenesses was clearly rejected, and for simultaneous invariance in the factor
systematically greater errors at the younger loadings, error/uniquenesses, and factor vari-
grade levels were noted. A model was for- ance/covariance matrix. The hierarchy is se-
mulated so that factor correlations were in- quential in that Joreskog (1971) suggested
variant across groups, and this model was that one should generally support earlier steps
also rejected. Systematically higher correla- in the hierarchy to progress toward later
tions are noted in the younger age groups, steps. For example, one should not test for
suggesting that factor correlations are less equality of the factor variance-covariance
differentiated at this level. As one would matrix if invariance in the factor loadings
expect from this finding, the invariance of a and invariance in the error/uniquenesses can-
higher order model (Model 5) across groups not be statistically demonstrated.
was also rejected. We deviate from this hierarchy in two
Although the techniques described herein ways. First, although we found that factor
are based on the work of Joreskog and Sor- loadings were not invariant in a strict statis-
bom (Joreskog, 1971; Joreskog & Sorbom, tical sense, we still proceeded with further
1983), our approach deviates somewhat from tests of invariance. Our justification was to
their original guidelines. First, Joreskog and argue that the lack of invariance was small
Sorbom did not explicitly illustrate tests of and practically insubstantial, and that we
the invariance of factor correlations (cf. Jo-
reskog, 1971; Joreskog & Sorbom, 1983, pp.
8
V.7; McGaw & Joreskog, 1971). Correlations The specification of Model 13 was identical to that
among the first-order factors are a function of Model 12, except that the variances for the seven first-
of factor variances and covariances. Thus, Such order factors in gamma were not constrained to equality.
a specification allowed first-order factor variances
these correlations cannot be held invariant to vary across groups, whereas the higher order factor
by specifying that factor covariances are in- structure was constrained to equality.
CONFIRMATORY FACTOR ANALYSIS 577
were interested in substantive research ques- Alwin, D. F., & Jackson, D. J. (1981). Applications of
tions that could only be answered by pro- simultaneous factor analysis to issues of factorial in-
variance. In D. D. Jackson & E. P. Borgotta (Eds.),
ceeding to further tests. Second, similar to Factor analysis and measurement in sociological re-
Alwin and Jackson (1981), we did not require search: A multidimensional perspective (pp. 249-280).
that error/uniquenesses be invariant over Beverly Hills, CA: Sage.
samples when examining invariance in factor Bagozzi, R. P. (1980). Causal models in marketing. New
correlations. Because the factor correlations York: Wiley.
Bejar, I. (1980). Biased assessment of program impact
are corrected for attenuation, any bias due due to psychometric artifacts. Psychological Bulletin,
to group differences in error/uniquenesses 87, 513-524.
should be accounted for. To constrain error/ Bentler, P. M. (1976). Multistructure statistical models
uniquenesses to invariance when prior anal- applied to factor analysis. Multivariate Behavioral
Research, 11, 3-25.
yses (see Model 8) argue against such invari- Bentler, P. M. (1980). Multivariate analysis with latent
ance would seem to constitute an unnecessary variables. In M. R. Rosenzweig & L. W. Porter (Eds.),
distortion of reality. Annual review of psychology (Vol. 31, pp. 419-456).
Another potential problem in studying fac- Palo Alto, CA: Annual Reviews.
torial invariance is overreliance on statistical Bentler, P. M., & Bonett, D. G. (1980). Significance tests
and goodness of fit in the analysis of covariance
criteria. As Joreskog (1971, p. 421) and others structures. Psychological Bulletin, 88, 588-606.
(Long, 1983a, pp. 68) pointed out, the prob- Bentler, P. M., & Weeks, D. G. (1980). Linear structural
ability levels associated with sequential tests equations with latent variables. Psychometrika, 45,
are not known, particularly when the results 289-308.
Bentler, P. M., & Woodward, J. A. (1979). Nonexperi-
of one analysis are used to determine a mental evaluation research: Contributions of causal
second analysis on the same sample. Further, modeling. In P. Datta & R. Perloff (Eds.), Improving
it may be that statistical criteria are too evaluation (pp. 71-102). Beverly Hills, CA: Sage.
conservative, particularly in view of the chi- Brokken, F. B. (1983). Orthogonal Procrustes rotation
square's relation to sample size. In other maximizing congruence. Psychometrika, 48, 343-349.
Browne, M. W. (1982). Covariance structures. In D. M.
words, models of invariance may be rejected Hawkins (Ed.), Topics in applied multivariate analysis
when there are only small or trivial differences (pp. 72-141). Cambridge, England: Cambridge Uni-
between groups. The likely violation of dis- versity Press.
tribution requirements for the chi-square test Browne, M. W., & Kristof, W. (1969). On the oblique
rotation of a factor matrix to a specified pattern.
provides a further basis for skepticism regard- Psychometrika, 34, 237-248.
ing the chi-square test. (Interested readers Cattell, R. B. (1962). The basis of recognition and
should see Fornell, 1983 and Cliff, 1983, for interpretation of factors. Educational and Psychological
further discussion of the problems inherent Measurement, 22, 667-669.
in the interpretation of LISREL models.) Heu- Cattell, R. B. (1971). Abilities: Their structure, growth,
and action. Boston: Houghton Mifflin.
ristic rules of thumb may eventually prove Cattell, R. B. (1973). Personality and mood by question-
to be a useful alternative to statistical criteria. naire. San Francisco: Jossey-Bass.
Among these are the well-known fit indexes Cattell, R. B. (1978). The scientific use of factor analysis.
for comparing factor models discussed earlier New \brk: Plenum.
Cattell, R. B., & Baggaley, A. R. (1960). The salient
and those developed for the analysis of co- variable index for factor matching. British Journal of
variance structures (e.g., Bentler & Bonett, Statistical Psychology, 13, 33-46.
1980; Fornell & Larker, 1981; Joreskog & Cliff, N. (1966). Orthogonal rotation to congruence.
Sorbom, 1983, sec. I. 12) and the target Psychometrika, 31, 33-42.
coefficient presented in this investigation. Fi- Cliff, N. (1983). Some cautions concerning the application
of causal modeling methods. Multivariate Behavioral
nally, as the present article demonstrates, Research, 18, 115-126.
subjective evaluation of the parameter esti- Everett, M., & Rog, D. J. (1981, April). The relevance
mates, together with an inspection of the and analysis of structural invariance. Paper presented
modification indexes, can add insight into at the annual meeting of the American Educational
the determination of the best model. Research Association, Los Angeles, CA.
Eysenck, H. J. (1947). Dimensions of personality. London:
Routledge & Kegan Paul.
References Fornell, C. (1983). Issues in the application of covariance
Ahmavaara, Y. (1954). The mathematical theory of fac- structure analysis: A comment. Journal of Consumer
torial invariance under selection. Psychometrika, 19, Research, 9, 443-448.
27-38. Fornell, C., & Larker, D. F. (1981). Structural equation
578 HERBERT W. MARSH AND DENNIS HOCEVAR
models with unobservable variables and measurement on the SDQ. Journal of Personality and Social Psy-
error: Algebra and statistics. Journal of Marketing chology, 45, 173-187.
Research, 18, 382-388. Marsh, H. W., Smith, I. D., & Barnes, J. (1983). Multi-
Gorsuch, R. L. (1970). A comparison of biquartimin, trait-multimethod analysis of interpretations based
maxplane, promax, and varimax. Educational and upon the SDQ: Student-teacher agreement on multi-
Psychological Measurement, 30, 861-872. dimensional ratings of student self-concept. American
Gorsuch, R. L. (1974). Factor analysis. Philadelphia, PA: Educational Research Journal, 20, 333-357.
Saunders. Marsh, H. W., Smith, I. D., Barnes, J., & Butler, S.
Guilford, J. P. (1981). Higher-order structure-of-intellect (1983). Self-concept: Reliability, dimensionality, validity,
abilities. Multivariate Behavioral Research, 16, 411- and the measurement of change. Journal of Educational
435. Psychology, 75, 772-790.
Harman, H. H. (1967). Modern factor analysis (2nd ed.). Maruyama, G., & McGarvey, B. (1980). Evaluating
Chicago: University of Chicago Press. causal models: An application of maximum-likelihood
Horn, J. L. (1972). The structure of intellect: Primary analysis of structural equations. Psychological Bulletin,
abilities. In R. M. Dreger (Ed.), Multivariate behavioral 87, 502-512.
research (pp. 451-511). Baton Rouge, LA: Claitor's. McGaw, B., & Joreskog, K. G. (1971). Factorial invariance
Humphreys, L. G. (1962). The organization of human of ability measures in groups differing in intelligence
abilities. American Psychologist, 17, 475-483. and socioeconomic status. British Journal of Mathe-
Joreskog, K. G. (1969). A general approach to confir- matical and Statistical Psychology, 24, 154-168.
matory factor analysis. Psychometrika, 34, 183-202. Meredith, W. (1964). Rotation to achieve factorial in-
Joreskog, K. G. (1970). A general method for analysis of variance. Psychometrika, 29, 187-206.
covariance structures. Biometrika, 57, 239-251. Muliak, S. A. (1972). The foundations of factor analysis.
Joreskog, K. G. (1971). Simultaneous factor analysis in New York: McGraw-Hill.
several populations. Psychometrika, 36, 409-426. Nesselroade, J. R., & Bakes, P. B. (1970). On a dilemma
Joreskog, K. G. (1981). Analysis of covariance structures. of comparative factor analysis: A study of factor
Scandinavian Journal of Statistics, 8, 65-92. matching based on random data. Educational and
Joreskog, K. G., & Sorbom, D. (1979). Advances in Psychological Measurement, 30, 935-948.
factor analysis and structural equation models. Cam- Olson, G. H. (1982, March). Covariance structure analysis
bridge, MA: Abt. involving measured variables assumed to have higher-
Joreskog, K. G., & Sorbom, D. (1983). LISREL V: ordered factor structures. Paper presented at the annual
Analysis of linear structural relationships by the method meeting of the American Educational Research Asso-
of maximum likelihood. Chicago: International Edu- ciation, Montreal.
cational Services. Pinneau, S. R., & Newhouse, A. (1964). Measures of
Kaiser, H., Hunka, S., & Bianchini, J. (1971). Relating invariance and comparability in factor analysis for
factors between studies based on different individuals. fixed variables. Psychometrika, 29, 271-281.
Multivariate Behavioral Research, 6, 409. Please, N. W. (1973). Comparison of factor loadings in
Levine, M. S. (1977). Canonical analysis and factor different populations. British Journal of Mathematical
comparison. Beverly Hills, CA: Sage. and Statistical Psychology, 26, 67-89.
Long, J. S. (1983a). Confirmatory factor analysis: A Royce, J. R. (1979). Toward a viable theory of individual
preface to LISREL. Beverly Hills, CA: Sage. differences. Journal of Personality and Social Psychol-
Long, J. S. (1983b). Covariance structure models: An ogy, 37, 1927-1937.
introduction to LISREL. Beverly Hills, CA: Sage. Rummel, R. J. (1970). Applied factor analysis. Evanston,
Marsh, H. (1984). Verbal and math self-concepts: An IL: Northwestern University Press.
internal/external frame of reference model. Manuscript Shavelson, R. J., & Bolus, R. (1982). Self-concept: The
submitted for publication. interplay of theory and methods. Journal of Educational
Marsh, H. W., Barnes, J., Cairns, L., & Tidman, M. Psychology, 74, 3-17.
(1984). The Self Description Questionnaire (SDQ): Shavelson, R. J., Huber, J. J., & Stanton, G. C. (1976).
Age effects in the structure and level of self-concept Validation of construct interpretations. Review of Ed-
for preadolescent children. Journal of Educational ucational Research, 46, 407-441.
Psychology, 76, 940-956. Taylor, P. A. (1967). The use of factor models in curric-
Marsh, H. W., & Hocevar, D. (1983). Confirmatory factor ulum evaluation: A mathematical model relating two
analysis of multitrait-multimethod matrices. Journal factor structures. Educational and Psychological Mea-
of Educational Measurement, 20, 231-248. surement, 27, 305-321.
Marsh, H. W., & Hocevar, D. (1984). The factorial Thurstone, L. L. (1947). Multiple factor analysis. Chicago:
invariance of student ratings of college teaching. Amer- University of Chicago Press.
ican Educational Research Journal, 21, 341-366. Vernon, P. E. (1969). The structure of human abilities.
Marsh, H. W., Parker, J. W., & Smith, I. D. (1983). London: Methuen.
Preadolescent self-concept: Its relation to academic Weeks, D. G. (1980). A second-order longitudinal model
ability. British Journal of Educational Psychology, 53, of ability structure. Multivariate Behavioral Research,
60-78. 15, 353-365.
Marsh, H. W., Relich, J. D., & Smith, I. D. (1983). Self- Wrigley, C. S., & Newhouse, J. Q (1955). The matching
concept: The construct validity of interpretations based of two sets of factors. American Psychologist, 10, 418.
CONFIRMATORY FACTOR ANALYSIS 579
Appendix A
Means and standard deviations for the 28 sub- Table A2 above and below the diagonal, respec-
scales are given in Table A1. Subscales are ordered tively. The lower matrix is the interscale correlations
and segregated in terms of the seven SDQ factors for Grades 4 and 5. Grade 4 is below the diagonal,
(Physical Ability, Physical Appearance, and so on). and Grade 5 is above it. Table A3 gives the
Interscale correlations are given in Table A2. parameters that were estimated in order to specify
Grades 2 and 3 are shown in the upper matrix of higher order factor Model 5.
Table Al
Means and Standard Deviations
Grade
2 3 4 5
Ability/subscale
no. M SD M SD M SD M SD
Physical ability
1 8.85 1.90 8.27 2.05 8.34 1.90 8.20 1.84
2 8.36 2.17 8.24 1.87 8.34 1.75 8.23 1.94
3 8.90 1.92 8.53 2.09 8.37 2.06 8.17 2.07
4 8.82 2.09 8.73 2.01 8.40 1.88 8.56 1.82
Physical
appearance
5 8.55 2.10 7.49 2.54 7.51 2.30 7.41 2.34
6 8.29 2.53 7.33 2.60 7.22 2.63 7.00 2.61
7 8.23 2.33 7.87 2.47 7.03 2.71 7.17 2.48
8 7.74 2.58 7.47 2.25 7.13 2.42 7.40 2.34
Relations with
peers
9 8.97 1.89 8.44 2.03 8.44 2.05 8.81 1.71
10 8.23 2.41 8.22 1.88 7.62 2.22 7.94 1.93
11 7.95 2.47 7.29 2.35 7.06 2.38 7.52 2.18
12 8.53 2.25 7.94 2.45 7.89 2.12 8.29 1.94
Relations with
parents
13 9.34 1.61 9.43 1.21 9.32 1.21 9.35 1.31
14 9.12 1.66 9.08 1.63 9.39 1.21 9.13 1.57
15 8.51 2.15 8.98 1.67 8.69 1.71 8.67 1.77
16 9.19 1.73 9.03 1.58 9.13 1.32 9.00 1.47
Reading
17 8.74 1.98 7.93 1.92 8.18 1.95 7.90 2.10
18 8.77 2.12 8.77 1.74 8.05 2.02 8.10 2.11
19 8.78 2.00 8.62 1.98 8.01 1.94 7.92 2.23
20 8.69 2.18 8.71 1.96 8.34 1.76 7.93 2.23
Mathematics
21 7.57 2.68 7.86 2.36 7.57 2.23 6.83 2.47
22 8.28 2.37 7.92 2.29 8.16 1.96 7.58 2.21
23 8.19 2.48 8.36 2.26 8.07 2.08 7.54 2.46
24 8.12 2.48 8.10 2.34 7.87 2.18 7.44 2.36
General school
25 8.03 2.09 7.70 2.07 7.68 1.82 7.21 2.00
26 8.42 2.11 7.71 2.21 7.67 1.95 7.56 1.84
27 8.07 2.61 8.28 2.23 8.37 1.91 8.02 2.26
28 8.25 2.46 8.05 2.06 7.60 1.80 7.39 2.13
580 HERBERT W. MARSH AND DENNIS HOCEVAR
,o. _ H r ^ C N < N r n O —' (
—, I/-, — .
_, o — •
I I
o o o — ( N f i m o o oO^--H- - H ( N ( N O f N ( N ' f t mminrn-^t •^••*^^- O —' — O— — —• —
? I I I I *!
fN
<N
( N r - t C N ( N ( N ( N - ^ ( N —' m — (
i _ O —O O O
OO — — OOO —
— i O — ' —• — m fN <N — o
O — < O O r-l <N — OOO — —< m m m <N m r-Tj-fN^-^TtTt-^-^-tn OO — —' — — —' <N
(N O '
O O O O — — —' fN
O — (
O — — OtNfN—.(N
^OON<
o —<
OOO—-OO(NO—'OO —— 5-' O O O O —— 00
(N — m ^ - c s — i m T t f N u i - ' t •<l-mTttnm'<a-»O'^--^-fnm^-mfn(Nrn "^(NmfSfnm'^m
(S —<^! ! — — — •* unmtNTrfn — T r m m m mm<Nm<Nrs|
Of^'o'or-Tj-Tt—<f> m ^o —- in ^-i o *o — ' — - i o - 3 - \ b — •nr-mo^l' ON^or-jooTj-r-'^OfN
o^ot^r-fNONr^-m oo-^-oo^o—'Ovofn^ooOtNmmoorf-^- Tfr*iTj-r«1</-|TfrTtO
!?
— rt oo —•
i ~- — oo —
O — O fN
— rf in '
^ Si 3
C/D
CONFIRMATORY FACTOR ANALYSIS 581
fN fN fN <N O O —— (N fO r*l ro r^i r*"i ^ ^ •
i^Ttm — oofNoo-^-ooooovivir^
OfNfNfNOO—•—'fNfNfimr-r- t
§ r—*' O
i»orNw-ioooo'—i^^\
-^O^- — — fNO^-
) f—N o^ -—
m•
O
— fN fi fN -<± VI — f N r * - i m — — O —« f N ~ - — fN
'— f N f N f N f N f N - ^ f N f N f N — —•
OONOOhOt^ — r^<^rOOOO<^l
- —' O — OO — O O - ^ — — —*
"fNmfNOfN-^fN — - H —- - H
-^hsO»n-^
)'sO'^'1<3'fN f N r < l f N r ' i r « * i f « i m f N - ^ — -
O 00 — I so^-^oo —
—' O O - - — — fN — fN
fN O "fr
m ^- fN •
1
s:
^ H O —' —' — ( N f N — f N — — — ~
1
• fN fN fN <N fN fN fN fN Cs|
582 HERBERT W. MARSH AND DENNIS HOCEVAR
Table A3
Pattern of Coefficients in Various Matrices Used to Specify the Higher
Order Factors in Model 5
Measured Eta Eta Eta Eta Eta Eta Eta Eta Eta Eta Eta
Variables 1 2 3 4 5 6 7 8 9 10 11