Professional Documents
Culture Documents
LISA D. BENDIXEN
KENDALL HARTLEY
University of Nevada
ABSTRACT
15
2003, Baywood Publishing Co., Inc.
16 / BENDIXEN AND HARTLEY
THEORETICAL FRAMEWORK
A review by Dillon and Gabbard (1998) explored the hypermedia literature
concerning learner comprehension, learner control, and learner style (i.e., learner
characteristics). They concluded that the benefits of hypermedia, over other
methods of instruction, are limited. There is, however, evidence that individual
characteristics play a role in learning from hypermedia environments (Dillon &
Gabbard, 1998). The preponderance of existing hypermedia research has investi-
gated differences in user interfaces or instructional methods. Less research has
been conducted that explores learner characteristics and their impact on learning
in a hypermedia environment. Some of the attributes that have been studied
in a hypermedia environment include ability (Repman, Willer, & Lan, 1993),
passive/active learners (Lee & Lehman, 1993), field independence/dependence
(Jonassen & Wang, 1993), deep vs. shallow processors (Shute, 1993), and learning
strategy use (Hartley, 2001). Dillon and Gabbards review concluded that
cognitive characteristics might offer the beginning of an explanation for the
generally conflicting results in the literature comparing hypermedia and non-
hypermedia learning environments (p. 344).
Self-regulated learning theory may provide the overriding framework that
will help address issues of individual characteristics and the use of hypermedia
(Hartley & Bendixen, 2001). Self-regulated learning (SRL) has been conceptu-
alized as including metacognitive, motivational, and behavioral processes related
to the active participation of individuals in their own learning (Zimmerman, 1990).
Using a broader definition of metacognition (i.e., knowing about knowing) from
Flavell (1979), Hofer (2001) proposes that dimensions of personal epistemologies
include aspects of metacognitive processes. Specifically, Hofer (2001) suggests
that the dimensions of fixed ability (nature of intelligence) and quick learning
(the speed of knowledge acquisition), often associated with epistemological
beliefs (Schommer-Aikins, 2002), seem to be more metacognitive than epistemic
in nature. Although the current study chooses to take a more traditional view of the
dimensionality of epistemological beliefs (i.e., Schommer, 1990), their relation-
ship to metacognition and the more general contribution that epistemological
SUCCESSFUL LEARNING WITH HYPERMEDIA / 17
EPISTEMOLOGICAL BELIEFS
on the assumption that if they failed to solve the problem during this time, the
problem could not be solved.
There is some evidence that these beliefs will also impact learning in a hyper-
media environment. For example, a study involving hypermedia by Jacobson
and Spiro (1995) briefly addressed epistemological beliefs. They found students
with simple epistemological beliefs had difficulty with the non-linear and multi-
dimensional nature of an ill-defined hypertext system. The measurements used
in this study were exploratory in nature and epistemological beliefs were not
the focus of the study. As indicated by Jacobson and Spiro (1995) in their article,
more research is necessary, but this study represents an important beginning to
the application of what is known about epistemological beliefs to hypermedia
learning.
Why would these differences exist and be particularly important in a hyper-
media learning environment? As discussed previously, particular epistemological
beliefs coincide with a less adequate approach to learning. The belief in fixed
ability as a primary determinant of success leads students to believe that more
effort does not coincide with more learning. As a consequence, the additional
hypermedia tools available, such as links to definitions, diagrams, self-check
materials, objectives, and advanced organizers, may have little positive impact.
The effort required to use the hypermedia tools is less than in traditional settings
(e.g., clicking on a term for a definition is easier than looking it up in the glossary).
However, it still requires mental effort and the choice to use them; therefore, it
could be expected that a belief in fixed ability would be negatively correlated with
use of hypermedia tools and subsequent successful learning. Similarly, a student
who takes a quick learning approach to hypermedia instruction will be less likely
to take the extra time involved in taking advantage of some of the useful tools
available in hypermedia environments and would not reap the benefits of them.
The aforementioned examples point to the potential impact particular epistemo-
logical beliefs may have on learning in a hypermedia environment.
METACOGNITION
Like epistemological beliefs, students metacognitive awareness will signifi-
cantly mediate success in most learning environments. Metacognition refers to
the ability to reflect upon, understand, and control ones learning (Schraw &
Dennison, 1994). Previous accounts of metacognition distinguish between two
major components: 1) knowledge about cognition; and 2) regulation of cognition.
Knowledge of cognition refers to a learners understanding of his or her own
thought processes (Schraw, 1998). Knowledge of cognition has been further
divided into declarative (about), procedural (how), and conditional (when) knowl-
edge (Brown, 1987; Jacobs & Paris, 1987; Schraw, 1998). The use of a strategy is
dependent on the students awareness of the strategy (declarative), understanding
of how the strategy works (procedural), and knowing when to use the strategy
SUCCESSFUL LEARNING WITH HYPERMEDIA / 19
METHOD
Participants
One hundred sixteen undergraduate teacher candidates (88 females, 28 males)
from a large Southwestern university participated in the study as part of their
educational psychology course assignment. Participants average age was 28.12.
Materials
Materials included a packet containing: a) a 32-item Epistemological Beliefs
Inventory (EBI); b) a 52-item Metacognitive Awareness Inventory (MAI);
c) a 36-item reading comprehension test (Nelson-Denney); d) a 16-item test of
syllogistic reasoning; and e) a brief demographic information sheet.
Epistemological beliefs were measured using the EBI developed by Schraw,
Bendixen, and Dunkle (2002). This inventory is based on Schommers (1990)
five dimensions of epistemological beliefs which include: 1) certain knowl-
edge; 2) simple knowledge; 3) omniscient authority; 4) fixed ability; and
5) quick learning. All items were written using a 5-point Likert-type scale.
Cronbachs a for the EBI was .71 indicating good internal consistency. See
Table 1 for sample items.
Students metacognitive awareness was measured using the Metacognitive
Awareness Inventory (MAI) developed by Schraw and Dennison (1994) in which
items are classified into two categories of metacognition (i.e., knowledge of
cognition and regulation of cognition). All items were written using a 5-point
Likert-type scale. Cronbachs a for the MAI was .86 indicating excellent internal
consistency. See Table 1 for sample items.
To best isolate variance resulting from the MAI and EBI, reading compre-
hension and reasoning measures were included. Reading comprehension was
assessed using the Nelson-Denny reading comprehension test, Form E (Brown,
Bennett, & Hanna, 1981). This test contains eight passages on various topics
and five-option multiple choice questions for each passage.
Syllogisms were used to provide a general measure of logical reasoning
skill. The 16 syllogisms consisted of two-premise statements. Individuals
were asked to choose a valid conclusion from four possible responses, only
one of which was correct. The syllogisms have been normed on a similar
group and ranged in difficulty from 94 percent to 31 percent correct (Schraw,
Dunkle, & Bendixen, 1995). The demographic variable sheet included infor-
mation about age, gender, year in school, academic major, and estimated grade
point average.
SUCCESSFUL LEARNING WITH HYPERMEDIA / 21
Table 1. Factors and Sample Items from the EBI and MAI
Instrument
(No. items) Factor Item
EBI (8) Certain knowledge What is true today will be true tomorrow.
EBI (7) Simple knowledge Too many theories just complicate things.
EBI (5) Omniscient authority People should always obey the law.
Procedure
Students completed the packet of measures (i.e., EBI, MAI, Nelson-Denney,
syllogisms, and demographic sheet) before the tutorial began. After a demon-
stration of the particulars of the tutorial, participants were instructed to Study the
material as if it were for a class and that they had 30 minutes in which to do it. The
instructions and timeframe were chosen to encourage the students to approach the
materials as they would naturally if preparing for a class (e.g., study a chapter from
the text). After 30 minutes the objective exam was given to measure students
achievement in the unit.
Scoring
All exams were scored by the authors and two trained graduate assistants
using an answer key that was developed. Each participant was given a score out of
37 points possible. Scores ranged from 5 percent correct to 81 percent correct.
After a practice session, each of the four raters scored each exam independently.
All disputes in scoring were settled in conference following a thorough discussion.
RESULTS
Given that our primary question was whether epistemic beliefs and meta-
cognitive awareness were related to achievement in the hypermedia tutorial, we
performed a conceptually-driven forced-order hierarchical regression to examine
whether epistemological beliefs and metacognitive awareness would predict
achievement after accounting for the variance associated with students logical
reasoning (syllogisms), GPA, and reading ability.
reasoning, GPA, and reading ability variables. The five dimensions associated
with epistemological beliefs (i.e., fixed ability, omniscient authority, simple
knowledge, certain knowledge, and quick learning) were entered as a block in
the final step of the regression analysis (see Table 2 for a description of the
variables used in the analysis). Gender did not contribute significant variance so
it was dropped from the analysis.
Regression Analysis
Table 3 shows the results of the forced-order regression. As expected, students
reading comprehension and GPA were strong predictors of achievement in the
hypermedia tutorial and accounted for a considerable proportion of the variance.
Contrary to our predictions, the two variables associated with metacognitive
awareness did not reach significance.
Even after removing variance from the variables in blocks one and two, the
epistemic beliefs variables accounted for additional variance. Three of the five
variables associated with epistemic beliefs reached significance, including
omniscient authority, fixed ability, and quick learning. Omniscient authority and
fixed ability were negatively correlated with achievement in the hypermedia
tutorial indicating that the less students believed that authorities have access to
knowledge that others do not (i.e., omniscient authority) and that the ability
to acquire knowledge is innate (i.e., fixed ability), the better they did in the
hypermedia tutorial. Interestingly, the quick learning variable was positively
Range
Cumulative
Predictor R R2 change B
GPA .184*
Reading Comprehension .367***
Syllogisms .054
Block One .473 .224
Regulation of Cognition .118
Knowledge of Cognition .097
Block Two .483 .010
Simple Knowledge .005
Certain Knowledge .014
Omniscient Authority .197*
Quick Learning .286*
Fixed Ability .280*
Block Three .557 .077
Note: Block One contains the variables GPA, Reading Comprehension, and Syllogisms.
Block Two contains the variables Regulation of Cognition and Knowledge of Cognition.
Block Three contains the variables Simple Knowledge, Certain Knowledge, Omnisicient
Authority, Quick Learning, and Fixed Ability.
*p < .05. **p < .01. ***p < .001.
correlated with achievement in the tutorial, meaning that the stronger the students
belief in quick learning, the higher their achievement scores on the tutorial
assessment. This contradicts previous research (e.g., Schoenfeld, 1983;
Schommer, 1990) that has found a negative relationship between a belief in quick
learning and achievement in various problem solving situations. Neither the
simple knowledge or the certain knowledge variables reached significance.
DISCUSSION
The present study indicated that students reading ability plays an important
role in learning within a hypermedia context. This is, essentially, a replication of
numerous studies examining the influence that reading skills have on achievement
(e.g., Royer, Abranovic, & Sinatra, 1987; Royer, Marchant, Sinatra, & Lovejoy,
1990). The crux of the tutorial was a timed reading for comprehension task. This
study serves as an important reminder that if reading is significantly involved in a
learning task, whether it be in a more traditional or in a hypermedia environment,
its influence cannot be taken for granted.
Certain epistemological beliefs were related to success in the hypermedia
task. This finding is supported by previous research looking at epistemological
beliefs and achievement (Schommer et al., 1992). In particular, students less
likely to believe in omniscient authority and fixed ability did better in terms of
achievement in the hypermedia tutorial. An important aspect of the tutorial on the
former Yugoslavia was discussion from various, sometimes opposing, experts.
Students less likely to see experts as having exclusive access to information may
be able to appreciate and understand conflicting views on a subject. Similar
to previous research (Dweck & Leggett, 1988; Schommer, 1990) a belief that
more effort does not coincide with more learning (i.e., fixed ability) was associated
with lower achievement in the hypermedia task. It may very well be that the
use of additional hypermedia tools available, such as links to definitions,
diagrams, self-check materials, objectives, and advanced organizers were viewed
as unnecessary mental effort by these participants and, therefore, not utilized.
Unlike previous research, a belief in quick learning was associated with success
in the hypermedia tutorial. For example, Schommer (1990) found that a belief
in quick learning was related to poor performance in a complex problem solving
task. Current results may be an artifact of the task itself. Students had 30 minutes
to study the material. Under strict time limitations, a belief that learning
happens quickly or not-at-all may have actually aided some students in navi-
gating through the tutorial in a more timely manner. In addition, the objective
assessment at the end of the tutorial may not have required higher levels of
thinking; therefore, this particular belief in quick (potentially low-level) learning
may not have been a detriment.
Finally, a broader question remains regarding the current studys findings:
Why didnt beliefs in simple and certain knowledge, and metacognition play a
significant role in the hypermedia tutorial? The answer to this question may, again,
lie in the structure of the hypermedia task and the subsequent assessment used.
A growing body of research has supported the idea that epistemological beliefs
are more related to ill-defined problem solving, as opposed to well-defined
problem solving (Bendixen & Schraw, 2001; Bendixen, Schraw, & Dunkle,
1998; Kitchener, 1983; Schommer, 1990). Well-defined problems are those in
which there is one agreed-upon solution and, generally, one way of getting there.
This is in contrast to ill-defined problems, which may contain several solutions
and various means of achieving them. Kitchener (1983), for example, proposed a
SUCCESSFUL LEARNING WITH HYPERMEDIA / 27
Implications
This study has important information for those who are designing and assessing
hypermedia environments and for educators involved in using technology to
enhance learning. Just because the task itself may be defined as hypermedia
(i.e., links to various forms of media) does not guarantee that it is necessarily
as non-linear and ill-defined a system as many have considered it (Jacobson &
Spiro, 1995). A cursory examination of the pathways participants took as they
navigated through the tutorial leads us to believe this may be the case. From this
preliminary analysis of log files, for example, it is clear that several of the
28 / BENDIXEN AND HARTLEY
participants read through the text only and did not use any additional hypermedia
tools available for the entire 30 minutes. Such information regarding hyper-
media environments should not be taken lightly when instructional design and
educational implications are being considered.
There are a number of educational implications stemming from the current
study. This study provides further evidence that what the student brings to the
learning task by way of abilities and epistemological beliefs have a significant
effect on learning outcomes, and vice versa. In other words, current evidence also
points to the idea that the types of learning and assessment tasks we offer students
may require certain types of abilities and beliefs for them to be successful.
Future Research
A number of questions have been raised by the current study that future research
could examine. In general, future research considering the unique aspects of
learning in a hypermedia context needs to further tease apart individual learner
differences, such as epistemological beliefs and metacognitive awareness, and
their role in learning. Specifically, future investigations could examine how
hypermedia environments can be presented in more ill-defined ways, the role of
epistemological beliefs and metacognition in them, and the subsequent impact
on learning.
Future research could also take a more detailed look at the pathways students
take while navigating through hypermedia learning environments. For instance:
What resources/hypermedia tools do students actually use?; For how long do they
use them?; and, more importantly, What do they gain from them? Along more
causal lines, future research could examine how epistemic beliefs impact problem
solving in hypermedia learning environments. For example: What deeper cogni-
tive processes are being tapped while students are engaged in learning with hyper-
media and how do they impact learning? Studies such as these could help us begin
answering important questions related to the educational potential of hypermedia.
REFERENCES
Bendixen, L. D., & Schraw, G. (2001, April). Why do epistemological beliefs affect
ill-defined problem solving? In L. D. Bendixen (Chair), Epistemological beliefs and
learning: What do we know and how do we know it? Symposium conducted at the American
Educational Research Association Annual Meeting, Seattle, WA.
Bendixen, L. D., Schraw, G., & Dunkle, M. E. (1998). Epistemic beliefs and moral
reasoning. The Journal of Psychology, 132:2, 187-200.
Brown, A. (1987). Metacognition, executive control, self-regulation, and other more
mysterious mechanisms. In F. Weinert & R. Kluwe (Eds.), Metacognition, motivation, and
understanding (pp. 65-116). Hillsdale, NJ: Erlbaum.
Brown, J. E., Bennett, J. M., & Hanna, G. (1981). The Nelson-Denny Reading Test,
Form E. Chicago, IL: The Riverside Publishing Company.
SUCCESSFUL LEARNING WITH HYPERMEDIA / 29
Royer, J. M., Marchant, H. G. III, Sinatra, G. M., & Lovejoy, D. A. (1990). The
prediction of college course performance from reading comprehension performance:
Evidence for general and specific prediction factors. American Educational Research
Journal, 27, 158-179.
Schoenfeld, A. (1983). Beyond the purely cognitive: Belief systems, social cognitions,
and metacognitions as driving sources in intellectual performance. Cognitive Science, 7:4,
329-363.
Schommer, M. (1990). Effects of beliefs about the nature of knowledge on com-
prehension. Journal of Educational Psychology, 82, 498-504.
Schommer-Aikins, M. (2002). An evolving theoretical framework for an epistemo-
logical belief system. In B. K. Hofer & P. R. Pintrich (Eds.), Personal epistemology:
The psychology of beliefs about knowledge and knowing (pp. 261-275). Mahwah, NJ:
Erlbaum.
Schommer, M., Crouse, A., & Rhodes, N. (1992). Epistemological beliefs and mathe-
matical text comprehension: Believing it is simple does not make it so. Journal of
Educational Psychology, 82, 435-443.
Schraw, G. (1998). Promoting general metacognitive awareness. Instructional Science,
26:(1-2), 113-125.
Schraw, G., Bendixen, L. D., & Dunkle, M. E. (2002). Development and validation of
the Epistemic Belief Inventory (EBI). In B. K. Hofer & P. R. Pintrich (Eds.), Personal
epistemology: The psychology of beliefs about knowledge and knowing (pp. 261-275).
Mahwah, NJ: Erlbaum.
Schraw, G., & Dennison, R. S. (1994). Assessing metacognitive awareness. Contem-
porary Educational Psychology, 19, 460-475.
Schraw, G., Dunkle, M. E., & Bendixen, L. D. (1995). Cognitive processes in ill-defined
and well-defined problem solving. Applied Cognitive Psychology, 9, 523-538.
Shute, V. (1993). A comparison of learning environments: All that glitters. In S. Lajoie
& S. Derry (Eds.), Computers as cognitive tools (pp. 47-73). Hillsdale, NJ: LEA.
Zimmerman, J. (1990). Self-regulated learning and academic achievement: An over-
view. Educational Psychologist, 25:1, 3-17.