You are on page 1of 7

Engineers as

Problem-Solving
Leaders:
Embracing the Humanities
KATHRYN W. JABLOKOW

I
n 1902, David Starr Jordan,
President of Stanford Uni-
versity, remarked: “There
are very many things be-
sides engineering [that] go
into the making of a real engineer”
[5]. Over a century later, in 2005,
Charles Vest, President of MIT, ad-
monished the attendees of the Na-
tional Academy of Engineering’s
“Engineer of 2020” National Edu-
cation Summit [15]:

“As you develop the concept


of a new curriculum and new
pedagogy, as you try to at-
tract and interest students
in nanoscale science, large
complex systems, product de-
velopment, sustainability, and
Todd Davidson/Stock Illustration RF/Getty Images

business realities, don’t be


tempted to crowd the humani-
ties, arts, and social sciences
out of the curriculum. The
integral role of these subjects
in U.S. engineering education
differentiates us from much
of the rest of the world. I be-
lieve the humanities, arts, and
social sciences are essential

Digital Object Identifier 10.1109/MTS.2007.911075

IEEE TECHNOLOGY AND SOCIETY MAGAZINE | winter 2007 1932-4529/07/$25.00©2007IEEE | 29


to the creative, explorative, ing of one of the core elements n Communication
open-minded environment of the engineering discipline n Collaboration
and spirit necessary to edu- as well. Specifically, I will pro- n Ethics and social responsibility

cate the engineer of 2020.” pose that framing the situation In the first case, engineers need
to be able to communicate to oth-
ers what they do, accurately and
Using problem solving as a backdrop persuasively (both orally and in
writing), and to understand what
leads to insights about what it takes others want them to do, where
to move beyond engineering these “others” are becoming in-
creasingly diverse in terms of both
competence to engineering leadership. discipline and culture as problems
expand to cover more different ar-
eas of specialization and the cor-
Other distinguished engineering in terms of problem solving – one porate workplace spans the globe
scholars and practitioners have of the activities with which engi- [7]-[9], [18]. Second, due to the
made similar observations and rec- neers are most familiar (in a tech- increasing difficulty and complex-
ommendations in the interim. In nical sense, at least) – provides a ity of today’s problems and what
1995, for example, delegates from view of non-technical subjects and Florman refers to as the “changing
12 nations at an international sym- their practical value that may be social order” [5], engineers must
posium sponsored by the European more appealing and compelling learn to work effectively in teams
Society for Engineering Education to engineers. This framework sug- (i.e., to collaborate), making best
(SEFI) agreed that “the humani- gests and enables a new mode of use of diverse human resources
ties and social sciences are vital for discourse, one that may be more (of knowledge, skill, and/or strat-
the full intellectual development of effective in reaching those who egy, for example) in order to solve
an engineer” [4], and Florman [5] remain as yet unconvinced; in es- the problems with which they are
noted several years later: “the vital sence, the language of problem faced [9]. All of these conditions
first step is to convince engineering solving is the language of engi- also lead to increasing demands
students that technical brilliance is neers, and I believe we can (and for higher sensitivity on the part
not enough”. should) use it more effectively. In of engineers to the social impact
Clearly, at least one message addition, using problem solving as of their actions [6], [14], [20]; en-
coming from those in the highest a backdrop leads to insights about gineers must behave ethically and
and most respected positions in what it takes to move beyond engi- responsibly within a broader social
our profession has not changed a neering competence to engineer- context than ever before.
great deal in 100 years: engineers ing leadership – a goal toward Unfortunately, in the view
must know more than engineer- which we must strive if we are to of many engineers, even these
ing in ­order to be good engineers. remain competitive in the current few key subjects are too widely
Equally clearly, a large number fast-paced global economy. separated from engineering to
of engineers must remain uncon- be relevant or useful, and sadly,
vinced, or there would be little Communicate, Collaborate, this opinion is held by students,
need to repeat the message with and Do the Right Thing faculty, and practicing engineers
such urgency at those same high Let’s begin by considering a few alike. Their ambivalence (which
levels of influence. What, then, of the non-technical subjects most sometimes borders on hostility) is
can be done to bridge this gap in often identified as relevant and demonstrated in a number of ways.
the appreciation of non-techni- important for engineers. Among Florman [5] reports, for example,
cal subjects? How might we do a the designers of engineering de- that many engineering students
better job of convincing engineers gree programs and those pro- choose engineering precisely be-
that non-technical knowledge and grams’ accreditors, it is generally cause it is “viewed as having no
skills are both relevant and useful? agreed that in addition to some political or cultural component”;
How can we implement the com- well-defined standard of techni- in essence, they see engineer-
mon vision of Jordan, Vest, Flor- cal material, the “competent” en- ing as a discipline that deals with
man, and others more effectively? gineer needs knowledge and skill things, not people – and they find
In this article, I offer a new in several key areas that have the apparently greater predictabil-
perspective on this quandary that their roots in the social sciences ity of “things” more attractive. In
may provide both a path to its and humanities [1], [15]. Some of addition, engineers often perceive
resolution and better understand- the most familiar of these are: that non-technical subjects “don’t

30 | IEEE TECHNOLOGY AND SOCIETY MAGAZINE | WINTER 2007


count in the real world” despite 1). Within this model, a “problem” generally and as I have discussed
repeated claims from companies is simply and broadly defined as for scientists and engineers in
that new hires must be “team a gap between some current state particular [7], a person’s problem-
­players” who are able to commu- and a desired state. To solve a par- solving style is directly related to
nicate and collaborate effectively, ticular problem, one or more prob- his/her preference for structure.
both within and across cultures. lem solvers (person) engage in a In the end, successful resolu-
For the most part, companies problem-solving process (alone tion of any problem depends on
continue to employ new gradu- or in collaboration) within a given the problem solver(s) identifying
ates (and experienced engineers environment, resulting in an out- and assembling all of the resourc-
as well) based primarily on their come or product. es (levels, styles) required by that
technical abilities [5], paying lip
service to non-technical qualifica-
tions or attempting to introduce The language of problem solving is the
them through training after the
hiring is done. Finally, engineer- language of engineers.
ing faculty members themselves
are frequently cynical about non-
technical subjects, viewing them Kirton [9] uses four funda- particular problem and managing
as a drain on already limited re- mental variables – opportunity, those resources well. This notion
sources of time and effort within a motive, level, and style – to de- is best explained using Kirton’s
crowded engineering curriculum. scribe the problem solver and his/ distinction between Problem A
her interaction with the remain- (the original problem a team has
Problem Solving: ing components of the model. In come together to solve) and Prob-
A New Perspective particular, the environment is the lem B (the automatically inherited
on an Old Quandary prime source of opportunity (i.e., problem of managing differences
Part of the challenge in convincing problems); each problem solver among team members): success-
engineers (in any sphere – academ- chooses which opportunities to ful teams spend more time and
ic or corporate – and at any rank) exploit (which problems to solve) energy on Problem A than on
that non-technical subjects are rel- under the direction of motive and Problem B [9]. All this means that
evant, important, and useful lies in then attempts to resolve them by engineering leaders need to man-
demonstrating concrete benefits in bringing to bear the levels and age diversity well – both diversity
exchange for their efforts in mas- styles required. A key contribution of problems and diversity of prob-
tering them. What, for example, of Kirton lies in his clear defini- lem solvers. The latter are diverse
will they do better as engineers if tions of and distinction between in level, style, and motive, but all
they become proficient in aspects level and style, which – despite must remain focused on a common
of the humanities or social sci- their independence – are often aim within a common process.
ences? Will they design more and confounded, with style being the Engineering leaders need to help
better products? Will they build most frequently misunderstood. everyone in the team concentrate
systems more rapidly and efficient- Level refers to “by or with how on Problem A and resolve any
ly? Engineers are taught to identify much” a person solves problems emerging Problem B’s as mutually
and use sound metrics to assess the (e.g., his/her capacity, knowledge, undesired distractions. This intro-
outcome of any new venture: what skill), while style refers to one’s duction to Kirton’s work, though
kinds of metrics might we use to preferred “way” (i.e., manner, very brief indeed, reveals the new
support the value of non-technical strategy, approach) of problem mode of discourse I hinted at ear-
education for engineers? Here, I solving. As Kirton [9] describes lier – one that might be used to
suggest that moving the discussion
into the general domain of problem
solving may help us answer these
Environment
questions and more.
Based on the early work of
Rhodes [17] and the more recent Person Process Product
contributions of Kirton [9], prob-
lem solving can be modeled as the
interaction of four components
that incorporate both technical
and non-technical factors (see Fig. Fig. 1. A general model for problem solving.

IEEE TECHNOLOGY AND SOCIETY MAGAZINE | WINTER 2007 | 31


“translate” some of the non-tech- great distances. Returning to the engineer, along with differential
nical challenges engineers face schema in Fig. 1: to avoid misun- equations, computer simulations,
when collaborating, using lan- derstanding, the problem solver prototypes, and other more famil-
guage that sounds more familiar (in this case, the engineer) must iar tools of the trade.
and consistent with the technical be able to communicate well in An example of a current,
aspects of their work. order to perceive all the relevant complex engineering problem in
Using these concepts (and corre- opportunities within his/her envi- which communication and collab-
sponding language) as a backdrop, ronment, assemble and help guide oration play particularly impor-
the concrete benefits engineers might his/her team (making best use of tant roles is distributed software
development. In such projects,
multiple teams of software de-
Engineers often perceive that non- signers and programmers – often
technical subjects “don’t count in the located on different continents
and in different time zones (and
real world.” cultures) – must regularly com-
municate and coordinate diverse
and detailed requirements, con-
rightfully seek in exchange for the its problem-solving diversity) in straints, resources, outcomes, and
effort they spend studying (say) the order to exploit those opportu- feedback asynchronously while
humanities or social sciences might nities, manage all the processes maintaining the integrity of the
include, among others, some or all of required, and introduce the prod- final product and maximizing ef-
the following outcomes: uct back into the environment, ficiency. In this context, Sangwan
where it will be used and evalu- et al. [18] have suggested that a
n Solving more problems (i.e., ated by other problem solvers, problem-solving framework (such
more Problem A’s) who – in turn – will try to com- as the one described above) can
n Solving more difficult and municate their assessments back be used to help project leaders
complex problems to the original problem solver(s). measure, monitor, and manage
n Solving problems more If communication breaks down in the gaps in knowledge and skill
quickly and efficiently only one of these stages, problem- (i.e., level) and approach (i.e.,
n Learning how to manage solving performance will suffer. style) that occur (seemingly with-
Problem B’s more effectively. Collaboration, as a second ex- out fail) between members of the
ample, lies at the very heart of same team, between teams, and
The associated metrics required complex problem solving, as we between individuals and/or teams
to assess progress in these areas consider the vast range of lev- and the tasks they must complete.
seem clear: the number of problems els (knowledge, skills, types of The results, they propose, are
solved, their degree of complexity, expertise) and styles (preferred improvements in shared under-
the time required for solution, the strategies, approaches) that may standing (which is critical to the
costs involved, the level of satisfac- be necessary in order to solve such resolution of any shared Problem
tion, and so on. If we can link the problems. No one problem solver A) and valuable insights into the
study and mastery of non-technical (engineer) can single-handedly convergent and divergent behav-
subjects to these goals (and others supply the vast breadth and depth ior of collaborating development
like them), the value of those sub- that is so often required. From this teams [18].
jects may become a bit clearer to a perspective, collaboration shifts Finally, knowledge of ethical
professional community that gen- from a “necessary evil” that must principles and experience with
erally prides itself on its problem- be tolerated (a view all too often socially responsible profession-
solving function in society. held by engineering students and al practices can also be linked
Returning to communication, experienced practitioners alike) to problem-solving goals. Such
collaboration, and ethics/social to a fundamental necessity, which knowledge and experience repre-
responsibility, we can see imme- – while admittedly a challenge sent additional (level) resources
diately the role and importance to manage – is absolutely critical that can be used to support the res-
of communication as an under- to success. The different levels, olution of many (if not all) com-
lying factor in all of the prob- styles, motives, and perceptions plex problem-solving scenarios;
lem-solving goals listed above. of opportunity provided by other we have only to look to the events
Misunderstanding (i.e., miscom- problem solvers (especially those surrounding the Challenger Space
munication) is a common cause not like us) become added tools in Shuttle disaster or the case of the
of project failure – particularly at the problem-solving toolbox of the Citicorp Tower [6] to realize their

32 | IEEE TECHNOLOGY AND SOCIETY MAGAZINE | WINTER 2007


importance. In her discussion of gineering excellence and beyond work for problem solving that can
the similarities between ethical – to engineering leadership. help them manage professional
problem solving and engineer- In confirming that all humans collaborations in the future. As
ing design, Whitbeck [20] notes: are problem solvers with the po- Jonassen et al. [8] describe:
“People confronted with ethical tential to assume leadership roles
problems must do more than sim- within problem-solving situations, “Workplace problems are ill-
ply make judgments; they must Kirton [9] notes that problem-solv- structured and complex be-
figure out what to do.” In other ing leaders in any discipline need cause they possess conflicting
words, they must develop the to have three things: goals, multiple solution meth-
skills required to actually solve ods, non-engineering success
problems with ethical dimensions, n enough domain knowledge to standards, non-engineering
not just analyze them in principle be competent, con­straints, unanticipated pro­
(or in hindsight). According to n knowledge and understand- blems, distributed knowledge,
Lynch and Kline [14], “investigat- ing of problem solvers, and collaborative activity systems,
ing the socio-technical aspects of n knowledge and understand- the importance of experience,
engineering practice” will help ing of the problem-solving and multiple forms of prob-
engineers build those skills by en- process, lem representation.”
abling them to recognize ethical
problems in real-world settings, where “domain knowledge” refers A few “team project” experi-
thereby preparing them “to ad- to content from the relevant disci- ences in school will not provide
dress issues of public health, safe- pline – here, engineering. Within young engineers with the founda-
ty, and welfare before they require engineering education, we seem tion they need to handle these far
heroic intervention.” to have the delivery of our domain more difficult workplace prob-
Harris et al. [6] agree, stating: knowledge fairly well in hand (al- lems. The problem-solving educa-
“A significant part of responsible though there is always room for tion that engineers need – though
engineering practice is the exercise improvement, of course). In add- it may not be fully comprehensive
of preventive ethics: the practice of ing communication, collaboration, – must be rigorous and based upon
sound ethical decision making to and ethics to the pedagogical and sound theory and proven applica-
avoid more serious problems later.” practical menu, we are begin- tion (avoiding some of the pitfalls
ning to cover more of the territory of the trendy creativity literature –
From Engineering Kirton recommends for develop- e.g., that nothing works except the
Competence to ing engineering leadership, but wildest “innovation”). Beveridge, a
Engineering Leadership we must take care not to separate Cambridge scientist, provides a fa-
Using problem solving as an un- these subjects (and others like miliar and useful analogy [3]:
derlying framework, we can see them) from the underlying frame-
now how non-technical subjects work we have built to support and “It is not necessary to be a
might be linked to the successful link them together. mechanic in order to drive
practice of engineering in ways In other words, we must add a car, nor trained in cogni-
that are reasonable and potential- knowledge about the general do- tive psychology (study of the
ly more appealing to engineers main of problem solving to the thinking process) or philoso-
than those used elsewhere. The menu as well (which will bring in phy in order to think or rea-
model described above also pro- psychology by default), broaden- son. But there are times when
vides a comprehensive framework ing the scope of each engineer’s the car will not go and times
for the study of problem solving non-technical expertise still fur- when the usual thought pro-
itself within scientific and other ther. The greatest weakness in the cesses do not solve a problem
disciplines, a matter which I have problem-solving education most and then it is useful to have
taken up in other works [7] and engineers receive today is simul- a working knowledge of the
to which I will return below. Even taneously its greatest strength: machinery one is using. This
more importantly, perhaps, by ex- namely, its almost exclusive fo- knowledge need not be pro-
amining engineering through the cus on the technical aspects of found; it often helps to get
lens of problem solving, we can problems and their technical so- the car going again if one just
obtain valuable insights into the lutions. Even when students are knows the general principles
strategic development of our pro- exposed to situations designed to of how the machine functions
fession – in particular, insights give them experience in collab- and some techniques that are
into how we might move from orative problem solving, they are useful in overcoming com-
engineering competence to en- rarely given a theoretical frame- mon difficulties.”

IEEE TECHNOLOGY AND SOCIETY MAGAZINE | WINTER 2007 | 33


Here, the “machinery” we are with which we are concerned, but examples can be placed. For ex-
talking about is the human brain with the process of problem solv- cellent examples of contributions
– the most powerful and versatile ing in general: how it is done, and made by engineers and scientists
to the history and/or ­philosophy of
science and engineering, one need
The engineering leader must only look to Petroski [16], Flor-
man [4], [5], Lienhard [11], [12],
understand and be able to manage Lipton [13], and, of course, Kuhn
[10], among others.
technological change.
Implications for the
Future: Toward a More
“engine” we have at our disposal. how it is done most effectively. Esteemed Profession
Engineers who aspire to leadership Above all, in this complex world While it may be more expensive in
need to know at least the “general of large, profound problems, we terms of time and effort, the broad-
principles” of how the brain solves must understand how other, differ- er view of what an engineer needs
problems (i.e., the problem-solv- ent problem solvers operate, their to know is surely safer (by includ-
ing process) – both alone and in value in being different, and how ing more, it is more conservative)
collaboration – in order to opti- to manage them, differences and and more sensible to the well-edu-
mize their own performance and all. This knowledge (and apprecia- cated person; today, it is also, in
to facilitate the performance of tion for difference) enables us to fact, critical. As we have noted,
the teams of which they are a part. be good followers and able lead- while engineers may not need to
The problem solver is the leader’s ers – as Kirton points out: leaders know everything about other dis-
prime resource, and a leader must need to master the management ciplines (indeed, this would not be
be well-prepared to manage the of diversity in order to master the possible in a lifetime), the com-
problem-solving diversity avail- management of change [9]. plexity and difficulty of the tech-
able within his/her team in order The questions we must ask in nological problems we now face
to make best use of it in solving order to gain this kind of under- mandate greater diversity in the
problems successfully. standing are fundamentally philo- knowledge and skills with which
The engineering leader must sophical [2], [13]: What kinds of we must be familiar in order to
know how to manage problem- patterns do we find in the develop- succeed; we must know more, and
solving diversity for another rea- ment of new theories, models, or about different things [7].
son as well: s/he must understand technologies? How do we know In considering the general man-
and be able to manage technologi- when a new theory or technology agement of such a vast array of di-
cal change. We, as engineers, ex- is needed, and how much (and in versity, Kirton offers some sound
pect the users of our products to what ways) should it differ from advice [9]:
understand enough about them to what already exists? How do we
use them safely and wisely (or so compare and choose between dif- “As with our own bodies
we hope). In return, it is our re- ferent theories, models, or technol- (including, critically, our
sponsibility as engineers to con- ogies? These are the kinds of ques- brains), all diversity within
sider how our creations influence tions that can help us characterize a group is potentially useful
society, and we can only do so if technological change; to under- to its members except that
we understand how technologies stand and facilitate such change, which is manifestly hostile.
and societies change and how in- engineering leaders must have a If the diversity is neutral,
dividuals respond to both [2], [19]. solid, working knowledge of both then its presence should be
Engineering is based on the devel- the history and the philosophy of seen as yielding more reward
opment and validation of models science and engineering as well. than cost. To worry about
and theories, as well as the devel- Both of these subjects deal with diversity that is neutral or to
opment and testing of new tech- how science (or scientific change) spurn one that has a net ad-
nologies. Understanding how those “works”: history provides an es- vantage are the prime ways
models, theories, and technolo- sentially inductive view through of mismanaging diversity.
gies develop is critical; how else its vast collection of examples (we Tolerance of neutral diversi-
(returning to Fig. 1) can we im- learn from the past failures and ty is a long-term strategy of
prove the processes and products successes of ourselves and others), survival; acceptance of the
of engineering? It is not only the while philosophy provides the the- cost of managing diversity is
solution of any particular problem oretical framework in which those a price of survival.”

34 | IEEE TECHNOLOGY AND SOCIETY MAGAZINE | WINTER 2007


In an engineering context, the to the rest of society (on society’s [6] C.E. Harris, M.S. Pritchard, and M.J.
social sciences, arts, and humani- terms); society, in exchange, will Rabins, Engineering Ethics: Concepts &
Cases, 3rd ed.. Belmont, CA: Thomson Wad-
ties (among other non-technical be more likely to reach out to us sworth, 2005.
disciplines) are at worst neutral in return. To propel this vision of [7] K.W. Jablokow, “The catalytic na-
diversity; in actual fact, they offer prominence and prestige into the ture of science: Implications for scien-
tific problem solving in the 21st century,”
a net advantage more often than future, we must convince engineer- Technology in Society, vol. 27, no. 4, pp.
not. Engineers must remember ing students, faculty, and practitio- 531–549, 2005.
that when the value of these sub- ners that non-technical subjects do [8] D. Jonassen, J. Strobel, and C.B. Lee, “Ev-
eryday problem solving in engineering: Les-
jects is not immediately apparent have value, they do “count” in the sons for engineering educators,” J. Engineer-
for a particular problem, it does grand scheme of things, they are ing Education, pp. 139–151, Apr. 2006.
not mean they are not useful at useful and relevant, and they will [9] M.J. Kirton, Adaption-Innovation in the
all; as we have discussed, without make them better citizens through Context of Diversity and Change. London,
U.K.: Routledge, 2003.
them, we will lose problem-solv- greater effectiveness and power in [10] T.S. Kuhn, The Structure of Scientific
ing power in the face of complex general. The key to delivering this Revolutions. Chicago, IL: Univ. of Chicago
challenges. If we spurn them, it is message more directly and more Press, 1962.
[11] J.H. Lienhard, The Engines of Our In-
at our own risk. persuasively may lie in showing genuity: An Engineer Looks at Technology
Becoming versed in non-tech- them how non-technical knowl- and Culture. New York, NY: Oxford Univ.
nical subjects promises other re- edge will make them better prob- Press, 2000.
[12] J.H. Lienhard, How Invention Begins.
wards as well. As Florman [5] lem solvers as well.
New York, NY: Oxford Univ. Press, 2006.
reports, many engineers feel that [13] P. Lipton, “The Medawar Lecture 2004:
their profession is not properly es- Author Information The truth about science,” Philosophical Trans.
teemed and that engineers are not The author is with the Pennsylva- Royal Society B, vol. 360, pp. 1259–1269,
2005.
viewed as leaders in U.S. society, nia State University, Great Valley [14] W.T. Lynch and R. Kline, “Engineering
even when they achieve social School of Graduate Professional practice and engineering ethics,” Science,
prominence (consider President Studies, 30 E. Swedesford Road, Technology, & Human Values, vol. 25, pp.
195–225, 2000.
Jimmy Carter during his term in Malvern, PA 19355 U.S.A. Email: [15] National Academy of Engineering, Edu-
office). Clearly, we need to im- KWL3@psu.edu. cating the Engineer of 2020. Washington, DC:
prove the prestige of the engineer- National Academies Press, 2005.
ing profession through – as Ben- [16] H. Petroski, “Technology and the hu-
References manities,” American Scientist, vol. 93, pp.
Haim remarks [2] – the “subtle 304–307, Jul.-Aug. 2005.
[1] ABET 2005-2006 Accreditation Policy
and intellectually sophisticated and Procedure Manual. Baltimore, MD: [17] M. Rhodes, “An analysis of creativity,”
interplay between science, tech- ABET, Inc., 2004; www.abet.org. Phi Delta Kappan, vol. 42, pp. 305–310,
[2] Y. Ben-Haim, “Why the best engineers 1961.
nology, and man’s understanding [18] R. Sangwan, K. Jablokow, M. Bass, and
should study humanities,” Int. J. Mechani-
of nature and of himself.” Florman cal Engineering Education, vol. 28, pp. D. Paulish, “Asynchronous collaboration:
[5] claims (and I agree) that we, as 195–200, 2000. Achieving shared understanding beyond the
[3] W.I.B. Beveridge, Seeds of Discovery. first 100 meters,” in Proc. 2006 ASEE Ann.
engineers, can enhance our posi- Conf. & Expo., Chicago, IL, 2006.
London, U.K.: Norton , 1980.
tion in society (i.e., achieve esteem [4] S.C. Florman, “The whole engineer,” Tech- [19] C.P. Snow, The Two Cultures and the
and higher social status as a pro- nology Rev., vol. 99, no. 3, p. 67, 1996. Scientific Revolution. Cambridge, U.K.: Cam-
[5] S.C. Florman, “Non-technical studies for bridge Univ. Press, 1959.
fession) by developing and present-
engineers: The challenge of relevance,” Euro. [20] C. Whitbeck, Ethics in Engineering
ing ourselves and the profession J. Engineering Education, vol. 22, no. 3, pp. Practice and Research. Cambridge, U.K.:
as willing and able to “reach out” 249–258, 1997. Cambridge Univ. Press, 1998.

IEEE TECHNOLOGY AND SOCIETY MAGAZINE | WINTER 2007 | 35

You might also like