Professional Documents
Culture Documents
(PGD-SRD)
(A Distance Mode Programme of NIRD and UoH)
EXECUTION
Course Editor
Programme Co-ordinators
R.R.Prasad
S. M. Ilyas
E. Haribabu
UNIVERSITY OF HYDERABAD
Hyderabad
Contributor: Dr.R.R.Prasad
PREFACE
A project is a time-bound intervention consisting of a set of planned and interrelated
activities executed to bring about a beneficial change. It has a start and a finish, involves a
multidisciplinary team collaborating to implement activities within constraints of cost, time
and quality, and has a scope of work that is unique and subject to uncertainty. Projects link
policy initiatives at a higher level (e.g. national or sectoral) with a specific problem faced by
a target group of local-level stakeholders or by institutions or organizations. Project proposal
formulation requires the involvement of stakeholders in the identification of needs, interests,
conflicts, resources, potentials, capacities and responsibilities and the review of all issues
that might influence project implementation.
If a project idea is to be funded and implemented, its formulator must communicate it in a
clear and concise manner. To this end, a document known as a project proposal is written to
summarize the project rationale and design. This course on Guidelines for Formulation and
Execution of Projects guides project proposal formulators through each step of project (or
pre-project) identification, formulation, and execution. This course has three Blocks
comprising 10 Units. The course material of the SRD 508 is divided into following Blocks
and each Bock has 3-4 units. Each Block also contains Introduction to the Block. The
scheme of the SRD 508 in terms of its distribution and Blocks and Units is given below.
BLOCK 1: Research & Action Research
Research and development can no longer be the exclusive domain of scientists. To find
sustainable solutions to development problems, a wider range of actors must be involved. It
is crucial, for example, that local stakeholders provide input to the process. In this context,
developing a good understanding of the various issues related to undertaking qualitative
research, methods for qualitative data collection and action research assumes added
significance. Therefore, in the Block 1, we have provided the following three units.
Unit 1: Qualitative Research
Unit 2: Methods of Qualitative Data Collection
Unit 3: Action Research
BLOCK 2: Guidelines for Preparation of Concept Notes and Research Proposal
The main purpose of this Block is to inspire and guide aspiring and new practitioners of
Research and Development to learn, reflect and constantly refine the way they work. The
primary objective of this Block is to enable the students to understand the importance writing
a concept note, and also how to write a good research proposal. This Block also helps the
students in understanding the common mistakes which they might make while preparing
research proposals.
Most funding organizations first requires a concept note before you submit a research
proposal because this should help to ensure that your idea for the project is a good one and
the way you want to go about the project is feasible. However, you will have to spend time
carefully thinking and planning the research, as the planning of the research project is very
important. How well you plan the research will largely influence how good the actual
research project is. The planning is perhaps the most critical stage of the research project.
This should reduce the risk of you preparing a full proposal that is rejected by the funding
organizations.
Unit 1: Guidelines for Preparing Concept Notes
Unit 2: How to Design Your Research Proposal
Unit 3: Common Mistakes and Problems in Research Proposal Writing
BLOCK 3: Indicators, Case Studies, and Evaluation of Sustainable Rural
Development
Improving the quality of life for the people of this country is perhaps the most important duty
of Government. We set measurable indicators across the whole range of issues that matter
most to people, and are likely to matter to future generations too. That means measuring
how we perform on the big, important things such as peoples health, the state of the
economy, employment, transport, crime and the environment. The indicators show how in
some areas things are already improving. Additionally, we are also required to conduct case
studies to capture various successful interventions in sustainable development. Thus we
need to know the sustainability indicators, basics of developing case studies, format for
writing case study reports, and how to carry out the evaluation of rural development
schemes.
Therefore, in the Block 3, we have provided the following four units.
Unit 1: Indicators of Sustainable Development
Unit 2: Basics of Developing Case Studies
Unit 3: Format for Writing Case Study Report
Unit 4: How to Evaluate Rural Development Schemes
I have no doubt that course materials contained in the SRD 508 will be immensely helpful to
the students in formulation of and execution of sustainable rural development projects.
R.R. Prasad
Course Editor
CONTENTS
BLOCK 1: Research & Action Research
Unit 1: Qualitative Research
Unit 2: Methods of Qualitative Data Collection
Unit 3: Action Research
1. Introduction
This Unit introduces the fundamental elements of a qualitative approach to research, to help
you understand and become proficient in the qualitative methods discussed in subsequent modules.
We recommend that you also consult the suggested readings at the end of the Unit for more in-depth
treatment of the foundations of qualitative research.
2. Objectives
After studying this Unit, you should be able to understand:
What is qualitative research?
Compare qualitative and quantitative research
Role of sampling method in qualitative research
Role of recruitment in qualitative research
Ethical guidelines in qualitative research
collects evidence
produces findings that were not determined in advance
produces findings that are applicable beyond the immediate boundaries of the study
The types of data these three methods generate are field notes, audio (and sometimes video)
recordings, and transcripts.
Qualitative methods are typically more flexible i.e. they allow greater spontaneity and
adaptation of the interaction between the researcher and the study participant. For example,
qualitative methods ask mostly open-ended questions that are not necessarily worded in exactly the
same way with each participant. With open-ended questions, participants are free to respond in their
own words, and these responses tend to be more complex than simply yes or no. In addition, with
qualitative methods, the relationship between the researcher and the participant is often less formal
than in quantitative research. Participants have the opportunity to respond more elaborately and in
greater detail than is typically the case with quantitative methods. In turn, researchers have the
opportunity to respond immediately to what participants say by tailoring subsequent questions to
information the participant has provided.
It is important to note, however, that there is a range of flexibility among methods used in
both quantitative and qualitative research and that flexibility is not an indication of how scientifically
rigorous a method is. Rather, the degree of flexibility reflects the kind of understanding of the
problem that is being pursued using the method.
longer bring additional insights to the research questions). Purposive sampling is therefore most
successful when data review and analysis are done in conjunction with data collection.
choice must be made between doing harm to a participant and doing harm to the research, it is the
research that is sacrificed. Fortunately, choices of that magnitude rarely need to be made in
qualitative research! But the principle must not be dismissed as irrelevant, or we can find ourselves
making decisions that eventually bring us to the point where our work threatens to disrupt the lives of
the people we are researching.
8. Summing up
Qualitative research is a method of inquiry appropriated in many different academic
disciplines, traditionally in the social sciences, but also in market research and further contexts.
Qualitative researchers aim to gather an in-depth understanding of human behavior and the reasons
that govern such behavior. The qualitative method investigates the why and how of decision making,
not just what, where, when. Hence, smaller but focused samples are more often needed, rather than
large samples. Qualitative methods produce information only on the particular cases studied, and any
more general conclusions are only hypotheses.
9. Keywords
Focus Group is a form of qualitative research in which a group of people are asked about their
perceptions, opinions, beliefs and attitudes towards a product, service, concept, advertisement, idea,
or packaging.[1] Questions are asked in an interactive group setting where participants are free to talk
with other group members.
Qualitative research is a method of inquiry appropriated in many different academic disciplines,
traditionally in the social sciences, but also in market research and further contexts. Qualitative
researchers aim to gather an in-depth understanding of human behavior and the reasons that govern
such behavior. The qualitative method investigates the why and how of decision making, not just
what, where, when. Hence, smaller but focused samples are more often needed, rather than large
samples.
Participant observation is a type of research strategy. It is a widely used methodology in many
disciplines, particularly, cultural anthropology, but also sociology, communication studies, and social
psychology. Its aim is to gain a close and intimate familiarity with a given group of individuals (such
as a religious, occupational, or sub cultural group, or a particular community) and their practices
through an intensive involvement with people in their natural environment, usually over an extended
period of time.
Program evaluation is a systematic method for collecting, analyzing, and using information to
answer basic questions about projects, policies and programs.
2.
3.
What are the basic differences between quantitative and qualitative research methods?
4.
Nkwi P, Nyamongo I, Ryan G.( 2001). Field Research into Social Issues: Methodological
Guidelines. UNESCO, Washington, DC:
Pelto P, Pelto G.( 1997) Studying knowledge, culture and behavior in applied medical anthropology.
Med Anthropol Q;11(2):147-63.
Pope C, Mays N. (2000). Qualitative Research in Health Care. BMJ Books. London.
Schensul, J, LeCompte M. (1999).Ethnographers Toolkit. Altamira Press, Walnut Creek, CA.
For additional information on this topic, refer to Chapter 1: Invitation to Explore, Chapter 3:
Designing the Study, Chapter 4: Collecting Qualitative Data: The Science and the Art, Chapter 5:
Logistics in the Field, and Appendix 2: Examples of Oral Consent Forms in these companion guides:
Qualitative Methods in Public Health: A Field Guide for Applied Research
Qualitative Methods: A Field Guide for Applied Research in Sexual and Reproductive Health
3.
Qualitative methods are typically more flexible that is, they allow greater spontaneity and
adaptation of the interaction between the researcher and the study participant.
Perhaps the most traditional division in the way qualitative and quantitative research have
been used in the social sciences is for qualitative methods to be used for exploratory (i.e., hypothesisgenerating) purposes or explaining puzzling quantitative results, while quantitative methods are used
to test hypotheses. This is because establishing content validity - do measures measure what a
researcher thinks they measure? - is seen as one of the strengths of qualitative research. While
quantitative methods are seen as providing more representative, reliable and precise measures through
focused hypotheses, measurement tools and applied mathematics. By contrast, qualitative data is
usually difficult to graph or display in mathematical terms.
4.
Three core principles form the universally accepted basis for research ethics.
Respect for persons requires a commitment to ensuring the autonomy of research participants, and,
where autonomy may be diminished, to protect people from exploitation of their vulnerability. The
dignity of all research participants must be respected. Adherence to this principle ensures that people
will not be used simply as a means to achieve research objectives.
Beneficence requires a commitment to minimizing the risks associated with research, including
psychological and social risks, and maximizing the benefits that accrue to research participants.
Researchers must articulate specific ways this will be achieved.
Justice requires a commitment to ensuring a fair distribution of the risks and benefits resulting from
research. Those who take on the burdens of research participation should share in the benefits of the
knowledge gained. Or, to put it another way, the people who are expected to benefit from the
knowledge should be the ones who are asked to participate.
In addition to these established principles, some bio-ethicists have suggested that a fourth principle,
respect for communities, should be added.
UNIT-2: METHODS OF
QUALITATIVE DATA COLLECTION
Structure
1. Introduction
2. Objectives
3. Observation Techniques
3.1 Recording observational data
3.2 The role of the observer
4. Interviews
4.1 In-depth interviews
4.2 When to use in depth interviews
4.3 Recording interview data
5.Focus Groups
5.1 When to use focus groups
5.2 Developing a focus group
5.3 Recording focus group data
6. Summing up
7. Keywords
8. Know your Progress
9. Further Reading / References
10. Model Answers
1. Introduction
There are two broad categories of data collection methods: qualitative and quantitative.
Qualitative research is a method of inquiry appropriated in many different academic disciplines,
traditionally in the social sciences, but also in market research and further contexts. Qualitative data is
extremely varied in nature. It includes virtually any information that can be captured that is not
numerical in nature. Sometimes referred to as touchy-feely research, qualitative data collection
requires researchers to interpret the information gathered, most often without the benefit of statistical
support. If the researcher is well trained in interpreting respondents comments and activities, this
form of research can offer very good information.
Qualitative research is grounded in the assumption that individuals construct social reality in
the form of meanings and interpretations, and that these constructions tend to be transitory and
situational. Qualitative research often categorizes data into patterns as the primary basis for
organizing and reporting results. Researchers use qualitative methods to capture what people say
about their meanings and interpretations. Qualitative research typically involves qualitative data, i.e.,
data obtained through methods such interviews, on-site observations, and focus groups that is in
narrative rather than numerical form. Such data are analysed by looking for themes and patterns. It
involves reading, rereading, and exploring the data. How the data are gathered will greatly affect the
ease of analysis and utility of findings.
In this Unit, we describe and compare the most common qualitative methods employed in
project evaluations. These include observations, indepth interviews, and focus groups. We also
cover briefly some other less frequently used qualitative techniques. Advantages and disadvantages
are summarized. For those readers interested in learning more about qualitative data collection
methods, a list of recommended readings is provided.
2. Objectives
After reading this Unit, you will be able to:
3. Observation Techniques
Observational techniques are methods by which an individual or individuals gather firsthand
data on programs, processes, or behaviors being studied. They provide evaluators with an opportunity
to collect data on a wide range of behaviors, to capture a great variety of interactions, and to openly
explore the evaluation topic. By directly observing operations and activities, the evaluator can
develop a holistic perspective, i.e., an understanding of the context within which the project operates.
This may be especially important where it is not the event that is of interest, but rather how that event
may fit into, or be impacted by, a sequence of events. Observational approaches also allow the
evaluator to learn about things the participants or staff may be unaware of or that they are unwilling
or unable to discuss in an interview or focus group.
When to use observations? Observations can be useful during both the formative and
summative phases of evaluation. For example, during the formative phase, observations can be useful
in determining whether or not the project is being delivered and operated as planned. In the
hypothetical project, observations could be used to describe the faculty development sessions,
examining the extent to which participants understand the concepts, ask the right questions, and are
engaged in appropriate interactions. Such formative observations could also provide valuable insights
into the teaching styles of the presenters and how they are covering the material.
Observations during the summative phase of evaluation can be used to determine whether or
not the project is successful. The technique would be especially useful in directly examining teaching
methods employed by the faculty in their own classes after program participation. Exhibits 3 and 4
display the advantages and disadvantages of observations as a data collection tool and some common
types of data that are readily collected by observation.
Readers familiar with survey techniques may justifiably point out that surveys can address
these same questions and do so in a less costly fashion. Critics of surveys find them suspect because
of their reliance on self-report, which may not provide an accurate picture of what is happening
because of the tendency, intentional or not, to try to give the "right answer." Surveys also cannot tap
into the contextual element. Proponents of surveys counter that properly constructed surveys with
built in checks and balances can overcome these problems and provide highly credible data. This
frequently debated issue is best decided on a case-by-case basis.
Describe the setting of program delivery, i.e., where the observation took place and what the
physical setting was like;
Identify the people who participated in those activities, i.e., characteristics of those who were
present;
Describe the content of the intervention, i.e., actual activities and messages that were
delivered;
Document the interactions between implementation staff and project participants;
Describe and assess the quality of the delivery of the intervention; and
Be alert to unanticipated events that might require refocusing one or more evaluation
questions.
Field notes are frequently used to provide more indepth background or to help the observer
remember salient events if a form is not completed at the time of observation. Field notes contain the
description of what has been observed. The descriptions must be factual, accurate, and thorough
without being judgmental and cluttered by trivia. The date and time of the observation should be
recorded, and everything that the observer believes to be worth noting should be included. No
information should be trusted to future recall.
The use of technological tools, such as battery-operated tape recorder or dictaphone, laptop
computer, camera and video camera, can make the collection of field notes more efficient and the
notes themselves more comprehensive. Informed consent must be obtained from participants before
any observational data are gathered.
3.2 The role of the observer
There are various methods for gathering observational data, depending on the nature of a
given project. The most fundamental distinction between various observational strategies concerns
the extent to which the observer will be a participant in the setting being studied. The extent of
participation is a continuum that varies from complete involvement in the setting as a full participant
to complete separation from the setting as an outside observer or spectator. The participant observer
is fully engaged in experiencing the project setting while at the same time trying to understand that
setting through personal experience, observations, and interactions and discussions with other
participants. The outside observer stands apart from the setting, attempts to be nonintrusive, and
assumes the role of a "fly-on-the-wall." The extent to which full participation is possible and
desirable will depend on the nature of the project and its participants, the political and social context,
the nature of the evaluation questions being asked, and the resources available. "The ideal is to
negotiate and adopt that degree of participation that will yield the most meaningful data about the
program given the characteristics of the participants, the nature of staff-participant interactions, and
the sociopolitical context of the program" (Patton, 1990).
In some cases it may be beneficial to have two people observing at the same time. This can
increase the quality of the data by providing a larger volume of data and by decreasing the influence
of observer bias. However, in addition to the added cost, the presence of two observers may create an
environment threatening to those being observed and cause them to change their behavior. Studies
using observation typically employ intensive training experiences to make sure that the observer or
observers know what to look for and can, to the extent possible, operate in an unbiased manner. In
long or complicated studies, it is useful to check on an observers performance periodically to make
sure that accuracy is being maintained. The issue of training is a critical one and may make the
difference between a defensible study and what can be challenged as "one persons perspective."
A special issue with regard to observations relates to the amount of observation needed. While
in participant observation this may be a moot point (except with regard to data recording), when an
outside observer is used, the question of "how much" becomes very important. While most people
agree that one observation (a single hour of a training session or one class period of instruction) is not
enough, there is no hard and fast rule regarding how many samples need to be drawn. General tips to
consider are to avoid atypical situations, carry out observations more than one time, and (where
possible and relevant) spread the observations out over time.
Participant observation is often difficult to incorporate in evaluations; therefore, the use of
outside observers is far more common. In the hypothetical project, observations might be scheduled
for all training sessions and for a sample of classrooms, including some where faculty members who
participated in training were teaching and some staffed by teachers who had not participated in the
training.
Issues of privacy and access: Observational techniques are perhaps the most privacy-threatening
data collection technique for staff and, to a lesser extent, participants. Staff fear that the data may be
included in their performance evaluations and may have effects on their careers. Participants may also
feel uncomfortable assuming that they are being judged. Evaluators need to assure everyone that
evaluations of performance are not the purpose of the effort, and that no such reports will result from
the observations. Additionally, because most educational settings are subject to a constant flow of
observers from various organizations, there is often great reluctance to grant access to additional
observers. Much effort may be needed to assure project staff and participants that they will not be
adversely affected by the evaluators work and to negotiate observer access to specific sites.
4. Interviews
Interviews provide very different data from observations: they allow the evaluation team to
capture the perspectives of project participants, staff, and others associated with the project. In the
hypothetical example, interviews with project staff can provide information on the early stages of the
implementation and problems encountered. The use of interviews as a data collection method begins
with the assumption that the participants perspectives are meaningful, knowable, and able to be
made explicit, and that their perspectives affect the success of the project. An interview, rather than a
paper and pencil survey, is selected when interpersonal contact is important and when opportunities
for follow up of interesting comments are desired.
Two types of interviews are used in evaluation research: structured interviews, in which a
carefully worded questionnaire is administered; and indepth interviews, in which the interviewer does
not follow a rigid form. In the former, the emphasis is on obtaining answers to carefully phrased
questions. Interviewers are trained to deviate only minimally from the question wording to ensure
uniformity of interview administration. In the latter, however, the interviewers seek to encourage free
and open responses, and there may be a tradeoff between comprehensive coverage of topics and
indepth exploration of a more limited set of questions. Indepth interviews also encourage capturing of
respondents perceptions in their own words, a very desirable strategy in qualitative data collection.
This allows the evaluator to present the meaningfulness of the experience from the respondents
perspective. Indepth interviews are conducted with individuals or with a small group of individuals.
4.1 In-depth interviews: An in-depth interview is a dialogue between a skilled interviewer and an
interviewee. Its goal is to elicit rich, detailed material that can be used in analysis (Lofland and
Lofland, 1995). Such interviews are best conducted face to face, although in some situations
telephone interviewing can be successful.
Indepth interviews are characterized by extensive probing and open-ended questions.
Typically, the project evaluator prepares an interview guide that includes a list of questions or issues
that are to be explored and suggested probes for following up on key topics. The guide helps the
interviewer pace the interview and make interviewing more systematic and comprehensive. Lofland
and Lofland (1995) provide guidelines for preparing interview guides, doing the interview with the
guide, and writing up the interview. Appendix B to this chapter contains an example of the types of
interview questions that could be asked during the hypothetical study.
The dynamics of interviewing are similar to a guided conversation. The interviewer becomes
an attentive listener who shapes the process into a familiar and comfortable form of social
engagement - a conversation - and the quality of the information obtained is largely dependent on the
interviewers skills and personality (Patton, 1990). In contrast to a good conversation, however, an
indepth interview is not intended to be a two-way form of communication and sharing. The key to
being a good interviewer is being a good listener and questioner. Tempting as it may be, it is not the
role of the interviewer to put forth his or her opinions, perceptions, or feelings. Interviewers should be
trained individuals who are sensitive, empathetic, and able to establish a non-threatening environment
in which participants feel comfortable. They should be selected during a process that weighs personal
characteristics that will make them acceptable to the individuals being interviewed; clearly, age, sex,
profession, race/ethnicity, and appearance may be key characteristics. Thorough training, including
familiarization with the project and its goals, is important. Poor interviewing skills, poor phrasing of
questions, or inadequate knowledge of the subjects culture or frame of reference may result in a
collection that obtains little useful data.
4.2 When to use in-depth interviews: In-depth interviews can be used at any stage of the
evaluation process. They are especially useful in answering questions such as those suggested by
Patton (1990):
What does the program look and feel like to the participants? To other stakeholders?
What are the experiences of program participants?
What do stakeholders know about the project?
What thoughts do stakeholders knowledgeable about the program have concerning program
operations, processes, and outcomes?
What are participants and stakeholders expectations?
What features of the project are most salient to the participants?
What changes do participants perceive in themselves as a result of their involvement in the
project?
Specific circumstances for which indepth interviews are particularly appropriate include
of responses
Allow interviewer to explain or help
clarify questions, increasing the
likelihood of useful responses
Allow interviewer to be flexible in
administering interview to particular
individuals or circumstances
across interviews
Volume of information too large; may
be difficult to transcribe and reduce
data
When ind-epth interviews are being considered as a data collection technique, it is important to keep
several potential pitfalls or problems in mind.
There may be substantial variation in the interview setting. Interviews generally take place in
a wide range of settings. This limits the interviewers control over the environment. The
interviewer may have to contend with disruptions and other problems that may inhibit the
acquisition of information and limit the comparability of interviews.
There may be a large gap between the respondents knowledge and that of the interviewer.
Interviews are often conducted with knowledgeable respondents, yet administered by less
knowledgeable interviewers or by interviewers not completely familiar with the pertinent
social, political, or cultural context. Therefore, some of the responses may not be correctly
understood or reported. The solution may be not only to employ highly trained and
knowledgeable staff, but also to use interviewers with special skills for specific types of
respondents (for example, same status interviewers for high-level administrators or
community leaders). It may also be most expedient for the project director or senior
evaluation staff to conduct such interviews, if this can be done without introducing or
appearing to introduce bias.
Considerations in conducting in-depth interviews
and focus groups
Factors to consider in determining the setting for interviews (both
individual and group) include the following:
4.3 Recording interview data: Interview data can be recorded on tape (with the permission of the
participants) and/or summarized in notes. As with observations, detailed recording is a necessary
component of interviews since it forms the basis for analyzing the data. All methods, but especially
the second and third, require carefully crafted interview guides with ample space available for
recording the interviewees responses. Three procedures for recording the data are presented below.
In the first approach, the interviewer (or in some cases the transcriber) listens to the tapes and
writes a verbatim account of everything that was said. Transcription of the raw data includes wordfor-word quotations of the participants responses as well as the interviewers descriptions of
participants characteristics, enthusiasm, body language, and overall mood during the interview.
Notes from the interview can be used to identify speakers or to recall comments that are garbled or
unclear on the tape. This approach is recommended when the necessary financial and human
resources are available, when the transcriptions can be produced in a reasonable amount of time,
when the focus of the interview is to make detailed comparisons, or when respondents own words
and phrasing are needed. The major advantages of this transcription method are its completeness and
the opportunity it affords for the interviewer to remain attentive and focused during the interview.
The major disadvantages are the amount of time and resources needed to produce complete
transcriptions and the inhibitory impact tape recording has on some respondents. If this technique is
selected, it is essential that the participants have been informed that their answers are being recorded,
that they are assured confidentiality, and that their permission has been obtained.
A second possible procedure for recording interviews draws less on the word-by-word record
and more on the notes taken by the interviewer or assigned note taker. This method is called "note
expansion." As soon as possible after the interview, the interviewer listens to the tape to clarify
certain issues and to confirm that all the main points have been included in the notes. This approach is
recommended when resources are scarce, when the results must be produced in a short period of time,
and when the purpose of the interview is to get rapid feedback from members of the target
population. The note expansion approach saves time and retains all the essential points of the
discussion. In addition to the drawbacks pointed out above, a disadvantage is that the interviewer may
be more selective or biased in what he or she writes.
In the third approach, the interviewer uses no tape recording, but instead takes detailed notes
during the interview and draws on memory to expand and clarify the notes immediately after the
interview. This approach is useful if time is short, the results are needed quickly, and the evaluation
questions are simple. Where more complex questions are involved, effective note-taking can be
achieved, but only after much practice. Further, the interviewer must frequently talk and write at the
same time, a skill that is hard for some to achieve.
5. Focus Groups
Focus groups combine elements of both interviewing and participant observation. The focus
group session is, indeed, an interview (Patton, 1990) not a discussion group, problem-solving session,
or decision-making group. At the same time, focus groups capitalize on group dynamics. The
hallmark of focus groups is the explicit use of the group interaction to generate data and insights that
would be unlikely to emerge without the interaction found in a group. The technique inherently
allows observation of group dynamics, discussion, and firsthand insights into the respondents
behaviors, attitudes, language, etc.
Focus groups are a gathering of 8 to 12 people who share some characteristics relevant to the
evaluation. Originally used as a market research tool to investigate the appeal of various products, the
focus group technique has been adopted by other fields, such as education, as a tool for data gathering
on a given topic. Focus groups conducted by experts take place in a focus group facility that includes
recording apparatus (audio and/or visual) and an attached room with a one-way mirror for
observation. There is an official recorder who may or may not be in the room. Participants are paid
for attendance and provided with refreshments. As the focus group technique has been adopted by
fields outside of marketing, some of these features, such as payment or refreshment, have been
eliminated.
5.1 When to use focus groups: When conducting evaluations, focus groups are useful in answering
the same type of questions as in-depth interviews, except in a social context. Specific applications of
the focus group method in evaluations include
1.
2.
3.
4.
5.
In the hypothetical project, focus groups could be conducted with project participants to
collect perceptions of project implementation and operation (e.g., Were the workshops staffed
appropriately? Were the presentations suitable for all participants?), as well as progress toward
objectives during the formative phase of evaluation (Did participants exchange information by e-mail
and other means?). Focus groups could also be used to collect data on project outcomes and impact
during the summative phase of evaluation (e.g., Were changes made in the curriculum? Did students
taught by participants appear to become more interested in class work? What barriers did the
participants face in applying what they had been taught?).
Which to use: Focus groups or in-depth interviews?
Factors to consider
Group interaction
Group/peer pressure
responses or withhold
information.
Continuity of information
it is necessary to understand
how attitudes and behaviors link
together on an individual basis.
Observation by stakeholders
Logistics geographically
interviewers need to be
supportive and skilled listeners.
high-quality data in a social context where people can consider their own views in the context of the
views of others, and where new ideas and perspectives can be introduced.
The participants are usually a relatively homogeneous group of people. Answering the
question, "Which respondent variables represent relevant similarities among the target population?"
requires some thoughtful consideration when planning the evaluation. Respondents social class, level
of expertise, age, cultural background, and sex should always be considered. There is a sharp division
among focus group moderators regarding the effectiveness of mixing sexes within a group, although
most moderators agree that it is acceptable to mix the sexes when the discussion topic is not related to
or affected by sex stereotypes.
Determining how many groups are needed requires balancing cost and information needs. A
focus group can be fairly expensive, costing $10,000 to $20,000 depending on the type of physical
facilities needed, the effort it takes to recruit participants, and the complexity of the reports required.
A good rule of thumb is to conduct at least two groups for every variable considered to be relevant to
the outcome (sex, age, educational level, etc.). However, even when several groups are sampled,
conclusions typically are limited to the specific individuals participating in the focus group. Unless
the study population is extremely small, it is not possible to generalize from focus group data.
5.3 Recording focus group data: The procedures for recording a focus group session are basically
the same as those used for indepth interviews. However, the focus group approach lends itself to
more creative and efficient procedures. If the evaluation team does use a focus group room with a
one-way mirror, a colleague can take notes and record observations. An advantage of this approach is
that the extra individual is not in the view of participants and, therefore, not interfering with the group
process. If a one-way mirror is not a possibility, the moderator may have a colleague present in the
room to take notes and to record observations. A major advantage of these approaches is that the
recorder focuses on observing and taking notes, while the moderator concentrates on asking
questions, facilitating the group interaction, following up on ideas, and making smooth transitions
from issue to issue. Furthermore, like observations, focus groups can be videotaped. These
approaches allow for confirmation of what was seen and heard. Whatever the approach to gathering
detailed data, informed consent is necessary and confidentiality should be assured.
Having highlighted the similarities between interviews and focus groups, it is important to
also point out one critical difference. In focus groups, group dynamics are especially important. The
notes, and resultant report, should include comments on group interaction and dynamics as they
inform the questions under study.
6. Summing up
This Unit intended to introduce the methods of qualitative data collection with special
reference to the three most common qualitative methods which are participant observation, in-depth
interviews, and focus groups. Participant observation is a qualitative method with roots in traditional
ethnographic research, whose objective is to help researchers learn the perspectives held by study
populations. Data obtained through participant observation serve as a check against participants
subjective reporting of what they believe and do. Participant observation is also useful for gaining an
understanding of the physical, social, cultural, and economic contexts in which study participants
live; the relationships among and between people, contexts, ideas, norms, and events; and peoples
behaviors and activities what they do, how frequently, and with whom.
Interviews provide very different data from observations: they allow the evaluation team to
capture the perspectives of project participants, staff, and others associated with the project. The use
of interviews as a data collection method begins with the assumption that the participants
perspectives are meaningful, knowable, and able to be made explicit, and that their perspectives affect
the success of the project. An interview, rather than a paper and pencil survey, is selected when
interpersonal contact is important and when opportunities for follow up of interesting comments are
desired.
Similarly, focus groups are a qualitative data collection method effective in helping
researchers learn the social norms of a community or subgroup, as well as the range of perspectives
that exist within that community or subgroup. Focus groups are often used to determine what service
or product a particular population wants or would like to have, such as in marketing studies Because
focus groups seek to illuminate group opinion, the method is especially well suited for socio
behavioral research that will be used to develop and measure services that meet the needs of a given
population.
7. Keywords
Data collection instruments: Tools or forms used to collect data from research participants. Data
collection instruments include in-depth interview guides, focus group guides, observation guides, and
interviewer scripts. Equipment used during data collection, such as tape recorders or microphones, are
not data collection instruments.
Data tracking: Monitoring the status of data processing.
Facilitator: The moderator or note-taker of a focus group.
Focus group: A qualitative research method in which one or two researchers and several participants
(usually representatives from, or individuals associated with, a target/study population) meet as a
group to discuss a specific research topic. This technique is effective for quickly accessing a broad
range of views on a specific topic. During a typical focus group, one researcher (the moderator) leads
a discussion by asking participants to respond to open-ended questions while a second researcher (the
notetaker) takes detailed notes on the discussion.
In-depth interview: A qualitative research method in which a researcher/interviewer gathers data
about an individuals perspectives on a specific topic(s) through a semi-structured exchange with the
individual. The researcher/interviewer engages with the individual by posing questions in a neutral
manner, listening attentively to responses, and asking follow-up questions and probes based on those
responses.
Interviewer: Person who conducts in-depth interviews; can also refer to the person who asks
questions during focus groups. Also known as the moderator.
Moderator: Person who facilitates a focus group. Also known as a facilitator. note-taker Person
responsible for taking notes during a focus group. Also known as a facilitator.
Participant observation: A qualitative research method in which researchers gather data either by
observing or by both observing and participating, to varying degrees, in the study communitys daily
activities, in community settings relevant to the research questions. Examples include bars, brothels,
and health clinic waiting areas.
Respect: Commitment to ensuring that research participants are not used only as a means to achieve
research objectives by ensuring their autonomy, voluntary informed consent, and confidentiality, and
by protecting persons with diminished autonomy.
What are the most common qualitative methods employed in project evaluations?
2.
3.
In-depth interviews method can be used for answering what type of questions.
4.
2.
The main disadvantage of participant observation is that it is time-consuming. In traditional
ethnographic research, researchers spend at least one year in the field site collecting data through
participant observation and other methods. This is not practical for most applied research studies,
which necessarily require a shorter period of data collection. This weakness is partially mitigated in
most current international development projects by the tendency for the inquiry to be more focused
than in traditional ethnographic study and for the data collection team to include researchers who are
native rather than foreign to the region. Researchers who already possess a solid base of cultural
awareness are better able to concentrate on the research question itself. A second disadvantage of
participant observation is the difficulty of documenting the data it is hard to write down everything
that is important while you are in the act of participating and observing. As the researcher, you must
therefore rely on your memory and on your own personal discipline to write down and expand your
observations as soon and as completely as possible. It is easy to tell yourself that you will do this task
later, but, because memory fades quickly, postponing the expansion of notes can lead to loss or
inaccurate recording of data.
The quality of the data therefore depends on the diligence of the researcher, rather than on technology
such as tape recorders. A third disadvantage of participant observation is that it is an inherently
subjective exercise, here as research requires objectivity. It is therefore important to understand the
difference between reporting or describing what you observe (more objective) versus interpreting
what you see (less objective). Filtering out personal biases may take some practice. One way to
practice is to write down objective observations of a given event on one side of a page, and then offer
more subjective interpretations of the same event on the other side of the page, as illustrated in the
box at left. Alternately, in team based research, field staff can review one anothers field notes and
help identify objective versus subjective observations.
3)
In-depth interviews can be used at any stage of the evaluation process. They are especially
useful in answering questions such as those suggested by Patton (1990):
What does the program look and feel like to the participants? To other stakeholders?
What are the experiences of program participants?
Specific circumstances for which in-depth interviews are particularly appropriate include
4)
When conducting evaluations, focus groups are useful in answering the same type of
questions as in-depth interviews, except in a social context. Specific applications of the focus group
method in evaluations include
6. identifying and defining problems in project implementation;
7. identifying project strengths, weaknesses, and recommendations;
8. assisting with interpretation of quantitative findings;
9. obtaining perceptions of project outcomes and impacts; and
10. generating new ideas.
In the hypothetical project, focus groups could be conducted with project participants to
collect perceptions of project implementation and operation (e.g., Were the workshops staffed
appropriately? Were the presentations suitable for all participants?), as well as progress toward
objectives during the formative phase of evaluation (Did participants exchange information by e-mail
and other means?). Focus groups could also be used to collect data on project outcomes and impact
during the summative phase of evaluation (e.g., Were changes made in the curriculum? Did students
taught by participants appear to become more interested in class work? What barriers did the
participants face in applying what they had been taught?).
Structure
1. Introduction
2. Objectives
3. What is Action Research?
3.1 Defining action research
3.2 Principles of action research
3.3 When is action research used?
3.4 Role of the action researcher
4. Differences between action research and mainstream science
5. Practicing action research
5.1 The process of reflection in action research
5.2 Challenging people to change
6. Summing up
7. Keywords
8. Know your Progress
9. Further Reading / References
10. Model Answers
1. Introduction
The action research is a reflective process of progressive problem solving led by individuals
working with others in teams or as part of a "community of practice" to improve the way they address
issues and solve problems. Action research can also be undertaken by larger organizations or
institutions, assisted or guided by professional researchers, with the aim of improving their strategies,
practices, and knowledge of the environments within which they practice. As designers and
stakeholders, researchers work with others to propose a new course of action to help their community
improve its work practices.
2. Objectives
After studying this Unit, you should be able to:
have evolved that adjust the balance to focus more on the actions taken or more on the research that
results from the reflective understanding of the actions. This tension exists between:
1. those who are more driven by the researchers agenda and those more driven by participants;
2. those who are motivated primarily by instrumental goal attainment and those motivated
primarily by the aim of personal, organisational, or societal transformation; and
3. 1st-, to 2nd-, to 3rd-person research, that is, my research on my own action, aimed primarily
at personal change; our research on our group (family/team), aimed primarily at improving the
group; and scholarly research aimed primarily at theoretical generalisation and/or large scale
change.
Action research challenges traditional social science, by moving beyond reflective knowledge
created by outside experts sampling variables to an active moment-to-moment theorising, data
collecting, and enquiring occurring in the midst of emergent structure. Knowledge is always gained
through action and for action. From this starting point, to question the validity of social knowledge is
to question, not how to develop a reflective science about action, but how to develop genuinely wellinformed action how to conduct an action science (Torbert 2001).
Action research involves utilising a systematic cyclical method of planning, taking action,
observing, evaluating (including self-evaluation) and critical reflecting prior to planning the next
cycle (O'Brien, 2001; McNiff, 2002). The actions have a set goal of addressing an identified problem
in the workplace, for example, reducing the illiteracy of students through use of new strategies
(Quigley, 2000) or improving communication and efficiency in a hospital emergency room
(Eisenberg, Baglia, Pyrnes, 2006). It is a collaborative method to test new ideas and implement action
for change. It involves direct participation in a dynamic research process, while monitoring and
evaluating the effects of the researcher's actions with the aim of improving practice (Dick, 2002;
Checkland & Holwell, 1998; Hult & Lennung, 1980). At its core, action research is a way to increase
understanding of how change in one's actions or practices can mutually benefit a community of
practitioners. One of the key characteristics of this approach is collaboration, which enables mutual
understanding and consensus, democratic decision making and common action (Oja & Smulyan 1989
p.12).
In this sense the action researcher is a practitioner, an interventionist seeking to help improve
client systems. "This help takes the form of creating conditions in the behavioural world of the client
system that are conducive to inquiry and learning. Lasting improvement requires that the
participatory action researcher help clients to change themselves so that their interactions will create
these conditions for inquiry and learning" (Argyris et al. 1985 p.137). Hence to the aims of
contributing to the practical improvement of problem situations and to the goals of developing public
knowledge we can add a third aim of action research, to develop the self-help competencies of people
facing problems.
Within this broad definition, there are four basic themes: i) collaboration through
participation; ii) acquisition of knowledge; iii) social change; and iv) empowerment of participants.
The process that the researcher uses to guide those involved can be seen as a spiral of action research
cycles consisting of phases of planning, acting, observing and reflecting (Masters 1995). As Oja and
Smulyan (1989) point out, the underlying assumption of this approach -- which can be traced back to
Lewin's writing in 1948 -- is that effective social change depends on the commitment and
understanding of those involved in the change process . In other words, if people work together on a
common problem "clarifying and negotiating ideas and concerns, they will be more likely to change
their minds if research indicates such change is necessary. Also, it is suggested that collaboration can
provide people with the time and support necessary to make fundamental changes in their practice
which endure beyond the research process (Oja & Smulyan 1989).
3.2 Principles of Action Research
What gives action research its unique flavour is the set of principles that guide the research.
Winter (1989) provides a comprehensive overview of six key principles.
1) Reflexive critique
An account of a situation, such as notes, transcripts or official documents, will make implicit
claims to be authoritative, i.e., it implies that it is factual and true. Truth in a social setting, however,
is relative to the teller. The principle of reflective critique ensures people reflect on issues and
processes and make explicit the interpretations, biases, assumptions and concerns upon which
judgments are made. In this way, practical accounts can give rise to theoretical considerations.
2) Dialectical critique
Reality, particularly social reality, is consensually validated, which is to say it is shared
through language. Phenomena are conceptualized in dialogue, therefore a dialectical critique is
required to understand the set of relationships both between the phenomenon and its context, and
between the elements constituting the phenomenon. The key elements to focus attention on are those
constituent elements that are unstable, or in opposition to one another. These are the ones that are
most likely to create changes.
3) Collaborative resource
Participants in an action research project are co-researchers. The principle of collaborative
resource presupposes that each persons ideas are equally significant as potential resources for
creating interpretive categories of analysis, negotiated among the participants. It strives to avoid the
skewing of credibility stemming from the prior status of an idea-holder. It especially makes possible
the insights gleaned from noting the contradictions both between many viewpoints and within a
single viewpoint
4) Risk
The change process potentially threatens all previously established ways of doing things, thus
creating psychic fears among the practitioners. One of the more prominent fears comes from the risk
to ego stemming from open discussion of ones interpretations, ideas, and judgments. Initiators of
action research will use this principle to allay others fears and invite participation by pointing out
that they, too, will be subject to the same process, and that whatever the outcome, learning will take
place.
5) Plural Structure
The nature of the research embodies a multiplicity of views, commentaries and critiques,
leading to multiple possible actions and interpretations. This plural structure of enquiry requires a
plural text for reporting. This means that there will be many accounts made explicit, with
commentaries on their contradictions, and a range of options for action presented. A report,
therefore, acts as a support for ongoing discussion among collaborators, rather than a final conclusion
of fact.
6) Theory, Practice, Transformation
For action researchers, theory informs practice, practice refines theory, in a continuous
transformation. In any setting, peoples actions are based on implicitly held assumptions, theories
and hypotheses, and with every observed result, theoretical knowledge is enhanced. The two are
intertwined aspects of a single change process. It is up to the researchers to make explicit the
theoretical justifications for the actions, and to question the bases of those justifications. The ensuing
practical applications that follow are subjected to further analysis, in a transformative cycle that
continuously alternates emphasis between theory and practice.
3.3 When is action research used?
Action research is used in real situations, rather than in contrived, experimental studies, since
its primary focus is on solving real problems. It can, however, be used by social scientists for
preliminary or pilot research, especially when the situation is too ambiguous to frame a precise
research question. Mostly, though, in accordance with its principles, it is chosen when circumstances
require flexibility, the involvement of the people in the research, or change must take place quickly or
holistically.
It is often the case that those who apply this approach are practitioners who wish to improve
understanding of their practice, social change activists trying to mount an action campaign, or, more
likely, academics who have been invited into an organization (or other domain) by decision-makers
aware of a problem requiring action research, but lacking the requisite methodological knowledge to
deal with it.
3.4 Role of the action researcher
The role of the action researcher is identical to that proposed for contemporary facilitators in
helping communities identify and adopt more sustainable natural resource management practices (eg.
Pretty & Chambers 1993, Pretty 1998).
These facilitators may come from the community or they may be research or agency staff.
However, their most effective role will be to involve the wider community to develop participatory
attitudes, excitement and commitment to work together on jointly negotiated courses of action to
bring about improvements and innovation for individual and community benefit. While this role is
similar to much of consultancy, action research provides a means by which is more rigorous, and
which allows for the development of public knowledge to advance the field.
In turn, by establishing conditions for the development of others, the action researcher
acquires increasing skills in such things as the ability to build shared vision, to bring to the surface
and challenge prevailing mental models, and to foster more systemic patterns of thinking. To
paraphrase Senge (1990), action researchers are responsible for building frameworks and networks
through which people are continuously expanding their capabilities to shape their future. That is,
action researchers are responsible for developing a learning environment which challenges the status
quo and generating liberating alternatives (Argyris et al. 1985 p.xi). Accordingly, the general aims of
AR are frequently expressed in terms of orienting process criteria (e.g. participation, emancipation)
and it seems worthwhile to continue to stress these characteristics to differentiate AR from other
approaches to social change (Altrichter et al. 1991). These characteristics are well captured by ZuberSkerritt's (1992 p.15) CRASP definition of action research as: Critical collaborative enquiry by
Reflective practitioners, who are Accountable in making the results of their enquiry public, Selfevaluative of their practice, and engaged in Participative problem solving and continuing
professional development.
This broad outline of action research sketched above is capable of encompassing and learning
from a variety of research and intervention methods in a number of fields. Today we can identify
clear applications of AR in a number of fields including organisational management, community
development, education, agriculture and participatory evaluation (Deshler & Ewert 1995). The term
'action research' itself can be regarded as an umbrella term that includes several traditions of theory
and practice. It is broad enough to include, for instance, Soft Systems Methodology (Checkland 1981)
and Guba and Lincoln's (1989) Fourth-generation evaluation. Other terms including participatory
research, action learning, praxis research, participatory inquiry, collaborative inquiry, action inquiry,
and cooperative inquiry are also used in the literature (e.g. Whyte 1991).
For more than one hundred years the positivist conception of science has dominated the
practice of physical, biological and social sciences. The underlying basis for this mainstream
approach is the consideration of scientific knowledge to be obtainable only from sense data that can
be directly experienced and verified between independent observors (Susman & Evered 1978 p.583).
While this epistemology was designed with the natural sciences in mind (particularly physics)
proponents argue that it characterises all sciences insofar as they are scientific; and this has also been
the predominant opinion among the social sciences (Argyris et al. 1985 p.12).
But, to use Nelson's moon-ghetto metaphor; while science has enabled us to control the soft
landings of space craft on distant planets, it has not helped us solve the 'lesser' problems associated
with urban slums (Rosenhead 1989 p.4). In particular, positivist science has proved to have some
deficiencies when it has been removed from the closely defined laboratory setting and asked to cope
with the kind of organised complexity facing humanity and the life sciences in the 'real' world (for a
more complete discussion of this topic see Checkland 1981). In fact Lewin's concern that mainstream
science was not helping in the resolution of critical social problems was the driving force beyond his
development of action research (Susman & Evered 1978). In mainstream social science
implementation has been seen as a problem of application, of practice, perhaps of politics -- but not of
theoretical science (Argyris et al. 1985 p.19). From the perspective of action research, however,
implementation is not separable from crucial theoretical issues.
In traditional research, the researcher makes every effort to remain objectively remote from
the system being studied (Bawden 1991 p.37). He / she is separated from the system being studied
by a hard boundary and the system is reduced to one, or only a few parts, with the rest of the system
assumed to be held constant. This research is appropriate in many circumstances, particularly in the
bio-physical sciences. On the other hand, action research involves taking action in social systems of
which the researcher is unavoidably a part. Indeed, it is the activity of the (researcher)-observer
joining with other participant-observers, that enables the system to become a researching system in
the first place! (Bawden 1991 p.37). These involve the study of soft systems without clearly
defined boundaries between the researcher and the system.
Because the research involves complex and dynamic problems, exploring the social process of
learning about situations is inextricably linked with the acts of changing those situations. In these
systems the researcher must actively participate with others in the critical exploration of complex and
dynamic issues of implementation which relate to the relationships between individuals, groups and
their physical and socio-cultural environments. Furthermore, success in social change is not achieved
simply by making the right decision at a particular time, but rather through developing a social
process that facilitates ongoing learning (e.g. Korten 1980, Whyte 1989).
Thus, while as Argyris et al. (1985 p.18) remind us that there are continuities in the core
features of mainstream science and action research including hard data and public testing, there are
crucial differences as well. For one, action research sits squarely within the tradition of qualitative
research methodology, rather than the more mainstream quantitative research paradigm. As Bunning
(1995) points out, one reason for this is that action researchers seek to influence the phenomena being
studied during the action research process itself, in the belief that the true nature of social systems
become most evident when you seek to make changes to them. Because of this interventionist
approach, the experimental standardisation of positivistic research is neither possible or desirable.
Similarly, because action research thus addresses whole system issues which are invariably multivariate (and somewhat indeterminate!) these are best approached within a qualitative and holistic
framework, rather than a reductionist, and quantitative framework.
Another contrast between action research and mainstream science is that action research is
focused on what could be, rather than what is. "New thinking in action research seems to take the
social construction of reality seriously. The emphasis is on possibility rather than prediction. From a
constructivist perspective (action research) can contribute to people realising their values -envisaging a preferred future and organising effectively to achieve it" (Elden & Chisholm 1993
p.127). As these authors go on to point out, this highlights how action researchers are not 'value
neutral', but rather concerned with selecting problems to solve that would both contribute to general
knowledge and practice solutions concerning democratic, humanistic values. In this way, action
research is change oriented and seeks to bring about change that has positive social value (e.g. healthy
communities, environmentally sound management, etc.).
These points and others which contrast the differences between mainstream science and action
research are outlined in Table 1.
Table 1: Comparisons of positivist science and action research
Points of
comparison
Positivist science
Action research
Value position
Time perspective
Observation of the
present
Relationship with
units
Detached spectator,
client system members
are objects to study
Treatment of units
studied
Language for
describing units
Denotative,
observational
Connotative, metaphorical
Exist independently of
humans
Epistemological
aims
Criteria for
confirmation
Logical consistency,
prediction and control
Basis for
generalization
Another point of distinction concerns the issue of participation in the research process. It is
already clear from the above discussion that action research is by definition participatory, however,
the implications of this -- particularly in the way that research is written up -- reveal clear differences
in the relationship of the researcher and the researched within different research paradigms.
Moreover, this distinction enables us not only to see the difference between mainstream positivist
science and action research, but also clear differences between action research and more mainstream
qualitative and interpretive social science approaches.
Fundamental, then, to action research is the concept of 'learning by doing' in which learning is
perceived as experiential and reflexive. It recognises that people learn through the active adaptation
of their existing knowledge in response to their experiences with other people and their environment.
As the dynamics of a social system are often more apparent in times of change, learning and change
can enhance each other.
However, some people are more suited to, and interested in, participating in an action research
change inquiry than others. As Bunning (1995) points out, the reality of that because of downsizing,
reduction in organisational levels and increased accountability, there are higher levels of stress and
pressure around than ever before. While it is precisely those symptoms that indicate that change and
development is needed, if people are not provided with the capacity to participate successful change
is unlikely to be developed. Thus more will be learnt by a few genuinely committed co-researchers
dedicated to exploring change within a smaller case study approach, than may be gained by engaging
with a larger number of less willing participants in a bigger inquiry.
Thankfully, for the action researcher, the idea of learning collaboratively is not new -although as pointed out above some people are more effective than others. "Most of us, if we wish to
learn a new skill or broaden our perspectives on an issue, will seek out some collaborative learning
environment such as a club or training programme. Similarly, talking an issue through is a natural
process for many people. We gain new insights as we express our own views and we subsequently
modify our views as other people provide us with new ways of looking at the issue at hand
(Kilvington et al. 1999 p.14). However, as these authors observe well-functioning groups do not
happen by accident, and skills in managing group dynamics to keep the group moving in a positive
direction are therefore central to the successful practice of action research. Awareness of what is
happening to a group and access to the skills necessary to address this are crucial to the long-term
viability of groups and their success in achieving their goals.
Similarly, the process of learning by building on experience is a natural one for most people
and action research provides a framework for formalising and making this process more effective. "In
brief, it consists of an iterative and cyclic approach of action and research with four major phases:
plan, act, observe and reflect"(Zuber-Skerritt 1991 ). The basic underlying assumption which
underpins theory and practice is the existence of an experiential-based learning cycle ( Kolb et al.
1979) that people can learn and create knowledge: i) on the basis of their concrete experience; ii)
through observing and reflecting on that experience; iii) by forming abstract concepts and
generalisations about what to do next; and iv) by testing the implications of these concepts in new
situations -- which will lead to new concrete experiences, and hence the beginning of a new cycle. As
a number of reviewers point out, this model is similar to other conceptions of basic adaptive
processes, or problem solving, creativity, and decision making (e.g. Bawden et al..1984, Ison & Ampt
1992) .
among human agents so that they may more freely choose whether and how to transform their world
(Argyris et al. 1985 pp.70-71).
As Kemmis and McTaggert observe, to do action research one must plan, act, observe and
reflect "more carefully, more systematically, and more rigorously than one does in everyday life: and
to use the relationships between those moments in the process as a source of both improvement and
knowledge" (1988 p.10). It is the process of reflection in this process, on one's own views as well as
those of others, that provides the basis for learning -- enabling all those involved to develop a more
holistic perspective of any given situation, within which they can best make their particular
contribution.
The challenge for the action researcher lies in the fact that learning can be difficult, even at an
individual level. Accepting new information that challenges the way we think and the things we do is,
even with the best of will, difficult to undertake, to accomplish, and to sustain (Michael 1995).
Finding out about problems also implies that we may have to act to correct them. What often stops us
doing this is an anxiety, or the feeling that if we allow ourselves to enter a learning or change process,
if we admit to ourselves and others that something is wrong or not right, we will lose our
effectiveness, our esteem, and maybe even our identity. Most of us need to assume we are doing our
best at all times, and it may prove a real loss of face to accept and even "embrace" errors. Adapting
poorly, or failing to realise our creative potential may be more desirable than risking failure and loss
of esteem during the learning process (Allen & Kilvington 1999).
5.2 Challenging people to change
Because of this, "learning, which mostly upsets beliefs and habits in individuals and
organisations, is hardly likely to be embraced easily and enthusiastically, even though there is a
growing, and sometimes powerful, recognition of the need for change" (Michael 1995 p.470). Indeed,
as Argyris et al. (1985 ch.3) point out, individuals and organisations have a number of defensive
reactions that resist change -- or learning -- by preventing open dialogue and the integration of new
information which may challenge their existing worldviews (values, assumptions, paradigms, etc.).
These defenses include making some subjects 'undiscussable' (Argyris et al. 1985 p.87), or an
unawareness that their 'espoused theory -- the world view and values people believe their behaviour is
based on -- is different to their 'theory in use' -- the worldviews and values implied by their behaviour
(Argyris et al. p.82).
Accordingly, as Aryris et al.. (1985 pp.84-85) suggest that the first match to any inquiry into a
mismatch between intention and outcome is likely to search for another strategy that will satisfy the
'governing variables', the belief systems and values which the individual or organisation is trying to
maintain. For example if a land manager views his/her enterprise solely in terms of sheep production
and notes that the vegetation condition of the land is deteriorating, the action strategy will likely be to
try a different grazing regime. In such a case when new strategies are used to support the same
governing variable (i.e. the land as a sheep production system) this is called single loop learning
(Figure 1). A similar science example might arise in response to funder requirements for a scientist to
be more participative. The response might be to find a 'friendly' group of people to work with that are
happy to acknowledge the scientist as the 'unquestioned expert' - the governing variable.
However, another possibility is to change the governing variables themselves. For example
rather than try a new grazing strategy, the land manager may choose to initiate a more open form of
enquiry. The associated action strategy might then be to look at how the enterprise could function as a
tourism, or forestry, system for example. The scientist may choose to involve appropriate stakeholder
groups in a more collaborative approach, changing the role of science to one of a co-researcher and
recognizing that the role of 'expert' is more a matter of perspective. These cases are called doubleloop learning, and involve more fundamental shifts in people's belief systems and values. In this way
they can often minimise the gap between espoused and theory-in-use.
Fig. 1: Single and double-loop learning (Adapted from: Argyris et al. 1985)
Accordingly, Meziro (1991, quoted in Bunning 1995) draws attention to the need to address
three elements through the reflective process: i) content, the substantive issues involved; ii) process,
how such issues were raised and addressed; and iii) premises, which are the values, assumptions,
paradigms and whole framework of individual and collective mindsets, which inevitably influenced
what was attended to and what was not, and other issues such as goals, process and interpretation.
Developing double-loop problem solving approaches is thus a critical part of changing
people's actions in respect to the environment. However, it also requires the action researcher to deal
with the defenses of individuals and organisations -- which is no small undertaking! In many cases
this will mean having to address situations in which participants may feel embarrassed or threatened.
However, as Grudens-Schuck (1998 ) points out, unless research and education programs build
specific processes for confronting people about unworkable theories and organizational defenses, the
use of local knowledge and interpretations of events cannot be a sound foundation for collaborative
learning and positive change.
6. Summing Up
This Unit has presented an overview of action research as a methodological approach to
solving social problems. The principles and procedures of this type of research, and epistemological
underpinnings, were described, along with the evolution of the practice. Details of a search
conference and other tools were given, as was an indication of the roles and ethics involved in the
research. The case studies gave concrete examples of projects, particularly in the relatively new area
of social deployment of information technologies. Further action research is needed to explore the
potential for developing computer-mediated communications in a way that will enhance human
interactions.
7. Key Words
Action research is a reflective process of progressive problem solving led by individuals working
with others in teams or as part of a "community of practice" to improve the way they address issues
and solve problems. Action research can also be undertaken by larger organizations or institutions,
assisted or guided by professional researchers, with the aim of improving their strategies, practices,
and knowledge of the environments within which they practice.
Action learning is an educational process whereby the participant studies their own actions and
experience in order to improve performance. This concept is close to learning-by-doing and teaching
through examples and repetitions.
Appreciative Inquiry (AI) is an organizational development process or philosophy that engages
individuals within an organizational system in its renewal, change and focused performance. AI is
based on the assumption that organizations change in the way they inquire and the claim that an
organization which inquires into problems or difficult situations will keep finding more of the same
but an organization which tries to appreciate what is best in itself will find/discover more and more of
what is good.
Empowerment refers to increasing the spiritual, political, social, or economic strength of individuals
and communities. It often involves the empowered developing confidence in their own capacities.
Participatory action research or Action research is a recognized form of experimental research
that focuses on the effects of the researcher's direct actions of practice within a participatory
community with the goal of improving the performance quality of the community or an area of
concern.
2)
3)
4)
Escobar, Arturo. 1992. Culture, economics, and politics in Latin American social movements theory
and research, pp. 6285 in Arturo Escobar and Sonia Alvarez (eds.), The Making of Social
Movements in Latin America. Boulder: Westview Press.
Fals-Borda, O., & Rahman, M. A. (Eds.). (1991). Action and Knowledge: Breaking the Monopoly
with Participatory Action-Research (1st ed.). New York: Apex Press.
Gramsci. A (1971). Selections from the prison notebooks. Q. Hoare and G. Nowell Smith (Eds. &
trans.). New York, NY: International Publishers.
Greenwood, D. J., Gonzlez Santos, J. L. i Cantn, J. (1991) Industrial democracy as process:
participatory action research in the Fagor Cooperative Group of Mondragn,
Assen/Maastricht-Stockholm: Van Gorcum Arbetslivscentrum.
Hickey, S., and Mohan, G. (2005). Participation: From Tyranny to Transformation? Exploring New
Approaches to Participation in Development.
Hult, M., and Lennung, S. (1980). "Towards a Definition of Action Research: A Note and
Bibliography," Journal of Management Studies (17:2), 1pp. 242250.
Kemmis, S., & McTaggart, R. (1988). The action research planner. Geelong, Victoria, Australia:
Deakin University Press.
Kemmis, S., & McTaggart, R. (2000). Participatory action research. In N. K. Denzin & Y. S.
Lincoln(Eds.), Handbook of Qualitative Research (2nd ed., pp. 567605). Thousand Oaks, CA: Sage.
Lunch, Chris & Nick. 2006. Insights into Participatory Video: a handbook for the field. Oxford:
Insight - free pdf download available
Madhu, Towards a Praxis Model of Social Work: A Reflexive Account of Praxis Intervention with
the Adivasis of Attappady unpublished PhD Thesis, 2005
Masters, J. (1995) The History of Action Research in I. Hughes (ed) Action Research Electronic
Reader, The University of Sydney, Accessed online on Feb 2, 2007 at
http://www.behs.cchs.usyd.edu.au/arow/Reader/rmasters.htm[dead link].
McIntyre, A. (2008). Participatory action research (paperback ed.). Thousand Oaks, CA.: Sage
Publications.
McTaggart, Robin. 1989. 16 Tenets of Participatory Action Research.
McNiff, (2002) Action research for professional development. Accessed online Feb 2, 2007
Narayan, D. 1996. What is Participatory Research? In Toward Participatory Research.
Washington, D.C. World Bank. p. 17-30.
O'Brien, Rory. 1998. An Overview of the Methodological Approach of Action Research.
contain all the key elements involved in the research process and include sufficient information for
the readers to evaluate the proposed study. In this unit, we shall discuss about the common mistakes
that one encounters in writing good research proposals.
Introduction
Objectives
Concept note
What is a project?
How to Prepare a Concept Note
10 steps in making concept notes
Summing up
Keywords
Know your Progress
Further Readings / References
Model Answers
1. Introduction
In this unit, we shall discuss about the concept note, how to prepare a concept note, what is a
project. The guidelines given in this unit should enable you to write a concise concept note on a
research topic that you intend to undertake.
2. Objectives
After studying this unit, you should be able to:
Spell out the research problem, outlining the background, methodology and location of
fieldwork;
Introduce the principal researcher and other researchers involved in the project, their
qualifications, and their previous research experience and publications;
Follow the framework laid out below;
Not contain a detailed literature review and a budget, and
It must not be more than 550 words - using single spaced paragraphs and font size 12 in
Microsoft Word.
4. What is a Project?
Definition: Project
A project is a combination of inputs managed in a certain way to achieve one or more desired outputs,
and ultimately one or more desired impact. Here is a nice metaphor to illustrate the definition of a
project and its components as described in a concept note:
Cooks are constantly designing and implementing projects. Ingredients (inputs) are cooked
(managed) according to a recipe (work plan) to achieve a warm, balanced meal (output), and a happy
feeling or fullness and wellbeing (impact).
Title
Background
Objectives
Outputs
Activities and duration
Beneficiaries and impacts
Project management (includes monitoring and evaluation)
Budget
However, the concept note should be prepared in the final format order. Instead prepare the concept
note in the following order:
i.
ii.
iii.
iv.
v.
vi.
vii.
viii.
Objectives
Inputs
Activities and duration
Outputs
Beneficiaries and impacts
Project management
Draft budget
Background
ix.
x.
xi.
Specific
Measurable
Achievable
Realistic
Time bound
Each objective should specify the QUANTITY of achievements (e.g., numbers of beneficiaries, area
covered by project), and the QUALITY (e.g., poor farmers, marginal lands, drought-tolerant
varieties). Objectives should also include an indication of TIME when the objective will be achieved
(e.g., in January 2008, three years after the start of the project). Remember objectives are more
achievable if quality, quantity and time are clarified.
Step 2. Inputs (What do you need to achieve the objectives?)
The inputs you will need to implement your project (i.e. achieve your objectives) may include:
Some inputs may come from many different partners, e.g. farmer groups, individual farm families,
other NGOs, international organizations, donor groups, government agencies, etc. Remember that all
partners will also have travel, supplies, services and other input requirements.
You will only need a list of inputs to prepare your budget. It does not appear in a section of the
concept note UNLESS you have substantial inputs from another donor or the community. But you
will need to brainstorm all costs and inputs to arrive at a realistic set of activities and budget.
Step 3. Activities and Duration (What will you do? How long will it take?)
Describe (in summary only for a concept note) what you and your partners plan to do to achieve the
project objectives. Remember that donors are mostly geared up to supporting projects of three years.
Tips:
Important note: in the full proposal each activities section sentence should explain who will do
what, when, and how.
Step 4. Outputs (What will have been achieved at the end of the project?)
The outputs of the project should be directly related to the project objectives. Outputs may include:
It is worth spending time with colleagues, partners, and friends brainstorming all the possible outputs,
as well as those directly related to the objectives.
Key outputs that are achieved during the life of the project may be useful milestones that you can
refer to when writing the full proposal.
Step 5. Beneficiaries and Impacts (Who will benefit from the project and how?)
Brainstorm this section with the design team or other colleagues. Think of all the possible groups who
may benefit from project activities and as many different benefits as may occur.
Impact is what the donor is "buying." In making promises about the impact of a project, you need to:
describe the benefits you expect, how many of them can be expected, and when and where
they will occur.
present your reasoning for why you expect the benefits to accrue to a given group if
necessary, state the assumptions you are making.
consider whether to suggest that the project will have either an impact assessment component
or will be assessed by a separate impact measurement project.
Benefits also accrue to radio stations, NGOs, and other organizations, but you should play down these
(although not omit them altogether) and play up the benefits to partners such as farmers and their
organizations who are the poorest and the target of the donors development aims.
Show impact in terms of the Development Goals, such as:
poverty alleviation
food security
preserving the environment
improved nutrition and health
Important note: Explain how you will measure the above. Impacts that can be quantified are the
most impressive, and are more likely to sell your project to the donor.
Step 6. Project Management (How will you achieve the objectives? How will the project be
managed and evaluated?)
The best objectives in the world can only achieve the desired outputs and impacts if the project can be
effectively managed. Your design needs to include a plan covering the roles and responsibilities of
the various people who will manage the project. In a concept note you need only to briefly describe
who will lead the project and who will be responsible (and when) for the main project tasks including
financial management, monitoring and evaluation.
Step 7. Budget
Unwillingness to prepare project budgets is one of the two most common failings of inexperienced
project designers. Even top-quality projects will not get funded if their cost estimates are unrealistic,
overly greedy, or full of gaps that will cause future delays and frustrations.
Budget preparation skills are an essential tool for all who seek funds to implement good science
projects.
Go back to your list of inputs. Remember to make an allowance (as generous as you have been to
yourself) for the budget of possible partners, and to include indirect costs for both you and your
partners. If your project will receive funds from other sources (in kind from beneficiaries and
partners, contributions from the radio stations core program, etc.), be sure to highlight these
contributions in the concept note and perhaps mention them in the covering letter.
Depending on its size, your project may be approved by a donor in the field or at its headquarters.
Field approval is usually much quicker and easier to obtain.
Be sure to include and label all projects costs, even if you are not asking for money for them in your
concept note. It is very important for all parties to understand the true and full project costs, and to
avoid hidden expenses.
Important note: Remember that nothing is so frustrating as an under-funded project due to a poorly
designed budget. For this reason you should develop a budget which is as accurate as possible to
include in your concept note.
Step 8. Background Material
In the concept note, organize background material in two sections.
1. Under "The Problem and Why It is Urgent", discuss the project in terms of Development
Goals of poverty alleviation, food security, preservation of the environment, and nutrition and
health. In this section provide background statistics if available, citing sources, writing in a
general sort of style.
2. Under "What Has Already Been Done", be sure not to focus only on only one organizations
activities. Donors will want you to acknowledge the contributions others have made and are
still making some may be organizations that they are supporting; some may be your
proposed partners. (If this is a follow-on project or second phase, describe the outcomes of the
earlier work in detail.)
Step 9. Selecting a Good Title
Titles need to be catchy, informative, and distinctive. Try using a two-part title. The first part should
be short, snappy, catchy; the second part can be more serious and informative. Test your title out with
a few colleagues.
Examples:
Fishers for the Future: radio listening groups for fishermen and fisher mongers in India
Mothers of Invention: sharing ideas for business women in India
Why do the Chickens Die? Communicating low-cost and simple techniques for improved
poultry raising
Did We Make a Difference? Assessment of past and expected impact of FM Radio 91.1s
work (2005-2009)
7. Summing Up
A Concept Note is perhaps the shortest expression your project idea given on paper to a
donor. It is usually requested by the donor in situations where no proposals have been solicited from
NGOs. Most of the donor agencies prefer to understand the project through a Concept Note rather
than a full-fledged proposal. We need to remember that it is the shortest possible text for our project
idea. So, shorter the better. Most donor agencies request a minimum of one page to a maximum of
three pages.
Usually donors do not have a format for a Concept Note as they have for a full proposal. But, there
are some agencies, which issue solicitation for Concept Notes based upon a basic format given in the
guidelines. Concept Note has many advantages for NGOs seeking funds. It practically gives a
framework for ideas when they are organized on paper. It is also the first expression of the project
and gives the flexibility for the organization to work and re-work on idea before presenting it to the
donor.
8. Keywords
Brainstorming: Brainstorming is a group creativity technique designed to generate a large number of
ideas for the solution of a problem. In 1953 the method was popularized by Alex Faickney Osborn in
a book called Applied Imagination. Osborn proposed that groups could double their creative output
with brainstorming.
Budget: A Budget is a plan that outlines an organization's financial and operational goals. So a
budget may be thought of as an action plan; planning a budget helps a business allocate resources,
evaluate performance, and formulate plans.
While planning a budget can occur at any time, for many businesses, planning a budget is an annual
task, where the past year's budget is reviewed and budget projections are made for the next three or
even five years.
Concept Note: A concept note is a brief summary of a project. A concept note (or a concept paper, as
some people call it) is a short version of a project proposal.
Input: Input is a term that refers specifically to any particular item, product, or mechanism that refers
to an internal or external device that can be used for the purposes of triggering the progression of a
particular process.
Output: When all is said and done, the ultimate measurement as to the success and failure of a
project is determined based on the quality, the quantity, and the timeliness of the deliverables of all
sorts that are provided at the conclusion of the project. The sum total of the deliverables as well as
other unique post project outlays are referred to by the project management term output.
Project: A project is a combination of inputs managed in a certain way to achieve one or more
desired outputs, and ultimately one or more desired impact.
Project objectives: The objectives are the single most important part of your project design. They tell
the reader what it is you want to do. They are one of the first parts of the concept note that your
reader will look at. You need to think very carefully about your objectives before you start to write.
Project objectives should a) correspond to a core problem, b) define the strategy to overcome the
problem, and c) contribute to the achievement of higher-level development goals.
Project Management: Program management or programme management is the process of managing
several related projects, often with the intention of improving an organization's performance. Program
management also emphasises the coordinating and prioritizing of resources across projects, managing
links between the projects and the overall costs and risks of the program.
2)
3)
When formulating objectives, what are the important elements that need to be kept in mind?
4)
A project is a combination of inputs managed in a certain way to achieve one or more desired outputs,
and ultimately one or more desired impact. And the concept note is a brief summary of a project. A
concept note (or a concept paper, as some people call it) is a short version of a project proposal.
2)
A concept note has a specific format. The final version of the concept note has the following
headings:
9. Title
10. Background
11. Objectives
12. Outputs
13. Activities and duration
14. Beneficiaries and impacts
15. Project management (includes monitoring and evaluation)
3.
Specific
Measurable
Achievable
Realistic
Time bound
Each objective should specify the QUANTITY of achievements (e.g., numbers of beneficiaries, area
covered by project), and the QUALITY (e.g., poor farmers, marginal lands, drought-tolerant
varieties). Objectives should also include an indication of TIME when the objective will be achieved
(e.g., in January 2008, three years after the start of the project). Remember objectives are more
achievable if quality, quantity and time are clarified.
4.
b.
Under "The Problem and Why It is Urgent", discuss the project in terms of Development
Goals of poverty alleviation, food security, preservation of the environment, and nutrition and
health. In this section provide background statistics if available, citing sources, writing in a
general sort of style.
Under "What Has Already Been Done", be sure not to focus only on only one organizations
activities. Donors will want you to acknowledge the contributions others have made and are
still making some may be organizations that they are supporting; some may be your
proposed partners. (If this is a follow-on project or second phase, describe the outcomes of the
earlier work in detail.)
1. Introduction
Most students and beginning researchers do not fully understand what a research proposal
means, nor do they understand its importance. To put it bluntly, one's research is only as a good as
one's proposal. An ill-conceived proposal dooms the project even if it somehow gets through the
Thesis Supervisory Committee. A high quality proposal, on the other hand, not only promises success
for the project, but also impresses your Thesis Committee about your potential as a researcher.
A research proposal is intended to convince others that you have a worthwhile research
project and that you have the competence and the work-plan to complete it. Generally, a research
proposal should contain all the key elements involved in the research process and include sufficient
information for the readers to evaluate the proposed study.
Regardless of your research area and the methodology you choose, all research proposals
must address the following questions: What you plan to accomplish, why you want to do it and how
you are going to do it ?
The proposal should have sufficient information to convince your readers that you have an
important research idea, that you have a good grasp of the relevant literature and the major issues, and
that your methodology is sound.
The quality of your research proposal depends not only on the quality of your proposed
project, but also on the quality of your proposal writing. A good research project may run the risk of
rejection simply because the proposal is poorly written. Therefore, it pays if your writing is coherent,
clear and compelling.
This Unit focuses on proposal writing rather than on the development of research ideas.
2. Objectives
After studying this Unit, you should be able to:
A research proposal is a detailed plan of action for scientific inquiry. It clearly and
systematically presents the research problem, indicates the significance of the problem, and delineates
the specific methods and procedures that will be used to answer the research question or test the
research hypotheses. It also provides a timetable or outline for conducting the study and details the
estimated cost of the investigation. It is written as a preliminary step in the research process. It
synthesizes current knowledge, indicates gaps in knowledge, and specifies a plan to address the
problem.
The research proposal can serve many useful functions. The most important is that it helps
you to think out the research project and predict any difficulties that might arise. For those who arent
sure what their focus will be, the research proposal can be a space to explore options. Writing
multiple proposals or drafts will help you to develop and focus your inquiry and to decide how to
proceed efficiently.
A good research proposal is an explicit, coherent and well-grounded description of your
research. The proposal should tell the reader what you aim to do, why your study is worth doing
(how it is new, interesting, useful) and how you intend to carry out your project ?
Hence, your proposal should :
State the topic and purpose of your study clearly and concisely.
Relate your work to previous research and specify how your study will contribute to it show
how your study is relevant to different audiences (eg. Other researchers or practitioners).
Give a description of the research questions your study addresses and the methods you have
chosen to address the problem or question of your choice (research design).
Give an outline of the overall work plan; aims and targets and the timeframe within which you
aim to achieve these targets.
Note that the proposal is NOT the final and definite plan of your project; it will be revised and
developed as you make progress with your work.
Writing also helps to revise your original ideas through considering different options and their
usefulness for your purposes.
Different versions of the proposal help your supervisor to follow your progress and give
advice and guidance when you need it.
Get started with the work itself; what you write in the proposal can be revised, expanded,
developed and used in the thesis itself.
As you write different versions of the proposal, it is easier to organize and manage your work
and proceed step by step.
The ability to draw up (and carry out) a good plan or outline for a project is a useful
professional skill in itself.
Start with collecting your ideas: make notes, draw a mind map, put together an idea paper
where you collect your thoughts on the topic of your choice.
Take a look at thesis already completed in your area to get an idea of what can be done and
how other people have approached the task.
Talk to your classmates, brainstorm with them, talk to your Supervisor about what you need
to rethink or revise.
Write up a first draft where you try to include as many of the points above as you can.
Identify questions that you cannot answer yet, but dont get worried about them : just show
how you intend to deal with them (for example, if you have not made a plan for collecting
data, try to show the reader that you are in the process of planning it and considering different
options).
Present your draft to other students and your Supervisor for comments and suggestions.
Title Page: Includes project title, name of applicant, name of agency submitted to, signature, typed
name and title of authorized personnel approving submission and date of approval. If your proposal is
lengthy, keep in mind that some grant reviewers like to see a Table of Contents page following the
Title Page, with tabs on each section within the application, to enhance user-friendliness.
Summary: Synopsis of project objectives, procedures, evaluation. Try to catch the "flavor" of the
project in approximately 250 words. Remember, this may be the only part reviewers read in the body
of the proposal, and this language may be used verbatim by the reviewer to describe or explain your
application to the board or other internal review/approval entity.
Introduction: Tell what needs to be done and why. Mention the general theory upon which the
project is based. If unique, it should be asserted here. If new or uncommon terms are used in the
proposal, explain their meaning here.
Problem statement: State why this problem needs to be addressed and provide references to
research, statistics, previous projects or other documentation to support the need for the project.
Objectives: State the proposed outcome of the project in clearly specified and measurable terms.
Each objective is usually related to (1) a need identified in the introduction section; (2) activities in
the methodology section; and (3) activities in the evaluation section.
Methodology: At this point, you want to describe the problem in terms of the methods you will use
in combating it and why you are choosing this strategy. It is here that specific activities are described,
as well as those action steps that will be used to achieve the objectives.
Evaluation: Provide details on how the organization and the funding source will determine whether
the project has accomplished its objectives. Include the type of evaluation information to be collected,
how it will be analyzed and a pattern for its dissemination and use. Care should be taken to strengthen
this section and provide evaluation criteria for each objective.
Future orientation: Discuss all topics relevant to the future of the project, whether its timeframe is
limited or if the intent is to continue or expand the project beyond the project time period. How will
continuation be done - what future funding has been lined up?
Budget: State the proposed project costs in a table or spread sheet format. Every item should be
carefully documented. Request as much money as you need to complete the project adequately
(asking for too little money can be as bad as asking for too much). The reviewers will likely know
what is a reasonable amount to conduct the project activities.
Appendices: Include all required support documentation deemed necessary by the funding source.
One of the ironies of grant planning and writing is that it costs time and money to prepare a
good proposal, yet it is difficult to obtain funds until after the grant is approved. There are a few
foundations and some government grant programs which will provide specific planning grants. This
possibility should be explored. If you already have received a grant, give some thought to how you
can use current resources for planning for the next grant application.
5.1 Introduction
The main purpose of the introduction is to provide the necessary background or context for
your research problem. How to frame the research problem is perhaps the biggest problem in
proposal writing.
If the research problem is framed in the context of a general, rambling literature review, then
the research question may appear trivial and uninteresting. However, if the same question is placed in
the context of a very focused and current research area, its significance will become evident.
Unfortunately, there are no hard and fast rules on how to frame your research question just as
there is no prescription on how to write an interesting and informative opening paragraph. A lot
depends on your creativity, your ability to think clearly and the depth of your understanding of
problem areas.
However, try to place your research question in the context of either a current "hot" area, or an
older area that remains viable. Secondly, you need to provide a brief but appropriate historical
backdrop. Thirdly, provide the contemporary context in which your proposed research question
occupies the central stage. Finally, identify "key players" and refer to the most relevant and
representative publications. In short, try to paint your research question in broad brushes and at the
same time bring out its significance.
The introduction typically begins with a general statement of the problem area, with a focus
on a specific research problem, to be followed by the rational or justification for the proposed study.
The introduction generally covers the following elements:
1. State the research problem, which is often referred to as the purpose of the study.
2. Provide the context and set the stage for your research question in such a way as to show its
necessity and importance.
3. Present the rationale of your proposed study and clearly indicate why it is worth doing.
4. Briefly describe the major issues and sub-problems to be addressed by your research.
5. Identify the key independent and dependent variables of your experiment. Alternatively,
specify the phenomenon you want to study.
6. State your hypothesis or theory, if any.
7. Set the delimitation or boundaries of your proposed research in order to provide a clear focus.
8. Provide definitions of key concepts. (This is optional.)
5.2 Problem Statement
This section of your proposal is quite important because it forms the basis for your project's
development. This section describes the problem or situation in your target area that needs to be
addressed and relates it to the overall environment and its impact if not rectified or alleviated. The
problem statement relates to your constituency and their needs and not to the concerns of your agency
or organization. Take care not to exaggerate the problem or situation. You want to convince the
funding source that the problems are serious but not insurmountable in solving. Funders appreciate
the use of statistical and comparative data to demonstrate the scope of a problem; however, they do
not appreciate being overwhelmed with data. Use local sources of information. Use national data only
to the extent that you are making comparisons of the situation
with the national outlook.
To sum up this section, keep in mind that you are describing why your constituency -- not
your organization -- needs assistance. Be specific. In addition, remember:
- Never paint a picture so terrible that there is no hope of solving it.
- You are seeking to address a situation or problem as the result of a condition that exists.
- Develop your research and make sure you know your constituency's desires. Remember to include
statistical and comparative data.
- Know what other experts and program operators are doing. Develop linkages with outside groups
and organizations.
- Never provide more than one option for tackling the problem. The option you pick should be the
final, most optimal solution.
5.3 Objectives
Objectives make up the specific components of your overall goal, that which you are ultimately
trying to achieve. Objectives describe the desired end product or situation to exist at the conclusion of
the project. They should be described in terms that are measurable and quantifiable. They are the
traceable and significant connection between the problem description and the actual goods or services
provided.
Objectives should be stated using the client's point of view and deal with a terminal nature -- what the
clients will look like at the project's conclusion.
Specific objectives serve to focus organizational activity around a common purpose and provide a
benchmark of measuring program achievement. The objectives, if successfully completed, result in
the direct and lasting impact on the problems experienced by clientele. Consider that objectives
generally fall into one of three categories: input, process and impact.
Programme inputs: This type of objective identifies the quality or quantity of different resources
judged necessary to complete a program task. Examples of such objectives include: to increase the
number of industrial settings for training programs; to increase cooperation and coordination of
program services; to increase the number of intakes by 5 percent; and to increase the number who
participate in training programs.
Programme process: These objectives state that specified services, treatments, functions or tasks
were accomplished, delivered or performed in specified quantities or qualities. For example, process
objectives might include: the provision of so many units of vocational education services; a specific
number of employment development services provided, one for each eligible client; or completion of
a program recruitment process with a specific number of clients recruited.
Impact Objective: These objectives state the purpose of the program or state the benefits that will
last after participants leave the program. Examples of impact (sometimes called output) objectives
are: reduce or eliminate dependency; achieve or maintain self-sufficiency; reduce unemployment;
increase the number of workers placed in jobs; and provide an adequate income in retirement.
Objectives are easily written if one remembers the five essential parts -What: the nature of the situation to be changed, often signaled by the preposition "to" followed by an
action verb;
Who: the particular group or segment (clients, staff, components), in which or for which achievement
is desired;
Where: the geographic area or that place in which the accomplishment is desired;
When: the target date for completion of the objective or the days or times the objective is carried out;
What extent: the quality or quantity of the situation to be achieved, a measurement which can later
be used as a basis for evaluation.
Objectives are not to be confused with activities. Activities are the means used to achieve the
objectives. They are your methods. Objectives are also not to be confused with goals. Goals are
identified as statements of the broad purpose of a program and are long range desires or benefits:
objectives are more immediate or short range.
5.4 Methodology
This section describes the methods (also referred to as strategies, activities, or procedures) to be
employed to accomplish the objectives.
The methodology section of a proposal should describe in detail:
- What you are doing (activities);
- Your justification for the actions to be taken;
- The flow of activities and how long it will take to get results;
- Target population in terms of characteristics and selection process;
- Staff requirements in terms of hiring and training; and
- Start up activities required prior to full project implementation.
Projects vary most in this area and no universal prescription can be useful. However, the best
proposals will contain:
Design: The basic technique or approach to be used such as a case study, pilot program, controlled
experiment, etc.
Population recruitment: The projected participants, subjects, or beneficiaries and how they are
selected. Also describe the role they have had in planning for the proposal.
Treatment: Provide sufficient detail about the procedures to be used so the reader can understand
thoroughly.
Reporting and participant tracking: How information will be collected and who will do it. Be
specific and include copies of any special instruments in the appendix.
Time schedule
Project an approximate time schedule for carrying out the proposed project. Charts are often
useful here.
Activities are a job or a task requiring both time and resources. Activities state in
chronological order how a strategy is to be accomplished -- in other words, what needs to be done to
achieve the strategies (and therefore objectives). Activities are developed by listing each step
necessary to complete a job. To ensure that each step is listed, one should "backward chain."
Backward chaining is not easy because it requires thinking of each step in reverse order. First, list the
last step which one does to complete a job or objective, then the next to last step and so on to the step
where you are starting. This process of backward chaining will give more detail than most other
methods of listing activities.
Keep in mind that just as objectives flow from the problem statement, so too should the
methodology section flow from the objectives. Including a timetable at the end of this section would
be helpful to the reviewer in analyzing the procession of events. It will also help you to ensure that
important details have not been overlooked. However, if charts or graphs are used, make sure they
are extremely cogent so as not to detract from the body of the proposal.
5.6 Evaluation
How will you know your project is a success? How will you document your projects success?
The evaluation section of your proposal should provide answers to these questions. Decision makers
generally need evaluations of program success in order to maintain or modify their program to
achieve maximum operating efficiency. In addition, performance indicators which can be measured
before, during and after the end of the program will help predict the success of the individuals while
they are participating in the program, as well as their post-programme success.
The evaluation section is quite important to funders since they want to be able to measure the
progress of programmes and determine whether their dollars have been well spent. The inclusion of
an evaluation shows that you have an interest in upgrading your project. In summary, the evaluation
section should:
- Describe how data will be collected and progress monitored and analyzed;
- Describe the type(s) of evaluation to be conducted (product and/or process);
- Tell how records will be kept;
- Describe the evaluator: name, title, credentials and extent of impartiality;
- Outline reporting procedures; and
- Provide specific due dates for completing the evaluation.
The product evaluation measures your success in meeting the objectives of your project. Did
you meet the projected and desired statistics of your project? Were your actions indeed helpful to
your clients and are they better off as a result?
5.6.1 Goal or objective achievement: With programme goal or objective achievement, organisations
examine the degree of success in attaining each of their short-term program goals and objectives.
Goal achievement measures are used for several reasons. These measures examine program success
in relation to the needs of the program as it exists to determine program saturation. The measures
examine programme success relative to the programme as planned to arrive at design efficiency. The
measures also examine programme success relative to expenditures to measure cost efficiency.
Examples of these kinds of quantifiable measures might include: reduced costs per participant,
increase in the proportion of parents involved in training, increase in the proportion of parents who
leave public welfare, planned versus performance measure of expenditures, planned versus
performance measure of placement, and percent placed in unsubsidised jobs.
While a product evaluation measures the objectives, a process evaluation measures methods
used in working towards the goal. Was the benefit of your actions worth the cost of their
implementation? Were you meeting some higher goal with each step taken?
5.6.2 Immediate post programme success: Another type of measure is that of immediate post
programme success. These measures of performance are based on the experience of a program as
seen primarily from the client's history. Examples of this type of measure include increased
employment or reduced unemployment, increased earnings, increased labor force participation,
increased mobility of the labor force, reduced dependency on the government, and jobs filled in
geographic areas or in occupational classifications. Additional examples of types of measures used by
organisations to determine post programme success are:
- Increased proportion of parents who leave welfare based on services;
- Maximized dollar volume of annualised welfare grant reductions;
- Increased number of registrants entering employment;
- Increased average hourly wage of participants;
- Number of placements in unsubsidised jobs; and
- Increased employability based on improved attitude towards work.
Programme operating efficiency: Because some programs are designed to serve a number of
functions for the participant, organizations have developed program operating efficiency gauges to
directly observe project functions and arrive at conclusions about the program's efficiency. Examples
of the measures of program operating efficiency -- how well the program activity was performed -include several measures related to workload, some related to the capacity for work and some related
to the mix or complexity of program activities. Indicative program operations measures may be, for
example: increase intake by 5 percent over the fiscal year to a total of 670,000; and increase the
number of tests administered to a total of 24,400.
5.7 Budget
The budget may be the key to your proposal. Your organisation is asking for money and your
budget statement is the concrete way to show that you need it. Many funding agencies complain that
they often read through an entire proposal and still are not exactly sure what the organization needs in
terms of money. The requested amount, as previously pointed out, should be stated explicitly at the
beginning of your proposal. Make sure your proposal supports each item in the budget -- and that it is
clear to the reviewers what costs are associated with each activity. The budget summary and detail
justification pages should have the total project cost, broken out by requested amount (from the
funder), organisation contribution and other outside sources (combined). The following budget items
should be carefully documented:
5.7.1
Salaries and wages: This line item represents expenditures for salaries and wages. Salaries and
wages are defined as fixed payments at regular intervals to professional and clerical staff, and hourly
based payments to part-time and intermittent employees, for services performed. List each staff
position with titles, monthly or weekly salary ranges, number of persons per position, number of
months or weeks to be devoted to the project, percent of time devoted to the project and total salaries
per position.
Fringe benefits: This line item represents payments other than salaries and wages made to staff, or
paid in their behalf or on their account, as in the form of a pension, vacation, insurance, etc. List
fringe benefits for project staff, including FICA, unemployment and workers' compensation, and
hospitalization. Include computation and rate details.
Consultant and contractual services: Use for procurement contracts (except those which belong on
other lines such as equipment or supplies), and contracts or other agreements with secondary recipient
organisations such as affiliates, cooperating institutions, delegate agencies, political subdivisions, etc.
Include cost of all consultants. List fees for all legal, accounting and professional services. Provide
specific cost breakouts for each item listed.
Space costs: This line item represents payments for building and space rent, utilities, janitorial
service, general maintenance and repairs, necessary re-arrangements and alterations of facilities
which do not materially increase the value or useful life of the facility, and other related costs
necessary to provide adequate space. A cost analysis study may have to be conducted to determine
the amount of rent to be charged to the project if the project is housed within the organisation's own
facility. Other more simplified methods may be employed to determine space costs. In any event,
show the amount of space cost per month by the number of project months to determine total cost or
cost per square footage.
Equipment purchases: This line item represents payments for the purchase of non-expendable
personal property having a useful life of more than one year and a unit acquisition cost of $300-500
or more (depending on the funding agency), payments of costs associated with the transportation and
installation of non-expendable personal property purchased or to be purchased, and 26 payments
made under a lease or rental contract for non-expendable personal property where an option-topurchase provision is expected to be exercised. Check the funding source policy for limitations on
equipment purchases first; many government funders, for example, have specific requirements.
Equipment rental: List the cost of each office and program equipment item to be rented for use in
the project. Again, check the funding source policy for limitations before including these items.
Specify each item and monthly rental fee.
Consumable supplies: These items include office and program supplies such as paper, pens, typing
ribbon, folders, etc.
Utilities: The costs for electricity and gas are sometimes broken out separately from space costs. If no
specific budget format is provided you may opt for breaking these items out under a separate budget
category.
Travel: This line item represents payments for transportation, meals and lodging of staff in
accordance with the funder's policy. Check with the funding source for allowable rates for in-state
travel. Check with the funding agency beforehand about out-of-state travel. Project the total local
mileage of each staff person and also specify the purpose of such travel for each position listed. If
out-of-state travel is an allowable expense, specify the purpose of such travel, i.e., program related
activities, training, conferences.
Telecommunications: Included in this line item category are costs associated with installation and
monthly charges for telephone lines, computer phone lines, fax machines, cellular telephones, pagers
and the like.
Programme income: These are direct charges to or fees to participants of the project. Program
income must be kept in a restricted account and either returned to the granting agency or used to fund
direct costs of items needed to expand the quality or quantity of services provided. With some public
funding programmes, it can also be carried over into the following fiscal year. In some programs,
funding agencies allow programme income to be used as match.
Special project costs: These include costs specific to the project. For example, meals served to
children in a recreational program, training manuals, printing original materials and the like. Show
specific cost details for each listed item. Other Costs: Included in this budget category are such items
as office and building maintenance services, postage, repair and maintenance charges for rental
equipment, meeting costs, subscription dues, printing and publication costs, temporary help, and
insurance and bonding costs. Remember to provide specific cost breakouts for each item listed.
Overhead/indirect costs: Overhead or indirect costs are those additional costs which will be incurred
by an organisation that operates multiple programs as a result of taking on this new project. Also
known as administrative costs or facilities and utilities, these costs are determined by charging a
fixed percentage, such as 10 to 15 percent, of the total grant request, to cover such expenses as
general and unit personnel and non-personnel costs. Some public and private funding sources may
disallow these charges, so again, check with the funding source before including this category! This
line item represents costs attributed to the program's administration cost category through application
of an indirect cost rate or cost allocation plan usually required by a government funder. These costs
are not to duplicate any costs charged to the other cost line items in this section. For most government
funded programmes indirect costs may not be recovered without an approved cost allotment plan.
Matching share
In general, matching share represents that portion of project costs that is not borne by the
funding source. For government programmes a minimum percentage for matching share is usually
required depending on the program legislation. The following information may be used as a guide in
developing the matching share section of your project budget. Check with the funder to assure its
matching share requirements. Matching share may consist of:
Charges incurred by the applicant as project costs, but not paid with grant funds;
Project costs financed with cash contributed or donated to the grantee by other public and
private sources; and
Project services and borrowed or donated real or personal property, or use thereof, donated
by other public and private sources.
Cash contributions: These represent the grantee's cash outlay including the outlay of money
contributed to the grantee by private organizations, foundations, corporations, individuals, and other
public agencies and institutions (if the grantor happens to be a government funding source for the
project). When authorized by federal legislation, federal funds received from other grants may be
considered as the grantee's cash contribution. Examples of cash match are:
- Salaries and fringe benefits;
- Travel costs;
- Postage;
- Office supplies; and
- New equipment purchased (with prior grant approval).
In-kind contributions: These represent the value of noncash contributions provided by the grantee
and other outside sources. In-kind contributions may be in the form of charges for real property and
non-expendable personal property and the rental value of goods and services directly benefiting and
specifically identifiable to the project or program. Grantees with government grants may wish to
check with the funding source to secure permission to consider property purchased with government
(usually federal) funds as the grantee's in-kind contribution. Examples of in-kind matching share
include:
- Salaries and fringe benefits (of persons not directly paid by program);
- Use of depreciable equipment;
- Value of donated services; and
- Value of office space (with prior grant approval).
Volunteer services may be furnished by professional and technical personnel, consultants, and
other skilled and unskilled labor. Volunteered service may be counted as in-kind matching share if
the service is an integral and necessary part of an approved plan.
Rates for volunteers should be consistent with those paid for similar work in other activities.
In those instances in which the required skills are not found in the grantee organisation, rates should
be consistent with those paid for similar work in the labor market in which the grantee competes for
the kind of services involved.
When an employer other than the grantee furnishes the services of an employee, these services
shall be valued at the employee's regular rate of pay (exclusive of fringe benefits and overhead cost)
provided these services are in the same skill for which the employee is normally paid.
Another in-kind contribution is donated expendable personal property. Donated expendable
personal property includes such items as expendable equipment, office supplies, laboratory supplies,
or workshop and classroom supplies. Values assessed to expendable personal property included in the
cost or matching share should be reasonable and should not exceed the fair market value of the
property at the time of the donation.
The method used for charging matching share for donated non-expendable personal property,
buildings and land may differ depending upon the purpose of the grant.
If the purpose of the grant is to furnish equipment, buildings, or land to the grantee or
otherwise provide a facility, the total value of the donated property could potentially be claimed as a
matching share. If the purpose of the grant is to support activities that require the use of equipment,
buildings, or land on a temporary or part-time basis, depreciation or use charges for equipment and
buildings may be made.
The value of donated nonexpendable personal property cannot exceed the fair market value of
equipment and property of the same age and condition at the time of donation. The value of donated
space cannot exceed the fair rental value of comparable space as established by an independent
appraisal. And finally, the value of loaned equipment cannot exceed its fair rental value.
5.7.2
Cash flow
While developing a project budget, an organisation should address the question of cash flow:
Many organisations have faced serious problems because they have overlooked these two
components of cash flow. In few instances will state or federal agencies allow "as needed"
disbursements. (A Letter of Credit from a federal agency would be an exception to this general rule.)
In many cases the state or federal agency only allows vouchers. Organizations are reimbursed for
expenses already paid out because the voucher represents payment for contracted services. This could
be contrasted to foundation or corporate grants where a specific sum of money is granted per period
based on planned project expenditures.
In any case an organisation must gauge its actual cash needs for each period (e.g., start up
periods, monthly allotments) and by each project. The organisation must also develop and send out
vouchers and disbursements in a timely manner and ensure that both are properly prepared.
Organizations must monitor cash flows in every line item to prevent serious overruns or idleness of
funds. Finally, your budget section should not be excessively long. A long presentation usually
demonstrates weak or poor organisation.
5.7.3
Future funding
This Section shows the funder that you are looking into the future. Discussion should focus on
several areas. Do you anticipate the possibility of a spin-off? In other words, what are the chances
that the project can become free-standing after the funding period? Will you seek future funding from
the same source and/or other sources? What are the implications for the project's continuation if
outside support declines? Can your organization operate the project without outside funding, and if
so, what are the plans to continue on?
What would it cost to operate any given program next year? Organisations would profit by
analysing past costs in each line item and estimating future cost of each line item considering
following :
- Inflation;
- Cost of living or other scheduled pay increases;
- Retirement benefits, vacation accrued, other fringes;
- Changes in social security deductions or workers' compensation laws; and
- Changes in rent, insurance, audits, postage, and other normal expenses.
5.8
Appendices
The items which are often included in the proposal's Appendices have been discussed in
earlier sections of this handbook. To reiterate, those items are:
Copy of the organisation's 501(c)(3) tax exemption letter from the Internal Revenue Service
(IRS);
List of board members, including addresses, and telephone numbers;
Copy of the organisation's most recent audit report, current financial statement and current
operating budget;
Copy of the organisation's Annual Report;
Resumes of key project staff to demonstrate qualifications and credentials;
Letters of support from established community and neighborhood organizations familiar with
the organization's work and credibility;
News clippings and releases highlighting the organisation's most recent achievements or
immediate past accomplishments; and
Brochures of the organisation describing its various programs and activities.
Make sure these items are packaged in a neat and orderly fashion. Nothing can be as frustrating to a
proposal reviewer as to have to search through a disorganized proposal package to find out if all the
required documents have been submitted. A good approach is to number and clearly label each
document or group of material as an individual Appendix, and to refer to that Appendix by number in
the body of the text.
6. Summing up
A research proposal can seem, at first, to be a mysterious document, mainly because, at early
stages in our investigations, we are not quite sure what we intend to write. We may have more or less
of a good idea about a problem that vexes us and that we intend to solve, or a research idea we want
to explore, but we havent determined yet how to satisfy this desire. The answer to this mystery lies
in the document itself, for the research proposal has two major, practical functions:
It helps you to structure your thinking about how to approach an answer to your problem.
It convinces your adviser and readers that you have thought through the parameters of your
problem and have a good strategy for solving it.
Thus, the preparation of a research proposal, far from being a chore that gets in the way of
your getting on with the task, actually provides the means of accomplishing the task, and in many
cases can serve as a first draft of the paper itself.
While there is no strict outline for a research proposal, since research projects can vary in the
shape and dynamics of gathering and analyzing information, a typical proposal will:
(a)
(b)
a)
b)
c)
d)
e)
State a clearly defined research question you intend to ask in order to solve this problem. This
question should be a combination of
the subject you intend to explore;
the question you intend to answer about your subject;
the significance of your answer in solving the problem and others like it,
elaboration of the different implications of the research question, substantively linking it to
the setting in which it fits; and
Discussion of why the question is important (intellectually, practically, and theoretically).
7. Keywords
Abstract The abstract is a clear concise summary of the proposed research project. It is commonly
50350 words long and takes up no more than one page. The funding organization's guidelines
usually specify the limitations. The abstract should capture the essence of the proposal concisely and
completely. Begin with a short statement of the purpose of your study, and indicate the research
hypothesis or questions. Give the rationale for the proposed study, and describe the research design
and data analysis. Finally, offer a conclusion about the anticipated results and their significance.
Include vital details that make the proposed research original and important. Reviewers should be
able to read the abstract and know what you propose to do.
Typically, the abstract includes the following major elements:
Title of the proposal.
Name of the principal investigator (project director).
Name of the applicant's organization (institution).
Objective (purpose of the study and rationale).
Methods (procedures and research design).
Significance (contribution).
Appendixes: Appendixes are used to support the research proposal. Do not put text that is central to
the proposal in an appendix; put it in the main body of the proposal. Put supportive information and
documentation in an appendix. In the body of the proposal, be sure to include reference to support
materials.
Appropriate materials for an appendix include the following:
Letters of support for the project (from clinical agencies, academic facilities).
Letter of approval or clearance from the institutional review board, human subjects
committee, or animal protection committee when appropriate.
Other supportive materials as needed (e.g., expanded detail on procedures mentioned in the
body of the proposal).
Funding agencies usually provide guidelines on the types of appendices that are acceptable. If
no guidelines are provided, call the agency before including any appendix in your proposal.
Some funding agencies do not allow appendices.
Letters of support from key personnel in clinical agencies about access to subjects are critical.
Documentation of previous experience and relevant expertise of the research team provides
strong support for feasibility of the study.
Covering Letter: The covering letter includes the title and content of the research proposal, the
name of the grant applied for, the name and affiliation of the investigator, and any other information
required for submission (e.g., applicant's eligibility for membership in an organization or other
qualifications). Address the cover letter to the contact person at the funding agency or, in lieu of a
contact person, the head of the agency or department. A well-written cover letter helps the agency
direct the application to reviewers whose expertise closely matches that required for the proposed
research.
Research Design The research design designates the type of inquiry that will be used to answer the
research hypotheses or questions and provides a framework for the rest of the study. The type of
design depends on the question asked; experience of the researcher; feasibility of the project; and
available resources such as time, money, staff, and access to subjects. Examples of quantitative
designs are survey, historical, single case study, descriptive, quasi-experimental, and experimental.
Examples of qualitative methods are grounded theory, hermeneutics, phenomenology, and descriptive
studies.
1)
2)
1. Introduction
Research provides the means for the acquisition of knowledge and information that is vital for
making informed decisions and developing policies necessary to improve the welfare of human
society. Ones research is only as a good as one's proposal. An ill-conceived proposal dooms the
project. A high quality proposal, on the other hand, promises success for the project. A research
proposal is intended to convince others that you have a worthwhile research project and that you have
the competence and the work-plan to complete it. Generally, a research proposal should contain all
the key elements involved in the research process and include sufficient information for the readers to
evaluate the proposed study. In this unit, we shall discuss about the common mistakes that one
encounters in writing good research proposals.
2. Objectives
After studying this unit, you should be able to:
The introduction of a proposal introduces to the reader the document and gives the readers their first
impression of a proposal. It is important that this first impression is positive; otherwise a reader may
have a negative bias towards the entire document.
The common reasons for rejection of research proposals relating to the introducing the proposal are
given below:
Many researchers deceive themselves by thinking that they can write a proper introduction without
having reviewed the most critical literature on their research topic. The introduction needs to include
a brief and concise statement on the intended research. Following this statement, the introduction
must state what is generally known about the research topic. This basically is the conclusion of the
author from a thorough survey of the current state of the knowledge on the subject. This survey must
also identify a knowledge gap and how the proposed research intends to reduce the gap and
contribute to the advancement of knowledge on the chosen topic. Identification of a knowledge gap
justifies the research proposed. Without this justification a study may be viewed as research
undertaken just for the sake of researchers.
3.3 Problem Statement
The problem statement is the centerpiece of a proposal as well as a report. Thus the statement of the
problem must be clear, brief and succinct. Very often researchers face serious problems with writing
the problem statement. Very few research proposals have a well-written problem statement. The
others have problems ranging from no problem statement, lack of clarity and articulation, and lack of
focus. Some proposals are muddled by attempting to cover many issues. There are also cases where
the problem statement is not even relevant.
3.4
A number of research proposals are rejected due to the problems related to clarity in stating the
objectives of the proposals. The ejected proposals either do not clearly state the objectives or
included many general objectives that obscured the intended research.
3.6
Relevance of Hypotheses
Problems related to writing hypotheses that are relevant to the proposed research topic and the subject
matter in question indicate that the proposal authors face serious problems articulating
comprehensible hypotheses. The problems noted include inadequate presentation, hypotheses not
stated, irrelevant hypotheses and lack of clearly formulated hypotheses.
As only few proposals adequately present relevant hypotheses, it is likely that most of the hypotheses
that are found to be testable are those which are relevant. The majority of proposals which are present
hypotheses are not testable.
on the quality of text and presentation show that over three-fifths of proposals had acceptable quality
of texts and presentation. Poor text and presentation represented 34% and only 3%
of proposals were submitted without being edited.
5. Summing Up
Common Mistakes in Proposal Writing
1. Failure to provide the proper context to frame the research question.
2. Failure to delimit the boundary conditions for your research.
3. Failure to cite landmark studies.
4. Failure to accurately present the theoretical and empirical contributions by other researchers.
5. Failure to stay focused on the research question.
6. Failure to develop a coherent and persuasive argument for the proposed research.
7. Too much detail on minor issues, but not enough detail on major issues.
8. Too much rambling going "all over the map" without a clear sense of direction. (The best
proposals move forward with ease and grace like a seamless river.)
9. Too many citation lapses and incorrect references.
10. Too long or too short.
6. Keywords
Hypothesis: A hypothesis is a tentative statement that proposes a possible explanation to some
phenomenon or event. A useful hypothesis is a testable statement which may include a prediction. A
hypotheses should not be confused with a theory. Theories are general explanations based on a large
amount of data. For example, the theory of evolution applies to all living things and is based on wide
range of observations. However, there are many things about evolution that are not fully understood
such as gaps in the fossil record. Many hypotheses have been proposed and tested.
Literature Review: A literature review is a body of text that aims to review the critical points of
current knowledge and or methodological approaches on a particular topic. Literature reviews are
secondary sources, and as such, do not report any new or original experimental work.
Most often associated with academic-oriented literature, such as theses, a literature review usually
precedes a research proposal and results section. Its ultimate goal is to bring the reader up to date with
current literature on a topic and forms the basis for another goal, such as future research that may be
needed in the area.
A well-structured literature review is characterized by a logical flow of ideas; current and relevant
references with consistent, appropriate referencing style; proper use of terminology; and an unbiased
and comprehensive view of the previous research on the topic.
Research: Research provides the means for the acquisition of knowledge and information that is vital
for making informed decisions and developing policies necessary to improve the welfare of human
society.
Research Instruments: The quality of research depends to a large extent on the quality of the data
collection tools. Interviewing and administering questionnaires are probably the most commonly used
research techniques. Therefore designing good questioning tools forms an important and timeconsuming phase in the development of most research proposals.
Once the decision has been made to use these tools, the following questions should be considered
before designing them:
What exactly do we want to know, according to the objectives and variables we identified
earlier?
Is questioning the right technique to obtain all answers, or do we need additional techniques,
such as observations or analyses of records?
Of whom will we ask questions and what techniques will we use? Do we understand the topic
sufficiently to design a questionnaire, or do we need some loosely structured interviews with
key informants or a FGD first to orientate ourselves?
Are our informants mainly literate or illiterate? (If illiterate, the use of self-administered
questionnaires is out of the question.)
How large is the sample that will be interviewed? Studies with many respondents often use
shorter, highly structured questionnaires while smaller studies allow more flexibility and may
use interview guides or questionnaires with a number of open-ended questions.
Research Proposal: A research proposal is intended to convince others that you have a worthwhile
research project and that you have the competence and the work-plan to complete it.
Sampling: A sample is a finite part of a statistical population whose properties are studied to gain
information about the whole(Webster, 1985). When dealing with people, it can be defined as a set of
respondents (people) selected from a larger population for the purpose of a survey. Sampling is the
act, process, or technique of selecting a suitable sample, or a representative part of a population for
the purpose of determining parameters or characteristics of the whole population.
What are the common problems faced in writing the title of a research proposal?
2)
What are the problems related to appropriateness of methods and research instruments?
Booth, Wayne C., Colomb, Gregory G, and Williams Joseph M. The Craft of Research. Chicago,
University of Chicago Press
Cooksey, Brian and Alfred Lokuji (1995). Some Practical Research Guidelines, REPOA Special
Paper 12, REPOA, Dar es Salaam, December
Kikula, Idris and Martha A S Qorro (2007). 'Common Mistakes and Problems in Research Proposal
Writing: A Review of Proposals for Research Grants Submitted to REPOA', Special Paper ,
Dar es Salaam.
Lapin, L. L. (1987). Statistics for mordern business decisions. Harcourt Brace Jovanovich, Inc.
Patton, M.Q.(1990). Qualitative evaluation and research methods. SAGE Publications. Newbury
Park London New Delhi.
Punch, Keith F. (2000). Developing Effective Research Proposals. London, Sage Publications
Ltd.
Salant, P. and D. A. Dillman (1994). How to conduct your own survey. John Wiley & Sons, Inc.
Wangwe, Samuel and Apronius Mbilinyi (2006). 'The Review of Evaluation Processes for Research
Proposals and Research Outputs at REPOA, Final Report to REPOA, Daima Associates Ltd.,
July
Webster, M. (1985). Webster`s nith new collegiate dictionary. Meriam - Webster Inc.
9. Model Answers
1)
One of the most common problems relating to rejection of research proposals is that the titles
are unsatisfactorily written. Some are unclear while others have long and clumsy. A small number of
titles do not reflect what was intended to be done during the research. Some of the inadequate titles
are too wordy and lack focus.
Problems faced by authors on stating appropriate research methods include:
2)
Unit 3 discusses about the format for writing a good case study report.
Unit 4 offers information about evaluation in the context of rural development. Rural development
evaluation must provide information on the implementation and impacts of the programmes. The
aims are, on the one hand, to increase the accountability and transparency with regard to the legal and
budget authorities and the public and, on the other hand, to improve the implementation of the
programmes by contributing to informed planning and decisions concerning needs, delivery
mechanisms and resource allocation.
Summing up
6.
Keywords
9. Model Answers
1. Introduction
Improving the quality of life for the people of this country is perhaps the most important duty
of Government. We set measurable indicators across the whole range of issues that matter most to
people, and are likely to matter to future generations too. That means measuring how we perform on
the big, important things such as peoples health, the state of the economy, employment, transport,
crime and the environment. The indicators show how in some areas things are already improving. For
example, the economy has grown and peoples incomes have increased in real terms. Educational and
housing standards have improved. Emissions of some of the gases that contribute to climate change
have declined. In this Unit we shall try to understand the meaning of the term indicator and what are
the sustainability indicators.
2. Objectives
After studying this unit, you should be able to:
3. What is an Indicator?
The word for indicator in Arabic is pointer. Indicators point to a desirable outcome, to 'which
way is up' in the policy arena.
The different levels of data for policy purposes are shown in the Information Pyramid. At the bottom
of the pyramid are data, which unprocessed are of little value for policy purposes. Once data are
processed into statistics or tables, they can be used in reports or as the basis for ad-hoc evaluations,
but still they are often difficult to understand or use for policy. Indicators are statistics directed
specifically towards policy concerns and which point towards successful outcomes and conclusions
for policy. They are usually highly aggregated and have easily recognizable purposes. Classic
indicators include the unemployment rate or GDP growth, numbers which are such powerful and
recognizable indicators of performance that they may cause governments to fall. At the highest level
are indices, such as the consumer price index or human development index, which combine different
indicators into a single number useful for comparison over time and space.
An indicator is something that helps you understand where you are, which way you are going and
how far you are from where you want to be. A good indicator alerts you to a problem before it gets
too bad and helps you recognize what needs to be done to fix the problem. Indicators of a sustainable
community point to areas where the links between the economy, environment and society are weak.
They allow you to see where the problem areas are and help show the way to fix those problems.
3.1
Indicators of sustainability are different from traditional indicators of economic, social, and
environmental progress. Traditional indicators -- such as stockholder profits, asthma rates, and water
quality -- measure changes in one part of a community as if they were entirely independent of the
other parts. Sustainability indicators reflect the reality that the three different segments are very
tightly interconnected, as shown in the figure below:
problems, indicators can point the way to a better future. For all communities, indicators can generate
discussion among people with different backgrounds and viewpoints, and, in the process, help create
a shared vision of what the community should be.
3.2
An indicator is something that points to an issue or condition. Its purpose is to show you how well a
system is working. If there is a problem, an indicator can help you determine what direction to take to
address the issue. Indicators are as varied as the types of systems they monitor. However, there are
certain characteristics that effective indicators have in common:
Effective indicators are relevant; they show you something about the system that you need to
know.
Effective indicators are easy to understand, even by people who are not experts.
Effective indicators are reliable; you can trust the information that the indicator is providing.
Lastly, effective indicators are based on accessible data; the information is available or can be
gathered while there is still time to act.
An example of an indicator is the gas gauge in your car. The gas gauge shows you how much
gasoline is left in your car. If the gauge shows the tank is almost empty, you know it's time to fill up.
Another example of an indicator is a midterm report card. It shows you whether a student is doing
well enough to go to the next grade or if extra help is needed. Both of these indicators provide
information to help prevent or solve problems, hopefully before they become too severe.
Indicators can be useful as proxies or substitutes for measuring conditions that are so complex that
there is no direct measurement. For instance, it is hard to measure the 'quality of life in my town'
because there are many different things that make up quality of life and people may have different
opinions on which conditions count most. A very simple substitute indicator is 'Number of people
moving
into
the
town
compared
to
the
number
moving
out.'
Barometric pressure and wind direction are indicators of upcoming weather changes
Note that these are all numeric measurements. Indicators are quantifiable. An indicator is not the
same thing as an indication, which is generally not quantifiable, but just a vague clue. In addition to
being quantifiable, effective indicators have the four basic characteristics noted above. These
characteristics
are:
Relevant
An indicator must be relevant, that is, it must fit the purpose for measuring. As indicators, the gas
gauge and the report card both measure facts that are relevant. If, instead of measuring the amount of
gas in the tank, the gas gauge showed the octane rating of the gasoline, it would not help you decide
when to refill the tank. Likewise, a report card that measured the number of pencils used by the
student
would
be
a
poor
indicator
of
academic
performance.
Understandable
An indicator must be understandable. You need to know what it is telling you. There are many
different types of gas gauges. Some gauges have a lever that moves between 'full' and 'empty' marks.
Other gauges use lights to achieve the same effect. Some gauges show the number of gallons of
gasoline left in the tank. Although different, each gauge is understandable to the driver. Similarly,
with the report card, different schools have different ways of reporting academic progress. Some
schools have letter grades A through F. Other schools use numbers from 100 to 0. Still other schools
use written comments. Like the gas gauge, these different measures all express the student's progress
or lack of progress in a way that is understandable to the person reading the report card.
On the other hand, a gas gauge that showed the number of BTU's left in the tank would probably not
be very useful to you in deciding when to fill up the tank. Likewise, a report card that gave grades in
ancient Greek script would be a mystery to most people. In order for you to know when action is
needed, you must be able to understand what an indicator is telling you.
Reliable
An indicator must be reliable. You must trust what the indicator shows. A good gas gauge and an
accurate report card give information that can be relied on. A gas gauge that shows the tank is empty
when in fact it is half full would make you stop for gasoline before it is needed. A gas gauge that
shows the tank is half full when in fact it is empty would cause you to run out of gas in an
inconvenient place. Similarly, if a student's grade were reported wrong, an honors student could be
sent for remedial work and a student who needs help would not get it. An indicator is only useful if
you
know
you
can
believe
what
it
is
showing
you.
Reliability is not the same as precision. When your gas gauge registers empty, you know there is still
a gallon or so of gasoline left as a reserve. The gas gauge reliably under-reports the amount of
gasoline. An indicator does not necessarily need to be precise; it just needs to give a reliable picture
of
the
system
it
is
measuring.
Accessible Data
Indicators must provide timely information. They must give you information while there is time to
act. For example, imagine a gas gauge that only gave you the amount of gasoline in the tank when the
engine was started. After you have been driving for several hours, that reading is no longer useful.
You need to know how much gasoline is in the tank at each moment. Similarly, a report card
distributed a week before graduation arrives too late to give a student remedial help. In order for an
indicator to be useful in preventing or solving a problem, it must give you the information while there
is
still
time
to
correct
the
problem.
One of the biggest problems with developing indicators of sustainability is that frequently the best
indicators are those for which there is no data, while the indicators for which there is data are the least
able to measure sustainability. This has led many communities to choose traditional data sources and
measures for indicators. There are several advantages to traditional indicators. First, the data is
readily available and can be used to compare communities. Second, traditional indicators can help to
define problem areas. Third, traditional indicators can be combined to create sustainability indicators.
However, there is a real danger that traditional data sources and traditional indicators will focus
attention on the traditional solutions that created an unsustainable community in the first place. It may
be tempting to keep measuring 'number of jobs,' but measuring 'number of jobs that pay a livable
wage and include benefits' will lead to better solutions. Discussions that include the phrase 'but you
can't get that data' are not going to lead to indicators of sustainability. In fact, if you define a list of
indicators and find that the data is readily available for every one of them, you probably have not
thought hard enough about sustainability. Try to define the best indicators and only settle for less as
an interim step while developing data sources for better indicators.
Using our checklist can help you determine whether or not an indicator is a good measure of
sustainability. The checklist does not address whether an indicator is a good indicator in general. It
assumes that the indicator meets the general criteria for effectiveness. This checklist concentrates on
the characteristics that make an indicator a good indicator of sustainability.
The checklist has 14 questions. Positive answers to the first 13 questions earn one point each for the
indicator being evaluated. This means that the total possible score for an indicator is 13 points. Few
indicators earn more than 8 points, however, because it is difficult to create an indicator that
simultaneously measures all six types of community capital and links the economy, society and
environment. The final question is the show-stopper question, because local sustainability is not
something that can be achieved at the expense of global sustainability.
The sustainable community indicator checklist consists of the following 14 questions:
1.
Does the indicator address the carrying capacity of the natural resources -- renewable and
nonrenewable, local and nonlocal -- that the community relies on?
2.
Does the indicator address the carrying capacity of the ecosystem services upon which the
community relies, whether local, global, or from distant sources?
3.
Does the indicator address the carrying capacity of esthetic qualities -- the beauty and lifeaffirming qualities of nature -- that are important to the community?
4.
Does the indicator address the carrying capacity of the community's human capital -- the skills,
abilities, health and education of people in the community?.
5.
Does the indicator address the carrying capacity of a community's social capital -- the
connections between people in a community: the relationships of friends, families,
neighborhoods, social groups, businesses, governments and their ability to cooperate, work
together and interact in positive, meaningful ways?
6.
Does the indicator address the carrying capacity of a community's built capital -- the humanmade materials (buildings, parks, playgrounds, infrastructure, and information) that are needed
for quality of life and the community's ability to maintain and enhance those materials with
existing resources?
7.
8.
Does the indicator address the issue of economic, social or biological diversity in the
community?
9.
Does the question address the issue of equity or fairness -- either between current community
residents (intra-generational equity) or between current and future residents (inter-generational
equity)?
11. Does the indicator measure a link between economy and environment?
12. Does the indicator measure a link between environment and society?
13. Does the indicator measure a link between society and economy?
14. Does the indicator measure sustainability that is at the expense of another community or at the
expense of global sustainability?
4.1
How can you organize indicators; how many and what kind do you need?
Just as sustainability is about finding the balance point between a community's economy,
environment, and society, developing a set of indicators for a sustainable community requires
balancing many different needs within that community. A brainstorming session might produce
hundreds of indicators. Deciding how many to keep can be difficult. More is not better. Less is not
better. The right number depends on many factors including what type of audience the indicator
report will have, how much time is available to research the data, the number of issues involved, and
any
specific
needs
of
the
community.
For example, the US Interagency working Group on Sustainable Development Indicators
initially identified 400 possible indicators, which they then reduced to 30. After further discussion
they added 10 more, for a total of 40. Feedback from knowledgeable reviewers generally said that 40
was too large a number, although each reviewer then suggested one more to add!
If the indicators will be used by different departments within large organizations, 50 to 100 might
make sense. If the indicators are to be used to keep the public informed, a smaller number of 10 to 20
would make more sense. Knowing which ones to keep is more than a matter of evaluating them with
a checklist and keeping the highest scores. It is also important that the final set of indicators cover all
the issues that are important to the community. Organizing or sorting the indicators in one of several
ways can help a community evaluate the effectiveness of the entire set of indicators.
There are four common methods for organizing sustainability indicators. These methods, often called
frameworks, are:
Category or issue lists based on the main focus of each indicator show whether all aspects of the
community (environment, society, and economy) are represented.
A goal-indicator matrix can show how each indicator relates to many issues or a set of
community goals. The matrix shows whether all issues or goals are evenly addressed. .
Driving force-state-response tables balance measures of causes or driving forces; measures of the
results, or state; and measures of programs and other human activities designed to alter driving
forces with the goal of improving the state. This provides a secondary level of analysis mainly
for use by policy-makers or decision-makers.
Endowments, liabilities, current results, and processes are headings in another table used by the
US Interagency working Group on Sustainable Development Indicators to check for balance
among measures of what we are leaving for the future, what we have now, and what is happening
to create both situations.
None of these frameworks are the best framework. Different frameworks work well for different
purposes. For organizing indicators in a report, a category list is easily understood by many people.
The Goal-Indicator matrix is useful for showing whether the indicator set measures all the goals of a
community. The Driving Force-State-Response framework shows the connections between human
activities and environmental states. The Endowments framework can highlight the longer term
aspects of sustainability. What is most important about the framework is that it works well for the
intended purpose.
4.2
Data for indicators can be found in a wide variety of places, including local government
agencies, state government agencies, academic institutions, large government databases, and reports
at your local library. In most cases, the more local the source of data, the more relevant it will be to
your community. Finding the data sources is a matter of talking to different people. If you have
succeeded in having a diverse cross section of the community represented in your project, locating
data sources will be easier because of the expertise of the people working on the project. Everyone
will know at least one potential source of information, some people will know many.
Local colleges and universities are a valuable source of information on a wide variety of issues and in
many different forms. Frequently there are professors and researchers at these institutions who have
experience in areas ranging from economics to environment to health and social services. Often the
schools have related institutions which publish reports and do surveys on community related issues.
These can provide information about the community and a point of comparison to other similar
communities.
Your local library is also an important source of information in three ways: First, many libraries have
copies of U.S. Census reports and similar national or regional reports. Getting federal data may be as
easy as asking your reference librarian. Second, in addition to having copies of reports from national
groups, local libraries often have copies of reports researched and written locally that are specific to
your community. Third, local libraries are helpful in locating additional sources of information. Most
reference librarians can provide suggestions for where to find additional sources of information and
frequently may even be able to get copies for you.
State and National Sources of Data
Although they probably will not be useful as a primary source of data for local community indicators,
there are also regional and national sources of information. These will be particularly useful in the
beginning stages of a project. These sources of data show general information and trends over time
that can be used to interest people in the process. The types of information include changes in
population, changes in employment and changes in housing.
Regional and state agencies can provide information on a variety of issues. Most states have a
planning board or a planning commission whose job it is to keep track of information about activities
in the state and project how those activities may change over time. For example, the planning board
may have yearly population projections for towns and cities in the state. The board may also have
information about traffic patterns and expected changes in those patterns. Environmental agencies at
the state and national level can provide information about air and water quality.
The best indicators are those that fit your community and link the community's economic,
environmental and social well-being.
4.3
What makes an indicator a good sustainability indicator? What sources of data exist for a particular
indicator? How are indicators actually being used? What do indicators say about a community's wellbeing? These are all questions of concern to anyone involved in community indicator work.
There are no perfect sustainability indicators, but there are indicators that address the critical issues of
community sustainability. These indicators help us understand and measure progress better than
traditional indicators. In this section we highlight indicators that are currently in use by a community
group or organization actively working on sustainable community issues. The purpose of highlighting
any particular indicator is not to suggest that every community should be using it. Rather, the purpose
is to provide food for thought and promote discussion of the issues involved in developing indicators
that measure and encourage progress towards becoming sustainable communities.
Indicators selected for good sustainability indicators should be based on how well they:
Address the issue of the community's carrying capacity relative to the four types of
community capital: natural, human, social, and built;
Highlight the links between the community's economic, social, and environmental wellbeing;
5. Summing up
Indicators provide early warning about non-sustainable trends of economic activity and
environmental deterioration. They can also support policy formulation and evaluation. Policy use
requires the setting of targets or benchmarks against which progress or failure can be assessed. he
strength and weakness of indicators lie in their selection, which facilitates decision-making.
Indicator lists of varying length seek to capture the different economic, environmental, social and
institutional - dimensions of sustainable development. They are indicators for (the assessment of)
sustainable development. They differ in the particular selection of representative indicators of these
dimensions and related sustainability concerns. Indicators of sustainable development are more in the
nature of indices that reflect the state of overall concepts or social goals such as human development,
sustainable development, the quality of life or socioeconomic welfare. The variety of indicator
proposals makes it necessary to evaluate their scope, coverage, definition and statistical validity. This
can be done transparently by placing them in a consistent system or framework.
6. Keywords
Sustain: to continue without lessening, to nourish, to allow to flourish. in the context of
sustainability, 'sustain' does not mean that nothing ever changes. Nor does it mean utopia, that
nothing bad ever happens. Sustainability is not about maintaining the status quo or reaching
perfection. A sustainable community seeks to maintain and improve the economic, environmental and
social characteristics of an area so its members can continue to lead healthy, productive, enjoyable
lives there.
Economic transactions: buying and selling goods and services to each other.
Social relationships: being friends and neighbors, sharing, cooperating, solving common
problems together.
Economy: the way that goods and services are produced, distributed and consumed. The word
economy comes from two Greek words meaning 'house' and 'manage.' Economics is about how we
manage our households, both our individual households and our collective community 'households.'
People need material goods to survive: food, water, energy, a place to live, and clothes to wear. These
goods are all based on resources from the natural environment in which we live. So, in the context of
sustainability, economics is about the material goods and services that we use in our lives-from basic
necessities to the special 'extras' that make life more enjoyable.
Community Capital: the natural, human, social, and built capital from which a community receives
benefits and on which the community relies for continued existence. The term 'capital' is most
commonly used to refer to money and material goods. However, in the context of sustainability,
communities have several different types of capital that need to be considered -- natural, human,
social, and built capital. Together, these types of capital are referred to as community capital. All four
types of capital are necessary for communities to function. All four types of capital need to be
managed by a community. All four types of capital need to be cared for, nurtured and improved over
time.
Carrying Capacity: the population that can be supported indefinitely by its supporting systems. In
ecological terms, the carrying capacity of an ecosystem is the size of the population that can be
supported indefinitely upon the available resources and services of that ecosystem.
Equity: In the context of sustainability, the term equity has to do with fairness -- whether all people
have similar rights, opportunities and access to all forms of community capital. Inter-generational
equity has to do with fairness between current and future members of a community. It doesn't mean
that we neglect our current needs, but that we try to achieve a reasonable balance between satisfying
our needs now and setting aside enough to provide for needs of the future. We are currently living
unsustainable lives. If we are not careful how we use and dispose of resources, our children,
grandchildren, and great-grandchildren will have a poorer, more polluted world to live in. Aiming for
inter-generational equity means we want to give equal consideration to our own immediate needs, our
own future needs, and our children's and grandchildren's future needs.
The term equity is also used in connection with the idea that all people throughout the community, be
it a town or the entire world, have the same basic needs that must be taken into consideration. This
concept is often referred to as intra-generational equity, meaning justice among the present
population. The preservation (or acquisition) of basic human rights and the fulfillment of basic human
needs are the fundamental driving forces behind economic transactions, social interactions, and
resource consumption. When people are operating under duress in any of these areas, concern for
immediate needs overwhelms any consideration for long term needs, thereby undermining the whole
principle of planning for the future. So, current or intra-generational inequity can lead to future or
inter-generational inequity.
2)
3)
4)
Organisation for Economic Co-operation and Development, 1993. OECD Core Set of
Indicators for Environmental Performance Reviews
Organisation for Economic Co-operation and Development, 2003. OECD Environmental Indicators:
Development, Measurement and Use
United Nations, 2001. Indicators of Sustainable Development: Guidelines and Methodologies, New
York: United Nations (sales no. E.01.II.A.6).
9. Model Answers
1)
1)
An indicator is something that helps you understand where you are, which way you are going
and how far you are from where you want to be. A good indicator alerts you to a problem before it
gets too bad and helps you recognize what needs to be done to fix the problem. Indicators of a
sustainable community point to areas where the links between the economy, environment and society
are weak. They allow you to see where the problem areas are and help show the way to fix those
problems.
2)
Effective indicators are relevant; they show you something about the system that you need to
know.
Effective indicators are easy to understand, even by people who are not experts.
Effective indicators are reliable; you can trust the information that the indicator is providing.
Lastly, effective indicators are based on accessible data; the information is available or can be
gathered while there is still time to act.
3. Data for indicators can be found in a wide variety of places, including local government agencies,
state government agencies, academic institutions, large government databases, and reports at your
local library. In most cases, the more local the source of data, the more relevant it will be to your
community. The best indicators are those that fit your community and link the community's
economic, environmental and social well-being.
4. There are no perfect sustainability indicators, but there are indicators that address the critical
issues of community sustainability. These indicators help us understand and measure progress better
than traditional indicators.
Indicators selected for good sustainability indicators should be based on how well they:
Address the issue of the community's carrying capacity relative to the four types of
community capital: natural, human, social, and built;
Highlight the links between the community's economic, social, and environmental wellbeing;
Structure
1. Introduction
2. Objectives
3. What is a Case Study?
4. Designing and Developing Case Studies
5. Summing Up
6. Keywords
7. Know your Progress
8. Further Reading / References
9. Model Answers
1. Introduction
A case study is a research methodology common in social science. It is based on an in-depth
investigation of a single individual, group, or event to explore causation in order to find underlying
principles. Rather than using samples and following a rigid protocol (strict set of rules) to examine
limited number of variables, case study methods involve an in-depth, longitudinal (over a long period
of time) examination of a single instance or event: a case. They provide a systematic way of looking
at events, collecting data, analyzing information, and reporting the results. As a result the researcher
may gain a sharpened understanding of why the instance happened as it did, and what might become
important to look at more extensively in future research. Case studies lend themselves to both
generating and testing hypotheses, write a research proposal, and common mistakes in research
proposal writing.
Case study research means single and multiple case studies, can include quantitative evidence,
relies on multiple sources of evidence and benefits from the prior development of theoretical
propositions. Case studies should not be confused with qualitative research and they can be based on
any mix of quantitative and qualitative evidence. Single-subject research provides the statistical
framework for making inferences from quantitative case-study data.[2][4] This is also supported and
well-formulated in (Lamnek, 2005): "The case study is a research approach, situated between
concrete data taking techniques and methodological paradigms."
2. Objectives
After studying this Unit, you should be able to:
limited. Hence the cases that are selected should be easy and willing subjects. A good instrumental
case does not have to defend its typicality.
Explanatory cases are suitable for doing causal studies. In very complex and multivariate
cases, the analysis can make use of pattern-matching techniques. Yin and Moore (1988) conducted a
study to examine the reason why some research findings get into practical use. They used a funded
research project as the unit of analysis, where the topic was constant but the project varied. The
utilisation outcomes were explained by three rival theories: a knowledge-driven theory, a problemsolving theory, and a social-interaction theory.
Knowledge-driven theory means that ideas and discoveries from basic research eventually
become commercial products. Problem-solving theory follows the same path, but originates not with
a researcher, but with an external source identifying a problem. The social-interaction theory claims
that researchers and users belong to overlapping professional networks and are in frequent
communication.
Descriptive cases require that the investigator begin with a descriptive theory, or face the
possibility that problems will occur during the project. Pyecha (1988) used this methodology to study
special education, using a pattern-matching procedure. Several states were studied and the data about
each state's activities were compared to another, with idealized theoretic patterns. Thus what is
implied in this type of study is the formation of hypotheses of cause-effect relationships. Hence the
descriptive theory must cover the depth and scope of the case under study. The selection of cases and
the unit of analysis is developed in the same manner as the other types of case studies.
Case studies have been increasingly used in education. While law and medical schools have
been using the technique for an extended period, the technique is being applied in a variety of
instructional situations. Schools of business have been most aggressive in the implementation of case
based learning, or "active learning" (Boisjoly & DeMichiell, 1994). Harvard University has been a
leader in this area, and cases developed by the faculty have been published for use by other
institutions.
The quintessential characteristic of case studies is that they strive towards a holistic
understanding of cultural systems of action (Feagin, Orum, & Sjoberg, 1990). Cultural systems of
action refer to sets of interrelated activities engaged in by the actors in a social situation. The case
studies must always have boundaries (Stake, 1995). Case study research is not sampling research,
which is a fact asserted by all the major researchers in the field, including Yin, Stake, Feagin and
others. However, selecting cases must be done so as to maximize what can be learned, in the period
of time available for the study.
The unit of analysis is a critical factor in the case study. It is typically a system of action
rather than an individual or group of individuals. Case studies tend to be selective, focusing on one or
two issues that are fundamental to understanding the system being examined.
Case studies are multi-perspective analyses. This means that the researcher considers not just
the voice and perspective of the actors, but also of the relevant groups of actors and the interaction
between them. This one aspect is a salient point in the characteristic that case studies possess. They
give a voice to the powerless and voiceless. When sociological studies present many studies of the
homeless and powerless, they do so from the viewpoint of the "elite" (Feagin, Orum, & Sjoberg,
1991).
Case study is known as a triangulated research strategy. Snow and Anderson (cited in Feagin,
Orum, & Sjoberg, 1991) asserted that triangulation can occur with data, investigators, theories, and
even methodologies. Stake (1995) stated that the protocols that are used to ensure accuracy and
alternative explanations are called triangulation. The need for triangulation arises from the ethical
need to confirm the validity of the processes. In case studies, this could be done by using multiple
sources of data (Yin, 1984). The problem in case studies is to establish meaning rather than location.
For example, various case studies about program failures might be compared to notice
commonalities in these clients' experiences and how they went through the program. These
commonalities might highlight where in the program the process needs to be strengthened.
Yin (1994) identified five components of research design that are important for case studies:
A study's questions
Its propositions, if any
Its unit(s) of analysis
The logic linking the data to the propositions
The criteria for interpreting the findings (Yin, 1994, p. 20).
The study's questions are most likely to be "how" and "why" questions, and their definition is
the first task of the researcher. The study's propositions sometimes derive from the "how" and "why"
questions, and are helpful in focusing the study's goals. Not all studies need to have propositions. An
exploratory study, rather than having propositions, would have a stated purpose or criteria on which
the success will be judged. The unit of analysis defines what the case is. This could be groups,
organizations or countries, but it is the primary unit of analysis. Linking the data to propositions and
the criteria for interpreting the findings are the least developed aspects in case studies (Yin, 1994).
Campbell (1975) described "pattern-matching" as a useful technique for linking data to the
propositions. Campbell (1975) asserted that pattern-matching is a situation where several pieces of
information from the same case may be related to some theoretical proposition. His study showed,
through pattern-matching, that the observed drop in the level of traffic fatalities in Connecticut was
not related to the lowering of the speed limit. His study also illustrated some of the difficulties in
establishing the criteria for interpreting the findings.
Construct validity is especially problematic in case study research. It has been a source of
criticism because of potential investigator subjectivity. Yin (1994) proposed three remedies to
counteract this: using multiple sources of evidence, establishing a chain of evidence, and having a
draft case study report reviewed by key informants. Internal validity is a concern only in causal
(explanatory) cases. This is usually a problem of "inferences" in case studies, and can be dealt with
using pattern-matching, which has been described above. External validity deals with knowing
whether the results are generalisable beyond the immediate case. Some of the criticism against case
studies in this area relate to single-case studies. However, that criticism is directed at the statistical
and not the analytical generalization that is the basis of case studies. Reliability is achieved in many
ways in a case study. One of the most important methods is the development of the case study
protocol.
Case studies can be either single or multiple-case designs. Single cases are used to confirm or
challenge a theory, or to represent a unique or extreme case (Yin, 1994). Single-case studies are also
ideal for revelatory cases where an observer may have access to a phenomenon that was previously
inaccessible. Single-case designs require careful investigation to avoid misrepresentation and to
maximize the investigator's access to the evidence. These studies can be holistic or embedded, the
latter occurring when the same case study involves more than one unit of analysis. Multiple-case
studies follow a replication logic. This is not to be confused with sampling logic where a selection is
made out of a population, for inclusion in the study. This type of sample selection is improper in a
case study. Each individual case study consists of a "whole" study, in which facts are gathered from
various sources and conclusions drawn on those facts.
Yin (1994) asserted that a case study investigator must be able to operate as a senior
investigator during the course of data collection. There should be a period of training which begins
with the examination of the definition of the problem and the development of the case study design. If
there is only a single investigator, this might not be necessary. The training would cover aspects that
the investigator needs to know, such as: the reason for the study, the type of evidence being sought,
and what variations might be expected. This could take the form of discussion rather than formal
lectures.
A case study protocol contains more than the survey instrument, it should also contain
procedures and general rules that should be followed in using the instrument. It is to be created prior
to the data collection phase. It is essential in a multiple-case study, and desirable in a single-case
study. Yin (1994) presented the protocol as a major component in asserting the reliability of the case
study research. A typical protocol should have the following sections:
An overview of the case study project (objectives, issues, topics being investigated)
Field procedures (credentials and access to sites, sources of information)
Case study questions (specific questions that the investigator must keep in mind during data
collection)
A guide for case study report (outline, format for the narrative) (Yin, 1994, p. 64).
The overview should communicate to the reader the general topic of inquiry and the purpose
of the case study. The field procedures mostly involve data collection issues and must be properly
designed. The investigator does not control the data collection environment (Yin, 1994) as in other
research strategies; hence the procedures become all the more important. During interviews, which by
nature are open ended, the subject's schedule must dictate the activity (Stake, 1995). Gaining access
to the subject organization, having sufficient resources while in the field, clearly scheduling data
collection activities, and providing for unanticipated events, must all be planned for.
Case study questions are posed to the investigator, and must serve to remind that person of the
data to be collected and its possible sources. The guide for the case study report is often neglected,
but case studies do not have the uniform outline, as do other research reports. It is essential to plan
this report as the case develops, to avoid problems at the end.
Stake (1995), and Yin (1994) identified at least six sources of evidence in case studies. The
following is not an ordered list, but reflects the research of both Yin (1994) and Stake (1995):
Documents
Archival records
Interviews
Direct observation
Participant-observation
Physical artifacts
There are some conditions that arise when a case researcher must start data collection before
the study questions have been defined and finalized (Yin, 1994). This is likely to be successful only
with an experienced investigator. Another important point to review is the benefit of using rival
hypotheses and theories as a means of adding quality control to the case study. This improves the
perception of the fairness and serious thinking of the researcher.
5. Summing up
Case studies are particularly useful in depicting a holistic portrayal of a client's experiences
and results regarding a program. For example, to evaluate the effectiveness of a program's processes,
including its strengths and weaknesses, evaluators might develop cases studies on the program's
successes and failures. Case studies are used to organize a wide range of information about a case and
then analyze the contents by seeking patterns and themes in the data, and by further analysis through
cross comparison with other cases. A case can be individuals, programs, or any unit, depending on
what the program evaluators want to examine through in-depth analysis and comparison.
Case studies are complex because they generally involve multiple sources of data, may
include multiple cases within a study, and produce large amounts of data for analysis. Researchers
from many disciplines use the case study method to build upon theory, to produce new theory, to
dispute or challenge theory, to explain a situation, to provide a basis to apply solutions to situations,
to explore, or to describe an object or phenomenon. The advantages of the case study method are its
applicability to real-life, contemporary, human situations and its public accessibility through written
reports. Case study results relate directly to the common readers everyday experience and facilitate
an understanding of complex real-life situations.
6. Keywords
Achieve: An archive is a collection of historical records, as well as the place they are located.
Archives contain primary source documents that have accumulated over the course of an individual or
organization's lifetime.
In general, archives consist of records that have been selected for permanent or long-term
preservation on grounds of their enduring cultural, historical, or evidentiary value. Archival records
are normally unpublished and almost always unique, unlike books or magazines for which many
identical copies exist. This means that archives (the places) are quite distinct from libraries with
regard to their functions and organization, although archival collections can often be found within
library buildings.
Artifact: The word "artifact" can be confusing because it masks a number of unexamined
assumptions. In academic parlance, "artifact" can refer to a physical object, a primary record, or a
physical object that constitutes a primary record.
Case study: A case study is a research methodology common in social science. It is based on an indepth investigation of a single individual, group, or event to explore causation in order to find
underlying principles.
Data: The term data means groups of information that represent the qualitative or quantitative
attributes of a variable or set of variables. Data (plural of "datum", which is seldom used) are
typically the results of measurements and can be the basis of graphs, images, or observations of a set
of variables. Data are often viewed as the lowest level of abstraction from which information and
knowledge are derived. Raw data refers to a collection of numbers, characters, images or other
outputs from devices that collect information to convert physical quantities into symbols, that are
unprocessed.
Document: A document (noun) is a bounded physical or digital representation of a body of
information designed with the capacity (and usually intent) to communicate. A document may
manifest symbolic, diagrammatic or sensory-representational information. To document (verb) is to
produce a document artifact by collecting and representing information. In prototypical usage, a
document is understood as a paper artifact, containing information in the form of ink marks.
Increasingly documents are also understood as digital artifacts.
Information, in its most restricted technical sense, is an ordered sequence of symbols. As a concept,
however, information has many meanings.[1] Moreover, the concept of information is closely related
to notions of constraint, communication, control, form, instruction, knowledge, meaning, mental
stimulus, pattern, perception, and representation.
2)
Campbell, D. (1975). Degrees of freedom and the case study. Comparative Political Studies, 8, 178185.
Carney, C. (1995). Teaching with cases in the Interdisciplinary classroom: Combining business
language and culture. In H. Klein (Ed.), WACRA Conference (pp.117-127). Needham, MA.
Crossland, F. (1980). Learning to cope with a downward slope. Change, 18, 20-25.
Eisner, E., & Peshkin, A. (Eds.). (1990). Qualitative inquiry in education. New York: Teachers
College Press.
Evans, R. (1976). Smoking in children: Developing a social psychological strategy of deterrence.
Preventive Medicine, 5, 122-140.
Feagin, J., Orum, A., & Sjoberg, G. (Eds.), (1991). A case for case study. University of North
Carolina Press, Chapel Hill, NC:
Garvin, D. (1991). A delicate balance: Ethical dilemmas and the discussion process. In C.
Christensen, et al. (Eds.), Education for judgement: The artistry of discussion leadership (pp. 287304, Harvard Business School.), Cambridge, MA.
Giddens, A. (1984). In R. Yin (1993). Applications of case study research. Sage Publishing, Beverly
Hills, CA.
Glesne, C., & Peshkin, A. (1992). Becoming qualitative researchers. Longman. New York.
Gopelrud, E. (1989, May). Presentation at Demand Reduction Task Force meeting,
Prevention/Education Programs of ADAMHA.
Greenwald, B. (1991). Teaching technical material. In C. Christensen, et al. (Eds.), Education for
judgment: The artistry of discussion leadership (pp. 193-214, Harvard Business School. ).
Cambridge, MA.
Hamel, J., Dufour, S., & Fortin, D. (1993). Case study methods. Sage Publications. Newbury Park,
CA.
Holder, H. (Ed). (1987). Control issues in alcohol abuse prevention: Strategies for states and
communitiesJAI Press, Greenwich, CT.
King, J., & Kraemer, K. (1985). The dynamics of computing. Columbia University Press. New York.
Levy, S. (1988). Information technologies in universities: An institutional case study. Unpubished
doctoral dissertation, Northern Arizona University, Flagstaff.
Miles, M., & Huberman, M. (1984). Qualitative data analysis: A source book for new methods. Sage
Publications, Thousand Oaks, CA.
Nicklin, J (1992, February 26). Harvard University reports $42 million deficit. Chronicle of Higher
Education, 38(25), 33-34.
Pyecha, J. (1988). A case study of the application of noncategorical special education in two states.
Chapel Hill, NC: Research Triangle Institute.
Runkel, P. (1990). Casting nets and testing specimens: Two grand methods of psychology. Praeger,
New York.
Sabol, (1990). Learning about the effects of community based prevention: A progress report. Cosmos
Corp, Washington, DC.
Stake, R. (1995). The art of case research. Thousand Oaks, CA: Sage Publications.
Strauss, A. and Glaser, B. (1967). The discovery of grounded theory: Strategies for qualitative
research. Aldine, Chicago.
Yin, R. (1984). Case study research: Design and methods (1st ed.). Sage Publishing. Beverly Hills,
CA.
Yin, R. (1989a). Case study research: Design and methods (Rev. ed.).: Sage Publishing. Beverly
Hills, CA.
Yin, R. (1989b). Inter-organizational partnerships in local job creation and job training efforts.
COSMOS Corp., Washington, DC.
Yin, R. (1993). Applications of case study research. Sage Publishing, Beverly Hills, CA.
Yin, R. (1994). Case study research: Design and methods (2nd ed.).: Sage Publishing. Beverly Hills,
CA.
Yin, R., & Moore, G. (1987). The use of advanced technologies in special education. Journal of
Learning Disabilities, 20(1), 60.
Zonabend, F. (1992, Spring). The monograph in European ethnology. Current Sociology, 40(1), 4960.
9. Model Answers
1.
A case study is a research methodology common in social science. It is based on an in-depth
investigation of a single individual, group, or event to explore causation in order to find underlying
principles. Rather than using samples and following a rigid protocol(strict set of rules) to examine
limited number of variables, case study methods involve an in-depth, longitudinal(over a long period
of time) examination of a single instance or event: a case. They provide a systematic way of looking
at events, collecting data, analyzing information, and reporting the results. As a result the researcher
may gain a sharpened understanding of why the instance happened as it did, and what might become
important to look at more extensively in future research. Case studies lend themselves to both
generating and testing hypotheses write a research proposal, and common mistakes in research
proposal writing.
2.
One can identify the following six sources of evidence in case studies.
Documents
Archival records
Interviews
Direct observation
Participant-observation
Physical artifacts
1. Introduction
Case studies are essentially summaries or syntheses of real-life stories and / or situations
based on a combination of primary research and secondary data. Their purpose is to make information
and experience available to those outside the immediate situation; whether for specific audiences
(such as donors or policy makers) or for more general purposes (to raise greater awareness for those
involved in similar activities elsewhere or for the general public). Sometimes case studies are
produced primarily as skills training or teaching tools because they provide more dynamic and real
life learning experiences. In this Unit, we shall discuss about the format for writing a good case
study report.
2. Objectives
After studying this Unit, you should be able to:
information, people, and relationships. Be careful with numbers; they must help solve the problems,
not confuse readers or send them off on unproductive analytic tangents.
f) Use as much dialogue as possible: Make the characters come alive with dialogue. Straight
narrative is boring.
g) Endings: Leave the reader with a clear picture of the major problems--either ask or imply "what is
to be done now?" If you have any recommendation(s) please dont forget to write it clearly.
Abstract or Executive
Summary
Contents Page
Term Definition
Topic of the research
Name of the researcher
Name of programme
Date
Abstract (no more than 250 words).
Short summary of complete contents:
What were your research questions and why were these
important?
How did you go about answering research questions?
hat did you find out in response to research questions
What conclusion did you draw regarding research
questions?
Introduction
8. Appendix
Introduction to research report (to provide necessary information
to the reader for better understanding and comprehension of the
report).
Background
Description of the current situation the context (e.g.Development of organisation over time, competitive environment,
success and survival factors).
Approach or Methodology
Findings
Recommendations
Conclusion
Reference List
Appendices
5. Summing up
Case study is an ideal methodology when a holistic, in-depth investigation is needed. Rather
than using large samples and following a rigid protocol to examine a limited number of variables,
case study methods involve an in-depth, longitudinal examination of a single instance or event: a
case. Before beginning to outline a case study, writers must decide on less than six dominant Issues.
Writer should keep diary, note book, pen, and tape recorder with her/him during interview. S/he
should take enough time for rapport building. Case writers must ask, "What is this case study about?"
Each issue (topic meant for discussion) should be written in the form of a simple question.
To evaluate the effectiveness of a programme's processes, including its strengths and weaknesses,
evaluators might develop cases studies on the program's successes and failures. Case studies are used
to organize a wide range of information about a case and then analyze the contents by seeking
patterns and themes in the data, and by further analysis through cross comparison with other cases.
6. Keywords
Audience: An audience is a group of people who participate in a show or encounter a work of art,
literature (in which they are called the "reader"), theatre, music or academics in any medium.
Audience members participate in different ways in different kinds of art; some events invite overt
audience participation and others allowing only modest clapping and criticism and reception.
Dialogue: Dialogue (sometimes dialog in North American English) is a literary form, the most
notable examples of which in Western literature are the dialogues of Plato.
Its chief historical origins as narrative, philosophical or didactic device are to be found in classical
Greek and Indian literature, in particular in the ancient art of rhetoric. Its everyday basis and
counterpart is a conversational exchange between two or more people.
Donor: A donor in general is a person that donates something voluntarily. Usually used to represent
a form of pure altruism but sometimes used when the payment for a service is recognised by all
parties as representing less than the value of the donation and that the motivation is altruistic. In
business law, a donor is someone who is giving the gift, and a donee the person receiving the gift.
Primary research: Primary research (also called field research) involves the collection of data
that does not already exist. This can be through numerous forms, including questionnaires, direct
observation and telephone interviews amongst others. This information may be collected in things
like questionnaires and interviews.
Secondary data: It is data collected by someone other than the user. Common sources of secondary
data for social science include censuses, surveys, organizational records and data collected through
qualitative methodologies or qualitative research. Primary data, by contrast, are collected by the
investigator conducting the research.
Short story writing techniques: While short-story writing uses many of the same techniques you'd
use to write any story, the way the techniques are used often vary to accommodate the length of the
shorter work.
9. Model Answers
1.
Before beginning to outline a case study, writers must decide on less than six dominant Issues.
1. Writer should keep diary, note book, pen, and tape recorder with her/him during interview.
2. S/he should take enough time for rapport building. Case writers must ask, "What is this case
study about?"
3. Each issue (topic meant for discussion) should be written in the form of a simple question
(For example: What types of development goals are effective?).
4. Writer should select suitable time and venue by preliminary discussion with concerned
person(s).
5. S/he has to go to selected venue timely for listening and write after listening clearly or use
tape recorder. If the words, phrases and sentences are not clear s/he should ask question(s).
Writer should write topic by using direct speech. S/he shouldnt ask question at the middle of
a conversation that may be disturbing. Rather s/he may write the question for later. S/he
shouldnt give any opinion or ask any question that will make emotional to the respondent. If
s/he has any opinion about the event s/he may write it in other paragraph with relevant figure
and facts.
6. After completion of interview s/he should read whole story to respondent or set on the
recorder for review and re-visit. S/He should include relevant photo(s) with the case study.
2. The case study writer should attach importance to the following elements in mind.
a) Keep your audience in mind: Remember that you are writing for program team or discussants who
may not be familiar with the background, details, and terminology of the situation. Keep jargon to a
minimum.
b) Use short-story-writing techniques: A case has flesh-and-blood characters who should be
interesting. Each story element should move the narrative forward.
c) Openings: Grab the reader with a character facing his or her biggest problem: set the scene for the
arguments, the frustrations, and the main conflicts.
d) Present situations and scenes without any attempt at analysis: Scenes must follow a logical order
and should illustrate a point, concept, or issue that relates to the problems that the writer wants to
have analyzed. Do not give any signals that one solution might be preferred.
e) Provide relevant details: After an opening that sets up the situation, provide relevant details about
goals, strategies, dilemmas, issues, conflicts, roadblocks, appropriate research, relevant financial
information, people, and relationships. Be careful with numbers; they must help solve the problems,
not confuse readers or send them off on unproductive analytic tangents.
f) Use as much dialogue as possible: Make the characters come alive with dialogue. Straight
narrative is boring.
g) Endings: Leave the reader with a clear picture of the major problems--either ask or imply "what is
to be done now?" If you have any recommendation(s) please dont forget to write it clearly.
1. Introduction
The present Unit offers information about evaluation in the context of rural development.
Rural development evaluation must provide information on the implementation and impacts of the
programmes. The aims are, on the one hand, to increase the accountability and transparency with
regard to the legal and budget authorities and the public and, on the other hand, to improve the
implementation of the programmes by contributing to informed planning and decisions concerning
needs, delivery mechanisms and resource allocation.
More specifically, evaluation helps to assess key aspects of the assistance (i.e., the relevance,
effectiveness, efficiency, utility, sustainability of the assisted actions, depending on the stage of
programme implementation) in relation to the general objectives of the rural development policy at
Community level as well as in relation to the specific needs and priorities incorporated into each rural
development programming document.
2. Objectives
After studying this Unit, you should be able to:
evaluation questions relevant at the Community level. the rural development plan must describe the
arrangements for the programme specific part of the evaluation. The arrangements for evaluating the
rural development programme should be designed as an articulated process in order to maximise the
quality and usefulness of its results.
The contents of the evaluation will vary according to the stage (ex ante, mid term, ex post) of
programme implementation as explained in Box 2.
Box 2 Functions of evaluation
The ex- ante evaluation shall analyse the disparities, gaps and potential of the current
situation and assess the consistency of the proposed strategy with the situation and
targets and have regard to the issues raised in the common evaluation questions. It shall
assess the expected impact of the selected priorities for action and quantify their targets
where they lend themselves thereto.
The mid term evaluation, while covering the evaluation questions, shall in particular
examine the initial achievements, their relevance and consistency with the rural
development plan and the extent to which the targets have been attained.
The ex- post evaluation, while answering the evaluation questions, shall in particular
examine the utilisation of resources and the effectiveness and efficiency of the
assistance and its impacts and it shall draw conclusions regarding rural development
policy.
The evaluations at the various stages of the programme implementation must deal with
aspects such as relevance, effectiveness, efficiency, utility and the sustainability of the
results. Relevance is mainly related to the ex ante situation, while the utility and the
sustainability of the results are particularly relevant for the ex post situation.
The ex- ante evaluation takes place before the implementation of the programme and
examines the proposed strategy. The mid term evaluation should consider the results of previous ex
ante evaluation, and the ex post evaluation should consider the conclusions of the mid term
evaluation.
other words the contribution of the operational objectives to the specific objectives. The mid term
evaluation will have to focus on these aspects. Irrigation piping or canals are examples of output, and
the availability of water to new areas, or water of better quality, could be the results. The latter
respond to the specific objectives. The impacts derive from the results. From the above example, an
intermediate impact might be a reorientation in the local cropping system or reduced local soil
pollution due to better quality irrigation water. Later on, more global impacts might be a higher level
of agricultural income or a change in market balance due to the availability of water for certain crops.
Global impacts respond to the overall objectives of the programme and, in a well-designed
programme, they meet the previously identified needs that led to the implementation of the
programme. There may also be unexpected, possibly negative impacts. For example, in the case of
irrigation it might be pertinent to look for impacts such as partial depletion of the water resource or
salination.
Intermediate impacts may be obvious soon after the assisted action has produced the direct
outputs while more global ones may become apparent only at a later time and may reach other or
more people than those directly targeted by the assisted action. Obviously, the evaluation should take
this into account and avoid looking for impacts that have not yet been produced. The reconstruction
of the links between the inputs, outputs, results and impacts of the programme is called the
intervention logic. It shows how assistance is transformed into intermediate and global impacts such
as rationalised agricultural production, stabilised agricultural markets, improvement of rural living
conditions or protection of the rural environment. The elaboration of this into a so-called Logical
Diagram of Impacts can help clarify the intervention logic of a programme, see for example Box 2.
Needs
Specific
Objectiv
Specific
Objectiv
Specific
Objectiv
Specific
Objectiv
Specific
Objectiv
Operational
Objective
Inputs
Fig. 1
Usually it is straightforward to identify the outputs and the expected global impacts of a
programme, but it may be difficult to identify how the outputs are transformed into global
impacts. A Logical Diagramme of Impacts can help clarify the intermediate impacts
arising from the assistance. It identifies causal links and describes what the outputs
contribute to, and from which action the impacts are produced.
Output 1
Result 1
Impact 1
Output 2
Result 2
Impact 2
Output n
Result n
2.4
Global Impact
Evaluation must go beyond monitoring, reporting and auditing which deal with inputs, outputs
and sometimes with results. Too often evaluations are restricted to the gathering of data about how
the financial inputs were used and about the direct outputs that have been paid for. Evaluation must
be concerned with the impacts whether they are positive, negative, expected or unexpected, and
including those which only become manifest in the long term or which are to the advantage of
persons other than the direct beneficiaries.
A single intervention can contribute to several impacts as illustrated in the above
outline of a Logic Diagram of Impacts. For example, processing equipment can contribute to the
development of new products and outlets as well as to the rationalisation of processing procedures
and cost reduction. Moreover, several outputs can contribute to the same impact. Environmental
concerns are often cross-cutting and can be partly dealt with through a training scheme by investing
in adapted equipment or by modifying agricultural practices. The evaluation should take such
interactions between different actions into account and should examine the complementarity and
synergy effects they may produce. The evaluation may also have regard to certain aspects of other
Community or national measures that may interact with the rural development program.
Evaluation should focus on aspects such as the utility, relevance, coherence, effectiveness,
efficiency and sustainability of the results. The pertinence and relative importance of these aspects
would vary according to the stage of implementation of the programme. It is also important to
distinguish net and gross effects and the possible contribution of exogenous factors (e.g., local
context or market influence) to the impacts in order to identify more precisely what can be attributed
to the evaluated assistance. Further aspects such as deadweight effect that may influence the
achievement of the objectives must also be examined. The influence of the implementing procedure
must also be examined in so far as they influence the effectiveness and efficiency of the assistance.
the evaluation question, but they do not constitute the complete answer. A wider data collection as
well as a qualitative assessment may well be necessary to provide comprehensive and fully reliable
findings.
Indicators can be used at the different stages of the intervention logic. Various programme
indicators should be used according to the level of evaluation: output indicators when dealing with
outputs, result indicators to assess the results, impact indicators to assess the impacts. A particular
output may simultaneously contribute to several impacts. For instance, piping and canals built can
contribute to provide more water in a given area and simultaneously influence the quality of water.
Also, the quantity of water used in a given area may influence both the level of salination and the
depletion of water in this area. An impact may also derive from several elements in the intervention
logic: the improvement of farmers income could be due to the irrigation as such or due to the
reorientation in the cropping system which it may lead to.
Criteria and indicators help to answer questions that have been defined in relation to the
objectives at the level of the regulation and the individual programme. Other sources of information,
such as previous evaluations, studies, or research can also contribute to the answers. Certain key
evaluation aspects should be taken into account for answering the questions. Questions may refer to
effectiveness, efficiency, utility, etc This should be considered when collecting the information. In
order to assess the net effects and have then more reliable evaluation results, it is also necessary to
take into account factors such as exogenous factors, displacement effect, etc.
4. Evaluation Methodology
4.1. Use of recognised methods
Evaluations need to be performed in accordance with recognised evaluation practice. The
evaluation reports must explain the methodologies applied, including the implications for the quality
of the data and the findings. Hence, the report must indicate the sampling techniques and the data
sources that have been used to collect data. This should enable the reliability of the evaluation
findings to be assessed and facilitate the production of sound and useful conclusions and
recommendations.
4.2. Data collection
The data collection should be performed with a view to the subsequent analysis.
It is necessary to assemble the appropriate resources for evaluations while making use of monitoring
results supplemented where necessary by the gathering of additional information.
4.2.1 Secondary data
Firstly, this means that optimum use should be made of so called secondary data, i.e., date that
exist already, for example from the monitoring system. They may sometimes be sufficient to answer a
question or a part of it. As such data are already available they can be assembled at a moderate cost.
Hence, it is important to have a well-designed monitoring system. The use of monitoring data would
especially be important in the mid term evaluation. Other secondary data may be obtained from
Unintended effects, including negative effects and the influence from significant exogenous
factors such as market prices should also be appreciated where relevant. Links to other programmes,
and / or between actions within a programme should be examined in order to estimate
complementarity and synergy effects. Several actions, or programmes, can produce the same impacts
or can be mutually reinforcing. As an example, the improvement of infrastructure for basic services
(e.g., transport or communication networks) in rural areas can alleviate remoteness and can, together
with the creation of tourist equipment, have synergy effects in terms of development of activities and
employment.
e)
f)
Executive summary
Introduction (context of programme, characteristics of the implementation, purpose of the
evaluation)
Explanation of the methodological approach (design and analysis, data collection and sources,
soundness of data and findings)
Presentation and analysis of the information collected (financial information and outputs,
uptake information on beneficiaries, replies to the common questions, findings on the
programme specific questions)
Conclusions (concerning community level objectives, programme specific goals, effectiveness,
efficiency, utility, sustainability of the results, ..) and recommendations
Annexes
6. Summing up
Rural development evaluation must provide information on the implementation and impacts
of the programmes. Evaluation helps to assess key aspects of the assistance (i.e., the relevance,
effectiveness, efficiency, utility, sustainability of the assisted actions, depending on the stage of
programme implementation) in relation to the general objectives of the rural development policy at
Community level as well as in relation to the specific needs and priorities incorporated into each rural
development programming document. The arrangements for evaluating the rural development
programme should in part be provided by the programme itself and in part by the common evaluation
questions with criteria and indicators. Evaluations should focus on the results and impacts of the
programme. Evaluation must also go beyond monitoring, reporting and auditing which deal with
inputs, outputs and sometimes with results. It has also been argued that evaluations should respond to
common evaluation questions which must be accompanied by achievement related to criteria and
indicators. Criteria and indicators help to answer questions that have been defined in relation to the
objectives. Evaluations need to be performed in accordance with recognised evaluation practice. The
evaluation reports must explain the methodologies applied, including the implications for the quality
of the data and the findings. Towards the end, the report must describe the programme being
evaluated, including its context and purpose, together with the procedure and findings of the
evaluation and the conclusions and recommendations it leads to.
7. Keywords
Coherence
Assessment of whether a better complementarity or synergy could be found within a programme and
in relation to other programmes. The internal coherence refers to the correspondence between the
resources allocated to a programme and its objectives. The external coherence refers to the adequacy
between the evaluated programme and other related programmes, e.g. Community aids for early
retirement and related national state aids.
Counterfactual situation
Situation which would have occurred without the public assistance. Also referred to "policyoff" situation.
Criterion
Characteristic on which a judgment can be based. The criterion must be explicitly defined. A
measure would usually be judged on several criteria. Indicators are then defined for each criterion.
"Reduction of costs" is an example of a criterion to examine the efficiency of agricultural holdings.
Effectiveness
Assessment of the effects in relation to the objectives of the evaluated programme. An action
will be effective when the objectives have been attained. For example, the ratio between the number
of kilometers of water pipes that should have been constructed (quantified objective) and the
number of kilometers that have actually been constructed could serve to assess the effectiveness of
an agricultural measure concerning irrigation.
Efficiency
Assessment of the achieved effects in relation to the inputs (financial or administrative)
mobilised; i.e., how economically have the inputs been converted into outputs, results or impacts.
Could the same result have been achieved with less resources, or more results with the same
resources?
Exogenous factor
External factors partly or entirely responsible for the changes observed. The evaluation must
take into account such factors (e.g., market prices) in order to assess the net effect of the assisted
action.
Gross effect
Change observed consequently to the implementation of the measure. The observation of
gross effect is not sufficient to conclude properly on the effects imputable to the assisted action.
Deadweight, displacement and substitution effects, exogenous factors must also be assessed to
conclude on the net effects.
Impact
Effects of the programme in the medium or long term. There can be expected,
unexpected, positive or negative impacts, depending also on the influence of exogenous factors.
Direct and indirect beneficiaries can be affected by the impacts of a programme.
Indicator
For the purpose of the present guidelines: information in a form suitable for assessing or
indicating the effects of an assistance. They help in quantifying and simplifying information about
complex phenomena. They represent more than the raw data on which they are based. Measurement
produces raw data, which may be aggregated and summarised to provide statistics; statistics can be
analysed and re-expressed in the form of indicators, which fed into the evaluation or decision-making
process.
There are programme indicators and context indicators. As an example, a programme
indicator for the criterion Reduction of costs might be the Ratio between costs and turnover on
assisted holdings. A context indicator relating to the income in the geographical area covered by the
programme might be compared to a programme indicator such as Gross farm income on assisted
holdings.
For the purpose of these evaluation guidelines, the programme indicators are linked to criteria.
Input
Resources mobilised to implement the programme: financial means, material, legal and
organisational resources.
Leverage effect
Fact that the public funding induces private spending among the beneficiaries.
Net effect Effect completely imputable to the programme. Deadweight, substitution and displacement
effects have been subtracted from gross effect to estimate the net effect.
Output
What the programme finances. For example: buildings, storage equipment, tourist facilities,
Primary data
Data collected ad hoc directly in the field at the time of the running evaluation.
Relevance
Appropriateness of the objectives of a programme in relation to the sectoral needs and socioeconomic problems to which the programme should respond.
Result
The most immediate impact, directly identifiable once the action has been implemented. It
occurs as soon as the public intervention has been completed. For instance, when tourist
accommodation is created or upgraded, a result would be an increased accommodation capacity;
when transport infrastructure has been created or upgraded the travelling time within or from the area
would be reduced.
Secondary data
Existing information, e.g., statistics, monitoring data, data from previous evaluations,
Sustainability of results
Effects are sustainable when they last in the long term, and after the end of the
programme.
Utility
The fact that the impacts observed correspond to sectoral needs and to identified
socioeconomic problems. Unlike relevance, utility does not appreciate the intervention by referring to
the objectives of the assisted actions.
2.
What are the important aspects which should become the focus of evaluation?
3.
4.
What are the important elements that should be included in the structure of
the evaluation reports?
Moxey A., Whitby M., and Lowe P. (1998) Environmental indicators for a reformed CAP,
Monitoring and evaluation policies in agriculture, Centre for rural economy, University of Newcastle
Upon Tyne
OECD (1994), Creating rural indicators for shaping territorial policy, OECD: Paris.
OECD (1997), Environmental Indicators for Agriculture, OECD: Paris.
Parris, K. (1999). Environmental indicators for agriculture: Overview in OECD countries. In:
F.M.Brouwer and J.R. Crabtree (Eds.) Environmental Indicators and Agricultural Policy. CAB
International, Wallingford,1999, pp. 25-44.
Rametsteiner, E. (1999).Criteria and indicators: Experience in the forestry sector. In: F.M.
Brouwerand J.R. Crabtree (Eds.) Environmental Indicators and Agricultural Policy.
CAB International, Wallingford, 1999, pp. 247-262.
Tucker, G. (1999). Measuring the impacts of agriculture on biodiversity. In: F.M. Brouwer and
J.R.Crabtree (Eds.) Environmental Indicators and Agricultural Policy. CAB
International, Wallingford, pp. 89-103.
Wascher D.M., Piorr H.-P. and Kreisel-Fonck (1998), Agri-environmental Indicators for Landscapes,
European Centre for Nature Conservation, Tilburg: The Netherlands.
Wascher, D.M., M. Mgica and H. Gulinck (1999). Establishing targets to assess agricultural impacts
on European landscapes. In: F.M. Brouwer and J.R. Crabtree (Eds.)
Environmental Indicators and Agricultural Policy. Wallingford, CAB International, pp. 73-87.
The ex ante evaluation helps to prepare the rural development plan and facilitates its
implementation.
The mid-term evaluation helps to reorient the programme if necessary and improve the
implementation.
The ex post evaluation recapitulates and judges an intervention when it is over.
2.
Evaluation should focus on aspects such as the utility, relevance, coherence, effectiveness,
efficiency and sustainability of the results. The pertinence and relative importance of these aspects
would vary according to the stage of implementation of the programme.
3.
Indicators may, depending on the implementing stage of the programme, relate to an output, a
result or an impact. Programme indicators attempt to measure the direct or indirect effects of the
programme. By contrast, context indicators apply to an entire territory, population or category, for
example a particular agricultural sector within the relevant region or country. By measuring
appropriate economic, social or environmental variables, such indicators can put the programme into
perspective. A context indicator may, for example, show that a certain programme, albeit successful
in relation to its own given objectives, is no longer justified or, on the contrary, that a certain type of
aid is still relevant even if the relevant programme indicator demonstrates limited progress. Some
context indicators may justify regular monitoring while others should be collected ad hoc for the
evaluation.
4. The recommended structure for the evaluation repots should have the following main
elements:
a)
b)
c)
d)
e)
f)
Executive summary
Introduction (context of programme, characteristics of the implementation,
purpose of the evaluation)
Explanation of the methodological approach (design and analysis, data collection
and sources, soundness of data and findings)
Presentation and analysis of the information collected (financial information and
outputs, uptake information on beneficiaries, replies to the common questions,
findings on the programme specific questions
Conclusions (concerning community level objectives, programme specific goals,
effectiveness, efficiency, utility, sustainability of the results, ..) and
recommendations
Annexes