Professional Documents
Culture Documents
Research Methodology
Prabesh Ghimire
Research Methodology MPH 19th
Batch
Table of Contents
UNIT 1: INTRODUCTION TO PUBLIC HEALTH RESEARCH ...................................................................................... 3
Definition of scientific methods in public health ....................................................................................................... 4
Problem Identification and Justification ................................................................................................................... 5
Research in Sensitive Issues ...................................................................................................................................... 6
Action Research......................................................................................................................................................... 9
Research Management ........................................................................................................................................... 10
Research Management ............................................................................................................................................ 10
Research Plan ........................................................................................................................................................... 11
UNIT 2: SELECTION OF A RESEARCH TOPIC ......................................................................................................... 13
UNIT 3: LITERATURE REVIEW ............................................................................................................................. 14
Need for Literature Review ..................................................................................................................................... 14
Different Search Strategies for Research Retrieval ................................................................................................. 15
UNIT 4: THEORY AND RESEARCH ....................................................................................................................... 16
UNIT 5: RESEARCH QUESTIONS AND HYPOTHESIS .............................................................................................. 17
Variables .................................................................................................................................................................. 17
Conceptual Framework ........................................................................................................................................... 17
UNIT 6: RESEARCH ETHICS ................................................................................................................................. 18
Brief History of Research Ethics .............................................................................................................................. 19
Ethical Issues during the Planning and Execution of Research ............................................................................... 21
UNIT 7: SELECTING STUDY PARTICIPANTS .......................................................................................................... 23
Determining Sample Size in Quantitative Studies ................................................................................................... 23
Determining Sample Size in Qualitative Studies ..................................................................................................... 24
Type I and Type II Error ........................................................................................................................................... 25
UNIT 8: INSTRUMENTATION .............................................................................................................................. 26
Developing Measurement Instrument .................................................................................................................... 26
UNIT 9: QUANTITATIVE RESEARCH METHODS EXPERIMENTAL ........................................................................ 29
Internal Validity ....................................................................................................................................................... 30
Threats to Internal Validity ..................................................................................................................................... 31
Controlling Threats to Internal Validity .................................................................................................................. 32
External Validity (Generalizability) .......................................................................................................................... 33
Threats to External Validity..................................................................................................................................... 33
Controlling Threats to External Validity ................................................................................................................. 34
Although some disagreements exist regarding the exact characteristics of the scientific method, most
agree that it is characterized by the following elements:
i. Empirical approach
- The empirical approach is an evidence based approach that relies on direct observation and
experimentation in the acquisition of new knowledge.
- The empirical approach, with its emphasis on direct, systematic, and careful observation, is best
thought of as the guiding principle behind all research conducted in accordance with the scientific
method.
ii. Observations
- In the context of science, observation means more than just observing the world around us to get
ideas of research.
- Observation also refers to the process of making careful and accurate measurements, which is a
distinguishing feature of well-conducted scientific investigation.
- When making measurements in the context of research, scientists typically take a great precautions
to avoid making biased observations.
iii. Questions
- After getting a research idea, perhaps from making observation of the world around us, the next step
in the research process involves translating that research idea into an answerable question.
- In order to yield a important information, it is important to formulate a research question that can be
answered through available scientific methods and procedures.
iv. Hypotheses
- Hypotheses are the researchers attempt to explain the phenomenon being studied, and that
explanation should involve a prediction about the variables being studied.
- These predictions are then tested by gathering and analyzing data, and the hypotheses can either be
supported or refused on the basis of data.
v. Experiments
- After articulating the hypothesis, the next step involves actually conducting the experiments (or
research study).
- A key aspect of conducting a research study is measuring the phenomenon of interest in an accurate
and reliable manner.
vi. Analyses
- After conducting the study and gathering the data, the next step involves analyzing the data, which
generally calls for the use o statistical techniques.
- A key decision that researchers must make with the assistance of statistics is whether the null
hypothesis should be rejected.
vii. Conclusions
- After analyzing the data and determining whether to reject the null hypothesis, the researcher is now
in a position to draw some conclusions about the results of the study.
- In scientific method, it is important that researchers make only those conclusions that can be
supported by the data analyses.
viii. Replication
- One of the most important elements of the scientific methods is replication,
- Replication essentially means conducting the same research study a second time with another group
of participants to see whether the same results are obtained.
- Replication serves several integral purposes, including establishing the reliability of the research
studys findings and determining whether the results of the original study are generalizable to other
groups of research participants.
The scientific method is based on certain basic postulates which can be stated as under:
- It relies on empirical evidence;
- It utilizes relevant concepts;
- It is committed to only objective considerations;
- It presupposes ethical neutrality, i.e., it aims at nothing but making only adequate and correct
statements about population objects;
- It results into probabilistic predictions;
- Its methodology is made known to all concerned for critical scrutiny are for use in testing the
conclusions through replication;
- It aims at formulating most general axioms or what can be termed as scientific theories.
The first step and one of the most important requirements of the research process is to identify the
problem. Whether a problem situation requires research depends on the three conditions:
i. There should be a perceived difference or discrepancy between what exists and the ideal or planned
situation.
ii. The reason(s) for difference should be unclear (so that it makes sense to develop research
questions); and
iii. There should be more than one possible answer to a question or more than one solution to the
problem.
The sources for generating appropriate research question/problems are numerous. These may be
personal experiences, literature sources, existing theories, and previous researches.
Following criteria may be considered for deciding the research problem: (FINER criteria)
i. Feasible to implement
- The selected research problem area should be feasible in terms of technical, financial and
administrative capabilities.
- It should be able to answer the following questions:
Can adequate number of subjects be available?
Is there adequate expertise to do the work?
Is the research affordable?
ii. Interesting
- The selected problem areas should be of interest to health policy managers and the researcher.
iii. Novel
- The research on identified problem should be able to fill the gap in existing knowledge and/or able to
solve the problem in an area.
iv. Ethical
- In applied research, most of the time human beings are involved and hence it is necessary to fully
observe ethical policies and procedures.
- Such problems should never be selected, the research on which may have a deleterious effect on
human beings.
v. Relevant
- Selected problem should be relevant and have priority for that geographical area, region and country.
Ranzetti and Lee define sensitive research topic as one that is intimate, discreditable or incriminating. It is
a type of research which potentially poses a substantial threat to those who are or have been involved in
it. Examples include research exploring death, cancer, sexual abuse, violence, drug abuse or
homelessness.
Although there are some topics that are more obviously sensitive, any topic could potentially be seen as
sensitive depending on the people being reached and their feelings about the topic.
For example, the level of sensitivity of the topic may vary according to culture, age, gender or a number of
other factors.
Areas in which research is likely to be sensitive
- where research intrudes into the private sphere or investigate into some deeply personal experience;
- where the study is concerned with deviance or social control;
- where the study intrudes on the vested interests of powerful persons or the exercise of coercion or
domination; or
- where the research deals with things that are sacred to those being studied that they do not wish
profaned.
v. Other methods
- Micro-aggregation method
- Grouped answer method (2 or 3 card method)
- Crosswise, triangular, diagonal and hidden sensitivity models
- Survey with negative questions
Prior to data archival, the researcher needs to remove any information that could allow subjects to be
identified. This can be done in two ways:
i. De-identification:
- De-identification of data refers to the process of removing or obscuring any personally identifiable
information in a way that minimizes the risk of unintended disclosure of the identity of individuals and
information about them.
- Some of the common methods of data de-identification includes
Data suppression
Randomization
Shuffling
Creating pseudonyms or surrogate
Sub-sampling
Aggregation/Generalization
Character masking
Masking
Encoding
Blurring
ii. Anonymization:
- Anonymization of data refers to the process of data de-identification that produces data where
individual record cannot be linked back to an original as they do not include the required translation
variables to do so.
Action Research
Action research is an approach to change which incorporates action (i.e. the change process) with
research which informs and assesses the impact of the change.
It is a form of research which informs and assesses the impact of the change.
- Action research is particularly suited to identifying problems in public health practice and helping
develop potential solutions in order to improve practice.
- For this reason, action research is increasingly being used in health related settings.
It has been noted that two criteria are fundamental to action research:
- The cyclic process of action research, which involves some kind of action intervention
- The research partnership, in which the degree of involvement or participation of the researched may
range from cooperation, when the research participants work with outsiders to determine priorities but
responsibility remains with the outsiders to direct the process, to collective action.
Distinguishing characteristics of Action Research
Hart and Bond presented a typology of action research that identified seven distinguishing characteristics:
- It has an educative base
- It deals with individuals as members in groups
- It is problem focused
- It involves a change intervention
- I t aims at improvement and involvement
- It involves cyclic processes
- It is founded on collaboration
Types of action research
i. Experimental
- Educative base: re-education
- Group in research are selected by researcher for purposes of measurement/inferring relationship
between cause and effect.
- Problem focus: Problem relevant for social science/ management interests
- Change intervention: Problems to be solved in terms of research aims
ii. Organizational
- Educative base: re-education/ training
- Groups in research are work groups and/or mixed groups of managers and workers.
- Problem focus: Problem relevant for management/social science interest
- Change intervention: Problems to be solved in terms of management aims
iii. Professionalizing
- Educative base: reflective practice
- Groups in research are professionals and/or (interdisciplinary) professional group.
- Problem focus: Problem emerges from professional practice/experience
- Change intervention: Problems to be resolved in the interests of research-based practice and
professionalization.
iv. Empowering
- Educative base: consciousness-raising
- Groups in research are fluid groupings, self selecting or natural boundaries or open/closed by
negotiation.
- Problem focus: Problem emerges from members practice/experience
- Change intervention: Problems to be explored as a part of process of change, developing an
understanding of meanings of issues in terms of problem and solution.
Research Management
Research Management
Every steps of research must first be planned, then designed and developed, implemented and ultimately
evaluated. The Elements of research management are described below:
i. Research Planning
- Research planning should be conducted in stages of increasing detail and exactitude.
- At the preliminary or research proposal stage, only the most general notion of data requirements may
be known.
- Once a proposal has been formulated, it is important to determine whether a new research is needed.
- If it is decided that alternative data sources cannot meet the information needs, the team proceeds to
formulate statement of objectives, and to develop some appreciation of frame options, the general
sample size, precision requirements, data collection options, schedule and cost.
- A decision about feasibility of the research is usually made at this point.
- In later stages of the survey process, plans are revised, elaborated and refined and more detailed
aspects are examined.
iii. Implementation
- Having ensured that all systems are in place, the research can now be implemented.
- Interviewers are trained, the sample is selected and information is collected, all in a manner
established during the development phase.
- Following these activities, data processing begins.
- The survey results are produced and analyzed. These results are then checked for confidentiality and
disseminated.
Research Plan
The research plan is the main part of a grant application describing a principal investigator's proposed
research, stating its importance and how it will be conducted.
ii. Research - Depending on the type of the study, the following questions should be
participants answered
- What are the criteria for inclusion or selection?
- What are the criteria for exclusion?
- What is the sampling procedure to ensure representativeness and reliability?
- Will there be use of controls in the study?
iii. Sample size - The proposal should provide information and justification about sample size in
the methodology section
iv. Ethical - The proposal must describe the measures that will be undertaken to ensure
issues that proposal is carried out in accordance with ethical principles.
v. Research - The research setting includes all the pertinent facets of the study such as
settings population to be studied, the place and time of study.
vi. Study - Instruments by which the data are collected should be described.
instruments
vii. Collection of - A short description of the protocol of data collection is described
data
viii. Data - The description should include the design of the analysis form, plans for
analysis processing and coding the data and the choice of the statistical method to be
applied to each data.
7 Gantt Chart - An overview of tasks/proposed activities and a time frame is presented in a
Gantt Chart
8 Budget - A proposal budget with item wise/activity wise breakdown and justification for
the same is provided.
9 References - A proposal should end with relevant references on the subject
10 Appendixes - Appropriate appendixes such as questionnaires, interview protocols, consent
form, official letters, etc are included
Should Plan be Flexible? Give your ideas in support and against the flexible plan. (2070/3)
- Yes, plan should be unconditionally be flexible.
- Detailed planning is key to the smooth running of research. However, research takes place in an
unpredictable and uncertain world and even the most meticulously planned projects will encounter
unforeseen barriers.
- An experienced researcher knows that as a result of the unexpected circumstances, research
generally takes longer than originally projected and often costs more too.
- It is not feasible to plan for every eventuality and therefore practitioner researchers so have to be
prepared to be flexible.
- In some research designs, such as action research, flexibility may be an important component in the
process as each stage depends upon the outcome of the preceding stage.
ii. Time
- Underestimated research time through inexperience
- The disappearing research participant
- Research governance and ethics: approval process
iii. Research life/balance
- Unforseen life events
Gantt Chart
- A Gantt chart is a type of bar chart, devised by Henry Gantt in the 1910s, that illustrates a project
schedule.
- Gantt chart provides an excellent overview of a research project and enables the researcher to
sequence research activities in the right order.
- Such chart shows activities as blocks or bars over time.
- It is an intuitive chart used to show resources and time allocation for key tasks, and it supports
monitoring of activities during the management phase.
- In Gantt Chart, the time taken by an activity is represented by a horizontal line, the length of which is
proportional to the duration of activity.
- As a rule, the time in the chart should flow from left to right and the activities be listed from top to
bottom.
Advantages
- It ensures that all activities are carefully and sequentially planned for and that the total duration or
activity times are considered.
- -The use of resource field helps isolate which person is responsible for the particular research tasks
and use of horizontal bars shows research activity over a timeline.
Limitations
- It does not show inter-dependencies between different activities, and thus impact of delay of one
activity over the other cannot be assessed.
- Analytical integration of time, work and resource is quite difficult.
- If the time schedule is changed, it is difficult to change the length or position of bars of a Gantt chart.
v. Applicability of results
- Is it likely that the recommendations from the study will be applied?
- The literature review is a process of gathering an analytical summary of research findings of a topic of
interest. It is a comprehensive compilation of what is known about the phenomenon.
- The literature review is guided by the researchers curiosity about a particular subject and gaps in the
knowledge about the subject area.
- The literature review is intended to assess the evidence regarding the research topic by identifying
and synthesizing studies that examine the subject of interest.
- The literature review provides the context within which the research is conducted.
The main purpose of literature review is to identify what is known and unknown about an area that has
not been totally resolved in practice.
A second purpose is to determine how an issue can be resolved and managed based on research
evidence.
A search strategy is a structured organization of terms used to search a database for literature. Some of
the techniques that can be used to develop a search strategy includes:
i. Truncation and wildcards
a. Truncation
- Truncation is useful for finding singular and plural forms of words and variant endings.
- A keyword should be shortened to its 'stem' or 'trunk' and truncation symbol should be added.
- Many databases use an asterisk *as their truncation symbol.
- For example, typing therap* into a search box will find references containing any of these words:
therapy, therapies, therapist or therapists.
b. Wild cards
- A wildcard finds variant spellings of words. It is used to search for a single character, or no
character at all, anywhere in the keyword.
- Many databases use a question mark? as their wildcard symbol.
- Wildcards are useful for finding British and American spellings, for example, behavio?r will find
behaviour and also behavior.
b. AND
- AND reduces the number of results retrieved and is usually used to combine different concepts to
make results more relevant
- Searching for mental health AND eating disorders finds articles that mention both of these topics.
c. NOT
- NOT reduces the number of results by excluding a search term.
- Searching for for mental health NOT eating disorders find articles that mentions mental health but
removes any articles that mention eating disorders.
v. Citation Searching
- Citation searching means that if we have found a relevant article, we can find a list of articles that cite
it.
- Citation searching helps to find more recent papers on the same or similar subject.
Theory of Verifiability
- The Verifiability theory of meaning was put forth in the early twentieth century by a group of logical
positivists.
- The verifiability theory was based upon the verifiability principle, which states: "A statement is literally
meaningful if and only if it is either analytic or empirically verifiable."
- If it failed that test, then it was held to be literally meaningless.
- Although the verifiability principle can be taken as a general principle of meaning, it also establishes
an important general criterion for scientific methodology and even the meaning of science itself.
- Since the verifiability principle can be interpreted as a general theory of meaning, it cannot act as a
sufficient condition for science. It however, does seem a necessary condition.
- That it seems a clear thesis of logical positivism that one cannot have science without the verifiability
principle as standard
Theory of Falsifiability
Sir Karl Popper (1902-1994), considered on of the most influential twentieth century philosophers of
science, asserted that for a theory to be science, a necessary condition is that the theory consist of
hypotheses that could be falsified.
- According to Popper, falsification is the best approach for testing scientific theories and contrasts
sharply with the verification approach.
- The theory must be organized in a way such that its assertions can be refuted. This necessity for a
scientific theory to be falsifiable is known as demarcation criteria.
- Advocating the use of falsifiability as a scientific method to test theories, Popper therefore rejected
inductivism, because falsification dictates that researcher must begin with falsifiable hypotheses
before observations are made.
- The data are collected to refute them not verify them.
- It is easier for the same set of fata to support or verify many different theories simultaneously. Thus,
falsification provides more rigor and confidence in the conclusions.
Variables
A variable is a characteristic, event, or response that represents the elements of the research question in
a detectable way (Creswell, 2008). Variables are carefully described upfront to guide the design of
quantitative studies.
- Dependent variables:
- These re variables in which changes are results of the level or amount of the independent variable or
variables.
- Synonyms: effect, outcome, consequence, result, condition, disease.
- Background variables:
- These are variables that are so often of relevance in investigations of groups or populations that they
should be considered for possible inclusion in the study.
- For example sex, age, ethnic origin, education, marital status, social status etc.
Conceptual Framework
- Conceptual framework is the researchers understanding of how the particular variables in his study
connect with each other. Thus, it identifies the variables required in the research investigation. It is
the researchers map in pursuing the investigation.
- According to Miles and Huberman (1994), A conceptual framework explains, either graphically or in
narrative form [both are much preferred], the main things to be studied the key factors, constructs or
variables and the presumed relationships among them
- According to McGahie et al. (2001), conceptual framework sets the stage for the presentation of the
particular research question that drives the investigation being reported based on the problem
statement.
- Conceptual framework lies within a much broader framework called theoretical framework. The latter
draws support from time-tested theories that embody the findings of many researchers on why and
how a particular phenomenon occurs.
No researches should take precedence over respect for human rights, fundamental freedom and
human dignity, and practices contrary to human dignity should be prohibited.
ii. Principle II: Beneficence and Non-Malfeasance
- The principle of beneficence requires that the research activity should benefit the participants directly
or indirectly.
- If benefits are not obvious, the researcher should ensure that the participation in research does not
lead any harm.
- All attempts to maximize benefits and minimize the risks should be taken by the researcher.
- The principle of non malfeasance proscribes those researches which are likely to cause deliberate
harm to the participants.
iii. Principle III: Justice
- Justice requires that persons in similar circumstances be treated alike and that differences between
persons due to circumstances be acknowledged and addressed.
- In the context of health research, justice requires that persons having similar health complaints or
threats be treated equally.
- Justice also requires the equitable distribution of the burdens and benefits of research.
- Code of medical ethics dates back as far as Babylon with Hammurabis Code of Law (1790 BC),
Charaka Samhita (800-400 BC) and the Hippocratic Oath (600 BC).
- Concept of just moral propriety in medicine was propounded by Thomas Hobbes in 1651 AD.
- Thomas Percival came up with the concept of bio-ethics and legislative aspects of ethics related
behavior.
- Ethics related to health and biomedical research is a more recent phenomenon. The first document
on this subject is the Nuremberg Code in 1947.
- This was followed by a series of international declarations, conventions and convenants related to
ethics in health, health care and research.
- The most prominent of these documents are the World Medical Association (WMA)s Declaration of
Helsinki, the council of International Organization of Medical Sciences (CIOMS)s International Ethical
Guidelines for Biomedical Research Involving Human Participants and the WHO and ICH Guidelines
for Good Clinical Practice.
Helsinki Declaration
The Declaration of Helsinki was adopted in the 18th General Assembly (June 1964) of World Medical
Association as a statement of ethical principles to provide guidance to physicians and other participants in
medical research involving human participants.
The declaration highlights that it is the duty of physicians to promote and safeguard the health of the
people. In medical research on human participants, consideration related to well-being of the human
participants should take precedence over the interests of science and society.
Some of the major principles for medical research highlighted in the declaration are summarized below:
i. It is the duty of the physician in medical research to protect the life, health, privacy, and dignity of the
human participants.
ii. Medical research involving human participants should be conducted only by scientifically qualified
persons and under the supervision of a clinically competent medical person.
iii. Every medical research project involving human participants should be preceded by careful
assessment of predictable risks and burdens in comparison with foreseeable benefits to the
participants or to others.
iv. Medical research involving human participants should only be conducted if the importance of the
objective outweighs the inherent risks and burdens to the participants.
v. The participants must be volunteers and informed participants in the research project.
vi. The right of research participants to safeguard their integrity must always be respected. Every
precaution should be taken to respect the privacy of the participants, the confidentiality of the
patients information and to minimize the impact of the study on the participants physical and mental
integrity and on the personality of the participant
vii. In any research on human beings, each potential participant must be adequately informed of the
aims, methods and institutional affiliations of the researcher, the anticipated benefits and potential
risks. The participant should be informed of the right to abstain from participation in the study or to
withdraw consent to participate at any time without reprisal. After ensuring that the participant has
understood the information, the physician should then obtain the participants freely-given informed
consent.
viii. For a research participant who is legally incompetent, physically or mentally incapable of giving
consent or is a legally incompetent minor, the investigator must obtain informed consent from the
legally authorized representative.
ix. Both authors and publishers have ethical obligations. In publication of the results of research, the
investigators are obliged to preserve the accuracy of the results. Negative as well as positive results
should be published or otherwise made publicly available.
Apart from basic principles, the declaration also highlights on the additional principle for medical research
combined with medical care. Some of them are listed below:
i. When medical research is combined with medical care, additional standards should apply to protect
the patients who are research participants.
ii. The benefits, risks, burdens and effectiveness of a new method should be tested against those of the
best current prophylactic, diagnostic, and therapeutic methods.
iii. At the conclusion of the study, every patient entered into the study should be assured of access to the
best proven prophylactic, diagnostic and therapeutic methods identified by the study.
iv. The physician should fully inform the patient which aspects of the care are related to the research.
According to the National Ethical Guidelines 2011, all health research conducted in Nepal must have the
approval of the Ethical Review Board (ERB) of the NHRC or a similar body authorized by NHRC.
The following ethical guidelines are proposed for any research involving human subjects:
i. Essential Research
- Research involving human participants should have been considered essential for the understanding
of a problem or disease process, or to identify a better diagnostic, therapeutic or preventive approach
to a disease.
viii. Compensation
- The research participants should make provisions for compensating the research participants or
community for the harms incurred in the research process.
- Also, the researcher should make provisions to compensate the efforts and time of the participants for
the purpose of the research.
x. Confidentiality
- The research activity is carried out in such a way that the identity and data related to human
participants are kept confidential as far as possible.
Roles of Nepal Health Research Council in Setting and Ensuring Ethical Standards
One of the roles of NHRC is to review all health research proposals to be conducted in Nepal for the
scientific quality and ethical propriety and take necessary steps to approve or disapprove such research
proposals.
NHRC has set a National Ethical Guidelines for Health Research and constituted an Ethical Review
Board (ERB) to safeguard the dignity, rights and well being of research participants and to promote
ethical health research in Nepal.
The roles of ethical review board under NHRC are
i. Review research proposals according to the National Ethical Guidelines for Health Research in Nepal
with a view to approve, amend or reject the proposal.
ii. Supervise or monitor the implementation of health research projects approved by ethical review
board.
iii. Resolve ethical issues arising out of reviewing, approving, supervising and disseminating of research
findings.
iv. Conduct training programmes for members and reviewers of ERB and Institutional Review
Committees on the ethical review process.
Calculation of exact sample size is an important part of research design. It is very important to understand
that different study design need different method of sample size calculation and one formula cannot be
used in all designs.
b. Formula for sample size calculation for comparison between two groups when endpoint is qualitative
( + 1) (/2 )2 (1 )
=
(1 2) 2
Where,
p 1 - p 2 is the difference in proportion of events in two groups
p = pooled prevalence
a. Formula for sample size calculation for comparison between two groups when endpoint is quantitative
data
- When the variable is quantitative data like blood pressure, weight, height, etc., then the following
formula can be used for calculation of sample size for comparison between two groups.
2 2 (/2 )2
=
2
Where,
SD = Standard deviation of variable. (from previously done study or through pilot study.)
Z (1-/2) is standard normal variate
Z is power of study (0.842 at 80% power)
d = effect size (difference between mean values)
b. Formula for sample size calculation for comparison between two groups when endpoint is qualitative
- When the endpoint of a clinical intervention study is qualitative, then the following formula can be
used for sample size calculation for comparison between two groups.
2 (/2 )2 (1 )
=
(1 2) 2
Where,
p 1 - p 2 is the difference in proportion of events in two groups
p = pooled prevalence
There are usually two types of errors a researcher can make, Type I error and Type II error.
Type I error
- A type I error is characterized by the rejection of the null hypothesis when it is true and is referred by
alpha () level.
- Alpha level or the level of the significance of a test is the probability researchers are willing to take in
the making of a type I error.
- In public health research, alpha level is usually set at a level of 0.05 or 0.01.
- Type I error can be minimized by increasing the sample size.
Type II error
- Type II error is the failure to reject false null hypothesis.
- The probability of making a type II error is called beta (), and the probability of avoiding type II error
is called power (1- ).
It is important to point out that both Type I and Type II errors are always going to be there in the decision
making process.
The situation is further complicated by the fact that a reduction in probability of committing a type I error
increases the risk of committing a type II error and vice versa. Thus, researchers have to find a balanced
type I and type II errors they are willing to allow for.
H 0 True H 0 false
Reject H 0 Type I error Correct Decision
Do not reject
Correct decision Type II error
H0
UNIT 8: INSTRUMENTATION
Instrumentation
Instrumentation is the process of developing, testing and using the measurement tools (questionnaire,
checklist, etc.) for a research purpose.
Questionnaire
A questionnaire is a research instrument consisting of a series of questions and other prompts for the
purpose of gathering information from respondents.
ii. Simplicity
Language of the questions should be simple, lucid and clear. Questions should be short, not long or
complex. Mathematical questions should be avoided.
v. Non-controversial
Questions should be such that it can be answered impartially. No controversial questions should be
asked.
vi. Instructions
A questionnaire must show clear instructions for filling in the form.
b. Questionnaire length
When developing a questionnaire it is wise to keep the length to a minimum in terms of the time it
is likely to take for participants to respond.
If it is necessary to construct a relatively long questionnaire, headings and transition statements
can be inserted to explain to the participant what the next group of questions is about.
Design of RCT
The basic steps in conducting a RCT include the following
i. Writing the protocol
- One of the essential features of a randomized controlled trial is that the study is conducted under a
strict protocol.
- The protocol specifies the aims and objectives of the study, questions to be answered, criteria for the
selection of study and control groups, size of the sample, procedures for allocation of subjects and
controls, treatment to be applied, etc.
- The protocol aims at preventing bias and to reduce the sources of error in the study.
iii. Randomization
- Randomization is the heart of the randomized controlled trial.
- It is the statistical procedure by which the participants are allocated into groups usually called study
and control groups, to receive or not to receive an intervention.
- Randomization is an attempt to eliminate bias and allow for comparability by matching both known
and unknown confounders.
- By randomization, every individual gets an equal chance of being allocated to either groups.
iv. Follow up
- This implies examination of the experimental and control group subjects at pre set conditions till the
final assessment of the outcome.
- The duration of follow up usually depends upon the study undertaken.
- Efforts should be made to minimize the losses to follow-up.
v. Assessment
- The final step is the assessment of the outcome of the trial in terms of positive and negative results.
- The incidence of positive/negative results is rigorously compared in both the groups and the
differences, if any are tested for statistical significance.
Strengths
- Excellent internal validity
- Provides precise measures of eifficacy and acute toxicity of new therapies under ideal conditions.
- Because of randomization, measurement of effect size is less prone to bias
Weakness
- Limited external validity
- Patients with co-morbidity are under-represented in RCTs.
- Have limited ability to detect rare and chronic toxicities, especially those that occur in patients
completion of the trial.
Internal Validity
Internal Validity is the degree to which the results of a study are correct for the sample of patients
being studied.
Internal validity of an experimental design concerns the degree to which changes in the dependent
variable (effect) can be attributed to the independent variable (cause).
It is internal because it applies to the conditions of a particular group of persons being studied and not
necessarily to others outside the study population.
The internal validity of a health research is determined by how well the design, data collection, and
analyses are carried out, and it is threatened by all the biases and random variation.
Therefore, the concerns of internal validity revolve around whether the design is randomized, whether
the outcomes are appropriate, whether there are confounding effects and so on.
Example of internal validity, measurements of blood haemoglobin must distinguish accurately
participants with anaemia as defined in the study. Analysis of the blood in a different laboratory may
produce different results because of systematic error, but the evaluation of associations with
anaemia, as measured by one laboratory, may still be internally valid.
i. Maturation
The term maturation refers to changes (biological pr psychological) that may occur within the subjects
simply as a function of the passage of time.
These changes threaten internal validity because they may produce effects that could be mistakenly
be attributed to the experimental treatment.
Subjects may perform differently on the dependent variable measure simply because they are older,
wiser, hungrier or more fatigued than they were at the time of first measurement.
ii. History
Specific events or conditions, other than the experimental treatment may occur between the
beginning of the treatment and the posttest measurement and may produce changes in the
dependent variable.
v. Statistical regression
Statistical regression occurs when an extreme performance on a test is followed by a less extreme
performance.
Many threats to internal validity are minimized through use of randomization and a control group.
i. Randomization
Randomization allows the assumption that the group do not differ at the beginning of the experiment.
The randomization process controls for history upto the point of the experiment; that is the researcher
can assume that past events are equally distributed among groups.
Randomization also controls for maturation because the passage of time is equivalent in all groups.
Statistical regression, selection biases and selection-maturation interaction are also controlled
because they occur only when groups are not randomly formed.
External validity refers to the extent to which the findings of a study can be generalized to other
subjects, settings and treatments.
It is the degree to which the results of a study hold true in other settings.
Generalizability expresses the validity of assuming that participants in a study are similar to other
population.
v. Subject effects
Attitudes and feelings of the participants that develop during a study may influence the
generalizability of the findings to other settings.
This threat is called the reactive effect because subjects are reacting to the experience of
participating in an experiment.
i. Randomization
Randomization is the key to controlling most threats to external validity.
Randomization increases the experiment's external validity by controlling for selection-treatment
interaction.
Data management falls under the rubric of research project management. Data management involves
preparatory, data collection, data organization and data analysis/dissemination stages. Each stage is
equally important for study outcomes.
Correlation matrices
Hypothesis testings (t-test, chi-square test, ANOVA)
Multivariate /logistics regression analysis
It is often helpful to prepare summary tables of basic information from the above examination that can
be used for reference purposes during later stages of analysis and writing.
Graphical representation of data is extremely useful throughout the examination of the data.
v. Report writing
All research members need to play a role in planning, developing and submitting manuscripts.
Multiple reviews are essential to the development of quality manuscripts/ report.
Multivariate analysis (MVA) is based on the statistical principle of multivariate statistics, which involves
observation and analysis of more than one statistical outcome variable at a time.
Statistically speaking, multivariate analysis refers to statistical models that have 2 or more dependent
or outcome variables.
A simple linear regression model has a continuous outcome and one predictor, whereas a multiple or
multivariable linear regression model has a continuous outcome and multiple predictors (continuous
or categorical).
The main methods of multivariate analysis are summarized in the table below:
Methods Type of dependent Type of independent Purpose
variable variable
Survival Analysis
Survival analysis is a collection of statistical procedures for data analysis for which the outcome variable
of interest is time until an event occurs. It is concerned with measuring the risk of occurrence of an
outcome event as a function of time. The time could be measured in days, weeks, months or years from
the beginning of observed follow-up on a subject. The event could be death, disease, incidence or
relapse or recovery.
In general, survival analysis allows for the proper treatment of incomplete data particularly due to subjects
dropping out of the study. This is known as censored data. There are generally three reasons why
censoring may occur:
i. A person does not experience the event before the study ends
ii. A person withdraws from the study before an event occurs (lost to follow-up)
iii. An intervening event occurs prohibiting further observation (e.g. adverse drug reaction)
Report Writing
The table below summarizes a general framework that must be considered in writing a research report.
Sections of the Key points to be considered
report
1 Title Page Title of the research/report
Name of the researcher
Date of Submission
2 Table of contents Table of contents shows the sections of the report
3 Executive summary This section gives a summary of the whole report
or abstract Outlines-purpose, research method, findings, main conclusions and
recommendations.
Mainly written in past tense
5 Methodology Explanation is made on how research was done and outline of how sampling
was performed, how data was collected, etc. is presented.
6 Results/Findings Findings of the research are presented in this section
Only facts are presented with no interpretations
Graphic forms (tables and graphs) are used to present quantitative findings
7 Discussion Interpretation and evaluation of the results are done
It analyses results; draws together different aspects of the findings, findings
of other studies and refers to literature.
8 Conclusion Brief statements of major findings pertinent to research question are
presented
9 Recommendations Suitable changes/ solutions are suggested
10 Appendix Additional information are attached (e.g surveys, questionnaires, glossary,
raw data, etc)
11 References All references used are listed out
UNIT 11: JOURNAL CLUBS AND DISSEMINATION OF RESEARCH FINDINGS, AND CRITIQUES ON
PAPER
A journal club is a group of individuals who meet regularly to critically evaluate recent articles in the
academic literature.
The purpose of a journal club is to review specific research studies and to discuss the implications on
public health. Journal clubs provide a forum for a collective effort to keep up with scientific literature.
Manuscript Development
According to the guidelines by International Committee of Medical Journal Editors (ICMJE), the general
requirements in development of manuscript include the following:
i. Title Page
General information about an article and its authors is presented on a manuscript title page and
usually includes
a. Article title
The title provides a distilled description of the complete article and should include information that
will make electronic retrieval of the article sensitive and specific.
Some journals require a short title, usually no more than 40 characters (including letters and
spaces) on the title page.
b. Author information:
Each author's highest academic degrees should be listed, although some journals do not publish
these.
The name of the department(s) and institution(s) or organizations where the work should be
attributed should be specified.
c. Disclaimers
An example of a disclaimer is an author's statement that the views expressed in the submitted
article are his or her own and not an official position of the institution or funder.
d. Source(s) of support
These include grants, equipment, drugs, and/or other support that facilitated conduct of the work
described in the article or the writing of the article itself
ii. Abstract
Original research, systematic reviews, and meta-analyses require structured abstracts.
The abstract should provide the context or background for the study and should state the study's
purpose, basic procedures (selection of study participants, settings, measurements, and analytical
methods), main findings and principal conclusions.
It should emphasize new and important aspects of the study or observations, note important
limitations, and not over interpret findings.
iii. Introduction
Introduction should provide a context or background for the study (that is, the nature of the problem
and its significance).
The specific purpose or research objective of, or hypothesis tested by, the study or observation
should be stated.
iv. Methods
Methods section should aim to be sufficiently detailed such that others with access to the data would
be able to reproduce the results.
The Methods section should include a statement indicating that the research was approved or
exempted by the responsible review committee.
a. Technical Information
Specify the study's main and secondary objectives
Identify methods and procedures in sufficient detail to allow others to reproduce the results.
b. Statistics
Describe statistical methods with enough detail.
When possible, quantify findings and present them with appropriate indicators of measurement
error or uncertainty (such as confidence intervals).
Specify the statistical software package(s) and versions used.
v. Results
Results should be in logical sequence in the text, tables, and figures, giving the main or most
important findings first.
All the data in the tables or figures should not be repeated in the text; only the most important
observations should be emphasize or summarized.
Restrict tables and figures to those needed to explain the argument of the paper and to assess
supporting data.
vi. Discussion
It is useful to begin the discussion by briefly summarizing the main findings, and explore possible
mechanisms or explanations for these findings.
Emphasize the new and important aspects of the study and putting the findings in the context of the
totality of the relevant evidence.
Link the conclusions with the goals of the study.
vii. References
Direct references should be provided to original research sources whenever possible.
References should be numbered consecutively in the order in which they are first mentioned in the
text.
- Because policy makers are constrained by time and overwhelmed by various sources of information,
they are likely to make quick decision by selecting the evidence most appropriate to their political
leanings.
iv. Press-release
- The media is a crucial audience for research findings because it is both a target for and dissemination
of research evidence.
- The media can reach stakeholders that research teams cannot.
- They can popularize findings, pres government for change and highlight inequities or programmes
that are not working.
- However researchers must be aware that the media can be too sensational with chances of reporting
twisted facts. For these reasons, one of the best way to reach media is through a press-release.
- In general press release can be prepared in no longer than one page summarizing in several lines
major findings, justifying why the research findings deserve publication.
v. Other approaches
- Scientific seminars
- Community presentations
- Dissemination workshops
- Websites
- Mass media
One tested way to decide target audience is to classify them into primary and secondary audiences.
- Primary audiences are those who need to make a decision or a change.
- Secondary audiences are those in a position to influence the decisions or actions of the primary
audience.
The level of audience (primary or secondary) is determined by the dissemination objectives.
An easy way to decide the target audiences is on the basis on dissemination objectives as follows:
Target Audiences Dissemination objectives Approach of
dissemination
1 Policy Makers - To provide policy options Policy briefs
2 Research community - Provide knowledge base to scientific Scientific publication
community in related field Conferences/seminars
3 Ethical review committee - To ensure compliance to ethical Research report
guidelines Scientific publication
Conferences/seminars
According to the guidelines for authorship established by the International Committee of Medical Journal
Editors (ICMJE), all persons designated as authors should qualify for authorship, and all those who
qualify should be listed.
The following are some general guidelines, which may vary from field to field
- The order of authorship should be a joint decision of the coauthors.
- Individuals who are involved in a study but dont satisfy the journals criteria for authorship, should be
listed as contributors or acknowledged individuals. Examples include: assisting the research by
providing advice, providing research space, departmental oversight and obtaining financial support.
- For large multi-center trials, the list of clinicians and centers is typically published, along with a
statement of the individual contributions made. Some groupd list authors alphabetically, sometimes
with a note to explain that all authors made equal contributions to the study and publication.
Publication Ethics
ii. Plagiarism
- One of the most common types of publication misconduct is plagiarism
- Plagiarism occurs when one author deliberately uses anothers work without permission, credit, or
acknowledgement.
- Plagiarism takes different forms, from literal copying to paraphrasing someone elses work and can
include data, words and phrases or ideas and concepts.
- When it comes to publication, it is essential to credit the work of others as a critical part of the
research process.
v. Salami Slicing
- Unlike duplicate publication, which involves reporting the exact same data in two or more
publications, salami slicing involves breaking up or segmenting a large study into two or more
publications.
- As a general rule, as long as the slices of a broken up study share the same hypotheses, population
and methods, the slices are not acceptable for publication more than once.
Plagiarism
- Plagiarism occurs when one author deliberately uses anothers work without permission, credit, or
acknowledgement.
- Plagiarism takes different forms, from literal copying to paraphrasing someone elses work and can
include data, words and phrases or ideas and concepts.
- Plagiarism has varying different levels of severity such as:
a. How much of someones work was taken- a few lines, paragraphs, pages, the full article?
b. What was copied- results, methods or introduction section?
- Providing credit for the work of others is a critical part of the research process.
Forms of plagiarism
Forms of plagiarism What is it? Key notes
Literal Copying Reproducing someones work word for Literal copying is only acceptable if
word, in whole or in part, without the source is referenced and
permission and acknowledgment of the quotation marks are put around the
original source. copied text.
Substantial Copying This can include research materials, "Substantial" can be defined as both
processes, tables, or equipment quantity and quality of what was
copied. If the research work captures
the essence of another's work, it
should be cited.
Preventing plagiarism
- Keeping track of sources used while researching and using it in a paper.
- Fully acknowledging and properly citing the original source in the paper.
- Using quotation marks around word for word text and referencing properly.
- Comparing the paraphrasing with the source to make sure the intended meaning is retained.
The overall goal of a research critique is to formulate a general evaluation of the merits of a study and to
evaluate its applicability to public health practice. A research critique goes beyond a review or summary
of a study and carefully appraises a studys strengths and limitations. The critique should reflect an
objective assessment of a studys validity and significance. A research study can be evaluated by its
component parts, and a thorough research critique examines all aspects of a research study. Some
common questions used to guide a research critique include:
6 Sampling - Are the size and key characteristics of the sample described?
- Is the sampling method appropriate?
- Were the participants suitable for informing research?
- How representative is the sample?
7 Methods and Design - Are the study methods described?
- How were the data collected?
- Are the data collection instruments clearly described?
- Were the instruments appropriate measures of the variables under
study?
- Describe and evaluate the validity and reliability of the instruments
8 Analysis - How were the data analyzed?
- Do the selected statistical tests appear appropriate?
- Is a rationale provided for the use of selected statistical tests?
9 Results - What were the findings of the research?
- Are the results presented in a clear and understandable way?
- Discuss the interpretations of the study by the authors
- Are the interpretations consistent with the results?
- Are study limitations addressed?
10 Conclusions and - Were the conclusions accurate and relevant to the problem the
recommendations authors identified?
- Were the authors recommendations appropriate?
11 Public Health - How does the study contribute to the body of knowledge?
Significance and - Discuss implications related to practice/education/research
Applications - What additional questions does the study raise?
Qualitative research is a type of formative research that offers specialized techniques for obtaining in-
depth responses about what people think and how they feel. It enables the program management to gain
insight into attitudes, believes, motives and behaviours of the target population.
- For example: a study on womens views and experiences on the mental health effect of unsafe
abortion following an unplanned pregnancy.
- Another example is the study on womens experience of delivery at home.
i. Positivism:
- It is based on the natural sciences.
- Theories and hypotheses are tested and verified or falsified.
- Neutrality and objectivity are characteristics of this approach where personal biases are intended to
be avoided.
- Positivist research usually employs quantitative statistical methods and claims to provide objective
scientific knowledge.
- Interpretivist researchers criticize this approach, as it is lacking in everyday subjective interpretations
or context.
ii. Post-positivism
- This paradigm accepts that society is really imperfect and that absolutes are difficult to establish, but
it still strives for objectivity.
- Post positivist research often combines qualitative (non-numerical) and quantitative (numerical)
approaches to data collection and analysis.
- Post-positivists recognize that all knowledge is fallible, but nevertheless insist that it is possible to
identify some knowledge claims as more likely to be true than others.
- The feminist standpoint, action research and phenomenology are influenced to some extent by critical
theory.
iv. Constructivism
- The basic assumption guiding the constructivism paradigm is that knowledge is socially constructed
by people active in the research process, and that researchers should attempt to understand the
complex world of lived experience from the point of view of those who live it.
- The constuctivist paradigm emphasizes that research is a product of the values of researchers and
cannot be independent of them
ii. Ethnography
- Ethnography involves the collection and analysis of data about cultural groups. The end purpose of
ethnography is the development of cultural theories.
- In ethnographic research, the researcher frequently lives with the people and becomes a part of their
culture.
- The researcher explores with the people their rituals and customs.
- An entire cultural group may be studies or a subgroup in the culture.
- Ethnographers interview people who are most knowledgeable about the culture. These people are
called key informants.
- Data are generally collected through participant observation and interviews.
iv. Case-Studies
- Case studies are in-depth examinations of people or groups of people.
- A case study can also examine an institution, such as hospice care for the dying.
- In public health, case studies have frequently been concerned with a particular disease or health
related states and events.
- For a case study to be considered as a qualitative study, the researcher must be interested in the
meaning of experiences to the subjects themselves, rather than in generalizing results to other
groups of people.
- Data may be collected in case studies through various means such as questionnaires, interviews,
observation or written accounts by the subjects. Content analysis is used in evaluating the data from
case studies.
Defining Behaviour is described as seen from the Behaviour described from a vantage external
assumptions perspective of cultural insiders to the culture.
and goals
Describe the cultural system as a Describe the ways in which cultural variables
working whole fit into general causal model of a particular
behavior
Typical Observations recorded in a rich Focus on external, measurable features that
features and qualitative term that avoid imposition of can be assessed by parallel procedures at
methods the researchers constructs different cultural sites.
Long-standing wide-ranging observation Brief, narrow observation of more than one
of one setting or a few setting setting, often a large number of settings
Examples of Ethnographic fieldwork; participant Multisetting survey; cross-sectional
typical study observation along with interviews. comparison of responses to instruments
types measuring health perceptions and related
variables.
Limitations
- Data is collected from a few cases or individual, which means that findings cannot be generalized to
the larger population.
- Research quality is heavily dependent on the individual skills of the researcher.
- Rigour is more difficult to maintain, assess and demonstrate.
- The volume of data makes analysis and interpretation time consuming.
- It is not well understood as quantitative research. It is therefore often more difficult to convince others
of the importance of its contribution.
Flexibility in Study design is stable from beginning Some aspects of the study are flexible (for
study design to end example, the addition, exclusion, or wording
of particular interview questions)
Participant responses do not influence Participant responses affect how and which
or determine how and which questions questions researchers ask next
researchers ask next
Study design is subject to statistical Study design is iterative, that is, data
assumptions and conditions collection and research questions are
adjusted according to what is learned,
Methods Research can take place even without Research generally takes place in the field
direct contact with the participant, as in and involves face to face encounters with the
the case of telephone or mailed survey participant.
Results and Results tend to summarize patterns of Results are in-depth explanations for
analysis similarities, variability, size, direction patterns of behavior
and/or significance of any differences
between specific groups
In-depth Interview
The in-depth interview is a technique designed to elicit a vivid picture of the participants perspective on
the research topic.
During in-depth interview, researchers engage with participants by posing questions in a neutral manner,
listening attentively to participants responses and asking follow up questions and probes based on those
responses.
They do not lead participants according to any preconceived notions, nor do they encourage participants
to provide particular answers by expressing approval or disapproval of what they say.
In-depth interviews are usually conducted face-to face and involve one interviewer and one participant.
ii. Interactive:
- The material is generated by the interaction between the researcher and participant in the sense that
what the researcher asks about, and the way they frame questions, is driven to a large degree by
what the participant says.
iv. Generative
- The in-depth interview is generative in the sense that new knowledge or thoughts are likely to be
created. The interview may also be generative in the sense that participants put forward ideas and
suggestions on a particular topic and propose solutions for problems raised during the interview.
v. Importance of language
- In-depth interview focuses on how participants express themselves. The language used by
participants is explored because it holds and elucidates meaning. To capture this as effectively as
possible, interviews as generally audio-recorded.
Strengths
- Elicits in-depth response, with nuances and contradictions
- Gets at interpretative perspective i.e, the connections and relationships a person sees between
particular events, phenomena, and beliefs.
Focus group discussion is a unique method of qualitative research that involves discussing a specific set
of issues with a pre-determined group of people.
Following are the five principles that guide qualitative data analysis
i. People differ in their experiences and understandings of reality:
- The participants often have different understandings of reality, and that their perspectives may differ
substantially from the researchers assumptions.
- In analysis, researcher should take account of the following:
Be aware of own perspectives and take account of them in field notes and bracket them in
transcripts.
Return to participants to validate what has been understood
Note what is thought as emerging explanations and check them against raw data
Work closely with key informants during analysis
iii. Exceptional cases may yield insight into a problem or new leads for further inquiry
- Although analysis may seek common ground or consensus across different individuals or groups, it is
equally important to understand how and why individuals or groups differ with respect to issues under
study.
- Identifying and tracking exceptions may yield important insights and lead to a better understanding of
the research problem.
There are several broad ways of analyzing qualitative data. Some of the important approaches to public
health practice are discussed below:
i. Content analysis
- Content analysis refers to a general set of techniques useful for analysing and understanding certain
words or concepts within texts or sets of texts.
- Researchers quantify and analyze the presence, meanings and relationships of such words and
concepts, then make inferences about the messages within the texts, the writer(s), the audience, and
even the culture and time of which these are a part.
- Mayring proposes two different approaches for qualitative content analysis according to researchers
approaches.
a. Inductive category development
b. Deductive category development
Open coding: It is the initial step that includes comparison of incident with other incidents in terms
of similarity and differences, giving conceptual labels to incidents, and grouping those concepts
together into categories.
Axial coding: In axial coding, researchers relate categories with their sub-categories, test the
relationships against data and test the hypothesis.
Selective coding: It refers to the process by which researchers select one or more categories
intended to generate a story that connects the categories.
e. Theoritical Saturation: This refers to the point when no further coding is necessary because no new
instances are required to confirm a category, and/or when no new data collection is required as there
is sufficient confidence about the nature of the emerging concepts.
f. Constant comparison: This is the process whereby the data and the subsequent conceptualizations
from it are compared to ensure that there is a good fit. This happens throughout data analysis.
According to Lincoln and Guba (1985), trustworthiness basically means how an inquirer can persuade his
or her audiences that the findings of an inquiry are worth paying attention to.
The qualitative research outlines four primary criteria in order to determine the trustworthiness of research
data. This consists of credibility, transferability, dependability and conformability.
i. Credibility:
- In qualitative research, credibility and authenticity refer to internal validity. Credibility is often linked to
the concept of truth value.
- The researcher asks: Are the findings credible to the people under study? And Do I have an
authentic portrait of what I am looking for?
- A studys credibility is said to be confirmed when the reader recognizes the situation described by a
research study as closely related to their own experiences.
ii. Transferability:
- Transferability and/or fittingness in a qualitative research refer as the degree to which the results of a
study can be generalized to other settings or samples.
- The researcher asks: Are the conclusions of the study transferrable to other contexts? Do they fit?
- S/he helps to provide a detailed database and thick description so that someone else can determine
whether the findings of the study are applicable to another context or setting
iii. Dependability:
- Dependability is another criterion to ensure the trustworthiness of the study. It roughly corresponds to
the concept of relaibaility in quantitative research.
- This requires an inquiry audit. The enquiry auditor generally a peer follows the process and a
procedure used by the researcher in the study and determines whether they are acceptable, that is
dependable.
iv. Confirmability:
- Confirmability captures the traditional concept of objectivity.
- Confirmability guarantees that the findings, conclusions and recommendation are supported by the
data and that there is internal agreement between the investigators interpretation and the actual
evidence. This is accomplished by incorporating and audit procedure.
i. Audit trail
- The audit trail provides a mechanism for subsequent reviews by other researchers and has been
identified as the single most important trustworthiness techniques.
- It established both dependability and credibility.
- An audit trail is systematically maintained documentation system that consists of raw data, products
of data analysis, including coding procedures, products of data reconstruction and synthesis and
process notes.
- Because it explicates the research process, it can be reviewed by other researchers to attest to the
trustworthiness of the research.
ii. Field Notes
- Maintaining field notes entails the recording of comprehensive and detailed information, sometimes
referred to as thick descriptions.
- The use of field notes ensures that important information from the researchers personal experiences
in the study are incorporated into the process of analysis.
iii. Memos
- Memos are used throughout the qualitative research process to record personal biases, assumptions
and feelings.
- This approach serves to record the researchers thoughts, perspectives, intuitions and preliminary
ideas regarding the ongoing investigation and also safeguards the loss of important ideas.
iv. Triangulation
- Triangulation is defined as the researchers effort to collect information from a diverse range of
individuals and settings, using a variety of methods in order to construct appropriate explanations of
the phenomena being studied.
- Information collected from a variety of sources is compared and contrasted and serves to protect the
accuracy of data interpretation.
- It minimizes the possibility of arriving at erroneous interpretations and conclusions.
Triangulation refers to the use of multiple methods or data sources in qualitative research to develop a
comprehensive understanding of phenomena (Patton, 1999).
Triangulation also has been viewed as a qualitative research strategy to test validity through the
convergence of information from different sources.
Types of triangulation
Denzin (1978) and Patton (1999) identified four types of triangulation:
i. Method triangulation:
- Method triangulation involves the use of multiple methods of data collection about the same
phenomenon.
- This type of triangulation, frequently used in qualitative studies, may include interviews, observation,
and field notes.
Mixed methods research is a research design with philosophical assumptions as well as methods of
inquiry. As a methodology, it involves philosophical assumptions that guide the direction of the collection
and analysis and the mixture of qualitative and quantitative approaches in many phases of the research
process. As a method, it focuses on collecting, analyzing, and mixing both quantitative and qualitative
data in a single study or series of studies. Its central premise is that the use of quantitative and qualitative
approaches, in combination, provides a better understanding of research problems than either approach
alone.
Creswell and Plano Clark (2011) identified six core characteristics of mixed methods research:
- Mixed methods research collects and analyzes rigorously both qualitative and quantitative data in
response to research questions.
- It mixes (or integrates or links) the two forms of data concurrently by combining them (or merging
them), sequentially by having one build on the other, or embedding one within the other.
- Mixed method research gives priority to one or both forms of data (in terms of what the research
emphasizes)
- Mixed methods research procedures are used in a single study or in multiple phases of a program of
study.
- The research procedures are framed within philosophical worldviews and theoretical foundation.
- Procedures into are combined into specific research designs that directs the plan for conducting the
study.
The four basic mixed method designs are the convergent parallel design, the explanatory sequential
design, the exploratory sequential design and the embedded design.
A decision tree can help identify choices for each of these three decisions
b. Instrument-development variant
- In the instrument development variant, the initial qualitative phase plays a secondary role, often
for the purpose of gathering information to build a quantitative instrument that is needed for the
prioritized quantitative phase.
MISCELLANEOUS
The objective of health system research is ultimately to promote the coverage, quality, efficiency and
equity of health systems.
Health systems research focus primarily upon health policies, organization and programs, but does not
address clinical management of patients or basic scientific research. The prime focus of health system
research is not a specific disease or service, but rather the health system as a whole.
Applications of Health System Research for health policy and system with examples
i. Formative researches in health systems, might for example, address how clients perceive their
interactions with the health system and how health services could be made more responsive to them.
Such research is unlikely to feed directly into a particular policy decision but can help shape policy
responses.
ii. Health systems research can contribute to the development of evidence-based policy and practices in
many different ways at the national and sub-national level.
iii. Sometimes policy makers will commission specific pieces of research to enable them to develop
policy ideas into full blown proposals. For example in the process of developing the Thai universal
coverage scheme, research was commissioned to help the government plan how to implement the
policy. This included research to help estimate the cost of implementing the new scheme, and how
best to organize the scheme.
iv. Health system research can also play a role in monitoring a evaluating existing interventions. For
example, the Global HIV/AIDS Initiative Network, research in twelve different countries were
proceeded, in order to assess the impact of global HIV/AIDS initiatives on health systems.
v. The Commission on Macro-economic and Health did a little primary research, but it synthesized the
findings of a large number of studies on the links between health and economic development, and as
a consequence highlighted the importance of investment in health for economic development.
vi. Health systems research can contribute to the development of evidence-based policy and practices in
many different ways at the national and sub-national level.
Quality Assurance in research includes all activities that are aimed at ensuring the quality.
Quality assurance in research takes place in overall process of the research cycle.
i. Quality assurance measures prior to data collection
- Recruiting technically qualified and competent persons to undertake research task
- Selecting standardized instruments and calibration to check the precision and bias
- Developing and maintaining standard definitions, classifications, frameworks and methodological
tools.
- Training of investigators