Professional Documents
Culture Documents
Chapter 3
Learning Outcomes
After studying this chapter, you should be able to:
5. Identify and deal with diverse opinions in research papers during the
literature review process by comparing and contrasting the evidence
for opposing academic viewpoints.
7. Describe how the conceptual model and literature review relate to the
research process as a whole.
3-1
Masters Level Module – Research Methods
3.1 Introduction
Conceptualisation is one of the distinguishing features of academic
research, central to its actual and perceived rigour. Comprehensive
conceptualisation of a research problem is fundamental to the sound
design of a research project. Without conceptualisation, it is not practical
to design a precise research project nor is it feasible to rigorously collect
data or analyse any findings. In this chapter, we define conceptualisation
in a research context and describe the conceptual model using an
illustrative metaphor. We also examine a methodology for reviewing
academic papers and show how the distinct activities of literature review
and conceptualisation can be integrated. Finally we look at the issues to
be considered when comparing literature, with particular emphasis on
handling contradictions.
In the first instance, the conceptual model is the logical ruleset by which
sense is made of the field information. Secondly, the conceptual model
may be a statement of possibilities, from which come the research
questions and their hypotheses. Later in the research process, the
conceptual model will provide the essential frame of reference for the
description and analysis of the findings, and a context within which the
researcher will set the meaning and/or application of the research as a
whole.
3-2
Masters Level Module – Research Methods
Focus
The conceptual model of the proposed research issue has to be focused.
This is not to say the entire picture has to be focused, since different
levels of knowledge may produce different focal depths, variations in
detail and precision of representation. However, the area under
investigation must be focused,.
Completeness
Ideally, the knowledge should be complete in the sense of not having
holes in it; nor should it have overlaps or inconsistencies. Research does
not usually take place in ideal settings, hence it is normal for there to be
gaps, overlaps and inconsistencies in the picture. This is where the
opportunities for further research can be found.
Detail
The level of detail of the picture depends on the type of problem and the
level of field knowledge. Conceptual pictures of poorly defined research
fields could be considered metaphorically as sketches. In a well-defined
field there may be extreme detail. It is important that the researcher
achieves a level of detail and understanding which is compatible with the
field and appropriate for the research project.
Representation
The entire picture should be recognisable as a single picture. The frame
of reference for the picture is drawn by making boundaries around the
image. Unlike the convention of regular boundaries around a picture (the
picture frame), the researcher may set irregular boundaries or identify
patches of exclusion within the picture by making specific limiting
assumptions.
3-3
Masters Level Module – Research Methods
Communication
Research is about communication, hence the concepts must be
communicable and be communicated. The key challenge for the
researcher is to preserve their picture as they translate it into writing for
the customer of the research.
PF3.1
How does the metaphor of a picture help to communicate the features of
a conceptual model? What kinds of purpose does such a model serve?
Activity
The picture in the mind analogy could probably be extended further, for
example by looking at more detailed issues such as what colour might
represent, say in terms of consistency of schools of thought or types of
data. Perhaps variations in richness across the entire picture, perspective
(2D or 3D?), would help with the analysis of the turbulent research field
with a variable quality of literature? Are there research issues analogous
to a moving picture, or jigsaws, or wide angle, portrait or
landscape/panoramic views on information which could be explored?
Would it be worth producing a meta-model, that is a model of how other
models fit together or producing images of how other pictures fit
together?
3-4
Masters Level Module – Research Methods
To avoid the literature review phase of the project being just a collection,
filtration and re-emission of existing work, it is essential to have a plan
for the information needs. Literature reviews only really serve research
projects where they are used in direct support of the development of a
conceptualisation phase of the research. During conceptualisation of the
research issue, you integrate the experiences you bring to the research
with the information that your review of existing third party information
sources uncovers.
3-5
Masters Level Module – Research Methods
Properly designed, these can be used for the review of most forms of
academic paper.
Main Points
Are the main points in the paper consistent and supported by evidence or
defensible conceptual founding?
Do you agree with them and do they support or contest your existing
concepts/ evidence?
Meaning
Is the meaning of the paper clear and realistic?
In what aspects is the meaning not clear, and is this because of a lack of
theory or evidence, or simply poor explanation or incomplete research?
3-6
Masters Level Module – Research Methods
How can you address this in your research? What do you think the
meaning of the data should be?
Concepts
What is the underlying conceptual model and terms of reference which
the author has used for the study? Are the key concepts clearly
discussed?
Which other key conceptual models from the research field that you are
aware of are comparable? How do these other concepts compare, and
how do they contrast? Do you agree with the author’s conceptual model
and the implicit or explicit assumptions? Are the key variables identified
and their inter-relationships explicitly discussed and reasonable?
Explain your reasons and the significance of any differences of opinion.
Data
Are you satisfied with the method of data collection?
3-7
Masters Level Module – Research Methods
Are you satisfied with the data quality and quantity? Are the data
appropriate for the study?
Does the data provide a direct reference for the analysi s of your data?
Data Analysis
Is the analysis of the data harmonic with the confidence levels in its
collection and inherent quality? Are the findings reasonable and realistic,
are they discussed in terms of validity and limitations? Are all the control
variables discussed? Are the conclusions consistent with the data and
hypotheses?
What do the findings mean for your study, and how do they relate to any
other comparable studies/ data that you are aware of? Does the
discussion of the evidence indicate any particular problems with
collection, validity, or analysis requirements?
Referencing
Are the references properly cited? Could any of the references provide
useful leads for your study?
Are there any significant references with which the study is inconsistent,
or over-reliant? Are there any key sources missing from the conceptual
defence in the paper? How would you change the reference choice?
Discussion
Are the discussion points and conclusions valid? Do they extend your
knowledge?
Do you agree with the discussion points and conclusions? What are the
theoretical and/ or practical implications of the results? How has your
conceptual understanding changed because of reading this paper? Do
you need to make any changes to your research design and/ or
conceptual assumptions?
3-8
Masters Level Module – Research Methods
Overall Importance
Now rank the paper according to its importance to your research. Note
also whether it is formative and does not need to be used again, or
whether it has an ongoing usefulness (including assisting with
establishing the terms of reference for your discussion).
Now do an analysis of the significance of the paper. What are the main
strengths of the paper? What are the main weaknesses of the paper?
What challenges does it raise for your existing concepts/ evidence/
proposed research? How opportunities does it raise?
Futures
Does the paper alert you to any information or requirements for
information which were hitherto unidentified? Does it raise issues which
require you to review any other papers? Does it indicate any particular
problems or risks to your research project/ process? Does the paper give
you any new ideas about the approach to the research (or challenge your
assumed approach)?
In what way does the paper add to the existing body of knowledge? Is it
contemporary? How could the paper be improved?
At the end of this chapter, you will find the parameters for evaluation set
out in the form of a checklist. You may find it useful to photocopy this
checklist and use it with the papers that you have identified as being
relevant to your research topic.
3-9
Masters Level Module – Research Methods
PF3.2
What differentiates the conceptualisation process from a literature
review?
PF 3.3
What are the key components of an academic paper that you should
consider when reviewing it?
3-10
Masters Level Module – Research Methods
3.4.2 Contradiction
Since the first information sources which the researcher examines tend to
set the approach to the conceptualisation, it is worth deliberately
collecting together a variety of papers which approach the issue from
differing perspectives, with the aim of making a specific exercise of
comparing and contrasting their approaches, their inherent and explicit
assumptions, and their findings. This diversity of approach will assist you
in taking a broad view of your own findings and in presenting the field
literature in a relatively neutral form. In doing so, you will need to deal
with contradictions in the field literature.
At the end of this chapter, you will find another checklist which should
help you deal with contradictory theories.
3-12
Masters Level Module – Research Methods
3-13
Masters Level Module – Research Methods
3-14
Masters Level Module – Research Methods
PF3.4
Write keyword notes on the issues to be considered when comparing
literature
3.5 Summary
You should now be familiar with the principles of conceptualisation and
the review of academic literature. When you have worked through the
checklists at the end of this chapter, you will have made a structured
analysis of an academic paper and should understand how to identify and
deal with diverse opinions presented in research papers. You should also
be able to compare and contrast the evidence for opposing academic
viewpoints and make a critical appraisal of academic theories in the
literature. It should also be clear how the creation of a conceptual model
and the literature review relate to the research process as a whole. These
3-15
Masters Level Module – Research Methods
The next stage of the research process involves the definition of a precise
research topic. This will be based on the structured analysis of the field
literature using the techniques outlined in this chapter. Your
conceptualisation of the research issues will allow you to design a
research question and identify the hypothetical answers to your question.
Based upon this you will be able to design the remainder of the research
project. The selection of research questions can be facilitated by a variety
of techniques for generating ideas, which will be introduced in the next
chapter.
Bell, J. 1993 Doing Your Research Project: A Guide For First Time
Researchers in Education and Social Science Open University Press (2nd
Edition) ISBN 0-335-19094-4. A good introductory text on literature
review (see pp 33-51).
3-16
Masters Level Module – Research Methods
Date:
How well does the title and abstract correspond to the content of the
paper?
Does the abstract relate well to the content of the paper? If not, why not?
3-17
Masters Level Module – Research Methods
Does the paper explicitly identify any areas of research which are
exhausted, unworthwhile, or unresearchable?
2. Main Points
Date:
Are the main points in the paper consistent and supported by evidence or
defensible conceptual founding? What are they?
3-18
Masters Level Module – Research Methods
Do you agree with them and do they support or contest your existing
concepts/ evidence? Discuss the contentions in detail, together with your
thoughts for their solution and/ or implications.
3-19
Masters Level Module – Research Methods
3. Meaning
Date:
In what aspects is the meaning not clear, and is this because of a lack of
theory or evidence, or simply poor explanation or incomplete research?
3-20
Masters Level Module – Research Methods
4. Concepts
Date:
3-21
Masters Level Module – Research Methods
Which other key conceptual models from the research field that you are
aware of are comparable?
Do you agree with the conceptual model and the implicit or explicit
assumptions?
3-22
Masters Level Module – Research Methods
5. Structure/ Design
Date:
Is the emphasis placed upon the various aspects of the research correct
and consistent with the findings and their application?
3-23
Masters Level Module – Research Methods
How does this approach relate to the process conventions of the field?
Date:
3-24
Masters Level Module – Research Methods
3-25
Masters Level Module – Research Methods
7. Data
Date:
Are you satisfied with the data collection (methodology)? If not, why
not?
3-26
Masters Level Module – Research Methods
Does the data provide a direct reference for the analysis of your data?
8. Data Analysis
Date:
Is the analysis of the data harmonic with the confidence levels in its
collection and inherent quality? If not, what significance does this have?
3-27
Masters Level Module – Research Methods
Are the findings reasonable and realistic, are they discussed in terms of
validity and limitations?
What do the findings mean for your study, and how do they relate to any
other comparable studies/ data that you are aware of?
3-28
Masters Level Module – Research Methods
9. Referencing
Date:
Could any of the references provide useful leads for your study? Which
ones?
Are there any significant references with which the study is inconsistent,
or over-reliant?
3-29
Masters Level Module – Research Methods
Are there any key sources missing from the conceptual defence in the
paper?
10. Discussion
Date:
3-30
Masters Level Module – Research Methods
Are the discussion points and conclusions valid? If not, why not?
3-31
Masters Level Module – Research Methods
Date:
Now rank the paper according to its importance to your research. Note
also whether it is formative and does not need to be used again, or
whether it has an ongoing usefulness (including assisting with
establishing the terms of reference for your discussion)
Now do an analysis of the significance of the paper. What are the main
strengths of the paper? What are the main weaknesses of the paper?
What challenges does it raise for your existing concepts/ evidence/
proposed research? How opportunities does it raise?
3-32
Masters Level Module – Research Methods
In what way does the paper add to the existing body of knowledge? Is it
contemporary? How could the paper be improved?
Choose an issue related to your research field and with which you are
sufficiently familiar to have identified some differences in opinion or
theory.
3-33
Masters Level Module – Research Methods
3-34
Masters Level Module – Research Methods
3-35
Masters Level Module – Research Methods
Comparing your reasoning for selecting the theories you agree with and
those which you disagree with, identify the pivotal issues which are
contentious for you:
3-36
Masters Level Module – Research Methods
Record here your initial opinion on the pivotal issue and your reasoning
behind it:
3-37
Masters Level Module – Research Methods
Now select at least two papers which take contrasting views on the
pivotal issue, and appraise their opinion and reasoning using the literature
critique structure outlines earlier in this chapter.
Identify the evidence for and against the contrasting views on the pivotal
issue. Record each piece of evidence below, together with a statement
about your opinion on the strength of the arguments for and against:
1.
3-38
Masters Level Module – Research Methods
2.
3.
4.
5.
3-39
Masters Level Module – Research Methods
Has your opinion changed from your initial position? If it has, how and
why?
3-40
Masters Level Module – Research Methods
Is there any obvious need for further research work? If so how would you
propose to design the study?
3-41