Professional Documents
Culture Documents
Methods
Research
Methods
PSYA1: Cognitive Psychology,
Developmental Psychology and Research
Methods
This booklet contains descriptions and evaluations of anything to do with
research methods, alongside guidance on how to put things into practice.
1
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Contents
What the specification says: 2
Research in psychology; aims, sampling, ethical issues, validity, 4
reliability, pilot studies
Methods in Psychology:
Experiments 12
Correlations 21
Self-reports (questionnaires and interviews) 25
Observations 30
Content analysis 37
Case studies 39
Analysing and presenting data: quantitative and qualitative data, 40
central tendency, dispersion, presenting quantitative and qualitative
data
2
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
4
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Research in psychology
All research will begin with an aim. This is written as a formal statement of what
you intend to investigate. Sometimes researchers will have one specific aim other
times there may be several aims linked to the overall aim.
Having stated your aim(s), you will also need to select a sample, ensure your
research is ethical, valid and reliable and that you have piloted your study to
make sure it works.
Sampling
Your sample refers to the participants who take part in your study. Your sample
should be made up of people who are representative of your target population –
the whole group of people you want to apply your results to. If your sample is
representative, you can generalise your findings, but if it is not representative, it
is biased and you cannot generalise results.
Self-selecting sampling
Participants volunteer themselves to take part.
This can arise as a consequence of many different methods – e.g. response to a
newspaper advertisement, poster placed in a public place or announcement on a
radio station etc.
Strengths Weaknesses
The participants are giving consent by Could be biased as the same type of
volunteering; therefore it reduces any people are likely to apply to take part -
ethical issues e.g. may all read the same newspaper.
5
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Random sampling
The researcher has access to all members of the identified target population-
e.g. via a sampling frame such as the electoral register, college list etc. Selection
of participants is then based on:
manual selection (names from a hat)
the use of random number tables
computer-generated selection
Strengths of Weaknesses of
There’s a much better likelihood of The sample may still be biased –
obtaining a representative sample as all especially if it’s a small sample
members of the target population have
an equal chance of taking part It’s more time consuming than
opportunity sampling
It’s relatively easy for a small target
population
Opportunity sampling
Participants are selected depending on their availability at the time of carrying
out the study. At university, researchers often use the undergraduate students
as they are available and often around the department.
Strengths Weaknesses
Quick, easy, inexpensive and May not be representative of the wider
convenient as all the participants are target population because the people
gathered in one place at the same time. who are available at the time/place of
the study may differ from those who
are unavailable.
7
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Ethical issues
These are the guidelines set out by the BPS British Psychological Society which
tell psychologists how they can and can’t treat participants in research.
When designing practicals, you need to be able to:
Identify possible ethical issues/problems with the research
Explain how you would deal with these issues to make your study ethical
Ethical issues can, where appropriate, include:
lack of consent from participants/informed consent,
age of participants [over 16]
confidentiality of the data
withdrawal, debriefing
avoiding stress, distress, harm or embarrassment to participants
invasion of privacy; (observations are allowed in public places where people
would expect others to be watching them)
Validity
Validity refers to the extent to which a study or test measures what it intends
to. One way to test validity is to look at whether it gives similar results to other
studies that have gone before or other measures of the same variable – this is
called concurrent validity (concur means to agree). Studies with a lot of demand
characteristics or confounding variables often have low validity.
Assessing validity
Predictive validity:
Predictive validity refers to whether the test will predict future performance
indicated by its results.
For example, high scorers on an I.Q. test at a young age should he predicted to
later perform better in studies or jobs requiring intelligence.
Face validity:
Involves examining the content of the test to see if it looks like it measures what
it is supposed to measure. This is generally done by asking other academics to
8
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
look over your work and access it in terms of validity. The idea is that “two heads
are better than one”
Concurrent validity:
Involves comparing a new method or test with an already well-established one
that claims to measure the same variable(s). A high positive correlation should he
gained between the results of the two tests. For example, correlating the results
from the same people tested by a new intelligence test and an older established
one.
Researcher bias: the extent to which the researcher can influence/distort the
outcomes of a study. When attempting to eliminate/evaluating researcher bias,
consider the use of double blind testing (when the participants do not know the
aim of the research and you use independent researchers to carry out the study
who also know nothing about what you are aiming to find out), type of data
collected (qualitative or quantitative – which involves more subjective
interpretation?)
Participant bias: the extent to which the participant can influence/distort the
outcomes of a study. When attempting to eliminate/evaluating participant bias
consider the effect of double and single blind testing, demand characteristics,
social desirability, distractor tasks
Task: to what extent does the task itself accurately measure the behaviour
being studied?
Internal validity can be checked through testing for concurrent validity (by
checking the results of one test against the results of another similar test), face
validity (assessing whether you are measuring what you intended to measure),
checking by other academics
External validity: the extent to which a study and its findings can be applied
beyond the research situation
9
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Ecological validity: does the task and setting reflect real life situations. Can we
generalise and say similar results would be found in the real world?
Population validity: does the sample of participants represent the type of people
we’d apply the results to in the real world. Can we generalise and say other people
would produce similar results?
Reliability
Reliability refers to the extent to which a study or measure is consistent/would
produce similar results when repeated/carried out by others. To be reliable a
study will have to be replicable. If reliability is low, validity also tends to be low –
but not always!
When you assess the reliability of a measure, you should consider the
following:
Were standardised procedures used?
Were standardised instructions used?
Were the tasks standardised?
Was the scoring/measurement standardised?
Were there any problems or biases in the way that the tests were
administered that prevented them being standardised?
Would you get the same results again with a similar group of participants?
Was there any test of inter-rater reliability* (for observational measures)
Are there any problems interpreting the results of the test or measure?
Test re-test reliability: whether a test can be repeated and produce similar
results. . It is particularly important when developing and making sure a
questionnaire is reliable. This is done by repetition of the original research,
identical in every way, and analysing the results to see if they are the same as
the original study
10
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Pilot studies
These are practice studies carried out on a small scale to see if your research
will work as you want it to. It enables you to identify problems that you can put
right before carrying the research out fully. They are useful to check things like:
Do your participants understand your instructions?
Can they do your tasks in the time allowed?
Are the tasks too easy/difficult?
Do they understand your questions?
Do you need to rephrase/add/remove questions?
Do you need to alter your behaviour categories?
11
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Methods in Psychology
Experiments
Aim to see if a change in the dependent variable (measured behaviour) was caused
by an independent variable
IV is the thing we think is the cause of a behaviour/change in
behaviour
DV is the behaviour we are interested in studying
Control extraneous variables so we can be confident they haven’t affected the
DV
Usually compare different conditions (with/without the IV)
Test a hypothesis/a number of hypotheses
Laboratory experiments
IV is manipulated by the researcher whilst the DV is measured and extraneous
variables are controlled so that we can identify cause and effect
Structured and standardised procedures – increasing replicability
Carried out in an artificial setting which is controlled by the researcher
Strengths Weaknesses
Allows cause and effect to be Low ecological validity in a controlled
identified i.e. we can say the DV environment or using unrealistic tasks
change was caused by the IV because
we can rule out the influence of Possibility of participant bias such as
extraneous variables. demand characteristics and social
desirability influencing results
12
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Strengths Weaknesses
More ethical way to study and IV Lower researcher control over
because it’s naturally occurring participant variables so it may be harder
to show cause and effect
Groups occur naturally so we get more
population validity because the groups Participants may realise what’s being
really exist studied and display demand
characteristics
Field experiments
Have an IV which is usually manipulated by the researcher, but sometimes is
naturally occurring
DV is measured
This is a study carried out in surroundings which are relatively natural/familiar
for the participants but may be controlled in some way.
Strengths Weaknesses
Higher ecological validity so we may be Harder to replicate so it’s difficult to
more able to generalise findings to real show the study is reliable
life
Lower researcher control so it’s
Low demand characteristics if harder to show cause and effect
participants don’t know they are being
studied Possible ethical problems (consent,
deception, debriefing)
13
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Two tailed/non-directional
This predicts that the IV will affect the DV but does not say how – therefore it
only predicts a difference between conditions
14
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Operationalising variables
Any hypothesis you write must refer to both variables and how they were
operationalised:
E.g. if you were carrying out an experiment to test whether chewing gum affects
concentration, a possible experimental hypothesis could be:
‘there is a difference in the number of differences found in a spot the
difference puzzle between those chewing gum and those not chewing gum’.
Experimental Designs
Experiments usually involve comparing performance under different conditions.
There are different ways of allocating participants to conditions known as
experimental designs.
Strengths Weaknesses
avoids order (or carry over) effects participant variables are not fully
when participants are only involved in controlled
one condition
need more participants overall
The aim of the research is less likely to
be assumed by participants (lowering
demand characteristics).
The task can remain the same across
conditions controlling for complexity
etc.
15
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Strengths Weaknesses
controlling for individual differences there may be carry-over/order effects
in the behaviour being studied that affect performance in the second
between the ps; condition (such as practice gained from
having done a similar task already or
Fewer participants required overall. fatigue)
Strengths Weaknesses
extraneous participant variables are less It can be hard finding people who
likely to interfere with the experimental match, so you may waste a lot of
16
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
17
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Participant variables:
Variables that are connected with any characteristic of participants which could
affect their performance on the DV, i.e.age, intelligence, motivation, experience,
gender and personality
Solutions:
Matched pairs design
Randomly assigning participants to conditions
Single blind design
Situational variables:
Variables connected with the research situation that could affect participants’
performance on the DV, i.e. temperature, instructions, time of day, lighting, noise,
materials used in the investigation, order effects, demand characteristics and
investigator effects
Solutions:
Use of standardised procedures and standardised instructions
18
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Correlations
Correlations describe a relationship between two measured co-variables
(sometimes called independent measures). Correlations may be positive or
negative:
Negative correlation
A negative correlation is where as the values of one variable increase the values
of the other tend to decrease, although not necessarily at the same rate
Positive correlation
A positive correlation is where as the values of one variable increase, related
values of the second variable also tend to increase (although not necessarily at
the same rate)
Strengths Weaknesses
provides information about does not inform us about cause-and-
patterns/trends that can then be effect
investigated more experimentally if
desired
the relationship revealed can be
misleading
can be plotted visually in a scattergraph
to see relationship clearly
some variables cannot be correlated
enables us to make predictions based on (only variables generating continuous
the relationship between variables data can be correlated)
One tailed/directional
This predicts how the co-variables are related by identifying the type of
correlation (positive or negative) you expect to find:
Two tailed/non-directional
This predicts that the co-variables are related but does not say how:
20
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Operationalising variables
Any hypothesis you write must refer to both variables and how they were
operationalised:
E.g. if you were carrying out a correlation to test whether self-rating of
concentration is correlated with actual concentration, a possible alternate
hypothesis could be:
‘There is a correlation between self-rating of concentration measured on a five
point scale (5 = fully concentrating) and actual concentration measured by number
of differences found in a spot the difference puzzle between’.
If you are to describe how one measure relates to another you talk about the
strength of correlation between them. The strength of a relationship is measured
on a scale from using a statistic called a correlation co-efficient. + or – shows the
correlation is positive or negative, and the value shows the strength of the
relationship e.g. -.79 would be a strong negative correlation, but +.3 would be a
weak positive correlation
21
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
22
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Interviews
An interview is similar to a questionnaire, except that the questions are asked
face to face (or over the phone) rather than on paper.
A structured interview is where all respondents are asked the same questions.
An unstructured interview has an overall aim/topic but the questions flow as part
of a conversation.
A semi structured interview combines both structured and unstructured
interviews. The interviewer might have a series of prepared questions, but will
alter the interview as it goes along, adding new questions as information arises.
It’s rather like the interview you have when you go see a doctor, and as such, is
often called a clinical interview.
Strengths Weaknesses
More detailed information can be Interviewer bias may be a particular
obtained from each respondent issue as the interviewer is making up
questions on the spot
Information can be accessed that
might not be revealed by using The interviewer’s own opinions may
predetermined questions. influence the interviewee. This is
called interviewer bias
Questionnaires
A questionnaire is a set of questions that participants fill in themselves. The
researcher may be present or the questionnaire may be posted out to people for
them to return. It is designed to collect information about a topic or topics.
Strengths Weaknesses
You can collect the same information The social desirability bias means that
from a large number of people respondents may deliberately answer
relatively easily. in a way which is socially acceptable
You can access what people think - Because only certain types of people
observations and experiments rely on fill in and return questionnaires, there
“guessing” what people think based on may be a sample bias
their behaviour. With a questionnaire
you can ask people directly. Questionnaires rely on a respondent’s
ability to report accurately. An
An advantage of questionnaires over individual may not have sufficient
interviews is that respondents may insight into their own behaviour to be
feel more able to reveal personal able to record it accurately.
information in a questionnaire than
face to face. Different questions may be
interpreted differently by different
participants.
Strengths Weaknesses
Responses are not restricted – Responses may be difficult to
participants can refer to any aspects interpret/analyse
of the topic being asked about Harder to compare with other peoples’
24
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
responses
More likely to generate rich
qualitative data - allows elaboration of
how/why people gave their particular
response
Closed question
A closed question is one in which individuals select their response from a choice
of predetermined options
Forced choice questions are a specific type of closed question which literally
force participants to choose a definite answer – there is no option to say
sometimes/undecided etc
Strengths Weaknesses
easy to interpret/analyse and present Does not allow elaboration on how/why
people answered the way they did
Can compare participants’ responses
directly Forced choice response may not reveal
full extent of people’s
Tends to produce quantitative data beliefs/attitudes
which is easier to interpret and analyse
Options for responses may be limited
and may not reflect what the
participant really wants to say
Rating scale
These give respondents questions or statements and allow them to say to what
degree the statement applies to them/they agree or disagree.
E.g. A likert scale (statement plus labelled numerical scale)
I get bored quickly: 5 strongly agree
4 agree
3 undecided
2 disagree
1 strongly disagree
Strengths Weaknesses
25
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
26
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Observations
This involves the researcher watching participants and recording their behaviour
in either a natural or manipulated setting. Observations are rarely used as a
research method in their own right in psychology, but are often used as a data
collecting technique in experiments and correlations.
27
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Behaviour sampling
As it’s difficult to observe and record everything that is going on, researchers
use behaviour sampling techniques to determine what they will focus on and how
they will do it
Time sampling
Time sampling involves observations at set lengths of time at set intervals
e.g. in a traffic survey 3 hourly observations between 08.00-09.00, 12.00-
13.00 and 17.00-18.00
eg three hourly observations between 08.00-09.00, 12.00-13.00 and 17.00-
18.00
every 5 minutes for a certain period (eg 1 hour)
Strengths Weaknesses
greater chance of sampling the more time consuming;
behaviour of how a variety of may decrease reliability as it
different people behave in a may be harder to be consistent
specific situation thus increasing if recording behaviour during
representativeness; many different time intervals
ability to ascertain the influence of
time of day on how people behave
in a specific situation
Event sampling
Event sampling involves observations of a specific event each time it occurs
throughout the duration of the observation period
29
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Strengths Weaknesses
less likely to miss things as behaviour is might get difficult to record all
monitored/recorded continuously and all specified behaviours at times and may
occurrences of the behaviours being miss some behaviours whilst
studied are noted, thereby potentially recording other things
increasing the overall validity of the
research, as well as the reliability of its Although there is a lot of data it is
findings often limited in detail, as data has to
be collected and categorised rapidly
Behaviour checklists/categories
Psychologists often use checklists when observing participants. These identify
the categories of behaviours the researcher is looking for and enable the
researcher to quickly record what is happening and to make comparisons across
participants. Categories are often quite general, with some explanation/examples
of what to include as in the example below.
Problems occur when the categories are too narrow or too general or when they
are ambiguous.
30
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Imitation of physical
aggressione.g. hit with mallet,
punching the doll in the nose
31
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Content Analysis
A content analysis does what it says: an analysis of the content of something!
That “something” is called an artefact (which is just a technical way of saying
“something made by people”). This could be magazines, television programmes,
websites, advertisements etc.
The researcher is aiming to identify patterns and trends, and to describe the
content in a systematic way so that conclusions can be drawn.
A content analysis is a form of indirect observation. It is indirect, because you
are not observing people directly, but observing them through the artefacts that
they produce. The process is similar to that of an observation.
Sample: a content analysis is different from other research methods in that the
sample is not a group of people. The sample will be the artefacts that are to be
analysed.
Results: the researcher then looks at the data collected, and draws conclusions.
Strengths Weaknesses
Content analyses tend to have high Observer bias: can affect both the
ecological validity because it is based objectivity and validity of findings as
on observations of what people different observers might interpret
actually do; real communications that the meanings of the categories in the
32
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
33
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Case studies
In-depth studies of individuals or small groups who are often unusual cases
Often collects data from a variety of sources, or using a variety of research
methods
Often longitudinal – studying the same participants over time
Strengths Weaknesses
Allows us to find out about the impact Cases are often unique so it’s hard to
of events and situations it would be replicate and establish their reliability
unethical to manipulate and study
experimentally The researchers may become
emotionally attached to the participant
They allow psychologists to look at -become less objective reducing
exceptional cases in order to test or validity.
establish a general rule
34
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Quantitative data
Quantitative data is data that can be expressed numerically in some way
(measurement in numbers).
Quantitative data is data where behaviour is measured in numbers or quantities.
Strengths Weaknesses
Numbers allow statistics to be applied Lack of descriptive, in depth data
(e.g. averages and dispersion) and means quantitative data may not fully
comparisons of participants in different reveal the reasons behind why
conditions can be made someone chose an answer
Qualitative data
It is descriptive, in-depth and rich data providing insight into the participants’
thoughts and beliefs.
Data left in its original form of meaning, such as speech or text.
It is the recording of something in terms of its ‘kind’ (nature), rather than
‘degree’ (or amount).
Qualitative data is data that cannot be quantified but it expresses a complete
account of what people think or feel.
Strengths of Weaknesses of
Represents the true complexities of Time consuming to collect and analyse
human behaviour and gives access to
thoughts and feelings that are not Impossible to statistically analyse,
present in other kinds of data. therefore you are unable to produce
35
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
Central tendency:
This indicates the typical average value of a set of data.
Mean
The mean is the arithmetic average that indicates the typical score in a data set.
The mean is obtained by summing all the scores in a data set and dividing by the
number of entries constituting the data set.
Median
The median is a more representative form of a measure of central tendency
(average) when there is anomalous data, or ‘outliers’.
This is because any ‘extreme’ or ‘unusual’ scores that would otherwise artificially
inflate or deflate the average if the mean was calculated are marginalised and do
not feature in the calculation
Mode
This is the most frequently occurring number in a set of data
Dispersion:
This shows how much participants varied in their scores
Range
This is the difference between the highest and lowest scores in a data set. It
tells us about how dispersed or spread out the results are.
A big range means the scores are widely spread suggesting there is a lot of
variation in participants’ ability
A smaller range suggests participants were consistent and got fairly similar
scores.
36
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
The range can be distorted by outliers and suggest a large variation, when really
it’s only one participant that is unusual.
Standard Deviation
Standard deviation measures the average difference (deviation) between scores
and means. So it shows the average spread of scores.
A big standard deviation means the scores are widely spread suggesting there is a
lot of variation in participants’ ability, whilst a smaller standard deviation would
mean participants got very similar scores.
Mean 45 30
Median
Mode
Range
Standard deviation
37
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
You also need to be able to interpret data that has been given to you in a table.
This involves summarising, in words what a table shows. There are some common
things to think about when doing this:
1. Does the table show raw score and descriptive statistics or only one of
these?
2. Does the data seem to suggest what the hypothesis stated the relationship
to be?
3. Are there any anomalies? These are stand out results, that don’t seem to
fit with the general pattern
4. Are there some clear numbers that can be compared across conditions to
show the experiments effect (only for an experiment)
After presenting data in a table, you need to be able to show that you can
present it in a graphical form:
38
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
shape:
1 2 3 4 5 6 7 8 9 10
10
1 2 3 4 5 6 7 8 9 10
No clear pattern:
4.5
4
3.5
3
2.5
2
1.5
1
0.5
0
1 2 3 4 5 6 7 8 9 10
1 2 3 4 5 6 7 8 9 10
1 2 3 4 5 6 7 8 9 10
1 2 3 4 5 6 7 8 9 10
39
Exam: PSYA1 Cognitive Psychology, Developmental Psychology and Research
Methods
General information:
You should always make sure any graphical illustration you produce accurately
represents the raw table you are using to produce it. This includes making sure all
the axes are labelled correctly and you graph having a clear and accurate title,
explaining what it shows
40