Experimental Designs

Experimental Research Designs
Experimental Design
Advantages
Best
establishes cause-and-effect relationships of experiments
Disadvantages
Artificiality Feasibility Unethical
Causality
Temporal precedence Covariation between IV and DV Eliminate alternative explanations
Types of Experimental Designs

Simple True Experimental Complex True Experimental Quasi-Experimental

Simple True Experimental

Characteristics Types Variations
Characteristics of True Designs

Manipulation (treatment) Randomization Control group
Characteristics of simple true designs

One IV with 2 levels (T, C) One DV
Types
Randomized posttest control group design Randomized pretest-posttest control group design
Randomized posttest control group design

R R T C Post Post
Randomized pretest-posttest control group design

R R Pre Pre T C Post Post
Advantages & Disadvantages
Advantages of pretest design

Equivalency
of groups Can measure extent of change Determine inclusion Assess reasons for and effects of mortality
Disadvantages of pretest design

Time-consuming
Sensitization
to pre-test
Solomon four-group design

R R R R Pre Pre T C T C Post Post Post Post
Variations
Independent groups (between groups) Repeated measures (within groups)
Repeated Measures Design
Advantages:
Fewer
subjects needed (less costly) Sensitive to finding statistical differences
Disadvantages:
Order
effect (practice, fatigue, carry-over)
Dealing with Order Effects
Counterbalancing
n! Latin
squares
Latin Squares
1
Row 1 Row 2 Row 3 Row 4
A (60) B (0) C (180) D (120)
2
B (0) C (180) D (120) A (60)
3
D (120) A (60) B (0) C (180)
4
C (180) D (120) A (60) B (0)
Dealing with Order Effects
Counterbalancing
n! Latin
squares Randomized blocks
Time interval between treatments
Variations
Independent groups (between) vs. repeated measures (within) designs
Consider external validity when deciding which design to use.

Simple True Experimental Complex True Experimental Quasi-Experimental Pre-Experimental

Characteristics of simple true designs

One IV with 2 levels (T, C) One DV
Complex True Experimental

Randomized matched control group design Increased levels of IV Factorial design Multiple DVs

Randomized matched control group design

M M R R T C Post Post
Used in small samples cost in time & money

Increased Levels of IV
Provides more complete information about the relationship between the IV & DV Detects curvilinear relationships Examines effects of multiple treatments
$0
Performance level (% complete)
Reward Amount $1 $2
$3
DV
Amount of reward promised ($)
IV
Increased Levels of IV
Performance level (% complete)
DV
Amount of reward promised ($)
IV

Factorial Design
>1 IV (factor) Simultaneously determine effects of 2 or more factors on the DV (real world) Between Factor vs. Within Factor IDd by # of factors and levels of factors
2X2
Do differing exercise regimens (hi, med, lo intensity) have the same effect on men as they do on women?
3 X 2 (Exercise Regimen X Gender)

2
factors Exercise Regimen 3 levels Gender 2 levels Between factors DV? Experimental IVs or Participant IVs?
Gender Male Female
Exercise Intensity
High Medium Low
Do strength gains occur at the same rate in men as they do in women over a 6 mo. training period? Measurements are taken at 0, 2, 4, 6 mo.
2 X 4 (Gender X Time)
?
factors Time 4 levels Gender 2 levels Between or within factors? DV? Experimental IVs or Participant IVs?
Time 0 mo. 2 mo. 4 mo. 6 mo.
Gender
Male Female
Cell means, Margin means Main Effects, Interactions
Time 0 mo. 2 mo. 70 60 65 4 mo. 90 75 83 6 mo. 130 90 110 85 64 74
Gender
Male Female
50 30 40
Cell means Margin means Grand mean
Time 0 mo. 2 mo. 70 60 65 4 mo. 90 75 83 6 mo. 130 90 110 85 64 74
Gender
Male Female
50 30 40
Parallel lines indicate no interaction.

Interaction of Exercise Intensity and Gender
70
VO2 Max (ml/kg/min)
Is there a main effect?
65 60 55 50 45 40 35 High Medium Exercise Intensity Low Male Female
Interaction of Exercise Intensity and Gender

70
VO2 Max (ml/kg/min)
65 60 55 50 45 40 35 Male Gender Female High Medium Low
Non-parallel lines indicate an there Is a main interaction.

Interaction of Gender and Time
140 120
Weight Lifted (lbs.)
effect?
100 80 60 40 20 0 0 mo. 2 mo. Time 4 mo. 6 mo. Male Female
Interaction Between Gender and Time

140 120
Weight Lifted (lbs.)
100 80 60 40 20 0 Male Gender Female
0 mo. 2 mo. 4 mo. 6 mo.
Interpretation
Always interpret the interaction first (graphical) If no significant interaction, interpret main effects
Advantages of factorial designs:

Greater
protection against Type I error More efficient Can examine the interaction
Disadvantages:
subject # for between factor designs
Consider external validity when deciding which design to use.
IV A: Exposure to Violence violent vs. nonviolent video IV B: Gender male vs. female DV: # ads recalled (0-8)
B
9
B1 B2
1 2
1 1
9 5
2 5
5 5
3 7
IV A: Exposure to Violence violent vs. nonviolent video IV B: Gender male vs. female DV: # ads recalled (0-8)
9
B1 B2
A: Yes B: No AxB: Yes

Do strength gains occur at the same rate in men as they do in women over a 6 mo. training period? Measurements are taken at 0, 2, 4, 6 mo.
Time 0 mo. 2 mo. 70 60 65 4 mo. 90 75 83 6 mo. 130 90 110 85 64 74
Gender
Male Female
50 30 40


Less control More real-world Program evaluation

R R T C Post Post

Quasi-experimental Designs
One group posttest-only design One group pretest-posttest design Non-equivalent control group design Non-equivalent control group pretest-posttest design Time series Single subject designs (Case study) Developmental designs
One group posttest-only design One group pretest-posttest design Non-equivalent control group design Non-equivalent control group pretest-posttest design Time series Single subject designs (Case study) Developmental designs

R R T C Post Post
One group posttest-only design (One shot study)

T Post
No control of IV threats Use?
One shot study One group pretest-posttest design Non-equivalent control group design Non-equivalent control group pretest-posttest design Time series Single subject designs (Case study) Developmental designs

One group pretest-posttest design

Pre T Post
History Maturation Testing Instrument decay Regression
Use control group

R R T C Post Post
Non-equivalent control group design (Static group comparison design)

T C Post Post
Selection bias

Non-equivalent control group pretest-posttest design

Pre Pre T C Post Post
Can check selection bias
Time series
Pre Pre Pre Pre T Post Post Post Post
Developmental Research Designs

Longitudinal

Cross Sectional
Powerful (within subject) Time consuming Attrition Testing effect
Less time consuming Cohorts problem
Choosing a Research Design

Best addresses the problem Ethics Cost in time and money Validity (internal & external)

Experimental Designs

Uploaded by

Document Information

Original Description:

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Experimental Designs

Uploaded by

Copyright:

Available Formats

Experimental Research Designs

establishes cause-and-effect relationships of experiments

Types of Experimental Designs

Types of Experimental Designs

Simple True Experimental

Characteristics of True Designs

Characteristics of simple true designs

Randomized posttest control group design

Randomized pretest-posttest control group design

Advantages & Disadvantages

Advantages of pretest design

Disadvantages of pretest design

Solomon four-group design

Repeated Measures Design

subjects needed (less costly) Sensitive to finding statistical differences

effect (practice, fatigue, carry-over)

Dealing with Order Effects

Dealing with Order Effects

squares Randomized blocks

Time interval between treatments

Independent groups (between) vs. repeated measures (within) designs

Consider external validity when deciding which design to use.

Types of Experimental Designs

Characteristics of True Designs

Characteristics of simple true designs

Complex True Experimental

Complex True Experimental

Randomized matched control group design

Used in small samples cost in time & money

Complex True Experimental

Amount of reward promised ($)

Amount of reward promised ($)

Complex True Experimental

3 X 2 (Exercise Regimen X Gender)

Gender Male Female

High Medium Low

Time 0 mo. 2 mo. 4 mo. 6 mo.

Cell means, Margin means Main Effects, Interactions

Time 0 mo. 2 mo. 70 60 65 4 mo. 90 75 83 6 mo. 130 90 110 85 64 74

Cell means Margin means Grand mean

Time 0 mo. 2 mo. 70 60 65 4 mo. 90 75 83 6 mo. 130 90 110 85 64 74

Parallel lines indicate no interaction.

Is there a main effect?

65 60 55 50 45 40 35 High Medium Exercise Intensity Low Male Female

Interaction of Exercise Intensity and Gender

Is there a main effect?

65 60 55 50 45 40 35 Male Gender Female High Medium Low

Non-parallel lines indicate an there Is a main interaction.

100 80 60 40 20 0 0 mo. 2 mo. Time 4 mo. 6 mo. Male Female

Interaction Between Gender and Time

Is there a main effect?

100 80 60 40 20 0 Male Gender Female

0 mo. 2 mo. 4 mo. 6 mo.

Advantages of factorial designs:

subject # for between factor designs

Consider external validity when deciding which design to use.

A: Yes B: No AxB: Yes

Complex True Experimental

Time 0 mo. 2 mo. 70 60 65 4 mo. 90 75 83 6 mo. 130 90 110 85 64 74

Types of Experimental Designs

Characteristics of True Designs

Less control More real-world Program evaluation

Randomized posttest control group design