Choosing Appropriate Statistics

C. L. Varte Department of Psychology, Mizoram University.

What are the independent and dependent variables?

Identify the independent and dependent variables and determine the scale of measurement. Our dependent variable is always the phenomenon or behavior that we want to explain or predict. The independent variable represents a predictor or causal variable in the study.

What is the scale of measurement of the study variables?

* Nonparametric statistics are used when our data are measured on a nominal or ordinal scale of measurement.
* Parametric statistics are used when our data are measured on approximately interval, interval, or ratio scales of measurement.

How many samples/groups are in the design?

With the scale of measurement of the dependent variable identified: 1. To use Z test; t test; Pearson and Spearman correlations; chi-square goodness-of-fit only one set or "sample" of data is applicable. 2. There must be at least two sets of scores or two "samples" to examines differences between groups with t test for dependent means; t test for independent means; one-way ANOVA; Friedman ANOVA; and chisquare test of independence.

How many samples/groups are in the design?

With single samples and one dependent variable, the one-sample Z test, the one-sample t test, and the chi-square goodness-of-fit test are the only statistics that can be used.

When we have a single sample and independent and dependent variables measured on all subjects, we typically are testing a hypothesis about the association between two variables we can use: chisquare test of independence, Spearman's and Pearson's correlation coefficient, bivariate regression and multiple regression.

How many samples/groups are in the design?

Repeated measurements or pairs of subjects typically collect at least two sets of scores: 1. Studies that are limited to two groups use either the chi-square statistic, Mann-Whitney U, Wilcoxon T, independent means t test, or the dependent means t test. 2. With three or more groups in the design, the chisquare statistic, Kruskal-Wallis H Test, Friedman ANOVA for ranks, One-way Between-Groups ANOVA, Simple Repeated Measures ANOVA, Factorial ANOVA, and Mixed Factorial ANOVA depending on the nature of the relationship between groups.

How many samples/groups are in the design?

Repeated measures, linked selection, or matching leads to some type of association or link in the research design between sets of scores. We can use: 1. McNemar Test (two samples or times of measurement), 2. Wilcoxon t Test (two samples), 3. Dependent Means t Test (two samples), 4. Friedman ANOVA for Ranks (three or more samples), 5. Simple Repeated Measures ANOVA (three or more samples), and 6. Mixed Factorial ANOVA (at least one factor is linked/correlated).

How many samples/groups are in the design?

When there is no subject overlap across groups, we define the groups as independent. Example gender differences. We can use: 1. 2. 3. 4. 5. Chi-square test of independence (two or more groups), Mann-Whitney U Test (two groups), Independent Means t test (two groups), One-Way Between-Groups ANOVA (three or more groups), and Factorial ANOVA (two or more independent variables).

How many samples/groups are in the design?

When there is no subject overlap across groups, we define the groups as independent. Example gender differences. We can use: 1. 2. 3. 4. 5. Chi-square test of independence (two or more groups), Mann-Whitney U Test (two groups), Independent Means t test (two groups), One-Way Between-Groups ANOVA (three or more groups), and Factorial ANOVA (two or more independent variables).

Have I met the assumptions of the statistical test selected?

If we violate test assumptions, the statistic chosen cannot be applied. In this circumstance we have two options: 1. 2. We can use a data transformation. We can choose a nonparametric statistic.

Have I met the assumptions of the statistical test selected?

All parametric tests assume that the populations from which samples are drawn have specific characteristics and that samples are drawn under certain conditions.

These characteristics and conditions are expressed in the assumptions of the tests.
Parametric tests make no distinction between approximately interval, interval, or ratio data. These are all considered "scale" data.

Have I met the assumptions of the statistical test selected?

Nonparametric tests make assumptions about sampling (random) and the independence or dependence of samples (varies by test) but make no assumptions about the population. Within nonparametric statistics, tests are further divided into those that are appropriate for nominal data and those that are applied to ordinal/rank data.

Nominal Data

Ordinal Data

Scale Data

Summary

When choosing statistical tests we should consider: Scale of measurement Number of samples/groups Nature of the relationship between groups Number of variables Assumptions of statistical tests