Professional Documents
Culture Documents
Skip to content
Home
Free Download
Basics
Distributions
ANOVA
Correlation
Regression
Multivariate
Appendix
Blogs
Tools
Contact Us
Cronbachs Alpha
One problem with the split-half method is that the reliability estimate obtained using any random
split of the items is likely to differ from that obtained using another. One solution to this problem
is to compute the Spearman-Brown corrected split-half reliability coefficient for every one of the
possible split-halves and then find the mean of those coefficients. This is the motivation for
Cronbachs alpha.
Cronbachs alpha is superior to Kuder and Richardson Formula 20 since it can be used with
continuous and non-dichotomous data. In particular, it can be used for testing with partial credit
and for questionnaires using a Likert scale.
Definition 1: Given variable x1, , xk and x0 =
Property 1: Let xj = tj + ej where each ej is independent of tj and all the ej are independent of
each other. Also let x0 =
Cronbachs alpha.
and t0 =
Here we view the xj as the measured values, the tj as the true values and the ej as the
measurement error values. Click here for a proof of Property 1.
Observation: Cronbachs alpha provides a useful lower bound on reliability (as seen in Property
1). Cronbachs alpha will generally increase when the correlations between the items increase.
For this reason the coefficient measures the internal consistency of the test. Its maximum value is
1, and usually its minimum is 0, although it can be negative (see below).
A commonly-accepted rule of thumb is that an alpha of 0.7 (some say 0.6) indicates acceptable
reliability and 0.8 or higher indicates good reliability. Very high reliability (0.95 or higher) is not
necessarily desirable, as this indicates that the items may be entirely redundant. These are only
guidelines and the actual value of Cronbachs alpha will depend on many things. E.g. as the
number of items increases, Cronbachs alpha tends to increase too even without any increase in
internal consistency.
The goal in designing a reliable instrument is for scores on similar items to be related (internally
consistent), but for each to contribute some unique information as well.
Observation: There are an number reasons why Cronbachs alpha could be low or even negative
even for a perfectly valid test. Two such reasons are reverse coding and multiple factors.
Reverse coding: Suppose you use a Likert scale of 1 to 7 with 1 meaning strongly disagree and 7
meaning strongly agree. Suppose two of your questions are: Q1: I like pizza and Q20: I
dislike pizza. These questions ask the same thing, but with reverse wording. In order to apply
Cronbachs alpha properly you need to reverse the scoring of any negatively phrased question,
Q20 in our example. Thus if a response to Q20 is say 2, it needs to be scored as 6 instead of 2
(i.e. 8 minus the recorded score).
Multiple factors: Cronbachs alpha is useful where all the questions are testing more or less the
same thing, called a factor. If there are multiple factors then you need to determine which
questions are testing which factors. If say there are 3 factors (e.g. happiness with your job,
happiness with your marriage and happiness with yourself), then you need to split the
questionnaire/test into three tests, one containing the questions testing factor 1, one with the
questions testing factor 2 and the third with questions testing factor 3. You then calculate
Cronbachs alpha for each of the three tests. The process of determining these hidden factors
and splitting the test by factor is called Factor Analysis (see Factor Analysis).
Example 1: Calculate Cronbachs alpha for the data in Example 1 of Kuder and Richardson
Formula 20 (repeated in Figure 1 below).
Since the questions only have two answers, Cronbachs alpha .73082 We see that this is the same
as the We see that this is the same as the KR20 reliability calculated for Example 1 of Kuder and
Richardson Formula 20.
Observation: If the variances of the xj vary widely, the xj can be standardized to obtain a
standard deviation of 1 prior to calculating Cronbachs alpha.
Observation: To determine how each question on a test impacts the reliability, Cronbachs alpha
can be calculated after deleting the ith variable, for each i k. Thus for a test with k questions,
each with score xj, Cronbachs alpha is calculated for for all i where =
.
If the reliability coefficient increases after an item is deleted, you can assume that the item is not
highly correlated with the other items. Conversely, if the reliability coefficient decreases, you can
assume that the item is highly correlated with the other items.
Example 2: Calculate Cronbachs alpha for the survey in Example 1, where any one question is
removed.
The necessary calculations are displayed in Figure 3.
As can be seen from Figure 3, the omission of any single question doesnt change the Cronbachs
alpha very much. Removal of Q8 affects the result the most.
Observation: Another way to calculate Cronbachs alpha is to use the Two Factor ANOVA
without Replication data analysis tool on the raw data and note that:
CALPHA(R1): array function which returns a row of Cronbachs alpha for R1 with each item
removed
Thus for the data in Example 1, we can obtain the results shown in Figure 1 and 3 using
CRONALPHA(B4:L15) = .738019 and CRONALPHA(B4:L15, 1) = .76321. Also the formula
CALPHA(B4:L15) can be used to produce the results shown in range B43:L43 of Figure 3.
Example 4: Calculate Cronbachs alpha for a 10 question questionnaire with Likert scores
between 1 and 7 based on the 15 person sample shown in Figure 6.
The output is shown in Figure 8. Cronbachs alpha is shown in cell M3, while the Cronbachs
alpha values with one question removed are shown in range M8:V8, which is the same as the
output from =CALPHA(B4:K18). Note too that the split-half measures are also shown in N12
and N13.
Additional information about Cronbachs Alpha can be found by clicking here. This includes
how to perform hypothesis testing on Cronbachs Alpha, confidence intervals, statistical power
and sample size requirements.
jeena says:
August 16, 2013 at 6:26 am
the test contains 18 questions in which 12 mcqs,5 two marks questions and 1 three marks
questions ,how can i calculate alpha coefficient
Reply
Charles says:
August 17, 2013 at 4:49 pm
Hi Jeena,
I believe that for each question you simply score 1 for a correct answer and 0 for
an incorrect answer, whether the multiple choice question has 2,3 or 4 choices.
Then follow the procedure described in Example 1 or Example 3 on webpage
http://www.real-statistics.com/reliability/cronbachs-alpha/. You can also use the
supplemental formula CRONALPHA provided in the Real Statistics Resource
Pack.
Charles
Reply
Charles says:
koel says:
August 25, 2014 at 4:05 pm
Hi,
I would like to know, if i have 5 variables that i want to
categorize into a single variable. Out of them, 4 questions
are likert scale and 1 is a yes/no question. how can i find
the chronbach alpha for the 5 questions?
Charles says:
2.
Charles says:
September 9, 2013 at 6:34 am
Mary Ann,
Enter your data as in Example 4 on http://www.realstatistics.com/reliability/cronbachs-alpha/. The example shows what to do for a
seven point scale, but a five point scale works exactly the same. Then carry out
the calculations as in Figure 6 on the same webpage or simply use
CRONALPHA(R1) where R1 is the the range containing your data (without
headings). CRONALPHA is a supplemental function which is contained in the
Real Statistics Resource Pack.
Charles
Reply
3.
4.
Krsna says:
November 11, 2013 at 1:53 am
Hi. I got negative cronbach alpha which made it unacceptable but the questions are just
right and fit to my study. What should I do? Thank you for your response. God bless.
Reply
Charles says:
November 13, 2013 at 8:18 am
Hi Krsna,
There are an number reasons for getting a low (or even negative) value for
cronbachs alpha for a perfectly valid test. Two reasons are reverse coding and
multiple factors.
Reverse coding: Suppose you use a Likert scale of 1 to 7 with 1 meaning strongly
disagree and 7 meaning strongly agree. Suppose two of your questions are: Q1: I
like pizza and Q20: I dislike pizza. These questions ask the same thing, but with
reverse scoring. In order to apply Cronbachs alpha properly you need to reverse
the scoring of the negatively phrased question, Q20. Thus if a response to Q20 is
say 2, it needs to be scored as 6 instead of 2 (i.e. 8 minus the score).
Multiple factors: Cronbachs alpha is useful where all the questions are testing
more or less the same thing, called a factor. If there are multiple factors then
you need to determine which questions are testing which factors. If say there are 3
factors, then you need to split the questionnaire/test into three tests, one
containing the questions testing factor 1, one with the questions testing factor 2
and the third with questions testing factor 3. You then calculate cronbachs alpha
for each of the three tests. The process of determining these hidden factors and
splitting the test by factor is called Factor Analysis. See the webpage
http://www.real-statistics.com/multivariate-statistics/factor-analysis/ for more
details about how to do this in Excel using Real Statistics.
Charles
Reply
5.
sivapriyagirish says:
November 24, 2013 at 12:42 pm
this method was very helpful for an average student like me,thank you very much
Reply
6.
Dalia says:
December 11, 2013 at 12:18 pm
Hi,
Thank you for the great explanation.
My work includes using a 5 point scale by 2 separate groups of raters (trained Vs
untrained in that field). Each group will rate 20 different cases.
My questions are:
1- Do I need to use Cronbachs alpha for each case separately (20 cases x 2 groups) (i.e.
40 times)?
2- How can I assess the consistency within each group for all the cases collectively?
3- How can I know if there is a significant difference between the 2 groups for all the
cases collectively?
Apologies for the long questions, but I really appreciate your help.
Best regards,
Dalia
Reply
Charles says:
7.
Mukesh says:
January 9, 2014 at 11:58 am
Hi,
I have approximately 200 respondense, could you please let me know how to ho about
getting the results of the Cronbach test. Do I have to enter a figure for each respondent to
a question?
Thanks,
MC.
Reply
Charles says:
January 10, 2014 at 7:44 pm
Mukesh,
If you have say 200 people taking the test and each test has 20 questions, then you
would create a range similar to that in Figure 1 with 200 rows and 20 columns.
You need to enter a figure to each question.
Charles
Reply
8.
Jonathan says:
January 12, 2014 at 7:07 am
Great site. Thank you.
I am looking for simple consistencies within a singular column of measured data, to see
how volatile it is. I tried to use your CRONALPHA function to simply analyze one
column of data of designated cells, and am getting the #VALUE response.
Am I missing something? Thanks much.
Jonathan
Reply
Charles says:
Jonathan says:
January 19, 2014 at 3:42 am
Thank you Charles.
Perhaps I am asking the wrong question. Lets say I have 120 responses
from one subject over time, and what I am trying to do is to look at the
consistency and repeatability of the answers from that subject. In other
words, I want to see if the data, once I reach a certain point, has a stability
to it. While I could do an even-odd correlation from the set, 1st-half / 2ndhalf, or something like that, that introduces the limitations you discuss.
Is there something that considers the stability of a great number of data
from one subject alone, to look at stability purposes? Thanks very much
for a great site.
Reply
Charles says:
9.
Mabel says:
January 15, 2014 at 2:26 pm
If I have a 2 group study and want to conduct a cronbach alpha test, do I have to separate
it into 2 groups?
Reply
Charles says:
10.
Krsna says:
January 28, 2014 at 1:10 pm
Thank you Charles. Your response is highly appreciated. My apology for this late reply.
God bless.
Reply
11.
Vien says:
January 31, 2014 at 10:26 pm
Do you have a reference for thisA commonly-accepted rule of thumb is that an alpha of
0.6-0.7 indicates acceptable reliability? Thank you very much!
Reply
Charles says:
I have generally seen that .7 is viewed as the minimum acceptable level. Here is
such a reference.
Ref 2: George, D., & Mallery, P. (2003). SPSS for Windows step by step: A
simple guide and
reference. 11.0 update (4th ed.). Boston: Allyn & Bacon. p. 231
The rules of thumb there are:
> .9 Excellent, _ > .8 Good, _ > .7 Acceptable, _ > .6 Questionable, _ > .5
Poor, and < .5 Unacceptable
Here is yet another example where .6 is used as the minimal acceptable level.
Ref 3: "Cronbachs alpha (Cronbach, 1951) which quantifies the degree of
internal consistency (reliability) of a set of items, was calculated for each
subscale, as well as the overall scale. In general, a Cronbachs alpha of at least .7
is the criterion used to establish an acceptable level of reliability. However, the
recommended minimum Cronbachs alpha for exploratory studies is .6"
(Nunnally, J.C. (1978). Psychometric Theory (2nd ed.). New York: McGraw Hill;
Robinson, J. P., Shaver, P. R., & Wrightsman, L. S. (Eds.). (1991). Measures of
personality an social psychological attitudes. San Diego: Academic Press).
Reply
12.
hadia says:
March 2, 2014 at 10:56 pm
Im not a student of mathematics. I am leading a research in applied linguistics and I need
to calculate a result using Cronbach alpha. I asked my students about the extent to which
they became autonomous after introducing language learning strategies on a five-graded
Likert scale with scores from 1 to 5. However, I didnt know how to calculate. On the
vertical column, I have to mention the respondents (students) and on the horizontal line, I
have only one question (so one item??). Could I calculate alpha with only one column?
I am seeking guidance and I would be very grateful if you could help me.
Thank you.
Reply
Charles says:
March 3, 2014 at 7:20 am
Hadia,
You cant measure consistency between the items (which is what Cronbachs
alpha does) since you only have one item. You need more than one item to use
Cronbachs alpha. My question to you is why do you want to use Cronbachs
alpha? What are you trying to demonstrate?
Charles
Reply
Charles says:
13.
Karen says:
March 8, 2014 at 6:54 am
Hi,
Im using a sample of 40 and I have 2 sets of questions, one with 9 and the other with 10
questions. Ive calculated the alpha for both using the formula as you explained and then
using the Real Statistics toolpack. Im getting different alphas when I use the two
methods with the toolpack function giving an alpha higher by around 0.08. Why is that?
Reply
Charles says:
14.
krisliz says:
March 10, 2014 at 8:16 am
how did you get the var in example 4. i just dont get it how it can be computed. is there a
formula needed?
Reply
Charles says:
15.
Hello,
I am using an instrument that has been previously tested for reliability with a Cronbach
Alpha of .91 and .93 for overall instrument (there are two variables being tested). The
instrument has four subscales and each subscale has a Cronbach Alpha number of >.61
(three subscales are in the .80 range). I used the same instrument and tested Cronbach
Alpha and received an overall number of .87 and .86. All of my subscales are
substantially lower than the original testing by the instrument author. How do I explain
that? We used a similar population. Her study was larger with 64 participants and mine
had 40.
Thank you.
Colleen
Reply
Charles says:
16.
Dianna says:
April 3, 2014 at 9:36 pm
Hello,
I am having trouble with measures that has items with reverse coding. When I calculate
the data with reverse coding, the Cronbachs Alpha is very low (.2), however when I
calculate the Cronbachs Alpha without using the reverse coding, it is very high (.9). I am
wondering if you know why that happens, and what I should do?
Reply
Charles says:
17.
Zargoon says:
April 4, 2014 at 1:11 am
Regarding example number 3, I have performed Anova: Two Factor without Replication
in Excel, but could not see Alpha value as it has been shown in Figure 5 above.
Reply
Charles says:
18.
colene says:
April 5, 2014 at 2:50 am
Hi there hopefully you can answer me
I would like to run a Cronbachs alfa test (or similar if you have an alteriour suggestion) to
include it in my reliability part. (using SPSS)
Charles says:
April 11, 2014 at 3:39 pm
Colene,
I have read a lot of conflicting information regarding the subject you are raising
and so I dont have a precise answer for you. My understanding is that Cronbachs
alpha is most relevant when the test is evaluating a single factor. You can
certainly calculate Cronbachs alpha even if the questionnaire contains a mix of
multiple choice, true-false and other types of questions. What I would be
especially cautious about is when the test is performing different types of
evaluations (e.g. Likert scale to assess your satisfaction with a product plus
multiple choice to assess your ability to use the product). You definitely need to
calculate separate Cronbach alpha for each concept/factor that you are testing.
Im nor sure what your curriculum means by indexes. Cronbachs alpha itself
can be used as an index, but it doesnt sound like this is what is meant.
The following are a couple of articles on the web that may give you further
information (although they may confuse things even more). I suggest that you
speak to your professor to get further insights from him/her. Please share with the
rest of us any insights you glean.
http://www.ctbassessments.com/assessment_insights/february_2011/research_insi
ghts.html
http://psychweb.psy.umt.edu/denis/datadecision/front/cortina_alpha.pdf
Charles
Reply
19.
20.
dee says:
April 14, 2014 at 4:31 pm
hi. i gor high Cronbach for my 4 variables but the correlations are zero. Is it somehing
wrong wih my calculations or the data? Need help. Tq
Reply
Charles says:
21.
Charles says:
22.
Luke says:
April 24, 2014 at 6:03 am
Hi Charles,
Thanks so much for this site. Very helpful.
Reading from one of your observations above, and I quote, If the variances of the xj
vary widely, the xj can be standardized to obtain a standard deviation of 1 prior to
calculating Cronbachs alpha, end of quote. just wondering how do you do that. Would
be grateful for your response.
Thanks
Reply
Charles says:
April 24, 2014 at 7:57 am
Hi Luke,
If you have a column of data in range A1:A10. You calculate the mean of the
values (say in cell A12) by =AVERAGE(A1:A10) and the standard deviation (say
in cell A13) by =STDEV(A1:A10). Now put the formula
=STANDARDIZE(A1,A$12,A$13) in cell B1. B1 now contains the standardized
value of the data in cell A1. If you highlight the range B1:B10 and press Ctrl-D
then column B will contain the standardized values of all the data in range
A1:A10.
Charles
Reply
23.
Luke says:
April 24, 2014 at 9:32 am
Thanks so much indeed Charles. I got it.
You have a Blessed day.
Best,
Reply
24.
Arin says:
April 25, 2014 at 10:58 pm
Hi Charles,
Thanks so much for the explanation. Its really easy to follow.
However, I have a question about example 1. How do you get the value for cell B20?
In figure 2, you just said its from M17. But how do you calculate it?
Any explanation on this would be very much appreciated.
Thx
Reply
Charles says:
25.
Arin says:
April 25, 2014 at 11:24 pm
Hi Charles,
I think I got it. Is it the sum of all the variance?
I got 1 different last digit than yours, instead of 3, I got 4.
I dont know if it matters or not or if I am mistaken.
Thx again.
Reply
Charles says:
26.
ricky says:
April 29, 2014 at 10:23 am
Hello Charles,
I really need your help.
I am process of Writing my thesis and I need to find Cronbachs alpha to state the
reliability of my research. I tried usingg SPSS but I keep getting -4 as the alpha which I
know is not right. It is a likert scale based questioonaire with a scale of 1 to 5 and the
number of questions that I selected to find the Cronbachs alpha is 10.
I will be glad to send you the questionnaire to see how you can help me.
regards, ricky
I would be willing to send you the data that I used.
I will be very grateful if you can assist me to solve this problem.
Reply
Charles says:
27.
Ricky says:
April 30, 2014 at 9:26 am
Hi Charles,
Thanks for your prompt response and the info that you provided. Ill download the
software and give it a try. The 15-day trial version of the SPSS that I initially used kept
outputing -4 as my alpha and it was frustrating.
Let me try again and if I encounter any problem, Ill let you know.
Thanks again.
Ricky
Reply
28.
juliet says:
May 1, 2014 at 3:59 pm
Pls can someone send me how to solve cronbach alpha of the example1 above.thanks
Reply
29.
Ness says:
May 5, 2014 at 7:06 pm
Hello,
Thank you for the explanation and the answers that you gave, it is very helpful !
I hope that you can help me with my problem, since it is more or less specific..
Im trying to calculate Cronbachs alpha for a specific purpose: inter-rater reliability
(rather than internal consistency reliability) where raters used Liker-scale to judge some
behaviors shown in videos. 8 items were used for the Likert-scale. Until now it seems
fine, I can measure Cronbachs alpha coefficient for one behavior (one observed video)
while considering 8 rows (for the 8 items) and n columns (for n raters).
However, there are many videos, and each rater evaluated only 16 videos (among around
600 videos). Each video was rated 24 times. My purpose is to measure the inter-rater
reliability for each group of videos (the videos that share a common concept), and later,
the overall inter-rater reliability..
My proposition is to measure the Cronbachs alpha coefficient for each video, and then to
measure the average of those coefficients in order to asses the global Cronbachs alpha
coefficient related to one group of videos. I only need to know whether this approach is
reliable, I mean computing the average of n Cronbachs alpha coefficients (that were
computed separately for each video) to get the inter-rater reliability for a group of videos
makes a sense !
Thank you in advance for your help, I really appreciate it since I could not find an answer
anywhere..
Best regards,
Ness
Reply
Charles says:
May 12, 2014 at 8:55 am
Ness,
I am not sure what you mean by measuring Cronbachs alpha for one video. I
would think that you would need more than one video even to use Cronbachs
alpha, unless you are comparing what you call items. In your explanation you
reference 8 items, but I am not sure what the items represent.
My key question to you is why you want to use Cronbachs alpha in this way,
when, if I understand what you are trying to accomplish well enough, there are
other tests which fit better with your goal? Perhaps you should be using Fleisss
Kappa instead. See, for example, the webpage http://www.realstatistics.com/reliability/fleiss-kappa/.
Charles
Reply
30.
Ermira says:
May 23, 2014 at 3:32 pm
Hi,
I have 4 questions of type Likert Scale ( each of them contain 4 questions describing the
main question).
As far I saw that cronbach alpha is for internal consistency, or it shows how good items
are related to describe the main question.
I want to measure inter-rater agreement. Is Cronbach Alpha the right metric for doing
this?
Thank you
Reply
Charles says:
May 23, 2014 at 7:05 pm
Hi Ermira,
Depending on your specific requirements, you could use Cohens kappa,
Weighted kappa, Fleisss kappa, ICC or Kendalls W. These all measure inter-rater
agreement and are described in the website. See http://www.real-
31.
marzieh says:
May 26, 2014 at 7:42 pm
Dear Charles,
I have made a series of multiple choice questions with 70 items and gave them to a group
of ten for piloting but it is really hard to estimate Cronbachs alpha. I know that it should
be more than 0.7 but I dont know how. Please help me. Thank you so much in advance.
Sincerely,
Marzieh
Reply
Charles says:
32.
farah says:
June 13, 2014 at 7:07 pm
I still dont understand about why should we change into 6 instead of 2
N Q20.Q20 in our example. Thus if a response to Q20 is say 2, it needs to be scored
as 6 instead of 2 (i.e. 8 minus the recorded score).
And why must be 8?
Im very confius
Hope u can help me
Thanks
Reply
Charles says:
33.
farah says:
June 13, 2014 at 7:20 pm
Charles says:
farah says:
Charles says:
June 16, 2014 at 4:48 pm
Farah,
On the referenced page I showed three ways of computing
Cronbachs alpha:
1. Directly using the definition of Cronbachs alpha (as in
Example)
2. Using ANOVA (as in Example 3)
3. Using the CRONALPHA function found in the Real Statistics
Resource Pack (as in Example 4)
Charles
Reply
farah says:
June 16, 2014 at 11:43 pm
Thank you very much charles:)
34.
MJ says:
June 22, 2014 at 3:08 pm
Hi,
for my thesis I conducted CRONBACH alpha on several measures- the core
questionnaire is the Five Facet Mindfulness Questionnaire (FFMQ). My sample is 265
Norwegian University students.
These are the scores I need to explain: FFMQ (0,582) where the individual facets never
reach even 0.5, for the Perceived Stress questionnaire (0,345) and for AUDIT (0,396).
My supervisor thinks these are too low and would like me to explain why, and thinks we
cannot be sure what the instruments were actually measuring. He wants me to give
reasons for this.
Also, the CORRELATION between measures was low even though in the past it usually
shows to be high. I am not sure what was different now, and what both a low cronbachs
alpha and correlation could indicate.
I have found some reasons that could explain it like Participant Fatique.
I would truly appreciate any help as my thesis defence is due very soon and I am still
stuck at this problem.
Best,
MJ
Reply
Charles says:
35.
Gabriel says:
June 24, 2014 at 11:11 am
Hi Charles, firstly thank you very much for providing this informative platform for
everyone. Your effort is greatly appreciated.
Anyway, i do have some issues regarding alpha cronbach. Hoping that you can give me
some clarification. Issues are stated as follows;
(i) In one full set of questionnaire, i have 42 items/ questions measuring different and
diverse concepts/ factors. In another word, i cannot put all the items together at one go for
Cronbach test (as this will lower the cronbach value as they are measuring different
things), so i separate them into few groups say 8 groups of factors (consists of 3-5 or 2-3
items). So theoretically, each group i have different value of Cronbach if i executed
cronbach for all the items. The question is do i need to execute the cronbach test for ALL
items or groups? Is it necessary to cronbach all the items? Can i just cronbach just one
group?
(ii) In exension of above issue, as you mentioned earlier, in order to use Cronbach, you
have at least 2 items right? but we know that the lesser the items, the lower alpha
cronbach will be. Say i have low cronbach value for 2 items, but these two items are valid
to be in questionnaire just the reported reliability is low, so, do i need to do the cronbach
test for that group? or i just ignore it? or there is a better alternative?
(iii) For your information, another issue is there are some items, like 2-3 items they are
unique (maybe i have to say, they are not ordinal data, they are nominal data- yes or no
etc, meaning to say, they are representing individual factor, so cronbach cannot be used
right? is there alternative to replace the cronbach if this is the case? One more issue is
multiple choices questions, i have about 8 of them, so, how can i establish reliability of
them, is that possible?
Thank you very much
Reply
Charles says:
36.
Chris says:
July 1, 2014 at 8:30 am
Just wanted to say what a fantastic resource you have put together here. Im an
educational researcher from a purely Arts background.
I put together a Likert survey, made up of 6 root statements (or factors?), and chose to
analyse 3 of them using this method. I had 79 respondents and used a 5 point scale. The
first factor consisted of 7 items and the second and third of 4 and 3 respectively. The
spreadsheet returned scores .88, .84, and .79. I am well pleased!
I may even have a go at using your site for Factor Analysis and go a step further
Much, much appreciated.
Chris, New Zealand.
Reply
Charles says:
37.
Martin says:
July 6, 2014 at 7:07 pm
Ive just discovered Real Statistics, and so far it looks fantastic!
Im looking to automate lots of calculations on a complex data set.
Is it possible to make the formula only calculate certain questions (for a subscale)?
How does the formula handle missing items/participants?
Kind regards,
Martin
Reply
Charles says:
38.
Darius says:
July 12, 2014 at 1:47 pm
Dear Charles,
I have followed the chat, however, still did not get how to calculate alpha with multiple
choice questions.
What do you mean by correct (1)/incorrect(0)? For instance, my questionnaire contains
some questions, beside of Likert scale questions, with 5 sentences and the respondent is
asked to mark those sentences which he associate with the particular subject. That means
many different combinations could be marked.
Also there are such questions which require to range 5 sentences from most favourable to
least favourable also the answers could vary alot. How to cope with such questions
while calculating alpha?
Thank you very much
Reply
Charles says:
39.
Kyan says:
July 20, 2014 at 9:27 am
Charles says:
40.
FFX-3 says:
July 29, 2014 at 7:47 pm
Hello Charles,
I wish to use cronbach to demonstrate some internal consistency of a survey. If this has
different sections and the sections each have mixtures of types of questions e.g,
likert,dichotomous,multiple choice..how do I test for cronbach please? Thanks
Reply
Charles says:
August 19, 2014 at 11:03 am
The important thing is to calculate a separate Cronbach alpha for each group of
questions that are testing the same thing. Stated the other way around, you
shouldnt calculate Cronbachs alpha for a set of questions that are testing
different things.
In my view there is no problem mixing true/false and multiple choice questions
provided the above paragraph is adhered to.
For multiple choice questions of the form Select one of the following four
choices a, b, c or d if say (c) is the correct choice then use the value 1 if the
person selects choice (c) and use the value 0 if the person selects a, b or d.
Questions of the form Select one or more of the following four choice a, b, c or
d, can be viewed as four True/False questions, namely choice (a) is correct (True
or False)?, choice (b) is correct (True or False)?, choice (c) is correct (True or
False)? and Choice (d) is correct (True or False)? If say the correct choices are (a)
and (d), and a person chooses (a) and (b) instead, then score 1 for question (a), 0
for question (b), 1 for question (c) and 0 for question (d).
I would not mix Likert scale questions (rate your opinion of Columbus from 1 to
5) with knowledge questions (in which year did Columbus discover America?).
Charles
Reply
41.
Debbie says:
August 20, 2014 at 6:39 pm
Hi there,
I have a questionnaire which contains:
1) Yes/No items
2) Likert-scale items
Can I use Cronbach? If yes, how do I perform the coding for 1) & 2) in SPSS?
Appreciate your advice.
Debbie
Reply
Charles says:
Debbie says:
42.
Charles says:
43.
Theophilus says:
August 30, 2014 at 10:47 am
please, how do I compute the correlation
between a particular item and the
sum of the rest of the items.
Reply
Charles says:
44.
sadhna says:
September 17, 2014 at 6:42 am
I have a mixed set of questions in my questionnaire where some questions are based on 5
point likert scale and some are single response questions not dichotomous. So, how
should I calculate the cronbachs-alpha value for all set of questions in my questionnaire.
Reply
Charles says:
sadhna says:
45.
Faisal says:
September 18, 2014 at 4:24 am
Thank you very much for your valued information given above. I really learn a lot. Only I
have one question. If I have three different companies answering same questions? Can I
measure the internal consistency by conducting Cronbachs alpha? Even ratters from
company A have different circumstances than B or C?
Reply
Charles says:
Faisal says:
Charles says:
September 18, 2014 at 12:37 pm
Dear Faisal,
Yes, you can use Cronbachs alpha to create one value of alpha (or
three values, one for each company). It would be interesting to see
whether you get different values for the three different companies.
Charles
Reply
46.
Phoenix says:
September 27, 2014 at 9:36 am
Dear Charles,
Really hope you can solve my problems.
My questionnaire consist 3 parts which are
1. Knowledge in action research Using test form (5 multiple choice answers and 5
open-ended questions)
2. Skills in implementing action research Using 5 point likert scale
3. Attitude towards action research Using 5 point likert scale
My problem is how to run reliability test for part 1. Because in this part have few
difference types of questions.
Example:
1. multiple choice (A , B , C , D )
2. list out 4 data collection techniques
3. pls arrange 10 steps of implementing action research using number 1 to 10.
My friend advise me to run Kuder Richardson, which one more suitable?
If use Kuder Richardson to get reliability for part 1, then how about the overall reliability
for the questionnaire? How to run the test?
Anyway thanks a lot.
Reply
Charles says:
September 27, 2014 at 6:53 pm
The multiple choice questions can be coded as 0 for a wrong answer and 1 for a
correct answer. You could code the 4 data collection techniques as four questions
with 0 for an incorrect technique and 1 for a correct tecnique. I am not sure how
you want to code the 10 steps question as right or wrong (this is necessary if you
want to use Kuder Richardson).
You can use Cronbachs Alpha. If all the scores are 0 or 1 the result for Kuder
Richardson is the same as for Cronbachs alpha (the referenced webpage). You
can also look at the webpage http://www.real-statistics.com/reliability/kuderrichardson-formula-20/.
What is most important is that Kuder Richardson (or Cronbachs alpha) is
calculated only from questions that are measuring/testing the same thing.
Charles
Reply
47.
ghazala says:
October 2, 2014 at 4:45 pm
i need draw backs of cronbach alpha test.
Reply
ghazala says:
Charles says:
Charles says:
48.
Charles says:
49.
Giacomo says:
Charles says:
Giacomo says:
October 12, 2014 at 2:40 pm
Thank you again!
Cheers
Giacomo
Reply
50.
maggy says:
October 13, 2014 at 11:07 am
hie,
what percentage of respondents do i need when using cronbach alpha during pretest?
where can i get this reference. a friend told me that i need 10% of the respondence, is it
true please help.
Reply
Charles says:
51.
Charles, thank you so much for this article; it is very helpful for a math novice like
myself. I would be grateful if you could assist me with some questions regarding the
calculation of the Cronbach Alpha.
We have a test which deals in direct assessment. To be brief, I would like to calculate the
reliability of our testbank broken down into topical groups. While our testbank will
contain about 300-400 questions per topic alone, each student is only presented with 10
random questions. I have a population of 800. Does it matter if the questions (all multiple
choice) are different for each student? Can I still create 10 columns with 800 rows?
My assumption tells me I cannot, because Q1 for student 1 may have gotten it correct,
and student 2 and 3 may have also gotten it correct, however, Q1 for student 2 and 3
could be the same, or, most likely entirely different (although all the concepts are the
same).
Please advise
Reply
Charles says:
52.
Reggie says:
October 23, 2014 at 10:02 pm
Charles:
I am conducting multi-variable regression using 5 independent variables to predict the
impact on transportation costs as a proportion of income in 75 metropolitan statistical
areas. The data includes employment rates, population density, and value of exports. Is
Chronbachs Alpha an appropriate test for reliability or should I be using a different type
of test? If is is appropriate, should I be including the dependent variable in the
calculation? Thank you very much.
Reply
Charles says:
53.
Lou says:
October 30, 2014 at 7:45 pm
There are typos in your equations for x_0 and t_0. You should be summing over x_j and
t_j (i.e.: $x_0 = /sum_{j=1}^k x_j$ and $t_0 = /sum_{j=1}^k t_j$), respectively.
Reply
Charles says:
54.
Regards
Shiba
Asst Prof
Reply
Charles says:
55.
Sona says:
November 26, 2014 at 7:50 am
Good afternoon sir.
my tool is checklist. It has three catageries 6 Year(1 catg),7 Year(2catg),8 year(3 catg). 1
catg contains 6 items,2 catg and 3 catg contains 7 items. How i will calculate reliability.
thank you
Reply
Charles says:
56.
sona says:
57.
Gracefield says:
November 30, 2014 at 7:44 pm
What Statistical tool can best be used to test hypothesis of significant INFLUENCE of
one variable over the other. the two variables have separate instruments measuring them.
Is it T-test, Correlation, Regression, Chi-square, or which
Thanks
Reply
Charles says:
58.
Frank says:
December 3, 2014 at 6:39 am
Thanks for the great resource pack and website. My question: While using Fleiss Kappa
to measure rater agreement, I experimented with various agreement scenarios but now
have trouble interpreting the kappa. With 11 subjects and 5 raters on a 5 point scale, I set
everyones agreement on the middle of the scale (e.g., 3 on a 1 to 5 scale). Kappa would
not calculate until I moved 1 score into another column. So, with all raters=3 for all
subjects except one, kappa calculated to -0.01852. Intuitively, I expected a number close
to 1. Im left wondering if the answer is 1 minus the calculation.
I appreciate your help.
Reply
Charles says:
Frank says:
59.
Udo says:
December 8, 2014 at 10:04 pm
I have 6 items with SA, A, SD, D, how do I apply cronbach alpha with these figures.
Reply
Charles says:
60.
Martin says:
December 12, 2014 at 8:30 pm
Charles,
I have done the split-half methodology against our set of multiple-choice questions; and
thus far, the results look good. Since students may not get the same question (although all
questions measure the same concept(s)) on their specific exam, I had to sample each
conceptual question into groups of 30.
For example, I would have thousand rows with the columns of NumQuestionOffered=30,
and NumQuestionCorrect=X
Provided I have the Odd/Even Anlysis Means, StdDevs, etc. ..is it possible to use that
data to produce a standardized Cronbachs Alpha?
Reply
Charles says:
December 21, 2014 at 9:55 pm
Sorry Martin, but I dont completely understand what you are trying to do. I see
that you are trying to combine questions, but I dont understand how the split half
accomplishes this.
Charles
Reply
61.
Yvonne says:
January 1, 2015 at 5:52 pm
Hi firstly thank you so much for this website it has been so helpful. I am doing an MSc
just now and am looking at managers self-awareness and how closely their
followers/direct reports assessment of their leadership styles agree. I have only 7
managers and 26 direct reports results.
I have a few queries from when I apply Cronbachs alpha should I be looking at the
manager and their direct reports results as individual cronbachs alpha? Or can I combine
all the data as one set of 33 results? Also when I first ran Cronbach alpha on the 6
questions which made up one scale, I got a figure of >1. I worked out this was because
the missing data points must be being used as 0s. I first excluded the whole column of
data (ie 3 of the criteria for the scale) and got a figure, then I ran it again removing the
people with the missing data and got a similar figure to that of removing the question.
Which is correct way of doing this? or how else should I deal with missing data? Also,
looking at an earlier response Cronbachs alpha may not be very accurate/reliable with
such a small sample? Any other ideas of how I could analyse the data? The purpose of my
MSc question was to discover if the managers view of their leadership style matched that
of their direct reports. So possibly I do need to do cronbachs alpha on each manager
rather than using it as one data set?
Reply
Charles says:
January 5, 2015 at 10:35 pm
Yvonne,
The current implementation of Cronbachs alpha doesnt accept any missing data.
If you remove an item, this item wont be included in your analysis. If there is a
lot of missing data for one item you might consider removing this item, but in this
case you should try to understand why there is so much missng data for this item.
Otherwise, I would tend to remove the data for subjects with missing data. Of
course this approach only works if there is a small amount of missing data.
Otherwise you should consider imputing values for the missing data.
Based on your description, it seems that you are interested in measuring the
agreement between raters. Usually intraclass correlation, Cohens kappa, Fleiss
kappa, etc. are used for this (and not Cronbachs alpha). You can get more
62.
Yvonne says:
January 1, 2015 at 9:43 pm
Hi I have another query to add to this. I have run the Cronbachs alpha for 2 of the
individual managers sets of results for one of the scales and a set of data I would have
thought should have shown far lower inter correlation than the other came out the other
way round. Is it because I only have about 6 individuals results which is too low?
Reply
Charles says:
63.
64.
Charles says:
65.
terry says:
January 17, 2015 at 2:06 am
love the info. thanks so much.
so nice to have experts share their knowledge on the net.
Reply
66.
Charles says:
67.
Kent says:
January 24, 2015 at 10:15 pm
Hi Charles,
Hope you can help. We did a survey on identifying comparison in students attitude
towards a list of 10 sub-factors (5 point Likert scale) on advantages of using a tool. The
Cronbach alpha for each of the 2 colleges (A and B) with 2 columns (A and B) is over .9
which should reflect good reliability. My question is, if we then look into overall gender
comparison analysis on students of the same two colleges using the same sub-factors with
2 columns (male and female), is it necessary to evaluate the Cronbachs alpha for the
gender comparison or can we assume that the reliability is the same?
Thanks in advance.
Reply
Charles says:
Kent says:
Charles says:
January 26, 2015 at 1:00 pm
Kent,
If you have gotten high values of Cronbachs alpha in your test
sample it is not necessary to repeat Cronbachs alpha for new
samples, unless you suspect there is something different about the
Kent says:
68.
Azili says:
February 4, 2015 at 3:42 am
Hi Charles,
I want to ask you about cronbach alpha.I have questionnaire which in this questionnaire
have Likert type scale (1-4) and question yes/no.In questionnaire also have question like
gender,marital status etc.How to get the cronbach alpha value using these data?Thank you
Reply
Charles says:
February 4, 2015 at 8:29 am
Hi Azili,
The idea of Cronbachs alpha is to measure the internal consistency of the
questionnaire. If the yes/no questions are measuring something different from the
Likert questions (e.g. the yes/no questions are testing the subjects knowledge and
the Likert scale questions are determining their satisfaction) then there may be no
point in calculating one Cronbachs alpha; better to calculate two or more values.
If instead the yes/no questions are measuring something similar to the Likert
questions then perhaps you can decide to treat the yes/no questions in a manner
similar to the Likert scale questions. E.g. if the Likert scale questions measure
satisfaction (with 0 very dissatisfied and 4 very satisfied) and yes = satisfied and
no = not satisfied, then perhaps a coding like yes = 3 and no = 1 will work. In
most cases, I suspect that the yes/no questions are measuring something different
from the Likert scale questions and so you need to calculate multiple Cronbach
alphas.
Charles
Reply
69.
Raman says:
February 12, 2015 at 5:22 pm
Hi Charles,
My querry regarding Cronbachs alpha values. No of respondand =100, The questionaire
having 5 point scale ans consisit of 22 input and 4 output facors. I used the procedure
expalined by you in figure 1. I got value. But some researcher are showing Cronbachs
alpha values for every input and output factors. If there need to compute the value if
Cronbachs alpha for for every input and output factors. If yes then how.. Kindly do
needfull
Reply
Charles says:
70.
Sammie says:
February 12, 2015 at 6:00 pm
For example 1, can you explain why cells B20 and B21 do not have the same value? Im
trying to follow the formulas, but it seems like M17 in B20 would have the same value as
the result of the formula for B21. Thank you!
Reply
Charles says:
71.
Raman says:
February 13, 2015 at 10:05 pm
Thanks Charles for ur kind reply. I want to check the influence of input parameres on the
output parameters of a system. for this questionnaire study was performed.
the data collected table has 100 rows and 15 column.
I got the single value of Cronbachs alpha. If there need to compute the value if
Cronbachs alpha for every column. If yes then how.. Kindly do needfull
Reply
Charles says:
February 14, 2015 at 5:18 pm
Raman,
In the examples I have given on the referenced webpage, the columns correspond
to items in a questionnaire (these are variables). Not only dont you need to
compute Cronbachs alpha for each column, but such a calculation would yield an
error since Cronbachs alpha requires more than one item. On the website,
however, Cronbachs alpha on one column corresponds to Cronbachs alpha on all
the item leaving out that one column. This tells you the influence that specific
Raman says:
72.
Brenda says:
February 16, 2015 at 12:22 am
Hello,
Thank you for this very helpful site! I am curious about the use of Excels VarS function
(instead of VarP). I notice you use VarP above, and Im wondering why that is. If I
understand Excels explanation, VarS would be used for a sample whereas VarP is used
for a population. Wouldnt most, if not all, of the scales we may develop require the
formula for sample variance? Can you help me understand your choice to use VarP so
that I can distinguish its use in my application of Cronbachs Alpha for scales I am
creating?
Thank you in advance,
Brenda
Reply
Charles says:
Brenda says:
73.
Charles says:
Charles says:
Charles says:
February 18, 2015 at 7:41 pm
Raman,
What do you mean by significantly influence?
Charles
74.
Raman says:
February 19, 2015 at 4:04 pm
Sir,
I want to know which input or inputs (out of 22) has more impact on output 1
which input/ inputs (out of 22) has more impact on output 2
which input/ inputs (out of 22) has more impact on output 3
which input/inputs (out of 22) has more impact on output 4
Reply
Charles says:
75.
K says:
March 2, 2015 at 1:57 pm
Good day sir.
In my experiment survey of Y/N(1-0) questions, where all 3 questions got a perfect score
of 1 from 15 respondents, I was not able to compute the alpha. The value of all the
variances is 0.
The final result is k=3, eVar=0, var=0.
What could it mean?
Is it also possible to get a perfect score of 1 or 0 for the alpha? What would each result
mean?
Thank you.
-K
Reply
Charles says:
March 3, 2015 at 8:51 am
K,
Unfortunately, in these circumstances Cronbachs alpha is undefined because of
division by zero. The good news is that all the respondents answered the same
way, it is pretty easy to make evaluate the effectiveness of the survey even
without using Cronbachs alpha.
If on each of the three questions the subjects didnt have identical scores, but if
each subject got the same score on all three questions, then Cronbachs alpha
would be 1.
76.
AriesMW says:
March 6, 2015 at 7:50 am
Hi Charles,
I am so glad to find your website. Your demonstration of how to calculate Cronbach
alpha is very relevant to my research. May I ask you one question?
I used a spelling test from a published study for my own research and I want to report the
internal consistency reliability of this test based on the data I have collected. The spelling
test examines how students spell four English vowel sounds. In such case, do I need to
calculate Cronbach alpha for each target vowel sound? Is it appropriate to calculate
Cronbach alpha for all items (all sounds) and report internal consistency reliability of the
whole test?
Thank you so much for helping me.
Reply
Charles says:
AriesMW says:
March 8, 2015 at 2:47 am
77.
watan says:
March 14, 2015 at 11:48 am
Dear sir,
I want to use a test with high zero frequency in scoring , if the answer is rarely or
sometimes or never then the score is equal zero (represent the same number) ?! so
Cronbachs alpha is low ?! but if I insert the data as, never represent=6 , rarely=5,
sometimes=4,usually=3, often=2, always=1 then Cronbachs alpha will increase !!
can I do that only to calculate Cronbachs alpha ?! I mean changing the scoring only for
the pilot study?!
Best,,
Reply
Charles says:
Leave a Reply
Your email address will not be published. Required fields are marked *
Name *
Email *
Website
Comment
You may use these HTML tags and attributes: <a href="" title=""> <abbr title="">
<acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime="">
<em> <i> <q cite=""> <strike> <strong>
Current Section
o Reliability
Split-Half Methodology
Kuder-Richardson Formula 20
Cronbachs Alpha
Continued
Advanced
Cohens Kappa
Weighted Kappa
Fleiss Kappa
Intraclass Correlation
Kendalls W
Item Analysis
Charles Zaiontz
RSS - Posts
RSS - Comments
Real Statistics Using Excel : 2014, Charles Zaiontz, All Rights Reserved
Proudly powered by WordPress.
9
inShare