Running head: EXPLORING SURVEY METHODOLOGIES

Exploring Survey Methodologies

Drake University
COUN 201
Marcela Hermosillo

EXPLORING SURVEY SCORING METHODOLOGIES

2

Exploring Survey Scoring Methodologies

Assessing, measuring and predicting behavior is an approach known as a scientific research
method. Psychology and medicine are both examples of sciences; both require ongoing
experiments to understand better human behavior. Experiments and research methodologies have
expanded in the last centuries. Understanding research methodologies and experiments allows
for counselors to advocate on behalf of the counseling model and hence change the systems that
surround all of us (Definition Psychology, retrieved Aug. 13, 2015). The scientific research
method is extremely complex. In the next few pages I will limit my topic to discuss the pros and
cons of scoring methodologies such as true-false questions, Likert scale, open-ended questions,
validity, reliability, and snowball methodology.
Survey worthiness is includes four factors, validity, reliability, cross-cultural fairness, and
practicality. Validity aims to answer the question of whether or not the survey measures what is
supposed to measure. For example, the ACT is supposed to measure college success, students
admittance to college takes into account high school grades and ACT scores. Many argue a high
ACT score leads to both college success and persistence. Will receiving a high grade in the math
section of the ACT result in the students ability to test out of developmental math? More than
likely yes, however, instruments such as ACT fail to measure are non-cognitive factors such as
ability to deal with disappointment, perseverance amongst others. Overall the ACT is a valid
instrument because it measures aptitude in areas such as Math, English, Reading, and Science.
The positive aspects of validity its ability to provide a set of guidelines for others to follow, it
provides a level of consistency across all instruments which are considered valid. Regardless of
the validity of an instrument it is highly impossible to have an instrument that is 100% valid. The
drawback of not having 100% validity in an instrument is that individuals who believe in a world

EXPLORING SURVEY SCORING METHODOLOGIES

3

of black and white may have a difficult time relying on results from a valid survey. As a method,
validation includes analyzing and collecting data to evaluate the precision of an instrument.
There are two types of validity, external and content.
Reliability is another one of the four factors related to survey worthiness. Instruments that
provide accurate results are important as they provide reliability. In sum, reliability refers to the
degree in which results are free from errors. For example, every time the same person takes the
survey will the same results are received? Reliability takes into account the environment in
which an instrument is being assessed. Furthermore, reliability helps answer the overall question
of is the survey put well together? Does every question make sense?
In high school, my favorite types of exams in math were the ones that provided me with a
true or false option. My preference consisted of the 50 percent likelihood that I would receive a
better grade without putting much effort into my thought process. Depending on the reliability of
true or false scoring methodologies the instrument may be highly reliable. The simplicity of
scoring results is very efficient and compared to other methodologies time saving. True-false
questions provide generality of level content knowledge, but do not allow for specific detail on
where the gap of knowledge may be. For example, the option to guess true or false to an algebra
equation may depict my inability to understand equations but it does not provide a clear level of
how much assistance I need to understand algebra equations. From a counselor in training
perspective, I would prefer to stay away from true-false survey scoring methodologies simply
because as a counselor I value qualitative data a lot more than quantitative. The more qualitative
data I gather from my client, the better I can support my client from a holistic counseling
approach.

EXPLORING SURVEY SCORING METHODOLOGIES

4

The counseling model views clients as always changing and evolving, open-ended
questions allow for survey scoring methodologies to gather more in-depth answers that in return
may provide more in-depth answers to assist answer challenging questions faced by
professionals in the counseling profession. The rich qualitative data gathered from open-ended
questions surpasses the data gathered from scoring methodologies such as true-false questions.
Open-ended questions seem to be extremely useful for answering complex questions. Personally,
open-ended questions preset answers allow for non-biased data to be gathered. In contrast with
open-ended questions they are extremely time-consuming and the time involved in analyzing the
data may be a involve a lengthy process. Furthermore, close-ended questions are perceived as
inadequate for people who are less educated.
Snowball methodology is by far the easiest way to increase the number of individuals
who partake in your experiment. Snowball methodology refers to recruiting acquaintances to
take the survey. For example, if my instrument entails identifying what causes people to be
resilient if I ask everyone who is friend with my initial survey participant my answers are not a
good representation of the total population. Snowball methodology is not used to infer from the
general population as it is a non-probability sample. Snowball methodology is extremely helpful
to determine if additional research needs to be done on a specific subject or topic. It is a way to
begin more meaningful research come to fruition.
Likert questions seem to be the most favorable type of survey scoring methodologies in
the psychology field. Some of the basis for that is due to the ability to measure on an ordinal
scale the level of agreement or disagreement on a certain topic. Likert scale functions under one
assumption, the intensity is linear, meaning, that it is functioning under the assumption that
attitudes can be measured. Likert scales tap into the cognitive and affective components of

EXPLORING SURVEY SCORING METHODOLOGIES

5

attitudes. Some of the downsides with Likert scales is that data is not continuous. Another con
that is similar to any other type of instrument is peoples ability to provide truthful information
due to social desirability. I am reminded of the social desirability factor every time I review with
school districts their 12th grade student survey results that more often than not reflect that the
majority of students will be pursuing an education beyond high school. After the actual data is
received from sources such as National Clearinghouse, it is seen that a high percentage of
students who had listed college as the next step in their career did not follow through. The reason
for the inconsistency can be numerous factors; I personally believe social desirability plays a
huge role. Indicating in a survey I plan on going to college even if a student has no desired or no
knowledge is better than asking what college is or what do you need to do attend college.
Therefore, students feel pressured to lie in surveys.
In summary, survey scoring methodologies play extremely important roles in our field.
As stated above, all of the methodologies have their advantages and disadvantages there are
never a one size fits all. Counseling operates under one principle, and clients are often evolving.
To ensure the counseling profession continues to evolve current and future counselors must
understand research methodologies.

Reference Page
Likert Scale. (n.d.). Retrieved August 14, 2015, from
http://changingminds.org/explanations/research/measurement/likert_scale.htm

EXPLORING SURVEY SCORING METHODOLOGIES

6

McLeod, S. A. (2008). Likert Scale. Retrieved from

www.simplypsychology.org/likert- scale.html
McLeod, S. A. (2014). Questionnaires. Retrieved from
www.simplypsychology.org/questionnaires.html
(n.d.). Retrieved August 14, 2015, from https://en.wikipedia.org/wiki/Nonprobability_sampling
True-False Test Items. (n.d.). Retrieved August 20, 2015, from
http://citl.illinois.edu/teaching-resources/evaluating-student-performance/writing-goodtest-questions/true-false-test-items