Daez 1
Carlos Daez
POL 3100 Independent Study
Measuring State Conditions: Quantitative Reports or Qualitative Reports?
Introduction
Quantity or Quality?
This brief independent study centers
on research methods in political science,
specifically whether quantitative or
qualitative approaches to data gathering
are better suited for measuring state
conditions. The main influence of this
topic is the emerging concept of state
fragility (Fund for Peace 2017)1, as
opposed to state stability. Fragile and
failed states appear more easily labelled
than stable states; research groups also
more often agree on what constitutes a
fragile state, rather than a stable one.
For one group to label another as
fragile is controversial; is this assessment
and labelling of states and government
influenced by quantitative or qualitative
data? Applying political science to
correctly identify which states are fragile
or stable requires a set method. This
project will explain how the quantitative
approach to data gathering, rather than
the qualitative approach, is better meant
for measuring state conditions.
Why Choose?
Evaluations in general are
undertaken is to provide clear
justification for performance
improvement; evaluation can improve
organizational decision making and
planning, and is an important aspect of
improving professions. Furthermore,
evaluations provide foundations from
which institutions can build upon
12017 Fragile States Index. The Fund For
Peace. Accessed May 4, 2017.
http://fsi.fundforpeace.org/
May 4, 2017
(Dobrovolny 2008)2. Considering this
logic for political science, measurements
of state condition are made in order to
determine and plan what can be done to
maintain or improve a state; evaluation
and diagnosis precedes advice.
Analyzing political systems is also one
of the purposes of political science (Bond
2007)3; by partaking in this
measurement process, political scientists
all the more have an incentive to decide
on either a quantitative or qualitative
method of data analysis to contribute to
the general improvement and sustenance
of states. In other words, it is important
to decide on a quantitative or qualitative
method of measuring and ultimately
determining state condition because it
shapes the way both political scientists
and regular people understand the value
of a state (Gravingholt 2015)4.
Ramifications
Research concludes that the
quantitative approach is preferable in
researching state fragility because of its
ability to provide concrete data, its
convenient information-gathering
2Dobrovolny, Jackie L., and Stephanie Christine
G. Fuentes. 2008. "Quantitative versus
Qualitative Evaluation: A Tool to Decide Which
to Use". Performance Improvement. 47 (4): 7.
3B Bond, Jon R. 2007. "The Scientification of
the Study of Politics: Some Observations on the
Behavioral Evolution in Political Science". The
Journal of Politics. 69 (4): 897.
4Grvingholt, Jrn, Sebastian Ziaja, and Merle
Kreibaum. 2015. "Disaggregating state fragility:
a method to establish a multidimensional
empirical typology". Third World Quarterly. 36
(7): 1282-1298.

process, and the convertibility of its
methods. These advantages, in deviating
from the original qualitative
measurement methods of traditional
political science, also reveal certain
insights regarding the future of political
science itself.
Body
I. State Conditions
History
Observing and understanding state
conditions is similar to visualizing the
states overall status; the sum of the
parts. Institutions measured vary
depending on the researcher, but
common areas studied include the
government, the economy, and the
population (Fukuyama 2010)5.
When the Cold War began, political
science transitioned to a more statistical
role, and international governmental and
financial organizations such as the
United Nations (UN) and the World
Bank (WB) sought the advice of political
scientists to become the popular
measurers of state conditions. Since the
end of the Cold War, state fragility has
become more prevalent, and smaller
groups such as international multimedia
companies (The Economist Group, Time
Warner), and think-tanks (Council on
Foreign Relations, Fund for Peace) have
also become capable of analyzing and
labelling states (Paris 2011)6. A shared
ability between these larger and smaller
organizations is the capacity to gather
large amounts of data and ultimately
5Fukuyama, Francis. 2013. "What Is
Governance?" Governance. 26 (3): 347-350.
6Paris, Roland. 2011. "Ordering the World:
Academic Research and Policymaking on Fragile
States". International Studies Review. 13 (1): 61-
62.
Daez 2
influence others to agree with their
conclusions (Bond 2007)7.
Usage in General
A common trend within the
measuring of state conditions is the level
of democracy. Democracy in particular is
a preferred unit of analysis because of its
ability to provide civilians with greater
opportunities to pursue their own
security, property, and liberty; non-
democratic regimes such as autocracies
are unable to provide as much data for
analysis. (Olson 1993)8.
Data sets such as the UN-updated
Sustainable Development Goals (SDGs)
and the Fragile States Index (FSI) from
the Fund for Peace are samples of how
the measurement of certain countries
state conditions result in them being
labelled as fragile states. These data sets
have increasingly favored quantitative
measurement methods in determining
state condition (Brinkerhoff 2011)9.
From a quantitative view, these states are
fragile because their ratings in specific
areas, such as human rights, or income
mobility, are lower than an established
average. Qualitatively, these figures may
not necessarily constitute fragility.
Impact on Political Science
As the studies of state conditions are
inherently political, it falls upon political
scientists to provide either quantitative
or qualitative data to help the major
inter-governmental and financial
institutions advise the rest of the world.
In addition, use of both quantitative and
7Bond, The Scientification of the Study of
Politics", 900-901
8Olson, Mancur. 1993. "Dictatorship,
Democracy, and Development". American
Political Science Review. 87 (03): 574-575.
9Brinkerhoff, Derick W. 2011. "State Fragility
and Governance: Conflict Mitigation and
Subnational Perspectives". Development Policy
Review. 29 (2): 133-134.
 Daez 3

qualitative methods of measurement as

scientific and humanistic approaches to
understanding the world justify the
existence of this particular social science.
(Bond 2007)10.
It is also interesting to note that the
formation of the American Political
Science Association was decided upon in
a meeting between the American
Economic Association and American
Statistical Association (Bond 2007)11.
This anecdote implies that the
measurement of politics nowadays is
based on combining figures from
economics and statistics.

II. Quantitative Data

History
At its most basic level, quantitative
data is associated with science and the
scientific method. With respect to a
certain area, it collects numerical and
factual data to support a hypothesis,
which may ultimately lead to a theory or
law (Moug 2007).
With the growing acceptance of
political science as a scientific pursuit,
the quantitative method of data
measurement has grown increasingly
popular. On average, political journals
(especially those based in the United
States) have slowly incorporated more
quantitative than qualitative reports, as
evident in Figure 1 below.

10Bond, The Scientification of the Study of

Politics", 903-904
11 Ibid., p. 900
 Daez 4

Figure 1: Trends in quantitative and qualitative studies in political science journals12

12Schedler, Andreas, and Cas Mudde. 2010. "Data Usage in Quantitative Comparative Politics". Political
Research Quarterly. 63 (2): 420.

Usage in Measuring State
Conditions (SC)
With reliance on hard data statistics
which reflect real-time changes in
targeted areas the quantitative method
determines state condition by the
numbers. The sum of a state is judged by
how well it is running its essential parts,
and how these actions are in line with the
established standards of international
organizations.
Considering that institutions such as
government, the economy, and the
population are measured, an example of
quantitative data in use determining
state conditions would be an analysis of
how well certain budgets are utilized by
departments within a branch of
government (Fukuyama 2010)13.
III. Qualitative Data
History
Qualitative data differs from
quantitative data in that it is less
scientific. Adherence to the standards of
the scientific method did not happen
until political science gained relevance at
the onset of the Cold War. By definition,
qualitative methods are more dependent
on words, interviews, and individuals,
rather than numbers, generalizations,
and groups.
Qualitative methods in political
science precede quantitative ones. This is
because the discipline is traditionally
based on political philosophy and theory;
thus, traditional political science is
qualitative and favors words and
generalizations rather than numbers and
quantitative data sheets. Before the
inclusion of computing technology, big
data, economists, and statisticians into
the political science, concerned groups
would consult an Aristotle or a Thomas
13 Fukuyama, What is Governance?, 352
Daez 5
Hobbes on political questions such as the
meanings or order, justice, and virtue
(Leca 2010)14. As qualitative data
gathering is associated with traditional
political science, it can be said that
quantitative data gathering is related
with modern or contemporary political
science, wherein a group rather than an
individual can be consulted for expertise.
Usage in Measuring SC
With long-standing political
philosophy at the heart of the qualitative
method, state condition is determined by
differing perspectives on what exactly
constitutes fragility and stability.
Differing schools of political thought,
especially between the east and the west,
make qualitative measurement more
unreliable in determining state
conditions and levels. The western
political philosophy of John Locke might
conclude that the United Kingdom is a
stable state with good governance, and
that the political system of the Peoples
Republic of China is flawed; this does not
necessarily mean that eastern political
philosophy of Confucius would agree
(Jing 2010)15.
But the qualitative approach has its
merits. For example, political scientist
Francis Fukuyamas Measuring
Governance (Fukuyama 2010) presents
some qualitative methods of determining
state condition. Fukuyama recommends
political scientists might consider
studying a states bureaucratic autonomy
14Leca, Jean. 2010. "Political Philosophy in
Political Science: Sixty Years on". International
Political Science Review. 31 (5): 528-529.
15Jing, Yuejin, and Guoqin Wang. 2009.
"Western Political Research Approaches and the
Development of Political Science Methodology
in China". Journal of Chinese Political
Science. 14 (3): 301-304.

(Weber 1919)16. Should studies show that
government departments within a state
can operate independently and
efficiently of one another regardless of
state fragility, would that overrule the
quantitative reports? Possibly.
IV. The Demands of the World
Quantitative or Qualitative?
Restated, the qualitative method
is more closely related to traditional
political science, using foundations such
as political philosophy and theory to
make judgements; while it may make
sense to study countries in the traditional
way of political science, this is growing
increasingly undesirable (Flinders
2013)17 and less useful. The demands of
the world beyond political science and
the university prioritize utilization of the
quantitative method for three reasons:
concreteness, convenience, and
convertibility. These three aspects, in
being useful for the world, support the
advantage the quantitative method over
the qualitative one in determining state
conditions.
Quantitative Concreteness
First, numbers and figures in
quantitative data are concrete. In being
concrete, these numbers and figures
provide solid criteria and are more easily
understood than the images and words.
The inclusion of hard data in political
science is also an essential reason as to
why political science is able to be referred
to as a science in the first place (Rice
1938).
The use of quantitative methods in
other data-gathering studies such as
economics and statistics is also related
16 Weber 1919
17Flinders M., and John P. 2013. "The Future of
Political Science". Political Studies Review. 11
(2): 222.
Daez 6
with the philosophical idea of positivism
(Sale 2004)18. Positivism simplifies
interactions, teaching that problems can
be solved using rational figures such as
numbers and graphs.
Consider quantitative data usage in
the Fragile States Index. One aspect
which influences the decision on whether
a state is fragile or not would be its
number of emigrants (refugees). In a
sample population of 100,000, an
emigrant count of 90,000 would be
easily understood and taken into
account.
Quantitative Convenience
Second, in addition to its figures
being concrete, the data required for a
quantitative measurement is often also
easily attainable. This makes the
quantitative method a more convenient
approach to analysis.
Data gathering is influenced by
available time and capacity of effort.
Developed countries naturally have more
time and effort than less-developed ones,
and are more suited to providing desired
the desired numbers for a study. This
also makes the gathering and utilization
of quantitative data a more convenient
process (Akkerman 2004)19. While the
ability to provide more human
perspectives on researching state
conditions and government is desirable,
qualitative data is ultimately a more
time-consuming process. By contrast, In-
depth quality research involving in
insertion and assimilation of researchers
is risky even though it may yield more
18Sale JE, and K Brazil. 2004. "A Strategy to
Identify Critical Appraisal Criteria for Primary
Mixed-Method Studies". Quality & Quantity. 38
(4): 352-354.
19Akkerman, Sanne, Wilfried Admiraal, Mieke
Brekelmans, and Heinze Oost. 2008. "Auditing
Quality of Research in Social Sciences". Quality
and Quantity. 42 (2): 257-258.

complex results (Moug 2007)20. Simply
put, data gathering for the evaluating and
reacting to state fragility is a matter of
time and effort; therefore, data which is
more convenient and concrete is
preferable to data which is not.
In labelling fragile and stable states,
one might argue that quantitative data is
heavily dependent on available sources;
the answer to this argument is the
development of globalism and the
internet, and the willingness of
governments to share certain vital
information with one another.
Quantitative Convertibility
Finally, experiences with concrete
numbers and convenient data gathering
methods for determining state
conditions and levels of government are
more influential and easily adaptable. In
doing so, these traits make the
quantitative method more convertible for
use.
Non-convertibility of information has
created conflicts in the past. In relation to
positivism, a unified, rational
interpretation of reality underlines the
concreteness and convenience of
quantitative data gathering. Reliance on
the qualitative reasoning in
measurement assumes multiple realities
influenced by different perspectives in
political philosophies, and would create
more questions about viability among
groups. (Leca 2010).21
For better or for worse, proactive
public reception and imitating of
quantitative studies from differing
international measurers of state
condition is also another indicator of how
concreteness and convenience creates
20 Moug, Peter. 2007. "Non-participative
Observation in Political Research: The Poor
Relation?" Politics. 27 (2): 112.
21Leca, Political Philosophy in Political
Science, 533
Daez 7
convertibility for quantitative political
data (Schedler 2010)22.
Qualitative Advantages
For a faster, more connected
world, the concreteness, convenience,
and convertibility of the quantitative
method would appear supreme. But
political scientists do not produce the
data, they merely interpret it after it has
already been gathered. Quantitative data
is in fact more susceptible to
manipulation than qualitative data it is
not uncommon for data providers to
bribe and purchase political scientists to
present findings in a specific way (White
2014)23. Qualitative data is more
abstract, harder to gather, and less
translatable, but in being so becomes
harder to manipulate. More will be said
about this aspect of the qualitative
approach later.
Quantitative Advantages
Despite its flaws, the quantitative
approach for data gathering in todays
contemporary political science provides
concrete, rational data. It is also a
convenient, less time-consuming
process. Its concrete and convenient
form its convertibility, making it an
attractive approach for governments to
consult. These three advantages make
the qualitative method of measurement
in less feasible. But does it completely
render the methods of traditional
political science obsolete?
V. The Future of Political
Science
The State of Political Science
22Schedler, Data Usage in Quantitative
Comparative Politics, 428-429
23White P., Breckenridge R.S., and Breckenridge
R.S. 2014. "Trade-offs, limitations, and promises
of big data in social science research". Review of
Policy Research. 31 (4): 335-337.

Political science today appears to be
unaware of its own identity, or the
changes being imposed upon it. A
recurring theme throughout studied
sources is the lack of self-awareness
within political science (Dunleavy 2010,
Ollman 2000)24. Taking into account its
origins and traditional use of qualitative
research methods, political science is
simply defined as the study of politics
and government. The lack of self-
awareness is attributed to the
disciplines willingness despite its
definition to spread itself thin into other
fields such as economics, statistics, and
psychology. The world is moving faster
and faster in the digital age, and the
willingness of political science to
collaborate with other fields is done out
of a need for survival (Dunleavy 2010)25.
Political scientists consult with
experts from these other studies to
assure that their own discipline
continues to be referred to as a science.
This is also done because of the
prevalence and pressure to use
quantitative data from these other fields.
Jon Bond, in The Scientification of the
Study of Politics, believes that political
science, in increasingly favoring
quantitative research methods and
interdisciplinary measures, is at risk of
losing its original, qualitative-based
identity altogether (Bond 2007)26.
Quantitative and Qualitative
Coexistence
24Dunleavy, Patrick. 2010. "New Worlds in
Political Science". Political Studies. 58 (2): 240-
244. Ollman, Bertell. 2000. "What Is Political
Science? What Should It Be?" New Political
Science. 22 (4): 555-557.
25 Dunleavy, New Worlds in Political Science,
239
26 Bond, The Scientification of the Study of
Politics", 904-905
Daez 8
Quantitative methods are proven
to be increasingly favored in political
science over qualitative ones a choice
made regarding matters of keeping the
study relevant (Flinders 2013)27. Thanks
to the rise of big data solutions,
quantitative data is popular, but the
limits it has in regard to answering
political questions of the world are
ignored simply because the alternative
would take up too much time and
resources. Big data provides necessary
values for quantitative research figures
for determining economic growth within
a fragile state, for example but, as
mentioned earlier, is not derived from or
monitored effectively by political
scientists (White 2014)28. Globalization
and cultural homogenization in favor of
the western powers also has a side-effect
of bending all quantitative research to be
based off of western standards. The
quantitative method is dominant in its
convenience, concreteness, and
convertibility, but research has its limits;
considering globalization and big data,
research is also more likely to be made in
social or financial interest rather than
academic interest more pressure on
quantitative methods in political science
(David 2002)29 in-depth qualitative
analyses are sacrificed for the speediness
of quantitative analyses.
Although the qualitative method
has been demonstrated to be inferior for
modern political science, losing it
altogether exposes the discipline to
further manipulation and loss of identity
for the future. Quantitative research
27Flinders, The Future of Political Science,
223-224
28 White, Trade-offs, 335-337
29David, Matthew. 2002. "Problems of
participation: the limits of action
research". International Journal of Social
Research Methodology. 5 (1): 15-17.
 Daez 9

methods can remain the popular choice
for political science studies, but the
qualitative method must be kept alive.
Not only does it form the origin of
political science, but it also allows the
public to understand how quantities in
politics affect the qualities (Flinders
2013)30.
The Future of Political Science
The prevalence of quantitative
research methods over qualitative
research methods in political science
does not have to signal the end of
political science in the traditional sense.
While the discipline may grow to become
acquainted with others, it does so along
with the rest of the world. Approaching
these changes in political science
keeping the quantitative at the front but
not totally disregarding the qualitative
as a sort of evolution is the best way to
ensure that political science continues to
be an outwardly quantitative and
inwardly qualitative study of the nature
of politics and government (Flinders
2013)31. With that being said, the
quantitative method must remain the
popular method, but more effort must be
made to ensure qualitative standards for
these quantitative reports.
qualitative method presupposes the
second question, which deals with the
future of political science when
considering the discipline itself is
founded on qualitative methods of
analyzing governments. Contemporary
political science, with its preference for
the quantitative method, may as well
overtake traditional political science
and the qualitative method. This
transition from qualitative to
quantitative methods may only become
worrisome if tomorrows political
scientists completely forego quality for
quantity.
The qualitative method, though
inferior for its time-consuming
processes, must nonetheless be relied on
when possible. Quantitative and
qualitative methods of data gathering in
political science may outpace one
another periodically, but are ultimately
co-dependent in helping the public
understand standards of not only state
condition, but how politics eventually
affects everything.

Conclusion
At the end, this project decides on
two questions. First, whether
quantitative or qualitative methods of
measurement are better used in
determining state conditions.
Quantitative methods, in being able to
acquire data more conveniently, present
concrete figures, and be convertible for
use across other fields, have the
advantage. The prevalence of the modern
quantitative method over the traditional

30 Flinders, The Future of Political Science,

226-227
31 Ibid.