INTERNATIONAL JOURNAL OF RESEARCH IN TECHNOLOGY (IJRT) ISSN No.

2394-9007
Vol. V, No. I, February 2018 www.ijrtonline.org

A Review of Medical Data based on Data Farming

Techniques
Abhilash Raghuwanshi, Gagan Sharma, Rajesh Sharma

Abstract— We can see that data farming is an emerging field of research
because decision making is an important issue in the competitive business
environment. The appropriateness of data and the data collection cost
become the goals of data farming. Data farming is emerging fields of
research in the current scenario, where data collection cost and time
consumed in data collection is significant to reduce. We can farm the data
where we have narrow data set and then apply the data mining algorithm
to extract the useful knowledge.
We proposed an algorithm for data farming steps data
plantation & harvesting. We farm sufficient data from the
available little seed data by applying the proposed algorithm of
data farming. Classification results of J48 classification, for
farmed data is achieved better than classification results for the
seed data, which proves that the proposed data farming
algorithm has produced effective data.
In this paper, we present an algorithm for data farming
which farms the data with the help of the seed data on a
predefined error threshold rate. Proposed algorithm has
implemented on farmed datasets are verified for the classification
accuracy on the WEKA open source data mining tool.
Keywords: data farming, J48, HPC
I. INTRODUCTION
Adequate data is required for decisions making on the basis of
knowledge extracted by the data mining process, data
collection is a crucial process, many times data is not adequate
for the mining. In that case data cleaning, data reduction,
selection and data farming techniques are applied to get
adequate data. After getting the adequate data, someone can
apply the mining algorithms to extract more accurate and
useful information compared to the former data.
Methodologies and tools are needed for determining the most
appropriate data at an acceptable cost. According to the
previous experience, we can see that the data farming effort
often outweighs the data mining task, especially in the
industry. One of the major reasons behind this is that the
industrial data is collected for reasons other than decision-
making. Sometime collected data is a wide range of features
that go beyond traditional models.
Manuscript received on February, 2018.
Abhilash Raghuwanshi, Reseach Scholar, Department of Computer Science
& Engineering, Sri Satya Sai College of Technology, Bhopal, M.P., India.
Prof. Gagan Sharma, Asst. Professor, Department of Computer Science &
Engineering, Sri Satya Sai College of Technology, Bhopal, M.P., India.
Prof. Rajesh Sharma, Asst. Professor, Department of Computer Science &
Engineering, Sri Satya Sai College of Technology, Bhopal, M.P., India.
Due to the lacking of analysis tools, narrow or insufficient
awareness of data mining and data farming tools increases the
data collection cost. Data farming enhances the data on hand
and also determines the most relevant data to be collected.
Determining the features for which data should be collected in
the absence of a dataset or its partial availability. This issue is
important as the interest in data mining is growing in
exponential order in the last decade. The process and methods
used to determine the most suitable features for data collection
and subsequent data analysis are referred to as data farming.
Feature extraction is a push approach, in which selected
features determine the quality of knowledge while data
farming pulls the data necessary for knowledge extraction.
The appropriateness of features can be expressed with
different measures like classification accuracy, missing values
etc. which may vary for different application areas. There are
two approaches of the data farming surveyed in the available
literature as follows.
This approach is used in the high performance computing
environment where thousands of iterations are executed in
parallel environment. Development of novel data mining
applications calls for the definition of appropriate features and
data collection at minimal cost Data farming is a process to
get data on minimum cost. Data farming is an iterative team
process. Presents the data farming approach for HPC as a set
of imbedded loops. This process normally requires input and
participation by subject matter experts, modelers, analysts, and
decision-makers.
The “Scenario Creation” loop shown on the left side of
the figure involves developing and honing a model that
adequately represents the system that addresses the question
being asked by the decision-maker .This is an iterative process
that often requires honing the question as well. The “Scenario
Run Space Execution” loop is entered once the base case of
the scenario is complete. In this loop the team defines a study
to determine which scenario input parameters should be
examined and what processes should be used to vary them.
Here the team is exploring the possible variations or
excursions of the base case in the initial conditions of the
scenario.
II. RELATED WORK
In this section we discuss the literature survey entitled with
their author name and given references number respectively.

Impact Factor: 4.012 35

Published under
Asian Research & Training Publication
ISO 9001:2015 Certified
INTERNATIONAL JOURNAL OF RESEARCH IN TECHNOLOGY (IJRT)
Vol. V, No. I, February 2018
Data farming was first developed and used at the Marine
Corps Combat Development Command in late 1997. Data
farming has been a never ending opportunity to explore our
question. The ideas behind data farming had been initially
developed much earlier, but were introduced by Dr. Horne to
the defence community in 1997 in concert with the
combination of agent based models with high performance
computing that was the start of Project Albert. Project Albert
was a congressionally funded modelling and simulation
initiative of the United States Marine Corps (USMC).
Then Dr. Alfred Brandstein and Dr. Gary Horne
published the concept of fertilize, cultivate, plant and harvest
when growing of the data discussed in 1998 [8]. They also
discussed Crop rotation and JWARS. Data farming came into
light by the Winter Simulation community in 1999 at Winter
Simulation Conference in Phoenix.
The international community drove the German mission
through other methodological developments such as
experimental designs, model developments (MANA,
Pythagoras, PAX, etc.), Application of agent based
development environments (NetLogo, REPAST, MASON,
etc.) and through evaluation and analysis tools of many types
[15]. In the international workshops the availability of the
experts and the free and open information sharing led to a big
success in Germany in the application of the tools.
III. DATA FARMING ARCHITECTURE
This approach is mostly used for the data farming process.
There are four steps in this approach similar to the agriculture
farming process [15]. Each step has an isolated & necessary
functioning. Data fertilization is essential to make the seed
data more productive. Cultivation is required to create the
environment for the plantation. Plantation is the core step in
any farming process, harvesting is an obligatory step for
collecting farmed data.
Fertilization initiates the data farming cycle. Data
fertilization is required, to make available seed data more
productive. Fertilized seed data can be achieved using filling
of missing data values in the sample, data selection/reduction
or applying prediction on some attributes; if the seed dataset
has some missing values then first of all we have to fill these
missing values.
A. Cultivation
Second step of data farming is cultivation. Cultivation is
responsible for developing the scenario for data plantation;
Cultivation is the procedure to prepare the environment for the
seed and pre-initialization of plantation method. Cultivation is
a highly application dependent step i.e. the different
algorithmic procedures are followed for the cultivation based
on the application. For example sometime statistical methods
are used for the cultivation & sometimes range of the seed
dataset is used to create the environment for plantation.
Impact Factor: 4.012
Published under
Asian Research & Training Publication
ISO 9001:2015 Certified
ISSN No. 2394-9007
www.ijrtonline.org
Fig. 1: Data Farming Approach for Single Processor
B. Plantation
Plantation is an essential step for farming. To plant, the
available fertilized seed in the cultivated environment is
known as plantation. In the terminology of data farming,
generating farmed data from fertilized seed data in cultivated
environment is called data plantation. This step is actually
responsible for the data farming. We can say algorithm for
growing data is actually run in this step.
C. Harvesting
Harvesting step is the last phase of the farming cycle.
Harvesting is a process to collect the crops. Similarly, data
harvesting is a process to collect the farmed dataset. Hence, in
this step, collection of the farmed data set is done.
Data farming is a cyclic procedure including the steps;
data fertilization, data cultivation, data plantation and data
harvesting. Data fertilization, in which the available data is
fertilized by filling missing values etc. The second step of data
farming is the data cultivation, in which we prepare the
available seed for plantation. The third step of data farming is
the data plantation, in which the seed data is planted to grow
more data by the proper algorithms. The last step of the data
farming is the data harvesting, in this step the farmed data or
crops are collected and stored permanently. The farmed data
can be used either for data mining purpose or it can be used as
seed data to the next iteration of the data farming.
IV. PROBLEM STATEMENT
Objective of data farming is to improve the mining accuracy
as well as reduce the data collection cost. Classification
accuracy, cluster density and rule support or confidence is a
measure of the data mining results. Data farming is used to
improve the results in terms of these performance measures.
The goal of data farming is given below.
 Maximize performance measure (e.g., classification
accuracy, cluster density, rule support and confidence)
 Minimize or reduce the data collection cost
36
INTERNATIONAL JOURNAL OF RESEARCH IN TECHNOLOGY (IJRT)
Vol. V, No. I, February 2018
These criteria directly affect accuracy and cost savings. High
accuracy on low price increased competitiveness. Various other
criteria for data farming may be evaluated in real life.
V. CONCLUSION & FUTURE WORK
In this paper presents the review of data farming techniques.
Prediction and classification is critical subject in information
mining and machine learning and it can be broadly utilized as
a part of many fields. Farming time required is highly
dependent on the instances to be farmed and lightly on the
number of seed data & error threshold. Correctly classified
instances (CCI) & kappa statistics (KS) are increased &
incorrectly classified instances (ICI), Mean Absolute Error
(MAE), Root Mean Squared Error (RMSE), Relative absolute
error (RAE), Root relative squared error (RRSE) are
decreased for the farmed data when compared to the original
dataset and sample datasets.
There are a few conceivable augmentations to MAE.
Presently, RAE utilizes a help certainty structure to find visit
thing sets and produce order rules.
REFERENCES
[1] Ankita Dewan and Meghna Sharma “Prediction of Heart Disease Using
a Hybrid Technique in Data Mining Classification”, IEEE, 2015, Pp
704-706.
[2] Ming Yuchi and Jun Jo “Heart Rate Prediction Based on Physical
Activity using Feed forward Neural Network”, International Conference
on Convergence and Hybrid Information Technology 2008International
Conference on Convergence and Hybrid Information Technology, 2008,
Pp 344-350.
[3] M. S. A. Megat Ali and A. H. Jahidin “Hybrid Multilayered Perceptron
Network for Classification of Bundle Branch Blocks”, IEEE., 2011, Pp
149-154.
[4] M.Akhiljabbar , Priti Chandra and B.L Deekshatulu “Prediction of Risk
Score for Heart Disease using Associative Classification and Hybrid
Feature Subset Selection”, IEEE, 2012, Pp 628-634.
[5] Sivagowry .S, Dr. Durairaj. M and Persia.A “An Empirical Study on
applying Data Mining Techniques for the Analysis and Prediction of
Heart Disease”, IEEE, 2013, Pp 1-6.
[6] Andrew Kusiak, Data Farming Methods for Temporal Data Mining,
Intelligent Systems Laboratory, 2139 Seamans Center, The University of
Iowa, Iowa City, Iowa 52242
http://www.sigkdd.org/kdd2001/Workshops/kus.pdf
[7] D. Burnell, A.Al-Zobaidie, G.Windall, A.Butler. Self-Optimising Data
Farming for Web Applications. Proceedings of the 15th International
Workshop on Database and Expert Systems Applications (Dexa’04)
1529-4188/04 IEEE.
[8] Gary E. Horne, Ted E. Meyer, Data Farming: Discovering Surprise,
Proceedings of the 2005 Winter Simulation Conference, R. G. Ingalls,M.
D. Rossetti, J. S. Smith, and B. A. Peters, eds.
[9] Jian Lin and Minjing Peng 2007, SVR-Based Data Farming Technique
for Web Application. In Ifip International Federation for Information
Processing, Volume 254, Research and Practical Issues of Enterprises
Impact Factor: 4.012
Published under
Asian Research & Training Publication
ISO 9001:2015 Certified
ISSN No. 2394-9007
www.ijrtonline.org
Information Systems II Volume I, eds. L.Xu, Tjoa A.,Chaudhry S.
(Boston: Springer),pp 433-441.
[10] M.Fleury, A.C.Downton and A.F.Clark, Scheduling Schemes for Data
Farming, IEEE Proc. Computer & Digital Tech., Vol. 146, No. 5,
September 1999.
[11] Han J, Kamber M 2001 Data Mining: Concepts and Techniques (San
Fransisco, CA: Morgan Kauffmann)
http://www.cs.uiuc.edu/homes/hanj/bk2/toc.pdf
[12] Dariusz Krola, Bartosz Kryzaa, Michal Wrzeszcza, Lukasz Dutka, Jacek
Kitowski, Elastic Infrastructure for Interactive Data Farming
Experiments, International Conference on Computational Science, ICCS
2012.
[13] Henrik Friman, Gary E.Horne, Using Agent Models and Data Farming
to Explore Network Centric Operations. Proceedings of the 2005 Winter
Simulation Conference.
[14] C.L. Chua, W.C. Sim, Automated Red Teaming: An Objective-Based
Data Farming Approach for Red Teaming. Proceedings of the 2008
Winter Simulation Conference.
[15] Dr. Alfred G. Brandstein, Dr. Gary E. Horne, Data Farming: A Meta-
Technique for Research in the 21st Century, Maneuver Warfare Science
1998.
[16] Dr. Gary E. Horne, Beyond Point Estimates: Operational Synthesis and
Data Farming, Maneuver Warfare Science 2001.
[17] Gary E.Horne, Henrik Friman. “Analysis of the Military Effectiveness
of Future C2 Concepts and Systems”, Held at NC3A, The Hague, the
Netherlands, 23-25 April 2002, in RTO-MP-117.
[18] Andrew Kusiak, Member, IEEE, “Feature Transformation Methods in
Data Mining”, IEEE Transactions on Electronics Packaging
Manufacturing, Vol. 24, No. 3, July 2001.
[19] Jun Zheng, Ming-Zeng Hu, Hong-Li Zhang, A New Method of Data
Pre-processing and Anomaly Detection, Proceedings of the third
international Conference on Machine Learning and Cybernetics,
Shanghai, 26-29 August 2004.
[20] Fang Yuan, Li-Juan Wang, Ge Yu, Study on Data Pre-processing
Algorithm in Web Log Mining, Proceedings of the Second International
Conference on Machine Learning and Cybernetics, Wan, 2-5 November
2003.
[21] Srivatsan Laxman And P.S. Sastry, A Survey of Temporal Data Mining,
Sadhana Vol. 31, Part 2, April 2006, pp. 173–198.
[22] Andrew Kusiak, Data Farming: A Primer, International Journal of
Operations Research Vol. 2, No. 2, 48−57 (2005) 1527
http://www.orstw.org.tw/ijor/vol2no2/Paper-6-IJOR-Vol2_2_-
Kusiak.pdf
[23] Brian F. Tivnan, Data Farming Co evolutionary Dynamics in Repast,
Proceedings of the 2004 Winter Simulation Conference R. G. Ingalls,M.
D. Rossetti, J. S. Smith, and B. A. Peters, eds.
[24] Theresa Princy. R and J. Thomas “Human Heart Disease Prediction
System using Data Mining Techniques”, ICCPCT, 2016, Pp 1-5.
[25] AigerimAltayeva, SuleimenovZharas and Young Im Cho “Medical
Decision Making Diagnosis System Integrating k-means and Naïve
Bayes algorithms”, ICCAS, 2016, Pp 1087-1092.
37