Fuzzy Neuro Systems for Machine Learning for Large Data Sets

#ahul $ala! Department of Information Technology Indian Institute of Information Technology and Management Gwalior http: students!iiitm!ac!in "ipg#$%%&'& rahul(alaiiitm)yahoo!co!in* r(ala)students!iiitm!ac!in
Paper: Kala, Rahul; Shukla, Anupam; Tiwari, Ritu, Fuzzy Neuro Systems for a!hine "earnin# for "ar#e $ata Sets%, Pro!ee&in#s of the '((( 'nternational A&)an!e *omputin# *onferen!e, ieee+plore, pp ,-./,-,, $i#ital 012e!t '&entifier .34..356'A$**473354-835395, 9/: ar!h 7335, Patiala, 'n&ia
Department of Information Technology Indian Institute of Information Technology and Management Gwalior IACC09 t h

March!

Data Size
In

General* More the training data, better the performance

Large

training sets +igh dimensionality +igh classification classes

Department of Information Technology Indian Institute of Information Technology and Management Gwalior IACC09 t h

March!

,ro-lems in Neural Networ(s

Department of Information Technology Indian Institute of Information Technology and Management Gwalior IACC09 t h

March!

The .asic Idea

Department of Information Technology Indian Institute of Information Technology and Management Gwalior IACC09 t h

March!

The /lgorithm

Department of Information Technology Indian Institute of Information Technology and Management Gwalior IACC09 t h

March!

The +ierarchical Nature

000

Department of Information Technology Indian Institute of Information Technology and Management Gwalior IACC09 t h

March!

The /pproach in Input Space

1 2 ' $ 1 1 $

1 2 ' $
Department of Information Technology Indian Institute of Information Technology and Management Gwalior

1 1
IACC09 t h

March!

3esults
Department of Information Technology Indian Institute of Information Technology and Management Gwalior IACC09 t h

March!

Fuzzy 4 Means 4lustering

Department of Information Technology Indian Institute of Information Technology and Management Gwalior IACC09 t h

March!

3esults
%& 'o& Data %et (fficiency )y (fficiency )y %ingle 'eural our Algorithm 'etwor* 51!16 85!&6 57!16 7$!&6

1! $!

Synthetic Data Face 3ecognition Data

Department of Information Technology Indian Institute of Information Technology and Management Gwalior IACC09 t h

March!

4onclusion
Training

Time Training 9fficiency

Department of Information Technology Indian Institute of Information Technology and Management Gwalior IACC09 t h

March!

3eferences
1!

/l:es* 3!Lde!S!; de Melo* <!D!; Neto* /!D!D! and /l-u=uer=ue* /!4!M!L* >New parallel algorithms for -ac(?propagation learning@* ,roceedings of the $%%$ International Joint Conference on Neural Networks* $%%$! I<4NN A%$* pp $B8B?$B71* $%%$ /min* Md! FaiCul; Murase* D!* Single?layered compleE?:alued neural networ( for real?:alued classification pro-lems* Neurocomputing F$%%8G* doi:1%!1%1B C!neucom!$%%8!%'!%%B /ng* <!+! et al!* Training neural networ(s for classification using growth pro-a-ility?-ased e:olution* Neurocomputing F$%%8G* doi:1%!1%1B C!neucom!$%%5!1%!%11 /zari* N!G! and Lee* S!?H* +y-rid partitioning for particle?in?cell simulation on shared memory systems* ,roc! of 11th International Conference on Distributed Computing Systems* $%?$' May 1771* pp! &$B?&22! .a-ii* Sorin; 4retu* Iladimir; ,etriu* 9mil M!* >,erformance 9:aluation of Two Distri-uted .ac(,ropagation Implementations@* ,roceedings of International Joint Conference on Neural Networks* Jrlando* Florida* KS/* /ugust 1$? 15* $%%5 4ampo-ello* Giuseppe; ,atane* Giuseppe and 3usso* Marco* >/n efficient algorithm for parallel distri-uted unsuper:ised learning@* Neurocomputing* Iolume 51* Issues 12?1&* /ugust $%%8* ,ages $71'?$7$8 Draghici Sorin* >/ neural networ( -ased artificial :ision system for licence plate recognitionL* international Journal of Network Security, International Journal of Neural Systems* Iol! 8* No! 1* 1775 9r* Meng <oo; Mhou* Hi* N/ no:el framewor( for automatic generation of fuzzy neural networ(sO* Neurocomputing, 51 F$%%8G &8'P&71 Q7R 9ste:ez* ,a-lo /; ,augam?Moisy* +elene* ,uzenat * Didier * Kgarte* Manuel* >/ scala-le parallel algorithm for training a hierarchical miEture of neural eEperts@* Parallel Computing $8 F$%%$G 8B1P871 Mhonghui; Mhou* .ing and Shen* <unyi* >/ parallel hierarchical clustering algorithm for ,4s cluster system@* Neurocomputing Iolume 5%* Issues '?B* <anuary $%%5* ,ages 8%7?818 /leE* Fernandez Santiago* Liwic(i Marcus* .un(e +orst* Schmidhu-er <urgen* SKnconstrained Jnline +andwriting 3ecognition with 3ecurrent Neural Networ(sL* d!ances in Neural Information Processing Systems $%* $%%8 Mdene(* >/ ,arallel algorithm for gradient training of feedforward neural networ(s@* Pattern Computing* $'F1778G* 8$2?827

$!

2!

'!

&!

B!

5!

8!

7!

1%!Feng*

11!Gra:es

1$!+anzale(

Department of Information Technology Indian Institute of Information Technology and Management Gwalior IACC09 t h

March!

12!

<ia* Mhen* .alasuriya* /rCuna and 4halla* Su-hash* @ Sensor fusion?-ased :isual target trac(ing for autonomous :ehicles with the out?of?se=uence measurements solution@* "obotics and utonomous Systems Iolume &B* Issue $* $7 Fe-ruary $%%8* ,ages 1&5?15B Da(* S!4!;@ New algorithms for training feedforward neural networ(s@* Pattern "ecognition #etters* 1&* $7&?$78 F177'G! Da(* Su-hash 4!*@ Jn generalization -y neural networ(s@* $#S$%I$" Information Sciences 111 F1778G $72?2%$ Lin* 4heng?<ian; +ong* Shang?<in* NThe design of neuro?fuzzy networ(s using particle swarm optimization and recursi:e singular :alue decompositionO* Neurocomputing 51 F$%%5G $75P21% Madineni* D!.!* > Two corner classiTcation algorithms for training the Da( feedforward neural networ(@! Information Sciences 81* $$7?$2' F177'G! Mohanty* S!; .hattacharya* S; N3ecognition of Ioice signals for Jriya Language using wa:elet Neural Networ(O* International Journal of $&pert Systems with pplications* Iol 2'* Issue 2* pp $12%?$1'5* /pril $%%8 CM

1'! 1&! 1B!

15!

18!

17!

Jzdzyns(i* ,iotr; Lin* /ndy; LilCeholm* Mimi and .eatty* <ac(son* >/ parallel general implementation of DohonenAs self? organizing map algorithm: performance and scala-ility@* Neurocomputing Iolumes ''?'B* <une $%%$* ,ages &B5?&51 ,agac* D!* Ne-ot* 9! M! and Durrant! U!* +!* >/n e:idential approach to map -uilding for autonomous ro-ots*@ I$$$ 'rans( )n "obotics and utomation* :ol!1'* no!$* pp! B$2?B$7* /ug! 1778! ,apa(ostas* G! /!* Darras D! /!* Mertzios .! G!* and .outalis* H! S* N/n 9fficient Feature 9Etraction Methodology for 4omputer Iision /pplications using Ua:elet 4ompressed Merni(e MomentsO* CM International Journal of Information Sciences* Iol 155* Issue 12* $%%5 ,urwin* Jli:er; DO/ndrea* 3affaello; Lee* <in?Uoo; >Theory and implementation of path planning -y negotiation for decentralized agents @* "obotics and utonomous Systems Iolume &B* Issue &* 21 May $%%8* ,ages '$$?'2B Sandhu * ,ar:inder Singh; Salaria* Dalwinder Singh; Singh * +ardeep* N/ 4omparati:e /nalysis of Fuzzy* Neuro?Fuzzy and Fuzzy?G/ .ased /pproaches for Software 3eusa-ility 9:aluationO* Proceedings of *orls cademy of Science, $ngineering and 'echnology Iolume $7 May* $%%8* ISSN 12%5?B88' Shu(la* /nupam; Tiwari* 3itu* NFusion of Face and Speech Features with /rtificial Neural Networ( for Spea(er /uthenticationO* I$'$ 'echnical "e!iew* Iol $'* No &* Septem-er?Jcto-er $%%5* pp 2&7?2B8 Suresh* S!; Jm(ar* S!N! and Mani* I* >,arallel Implementation of .ac(?,ropagation /lgorithm in Networ(s of Uor(stations@* I$$$ 'ransactions on Parallel and Distributed Systems* Iol 1B* No 1* pp $'?2'* <anuary* $%%& Taur* <!S!; Tao* 4!U!* N/ New Neuro?Fuzzy 4lassifier with /pplication to Jn?Line Face Detection and 3ecognitionO* Journal of %#SI Signal Processing $B* 275P'%7* $%%% Iieira* /rmando; .arradas* Nuno; N/ training algorithm for classification of high?dimensional dataO* Neurocomputing &% F$%%2G 'B1 P '5$

$%!

$1!

$$!

$2!

$'!

$&!

$B!

$5!

Department of Information Technology Indian Institute of Information Technology and Management Gwalior IACC09 t h

March!