18 views

Uploaded by rohan_sh2003

swarm intelligence

- PSO optimized Feed Forward Neural Network for offline Signature Classification
- A Biologically-Inspired Clustering Protocol for Wireless Sensor Networks
- CVEN 2401 Workshop Week6
- 2012-NewBinaryPSObasedMethodforfindingbestthresholdsinassociationrulemining
- x 25119123
- Swarm Cluster Ind Grant Rev Rep Summary
- Schoen 1993
- PSO Heuristic Workflow Cloud2009
- Particle Swarm Optimization Based Adaptive Strategy for Tuning of Fuzzy Logic Controller
- VOLTAGE PROFILE IMPROVEMENT AND LINE LOSSES REDUCTION USING DG USING GSA AND PSO OPTIMIZATION TECHNIQUES
- swarm intelligence
- Homework 1
- Schedule
- Pancake Recipe
- The Solutions Of Travelling Salesman Problem using Ant Colony and Improved Particle Swarm Optimization Techniques
- L7
- Spectral Sub
- Sonar Image Processing Techniques for Reducing Noise.
- dm-recurrences.pdf
- div&Conq.pdf

You are on page 1of 6

What is swarm intelligence ? Swarm Intelligence (SI) is the property of a system whereby the collective behaviors of (unsophisticated) agents interacting locally with their environment cause coherent functional global patterns to emerge. SI provides a basis with which it is possible to explore collective (or distributed) problem solving without centralized control or the provision of a global model. (http://dsp.jpl.nasa.gov/members/payman/swarm/)

1 2/25/2003 CS 851: Bio-Inspired Computing 2

Eric Bonabeau, Marco Dorigo, and Guy Theraulaz

2/25/2003

Chapter 2: Ant Foraging Behavior, Combinatorial Optimization, and Routing in Communications Network

http://uk.geocities.com/markcsinclair/aco.html http://iridia.ulb.ac.be/~mdorigo/ACO/ACO.html http://www.iwr.uniheidelberg.de/groups/comopt/software/TSPLIB95/index.html

The Binary Bridge Experiment (Page 27) The ants choose one branch over the other due to some random fluctuations. Probability of choosing one branch over the other ~

PA =

( k + Ai ) n = 1 PB ( k + Ai ) n + ( k + Bi ) n

The values of k and n determined through experiments. k = degree of attraction of an unmarked branch n = choice function

CS 851: Bio-Inspired Computing 4

2/25/2003

2/25/2003

Ants deposit pheromone on the paths that they cover and this results in the building of a solution (optimal path). In SI and optimization, concept of pheromone evaporation is used. Helps in avoiding suboptimal solutions local optima. May differ from how it takes places in the real world.

Inter-nest Traffic studied a case of natural optimization Similarity with MST shown by Aron et al. Other experiments done effect of light vs dark, chemical vs visual cues. Conclusion here: some colonies have networks of nests several hundreds of meters in span it is possible this is close to a MST.

2/25/2003

2/25/2003

An example of powerful, totally decentralized control. Example : Eciton burchelli can consist of as many as 200,000 workers. These individuals are blind, communication via pheromone.

3 species of ants have a common ancestor. Can the foraging behavior be explained through a different environment in each case? Deneubourg et al. modeled the behavior of these ants. Used a 2-D grid Had several rules like: 1 ant deposits 1 unit of pheromone per each visited site while returning to its nest. Maximum number of ants per site

2/25/2003

2/25/2003

Pheromone disappearance rate at each site Movement of an ant from one site to the other based on a probabilistic mechanism shown earlier. Particular food distribution in the network A well-defined raid pattern is observed. Some similarity with the actual observations.

We now come to more rigorous mathematical models. TSP has been a popular problem for the ACO models. - several reasons why TSP is chosen.. Key concepts: Positive feedback build a solution using local solutions, by keeping good solutions in memory. Negative feedback want to avoid premature convergence, evaporate the pheromone. Time scale number of runs are also critical.

9 2/25/2003 CS 851: Bio-Inspired Computing 10

2/25/2003

1. 2. Used to solve TSP Transition from city i to j depends on: Tabu list list of cities not visited Visibility = 1/dij; represents local information heuristic desirability to visit city j when in city i. 3. Pheromone trail Tij(t) for each edge represents the learned desirability to visit city j when in city i. Generally, have several ants searching the solution space. m=n

CS 851: Bio-Inspired Computing 11

Transition Rule Probability of ant k going from city i to j:

k (t ) = pij

[ (t)] .[ ]

ij ij

[ il (t )] .[il ]

J ik

2/25/2003

2/25/2003

12

k (t ) = pij

[ (t )] .[ ]

ij ij

Pheromone update :

k ij = Q / Lk (t ) if (i, j ) T k (t ) else 0.

[ il (t) ] .[il ]

J ik

Alpha = 0 : represents a greedy approach Beta = 0 : represents rapid selection of tours that may not be optimal. Thus, a tradeoff is necessary.

T is the tour done at time t by ant k, L is the length, Q is a heuristic parameter. Pheromone decay:

ij (t ) = (1 ). ij (t ) + ij (t )

2/25/2003

13

2/25/2003

14

Modifications to the algorithm: Elitist scheme borrowed from GA Use the elitist to update its own tour (T+) edges for pheromone deposition. Could extend the same concept to e elitists ants. Results ..? Does not perform as well as other methods the ones mentioned are TS (Tabu Search) and SA.

Does not converge to a single solution is that a good criteria?

However, they conclude that the nonconvergence property is interesting 1. It tends to avoid trappings in local optima. 2. Could be used for dynamic problems. So next ..ACS

2/25/2003

15

2/25/2003

16

j = arg max uJ i { ij (t ) .[ iu ] } if q q o j = J

ij (t ) = (1 ). ij (t ) + . ij (t )

Pheromone update rule (new): However, only applied to the best ant. The change in the pheromone concentration = 1/L+. Local updates done as follows:

Modifications to AS. New transition rule: qo is a parameter that can be tweaked It is similar to tuning temperature in SA. J is a city randomly selected according to the probability calculated previously. This helps ACS to improvise on the best solutions.

ij (t ) = (1 ). ij (t ) + 0

2/25/2003

17

2/25/2003

18

To improves its search methodology, uses a candidate list of cl closest cities, considers these first, considers other cities only when the list is exhausted. Example cl = 15 on Page 51. ACS-TSP has been applied on problems of various sizes. ACS-TSP has been shown to be superior over other methods like GA, SA, EP for problems of size 50 100 cities. For larger size problems

Use a local search method in conjunction with ACS-TSP. Called as 2-opt, 3-opt refers to the number of edges exchanged iteratively to obtain a local optima. Has been shown to be comparable to the best techniques available (GA). Other methods for improvement Elitism, worst tours (pheromone removed), local search enhancement.

19 2/25/2003 CS 851: Bio-Inspired Computing 20

2/25/2003

Find pi such that the following is minimized:

Associate the minimum total flow at a node with the maximum total potential and so on : min-max coupling rule. This is a good heuristic, but does not give the optimal results. Hence AS-QAP proposed. The transition rule the probability that the kth ant chooses activity j as the activity to assign to location i is:

C ( ) =

i, j=1

ij

(i) ( j)

QAP has shown to be NP-hard. ds are the distance between the nodes and fs are the flows between nodes. The problem is similar to TSP. distance potentials and flow potentials.

k (t ) = pij

[ (t )] .[ ]

ij ij

[ il (t )] .[il ]

22

J ik

2/25/2003 CS 851: Bio-Inspired Computing 21 2/25/2003 CS 851: Bio-Inspired Computing

1. 2. 3. Departs radically from previously described ACO algorithms. Three procedures: Pheromone-trail-based modification Local search Pheromone trail updating

ij (t ) = (1 ). ij (t ) + ij (t )

Same pheromone update rule as AS-TSP. Here the change is equal to Q/Ck(t) though hence low coupling (C) value means a stronger pheromone trail. Results : GA, ES < AS-QAP < TS, SA Improvements..

2/25/2003

23

2/25/2003

24

p

k ij

Local search: After a new solution is obtained, do a local search to get a lower point in solution space. This point may not necessarily be the local optima (why?) Pheromone-trail updating is done as follows:

n l = 1

j )

+

( l )

( i )

( i )

Over here, each ant represents a solution like in GA, SA etc. It moves to another solution by applying R swaps. Example R = n/3. And the probability of moving from one point in solution space to the other is given above.

i (i ) (t ) = (1 ). i (i ) (t ) + i (i ) (t )

Here the change at each time step = 1/C(pi)+.

2/25/2003

25

2/25/2003

26

Intensification keeping new best solutions in memory and replacing the current ones with them; again similar to elitism. Diversification: All pheromone trail values are reinitialized if no improvement is made in S generations example S = n/2. How does HAS-QAP perform ? The results are that it performs comparable to other methods. However, it does not do so well for regular problems reason? Does good for problems that have a irregular structure.

ACO algorithms have been applied to several optimization problems now. Some of them are: Job-scheduling problem TSP Graph-coloring Vehicle Routing Shortest common supersequence

2/25/2003

27

2/25/2003

28

Applications to networks

These problems have their states changing with time. Routing in telecommunication networks is dynamic and distributed. Ant-based control (ABC) approach The ants goal is to build, and adapt to load changes as the system evolves. Example a telephone network having bidirectional links; each node has ki neighbors. Each node has certain constraints.

2/25/2003 CS 851: Bio-Inspired Computing 29

Ant-based control

Each node has a capacity Ci and a spare capacity Si. Each node has a routing table Ri this table is update according to probability calculated from pheromone depositions. This is shown on Page 82. To calculate this, the concept of aging is involved this means that an older ant has less influence on changes as compared to a younger ant. We want this since the conditions are changing the nodes are receiving new calls. New ants are also generated from any node of the network at any time.

2/25/2003 CS 851: Bio-Inspired Computing 30

Ant-based control

The objective here is to minimize the cost (Page 80). Schoonderwoerd et al. applied ABC to the British Telecom SDH network. (Page 88). ABC was shown to do better than other methods in terms of average number of call failures. (Page 87). Other modification to ABC ABC with smart ants reinforce other paths with pheromone in addition to the main path.

Ant-based control

Other methods that build upon ABC: ANTNET Ant Routing based on the Ant System (AS)

2/25/2003

31

2/25/2003

32

Conclusions

Pros ?

Cons?

2/25/2003

33

- PSO optimized Feed Forward Neural Network for offline Signature ClassificationUploaded byAnonymous 7VPPkWS8O
- A Biologically-Inspired Clustering Protocol for Wireless Sensor NetworksUploaded byM Z Khan
- CVEN 2401 Workshop Week6Uploaded byMichael Boutsalis
- 2012-NewBinaryPSObasedMethodforfindingbestthresholdsinassociationruleminingUploaded byjkl316
- x 25119123Uploaded byAnonymous 7VPPkWS8O
- Swarm Cluster Ind Grant Rev Rep SummaryUploaded byMegan Dee
- Schoen 1993Uploaded byWesternDigi
- PSO Heuristic Workflow Cloud2009Uploaded bydanang2008
- Particle Swarm Optimization Based Adaptive Strategy for Tuning of Fuzzy Logic ControllerUploaded byAdam Hansen
- VOLTAGE PROFILE IMPROVEMENT AND LINE LOSSES REDUCTION USING DG USING GSA AND PSO OPTIMIZATION TECHNIQUESUploaded byJournal 4 Research
- swarm intelligenceUploaded bykomalpilla
- Homework 1Uploaded byKrutarth Patel
- ScheduleUploaded byjijo123408
- Pancake RecipeUploaded byAndrew Gawidan
- The Solutions Of Travelling Salesman Problem using Ant Colony and Improved Particle Swarm Optimization TechniquesUploaded byInternational Journal for Scientific Research and Development - IJSRD
- L7Uploaded byJason Chiang
- Spectral SubUploaded byshivarajmd
- Sonar Image Processing Techniques for Reducing Noise.Uploaded byIJSTE
- dm-recurrences.pdfUploaded byLawrence Lim Ah Kow
- div&Conq.pdfUploaded byEbmesem
- MAE core NTUUploaded byĐức Long Nguyễn
- d 0361034037Uploaded byinventionjournals
- QueueUploaded byAnonymous PDGLsjN1Q5
- Radial Fourier Analysis (RFA) Descriptor with Fourier-based Keypoint OrientationUploaded byAI Coordinator - CSC Journals
- systemsUploaded byapi-252490560
- Automatic Load Frequency Control of Two Area Power System With Conventional and Fuzzy Logic ControlUploaded byesatjournals
- HAZOP (2)Uploaded byAnthony Rosa
- Operations ResearchUploaded bynoah
- Power System Operation and ControlUploaded byDebabrata
- ZLPEP_FI_0026_IN_V2Uploaded byJuan Carlos Hermitaño Villegas

- Typesetting Tables With LATEXUploaded bysunke2009
- Lab2 Fitting Probability DistributionsUploaded byrohan_sh2003
- Table TricksUploaded byrohan_sh2003
- Holy Science 1920 EditionUploaded byrohan_sh2003
- Swarm IntelligenceUploaded byrohan_sh2003
- LaTeX Mathematical SymbolsUploaded byjfreyre
- Assignment 1Uploaded byrohan_sh2003
- Solution.manual.to.Introduction.to.Mathematical.statistics..6ed..Hogg..McKean.and.CraigUploaded byrohan_sh2003
- 21st Century Dawn of the Era of Divine Descent on EarthUploaded byrohan_sh2003
- 21st Century Dawn of the Era of Divine Descent on EarthUploaded byrohan_sh2003
- 21st Century Dawn of the Era of Divine Descent on EarthUploaded byrohan_sh2003

- SIMSCAPE Optimal Control DesignUploaded bywararu
- DSS Simon's ModelUploaded bydiptimansom
- What Are Carnot Cycle, Otto Cycle, And Diesel Cycle_ - QuoraUploaded by666667
- Wiley.software.testing.and.Quality.assurance.theory.and.Practice.aug.2008.eBook DDUUploaded byahamoriahamori
- advanced microprocessor questionsUploaded byNikhil Pathak
- 00 Good Switched Afﬁne Systems DC-DC Optimal ControlUploaded byTớThíchThienvanHoc
- Fourier Family CheatSheet v2.0Uploaded byNikesh Bajaj
- NI-Tutorial-6163 , Build a Hybrid Control System With NI LabVIEWUploaded bygmagi169337
- 131control SystemsUploaded bySushant Yadav
- 1 programa oficialUploaded byapi-325735090
- An Agile BPM Project MethodologyUploaded bysinisa.milosevic4125
- Fast Fourier Transform and Its Applications PDF BrighamUploaded byValerie
- Portugali_1997_SELF-ORGANIZING cities.pdfUploaded byShreyas Srivatsa
- Minimum Time Control(1) (1)Uploaded byhgfhgfhf
- An Introduction to Agent-Based ModelingUploaded bysmarteletto
- Monitor and Optimize PID Loop Performance With Aspen PID WatchUploaded byreclatis14
- pilz-safety-plcUploaded byAvinash Gokhale
- Experiment No. 02Uploaded byfahadfiaz
- Fuzzy ControlUploaded byOla Skeik
- EID303_SE_UNIT_I_Lecture_Notes_3B5.docx.docUploaded byrevathi
- Quality New Competitive WeaponUploaded byChinmaya Mohanty
- SCADA IN WATER SECURITYUploaded byBharadwaj Santhosh
- Artificial Bee Colony AlgorithmUploaded bynitte5768
- Qestions-chap1+2.pdfUploaded byKathleen Qui Saldon
- Vehicle Connectivity EASISUploaded byGirish Kasturi
- operation researchUploaded bykamun0
- OBATSUploaded byArpan Mehta
- Supply Chain and Operations Management April16Uploaded byvipinvermasept
- DO178Uploaded byDharma Teja Chowdary
- lee1995.pdfUploaded byhuse