Documente Academic
Documente Profesional
Documente Cultură
Swarm Intelligence
Swarm Intelligence (SI) is the property of a system
whereby
the collective behaviors of (unsophisticated) agents
interacting locally with their environment
cause coherent functional global patterns to emerge.
SI provides a basis with which it is possible to explore
collective (or distributed) problem solving without
centralized control or the provision of a global model.
Leverage the power of complex adaptive systems to
solve difficult non-linear stochastic problems
2
Swarm Intelligence
Characteristics of a swarm:
Swarm Intelligence
Social interactions (locally shared
knowledge) provides the basis for unguided
problem solving
The efficiency of the effort is related to but
not dependent upon the degree or
connectedness of the network and the
number of interacting agents
4
Swarm Intelligence
Robust exemplars of problem-solving in
Nature
Survival in stochastic hostile environment
Social interaction creates complex behaviors
Behaviors modified by dynamic environment.
History
Main idea and Algorithm
Comparisons with GA
Advantages and Disadvantages
Implementation and Applications
History
Main idea and Algorithm
Comparisons with GA
Advantages and Disadvantages
Implementation and Applications
What is PSO?
In PSO, each single solution is a "bird" in the
search space.
Call it "particle".
All of particles have fitness values
which are evaluated by the fitness function to be
optimized, and
have velocities
which direct the flying of the particles.
10
PSO Algorithm
Initialize with randomly generated particles.
Update through generations in search for
optima
Each particle has a velocity and position
Update for each particle uses two best
values.
Pbest: best solution (fitness) it has achieved so
far. (The fitness value is also stored.)
Gbest: best value, obtained so far by any
particle in the population.
11
12
13
14
PSO Algorithm
a
b
inertia
Personal influence
PSO Algorithm
a
b
PSO Algorithm
Inertia Weight
History
Main idea and Algorithm
Comparisons with GA
Advantages and Disadvantages
Implementation and Applications
19
23
24
Inertia Weight
Large inertia weight facilitates global
exploration, small on facilitates local
exploration
w must be selected carefully and/or decreased
over the run
Inertia weight seems to have attributes of
temperature in simulated annealing
25
Vmax
An important parameter in PSO; typically the
only one adjusted
Clamps particles velocities on each dimension
Determines fineness with which regions are
searched
if too high, can fly past optimal solutions
if too low, can get stuck in local minima
26
Simple in concept
Easy to implement
Computationally efficient
Application to combinatorial problems?
Binary PSO
27
29
ACO Concept
Ants (blind) navigate from nest to food source
Shortest path is discovered via pheromone trails
30
ACO System
Virtual trail accumulated on path segments
Starting node selected at random
Path selected at random
based on amount of trail present on possible paths from
starting node
higher probability for paths with more trail
34
35
36
37
38
39
ACO Background
Discrete optimization problems difficult to
solve
Soft computing techniques developed in
past ten years:
Genetic algorithms (GAs)
based on natural selection and genetics
42
Implementation
Can be used for both Static and Dynamic
Combinatorial optimization problems
Convergence is guaranteed, although the
speed is unknown
Value
Solution
43
The Algorithm
Ant Colony Algorithms are typically use to solve
minimum cost problems.
We may usually have N nodes and A undirected
arcs
There are two working modes for the ants: either
forwards or backwards.
Pheromones are only deposited in backward mode.
(so that we know how good the path was to update
its trail)
44
The Algorithm
The ants memory allows them to retrace the
path it has followed while searching for the
destination node
Before moving backward on their
memorized path, they eliminate any loops
from it. While moving backwards, the ants
leave pheromones on the arcs they
traversed.
45
The Algorithm
The ants evaluate the cost of the paths they
have traversed.
The shorter paths will receive a greater
deposit of pheromones. An evaporation
rule will be tied with the pheromones,
which will reduce the chance for poor
quality solutions.
46
pijk
where
ij
lN ik
il
if j N ik
k
0
if
j
N
i
is the neighborhood of ant k when
in node i.
N ik
47
The Algorithm
When the arc (i,j) is traversed , the
pheromone value changes as follows:
ij ij
The Algorithm
After each ant k has moved to the next node,
the pheromones evaporate by the following
equation to all the arcs:
ij (1 p ) ij , (i, j ) A
where p (0,1]is a parameter. An iteration is a
complete cycle involving ants movement,
pheromone evaporation, and pheromone
deposit.
49
Applications
Efficiently Solves NP hard Problems
Routing
TSP (Traveling Salesman Problem)
Vehicle Routing
Sequential Ordering
Assignment
1
5
Applications
Scheduling
Job Shop
Open Shop
Flow Shop
Total tardiness (weighted/non-weighted)
Project Scheduling
Group Shop
Subset
Multi-Knapsack
Max Independent Set
Redundancy Allocation
Set Covering
Weight Constrained Graph Tree partition
Arc-weighted L cardinality tree
Maximum Clique
52
Applications
Other
Machine Learning
Classification Rules
Bayesian networks
Fuzzy systems
Network Routing
Connection oriented network routing
Connection network routing
Optical network routing
53
k
)
u
m
P ( m)
(u m k ) (l m k )
h
54
Empirical Results
Compared Ant Colony Algorithm to
standard algorithms and meta-heuristic
algorithms on Oliver 30 a 30 city TSP
Standard: 2-Opt, Lin-Kernighan,
Meta-Heuristics: Tabu Search and
Simulated Annealing
Conducted 10 replications of each
algorithm and provided averaged results
59
2-Opt L-K
Near
Neighbor
437
421
Far Insert
421
420
Near Insert
492
420
Space Fill
431
421
Sweep
426
421
Random
663
421
60
Comparison to Meta-Heuristic
Algorithms
Meta-Heuristics are algorithms that can be applied to a variety of
problems with a minimum of customization.
Comparing ACO to other Meta-heuristics provides a fair
market comparison (vice TSP specific algorithms).
Best
Mean
Std Dev
ACO
420
420.4
1.3
Tabu
420
420.6
1.5
SA
422
459.8
25.1
61
62
63
65
67
Sources
Questions?
69