L8 - ACO Flashcards

1
Q

Define ACO…

A

A population based metaheuristic that can be used to find approximate solutions for difficult combinatorial optimisation problems.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
1
Q

Define Heuristic…

A

A problem solving technique that uses a practical approach to find an optimal solution to a complex problem. Heuristics are are designed to quickly arrive at a ‘good enough’ solution.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Define Metaheuristic…

A

An algorithm that guides exploration and exploitation of search spaces in optimization and search problems

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Define Stochastic…

A

A term used to describe randomness or the presence of chance or probability in a process. It’s the opposite to deterministic.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are some of the properties that make ACO metaheuristic?

A
  • Problem independent → Is a generic algorithm that can be applied in various scenarios.
  • Exploitation and exploration balance.
  • Iteratively converge to a more optimal solution.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

How can we quickly determine whether we can utilise ACO to find an optimal solution?

A

Determine whether the problem can be thought of in terms of finding the best path in a weighted graph.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

In brief, what are the 4 steps of the ACO algorithm?

A
  1. A set of artificial ants searching for a good solution ( path ) over the graph.
  2. The ants build a solution by applying a pheromone model to the graph as they traverse it. This process is stochastic and is biased by the pheromone model, with ants more likely to take routes of a higher pheromone value. Pheromone values are modified at run time.
  3. This iterates until a termination criteria is met.
  4. The optimal solution is chosen.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is a Construction Graph?

A

A graph representation of the problem to be solved by ACO.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Edges of the Construction Graph have both a Pheromone and Heuristic value. Define each…

A

Pheromone Value : Cumulatively create the Pheromone model, which represents the global experience of the ant colony. This is updated during run time.

Heuristic Value : Problem dependent values.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Explain the process of how ACO works on the TSP…

A
  • The process goes:
    • Each ant starts at a random vertex, and adds this vertex to their visited vertices.
    • Ants take a construction step by travelling to a vertex that they have not visited before.
    • Each construction step is chosen probabilistically, which is biased by pheromone and heuristic values of the candidate edges.
      • Higher pheromone and heuristic value → Higher probability the ant will take that edge.
    • Once each ant has completed their tour, the pheromone values of each edge are updated. Initially, each edge experiences a set reduction ( evaporation ). Then, pheromones are added to each edge based on the quality of solutions that traversed the edge. For example, the edges of the highest quality solution will receive the most pheromones, and the edges of the lowest solution will receive he lowest number of pheromones.
    • This repeats until a termination criteria is met.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is the correlation of a solution path and the pheromone levels?

A

The higher the quality of the solution path ( shortest ), the higher the pheromone level. They are directly proportional.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the 3 key processes that the ACO performs during execution?

A

Generate Solutions
Daemon Actions
Pheromone Update

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Define the Generate Solutions process…

A

A process within the ACO metaheuristic…

  • The phase where ants traverse the graph to construct solutions.
  • Construction is defined by the Transition Rule.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the Transition Rule? How does it work?

A

The rules followed at each vertex that determines the ants next step in a probabilistic way.

The probability of taking a certain next path depends on the pheromone and heuristic values of the next edges.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the variables of the Transition Rule?

A

Tao i,j = Pheromone level of next edge.
n i,j = Heuristic value of next edge.
alpha = Global information, exponent of tao.
Beta = Local information, exponent of the Heuristic Value n.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is the trade off between alpha and beta in the Transition Rule?

A

Alpha is the exponent of tao, and controls the amount global knowledge is used to influence the probability of the next move.

Beta is the exponent of N ( heuristic value ), and controls the amount local knowledge is used to influence the probability of the next step.

16
Q

What are Daemon Actions?

A

Process during execution of ACO…

Sub-process after solutions have been generated. Most often this is a local search to further optimise the solutions.

17
Q

What is Pheromone Update?

A

Process during execution of ACO…

Increases the pheromone value of good solutions, decreases the pheromone value of bad solutions via evaporation.

18
Q

What is the equation for pheromone evaporation?

A

(1 - p)tao

19
Q

Define the Pheromone Update Rule…

A

The updated pheromone of an edge is calculated by performing evaporation on the edge, and then adding pheromones to the edge based on the quality of solutions that passed over it.

20
Q

How effective is ACO on the following types of problems? Small, Large, Dynamic, Static

A

Small : Can find optimal
Larger : Can find solutions that lean to optimal, but can’t guarantee optimal solution is found.
Dynamic : Work best due to need of continuous optimisation.
Static : Such as TSP, problem specific algorithms are better.

21
Q

Is ACO ideal for TSP problem?

A

No, because TSP is considered a static problem. ACO’s work best on dynamic problems. TSP would be better suited for a problem specific algorithm.

22
Q

For the transition Rule, when are Alpha and Beta decided? Do they change?

A

They are both decided at the start. This is an architectural design choice. They are constant throughout.