L3 - Search Landscapes and Hillclimbing Flashcards

1
Q

Give key umbrella terms of Evolutionary Computation…

A

Algorithm Type
Recombination ( Crossover )
Selection
Replacer
Mutation
Parameters

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Give 2 non evolutionary algorithms, that are flawed and less optimal, but are simpler…

A

Hillclimbing
Local Search

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Why are Hillclimbing and Local Search less optimal that EA’s?

A

Because they are prone to getting stuck at local optima. This is because they’re always looking for the next more optimised solution. Thus, if they reach a local optimum, they will stay at that solution since both the previous and next solution will be less optimum.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Define the Hillclimbing algorithm…

A

A search optimisation algorithm that finds the local optimal solution. It does this by making small mutations to the current solution, and assessing the fitness of each mutation. The algorithm only considers solutions that are no worse than the current locally optimal solution. In this sense, the algorithm can only climb up hill.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Explain the 4 steps of the Hillclimbing algorithm…

A
  1. Initialise a current solution c, and get the fitness of c.
  2. Mutate c to get some m
  3. Evaluate the fitness of m, compared to c, if m is no less optimal than c, assign m to c such that c = m.
  4. Repeat until termination criteria.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is a Landscape Graph in Hillclimbing? Define what is on the Y-axis and X-axis…

A

A graph that shows the fitness of an initial solution and it’s mutations.

Y-Axis is the fitness score.
X-Axis is the initial solution and it’s mutations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Describe how we can use Hillclimbing to solve the Travelling Salesman Problem for a graph with nodes A,B,C,D,E

A

Take the initial solution of A,B,C,D,E and iteratively apply a Mutation function of swapping 2 adjacent nodes. Whenever a mutation is no worse that the current solution, we assign it to the current solution.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Define a Landscape…

A

The graph we get when imposing F(s) on all s within a search space of solutions S.

Solutions are along the X-axis and fitness scores are along the Y-axis.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Define a Neighbourhood…

A

Given a mutation factor M, the neighbourhood of a solution is the set of all mutations of the solution.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Find the neighbourhood of the solution ‘1100101’ when M = flip a random bit.

A

If the initial solution s = 1100101

For every mutation, we need to choose a random bit from s, and flip it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

When mutating a solution, do we always mutate from the initial solution s?

A

Yes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Why do Landscapes tend to be smooth?

A

Because solutions and their neighbourhood only have small mutations applied, thus their fitness values are likely to be similar. These small increments / decrements in fitness result in a smooth local area in the landscape.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What would happen if the applies big mutations?

A

The landscape would be lively to have more drastic fluctuations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the 4 types of landscapes?

A

Unimodal
Plateau
Multimodal
Deceptive

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Explain the landscapes we usually see in real world problems…

A

We typically see landscapes that are not smooth and have more drastic fluctuations. This is because the search space for real problems is huge and varied, and only a small area of the search space contains solutions with high fitness. Thus, we typically end up with large, fluctuating landscapes that have only a small area of solutions with relevant fitness.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the most common type of landscape we see?

A

Multimodal

17
Q

If for real world problems we only have a small area of optimal fitness, why does it make it even more important not to apply big mutations?

A

Because big mutations would take our solution out of this area of relevant fitness.

18
Q

In what 2 ways could we improve the Hillclimbing algorithm?

A
  • Allow downhill moves
  • Enable populations of solutions, meaning we can analyse fitness of solutions and neighbourhoods in parallel as well as conduct crossover of solutions.
19
Q

Define what is meant by Local Search…

A

An optimisation technique where we iterate and mutate each neighbour of a solution.

The aim is to find the optimum solution within the neighbourhood.

20
Q

What is the relationship between Local Search and Hillclimbing?

A

Hillclimbing is a type of Local Search algorithm. Thus Local Search encompasses Hillclimbing, as well as other algorithms.

21
Q

What is an issue with Local Search?

A

Local Search still has an issue of getting stuck at a local optimum.

22
Q

What is the solution to the issue that Hillclimbing and Local Search have ?

A

Population-Based Search.

23
Q

Define Population-Based Search…

A

The same as Local Search but we have a set of current solutions rather than one. Thus, this helps resolve issues of getting stuck and gives the ability to perform recombinations of 2 or more solutions.

24
Q

Explain how Population-Based Search starts to show a convergence from these simpler algorithms to Evolutionary Algorithms…

A

Because we start to see sets of populations with locally optimal solutions. We can then see recombination between optimal solutions. Due to this, we build future solutions off of optimal solutions. Much like in nature, we see the survival of the fittest.

25
Q

As EA’s progress, what 2 properties do we see?

A
  • Genotypical convergence
  • Phenotypical convergence
26
Q

Using the concept of EA’s, work through the Travelling Salesman Problem…

A

27
Q

What is the difference between EA’s and Hillclimbing?

A
  • EA’s are population-based as opposed to Hillclimbing with is focussed on finding the local optimum.
  • EA’s deal with the search space of the problem, whereas Hillclimbing deals with the local search space ( neighbourhood ) of a current solution. Thus EA’s are broader and cover more solutions, thus are structured to find more optimum solutions.