Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS)...
-
date post
15-Jan-2016 -
Category
Documents
-
view
228 -
download
0
Transcript of Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS)...
![Page 1: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/1.jpg)
Unconventional Optimization
David Corne, School of Mathematical & Computer Sciences
(MACS)Heriot-Watt University, Edinburgh, UK
![Page 2: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/2.jpg)
• About Heriot-Watt University - born: 1821
- address: Edinburgh, UK
- very focussed on science and technology
- photo, from close up:
![Page 3: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/3.jpg)
MACS by numbers~50 Mathematicians (academics)
~25 Computer scientists (academics)
~50 current funded projects (~£18M)
~30 current industry collaborators
~2 Mathematics Depts
~1 world leading paper published every 6 weeks
~1 world-class paper published every 2 weeks
![Page 4: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/4.jpg)
International Collaborations
(MACS)
![Page 5: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/5.jpg)
Broadly speaking, we do ...
High performance computing (languages, numerical analysis) 4M
Mathematical Physics (structure of universe, & other things) 0.5M
Mathematical Biology (spread of diseases, pop dynamics, tumour growth) 0.3M
Financial Mathematics (actuarial, etc.) 0.5M
Stochastic Systems (energy supply/demand, carbon markets,...) 1.2M
Voice/Dialogue Interaction (and – touch, gesture, multi-) 5M
Intelligent Systems (designing, optimising, planning, virtual reality) 3.5M
Pervasive, Ubiquitous & Mobile Computing (World: “Hello”) 3M
Analysis (PDEs, dynamical systems, nonlinearity) 0.4M
And, of course, much much more ...
![Page 6: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/6.jpg)
Enhancing recovery from oil wells (using various methods from optimisation and machine learning)
Modelling energy consumption and social interaction in an eco-village (social networks save energy)
Multiobjective probability collectives
Self-organisation in LTE neworks
Topic and structure discovery in research texts
Forecasting behaviour of large-scale IT systems
DWC
![Page 7: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/7.jpg)
![Page 8: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/8.jpg)
![Page 9: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/9.jpg)
Framework:
problem instance k Algorithm Solution to problem instance k
![Page 10: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/10.jpg)
Two CEC 2011 Plenaries / Two Visions of Optimization
1. A tested vision from Holger Hoos – automated optimizer parameter/configuration tuning; humans are very bad at this – algorithms are good at it
2. A less-tested vision from Nat Krasnogor - algorithms will self-generate to work well in their environment, like a network of veins grows and adapts to irrigate its environment
![Page 11: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/11.jpg)
A less conventional vision
• Holger and Nat were (mainly) talking about designing standard optimizers (that in themselves work in a conventional way), but new ways to design them, exploiting increasingly available processing power
• My ‘vision’ is different:– Step changes in processing power and memory suggest a
different kind of optimizer may be possible– One that exploits memory
![Page 12: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/12.jpg)
Conventional Optimization
RealProblem Instances
![Page 13: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/13.jpg)
Conventional Optimization
RealProblem Instances
Formulateas single-objectiveproblems
![Page 14: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/14.jpg)
Conventional Optimization
RealProblem Instances
Formulateas single-objectiveproblems
Develop slow algorithms
that do well on test
instances
![Page 15: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/15.jpg)
Conventional Optimization
RealProblem Instances
Formulateas single-objectiveproblems
Develop slow algorithms
that do well on test
instances
...with no guarantees on how well the algorithms generalise
![Page 16: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/16.jpg)
Unconventional Optimization
RealProblem Instances
Formulateas single-objectiveproblems
Develop slow algorithms
that do well on test
instances
...with no guarantees on how well the algorithms generalise
![Page 17: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/17.jpg)
Unconventional Optimization
RealProblem Instances
Formulateas single-objectiveproblems
Develop slow algorithms
that do well on test
instances
...with no guarantees on how well the algorithms generalise
Formulate as
multi- objective
![Page 18: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/18.jpg)
Unconventional Optimization
RealProblem Instances
Formulateas single-objectiveproblems
Develop slow algorithms
that do well on test
instances
...with no guarantees on how well the algorithms generalise
Formulate as
multi- objective
Develop fast
algorithms that do
well on spaces of
test instances
![Page 19: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/19.jpg)
Unconventional Optimization
RealProblem Instances
Formulateas single-objectiveproblems
Develop slow algorithms
that do well on test
instances
...with no guarantees on how well the algorithms generalise
Formulate as
multi- objective
Develop fast
algorithms that do
well on spaces of
test instances
with a principled
understanding of
how they
generalize
![Page 20: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/20.jpg)
Unconventional Optimization
RealProblem Instances
Formulateas single-objectiveproblems
Develop slow algorithms
that do well on test
instances
...with no guarantees on how well the algorithms generalise
Formulate as
multi- objective
Develop fast
algorithms that do
well on spaces of
test instances
with a principled
understanding of
how they
generalize
![Page 21: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/21.jpg)
Unconventional Optimization
Develop fast
algorithms that do
well on spaces of
test instances
Hyper-
heuristics
Super-
heuristics Optimization via
Precomputation
![Page 22: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/22.jpg)
Unconventional Optimization
• Hyper-heuristics now ~ 30,000 hits on google scholar
• Much industry uptake
• Rooted in “Fang, Corne, Ross” work in mid 90s
• Basic idea: don’t evolve a solution to a given problem instance, evolve an algorithm that builds a solution to any given instance
• Pursued in two directions:
– Not very interesting: use it as a fancy encoding, just solving one instance at a time
– Very Very interesting, evolve very fast algorithms that give workable solutions for entire subspaces of problems (Ross, Terashima-Marin, Vella, Corne, ...)
Hyper-
heuristics
Super-
heuristics
![Page 23: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/23.jpg)
Hyper-Heuristics 1990-2008
![Page 24: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/24.jpg)
Unconventional Computing 1960-2208
![Page 25: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/25.jpg)
`Most’ problems in industry …
• Need to be solved hourly, daily or weekly• Need to be solved almost instantly (also think
of green computing)
Near-optimality is not very important:
• Data/conditions will change• The problem solved is not the real problem
anyway
![Page 26: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/26.jpg)
motivation for hyper (super)-heuristics
The space of optimisation problem instances (including machine learning)
in industry, science, commerce, etc…
Very fastVery slowHow fast we solve an instance
How good the solution needs to be
Bestpossible
OK
poor/random
We have supplied lots of this, but it is not what is really needed in a lot of
scenarios
We have supplied lots of this, but it is not what is really needed in a lot of
scenarios
![Page 27: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/27.jpg)
The space of optimisation problem instances (including machine learning)
in industry, science, commerce, etc…
Very fastVery slowHow fast we solve an instance
How good the solution needs to be
Bestpossible
OK
poor/random
We have supplied lots of this, but it is not what is really needed in a lot of
scenarios
We have supplied lots of this, but it is not what is really needed in a lot of
scenarios Supplied by sup-heuristics (also OvP)
Supplied by sup-heuristics (also OvP)
motivation for hyper (super)-heuristics
![Page 28: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/28.jpg)
Notes...
1. Extremely fast, but low-power-consumption, algorithms are a
huge challenge for lots of problems. Think of greedy, constructive algorithms, but which achieve good,maybe optimal
solutions to large problems with the first solution they construct.
2. If such existed, they could of course be engineered to be slower, but more optimal …
3. The techniques involved can give us real, new scientific insights into the relationships between problems, heuristics and solutions. This and point 2 are salient for all problems.
![Page 29: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/29.jpg)
Hoos space
Corne space
Standard human designed ingredientsfor standard algorithms (broadly speaking!)-- configured and optimised automatically togive better or faster solutions
![Page 30: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/30.jpg)
Hoos space
Corne space
very fast algorithmsthat give `good enough’solutions.
Generalisation:design of training instancesfor target space of real instances
Standard human designed ingredientsfor standard algorithms (broadly speaking!)-- configured and optimised automatically togive better or faster solutions
![Page 31: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/31.jpg)
Hoos space
Corne space
very fast algorithmsthat give `good enough’solutions.
Generalisation:design of training instancesfor target space of real instances
Slow algorithms, like EAs, SA, ILS, etc … do have their place, and I use them allthe time, but I think the best use for them is as the learning method in SH
Standard human designed ingredientsfor standard algorithms (broadly speaking!)-- configured and optimised automatically togive better or faster solutions
![Page 32: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/32.jpg)
Unconventional Optimization
• Hyper-heuristics hits (n hits g-s)
• Much industry uptake
• Rooted in “Fang, Corne, Ross” work in 90s
• Basic idea: don’t evolve a solution to a given problem instance, evolve an algorithm that builds a solution to any given instance
• Pursued in two directions:
– Not very interesting: use it as a fancy encoding, just solving one instance at a time
– Very Very interesting, evolve very fast algorithms that give workable solutions for entire subspaces of problems (Ross, Terashima-Marin, Vella, Corne, ...)
Hyper-
heuristics
Super-
heuristics
![Page 33: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/33.jpg)
Early days: Evolving Heuristic Choice
Fang, Ross, Corne, “A promising …”, Proc. ECAI, 1994
An example Open-Shop Scheduling problem solved to optimality
![Page 34: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/34.jpg)
Early days: Evolving Heuristic Choice
Fang et al used an encoding like this:
a,b,c,d,… means:
use heuristic a to choose a task from the bth uncompleted job, and schedule it in the earliest place it can go;
use heuristic c to choose …
Examples of heuristics are: LPT (the task with the longest processing time) SPT (the task with the shortest processing time) SG-LPT (consider operations that can fit in a gap – choose the one which has longest processing time etc …
![Page 35: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/35.jpg)
Results were ‘promising’
For a brief time, this was the best recorded result on the 10x10 benchmark
![Page 36: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/36.jpg)
We noticed ...
5, 7, 2, 9, 7, 1, 1, 4, 5, 3
Is a ‘chromosome’ that specifies a solution to our 5-job OSSP
It is also an algorithm, that can be applied to any 5-job OSSP
So, we had evolved fast algorithms – but not particularly good ones: restricted to a fixed number of tasks, and seeming to
ignore instance specifics.
![Page 37: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/37.jpg)
Better choices for fast constructive algorithms
![Page 38: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/38.jpg)
Example of a problem state vector 5 items remaining 3 large 2 small 0 bins more than 50% packed etc ...
![Page 39: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/39.jpg)
Another problem state vector 3 items remaining 1 large 2 small 1 bins more than 50% packed etc ...
![Page 40: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/40.jpg)
Rules forProblem State Heuristic Choice
Problem State For bin packing, maybe:
A vector describing the distribution of sizes of items remaining to pack;
A vector describing the current state of the partly packed bins;
Etc … easy to think of corresponding characterisations for other problems
![Page 41: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/41.jpg)
Sets of State -> Heuristic rules
If state = S1 use heuristic H3
If state = S2 use heuristic H1
If state = S3 use heuristic H7
If state = S4 use heuristic H4
If state = S5 use heuristic H2
Default
either Use best matching state
or Use a default, e.g. H1
This is the basis of a constructive algorithm
![Page 42: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/42.jpg)
A constructive algorithm using<problem state> <heuristic> ruleset
Initialise solution Identify initial problem state S Repeat nitems times determine rule R whose LHS best matches problem state S
{schedule/place/set} next item using heuristic on RHS of R Update state S
![Page 43: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/43.jpg)
About such ‘super-heuristic’ encodings
• Fast, constructive algorithms
• Very, very very fast, compared with something like Evolutionary Algs or simulated annealing, etc …
• We could just use this as a sophisticated encoding for an EA solver that solves one instance at a time, but that’s wasteful and blinkered.
•The idea of SH is to set up an appropriate search or learning method (EA, classifier system, NN, etc) to find a single ruleset that works ideally over a given space of instances
![Page 44: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/44.jpg)
Ross et al evolved algorithms that looked like this
The evolved algorithms are rule-sets. The Interpretation is:
Repeat until no more items {execute rule with closest state match to current problem state}
An example rule-set with 12 rules
![Page 45: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/45.jpg)
Some of Ross et al’s results
Note: three differentSH tested – GA,XCSs and XCSm
Reported for bestResult of each GAor XCS run
E.g. on 5.5% of thetest problems, the H found by GA found a solution with 1 bin fewer than the best found by the four heuristics LFD etc…
5.5
![Page 46: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/46.jpg)
Tereshima-Marin et al,stock-cutting
![Page 47: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/47.jpg)
![Page 48: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/48.jpg)
SH
![Page 49: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/49.jpg)
The power of automated algorithm configuration
Hoos and co-workers use “ParamILS” (a fairly standard iterated local search) to optimise algorithm parameters and decision variables
![Page 50: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/50.jpg)
The power of automated algorithm configuration
Hoos and co-workers use “ParamILS” (a fairly standard iterated local search) to optimise algorithm parameters and decision variables; originally ParamILS was used to improve “SPEAR”, an algorithm for SAT problems.Here tested on real software verification benchmarks:
These are results on
![Page 51: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/51.jpg)
The power of automated algorithm configuration
Hoos and co-workers use “ParamILS” (a fairly standard iterated local search) to optimise algorithm parameters and decision variables; originally ParamILS was used to improve “SPEAR”, an algorithm for SAT problems.Here tested on real software verification benchmarks:
These are results on
![Page 52: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/52.jpg)
The power of automated algorithm configuration
• http://people.cs.ubc.ca/~hoos/Talks/lion-4-tutorial-slides.pdf
![Page 53: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/53.jpg)
Unconventional Optimization
Develop fast
algorithms that do
well on spaces of
test instances
Hyper-
heuristics
Super-
heuristics Optimization via
Precomputation
![Page 54: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/54.jpg)
Computers are faster and faster, storage is cheap
Here is a really simple idea
![Page 55: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/55.jpg)
Computers are faster and faster, storage is cheap
Here is a really simple idea
Client has a daily VRP
![Page 56: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/56.jpg)
Computers are faster and faster, storage is cheap
Here is a really simple idea
Client has a daily VRP
Develop an EA/PSO/SA/etc... to solve instances of the client’s VRP
3 months (say)
![Page 57: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/57.jpg)
Computers are faster and faster, storage is cheap
Here is a really simple idea
Client has a daily VRP
Develop an EA/PSO/SA/etc... to solve instances of the client’s VRP
3 months (say)
Deliver app that takes
~10m to find near-opt
![Page 58: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/58.jpg)
Computers are faster and faster, storage is cheap
Here is a really simple idea
Client has a daily VRP
Develop an EA/PSO/SA/etc... to solve instances of the client’s VRP
3 months (say)
Deliver app that takes
~10m to find near-opt
![Page 59: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/59.jpg)
Computers are faster and faster, storage is cheap
Here is a really simple idea
Client has a daily VRP
Develop an EA/PSO/SA/etc... to solve instances of the client’s VRP
3 months (say)
Deliver app that takes
~10m to find near-opt
Client has a daily VRP
![Page 60: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/60.jpg)
Computers are faster and faster, storage is cheap
Here is a really simple idea
Client has a daily VRP
Develop an EA/PSO/SA/etc... to solve instances of the client’s VRP
3 months (say)
Deliver app that takes
~10m to find near-opt
Client has a daily VRP
Generate and solve every problem the client might face
3 months (say)
![Page 61: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/61.jpg)
Computers are faster and faster, storage is cheap
Here is a really simple idea
Client has a daily VRP
Develop an EA/PSO/SA/etc... to solve instances of the client’s VRP
3 months (say)
Deliver app that takes
~10m to find near-opt
Client has a daily VRP
Generate and solve every problem the client might face
Deliver app that looks up
solution to the instance
presented.
3 months (say)
![Page 62: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/62.jpg)
Why not?
![Page 63: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/63.jpg)
Why not?
![Page 64: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/64.jpg)
Customers: 30
Each day’s problem is selection of 20
30C20 is only ~30,000,000 (almost 0)
We can just solve/store them all
![Page 65: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/65.jpg)
Customers: 50
Each day’s problem is selection of 20
50C20 is ~47,000,000,000,000 (> 0)
not so easy to solve/store all
![Page 66: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/66.jpg)
Customers: 50
Each day’s problem is selection of 20
50C20 is ~47,000,000,000,000 (> 0)
not so easy to solve/store all
but we can solve/store some
![Page 67: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/67.jpg)
The continuum of opportunity
All possible instances
can be solved
10−1 instances
can be solved
...
10−2 instances
can be solved
10−3 instances
can be solved
10−4 instances
can be solved
10−5 instances
can be solved
![Page 68: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/68.jpg)
The continuum of opportunity
All possible instances
can be solved
10−1 instances
can be solved
...
10−2 instances
can be solved
10−3 instances
can be solved
10−4 instances
can be solved
10−5 instances
can be solvedNew instance to solve
Tablelookup
Exploit ‘closest’ solved instances
![Page 69: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/69.jpg)
![Page 70: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/70.jpg)
![Page 71: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/71.jpg)
![Page 72: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/72.jpg)
![Page 73: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/73.jpg)
Suppose a problem instance has m features
![Page 74: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/74.jpg)
Suppose a problem instance has m features
each with k possible values
![Page 75: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/75.jpg)
Suppose a problem instance has m features
each with k possible values
we have a solved instance a
we have a new instance b
![Page 76: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/76.jpg)
Suppose a problem instance has m features
each with k possible values
we have a solved instance a
we have a new instance b
Prob that a and b coincide in c features is
![Page 77: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/77.jpg)
![Page 78: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/78.jpg)
When k=5, chance of a and b sharing2/3 of their features is 3.8×10−8
So if we have 100M pre-solvedinstances, ~3 will share 67%
![Page 79: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/79.jpg)
Nota Bene ...
- instance space may be far smaller than an instance’s search space
- there are often good quality priors over instances
![Page 80: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/80.jpg)
Optimization via Precomputationopportunities and issues
• the distance measure between problem instances– E.g. 10-job Single-machine job shop problem,
instances defined by processing time and due dates:
• Order tasks by proc. time, normalize resulting due date vector – Euclidean distance on that?
• Distance between 12-job and 10-job instance?
![Page 81: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/81.jpg)
Optimization via Precomputationopportunities and issues
• the distance measure between problem instances– E.g. 30-customer vehicle routing problem
• Set overlap between the subsets of customers in the two instances?
• An optimized geographical alignment between the two sets of customers?
![Page 82: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/82.jpg)
Optimization via Precomputationopportunities and issues
• the distance measure between problem
instances• How to exploit the close pre-computed
instances– Seed a population-based search with the solutions
of the closest k , perhaps with mutations ?– Use the closest k to bias neighbourhood
operators? To impose constraints?
![Page 83: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/83.jpg)
Optimization via Precomputationopportunities and issues
• the distance measure between problem instances
• How to exploit the close pre-computed instances
• Mapping the solution of instance a into a candidate solution for instance b– in some cases far from obvious!
![Page 84: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/84.jpg)
Optimization via Precomputationopportunities and issues
• the distance measure between problem instances
• How to exploit the close pre-computed instances
• Mapping the solution of instance a into a candidate solution for instance b
• Fast retrieval of closest instances
![Page 85: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/85.jpg)
CBR
Of course, OvP is similar in nature to Case-Based Reasoning, but completely different in application context and research issues
![Page 86: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/86.jpg)
Potential Applicability
• Where regular instances come from a ‘stable’ with its own characteristic space– E.g. a specific florist in Helsinki, a button
manufacturer in Ningbo province, a commercial TV station in southern USA
• Where there is need to quickly change solutions to adapt to new circumstances
• Wherever else there is a great need or desire to reduce the time to find solutions
![Page 87: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/87.jpg)
the crucial element ...
OvP can only be effective if:
given pre-solved instance a
given new instance n
the solution of a is helpful in solving n
![Page 88: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/88.jpg)
Perturbation distance between instance and seed instance
Single-Machine-tardiness, 50 tasks
To what extent is it helpful to seed a population with the solution to a similar instance?
![Page 89: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/89.jpg)
Vehicle Routing Problem with 50 deliveries
To what extent is it helpful to seed a population with the solution to a similar instance?
![Page 90: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/90.jpg)
SMT
Number of tasks
Suc
cess
of
seed
ing
(out
of
1000
)
![Page 91: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/91.jpg)
VRPS
ucce
ss o
f se
edin
g (o
ut o
f 10
00)
Number of deliveries
![Page 92: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/92.jpg)
Realistic VRPs
![Page 93: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/93.jpg)
@Marta_Vallejo’s work
Full-featured VRP; several vehicles, 1,000 customers in 25km2 region
instance-distance metric and
solution solution mapping
Mediated by geographical customer alignment
![Page 94: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/94.jpg)
![Page 95: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/95.jpg)
![Page 96: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/96.jpg)
![Page 97: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/97.jpg)
![Page 98: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/98.jpg)
Good news: it’s over• Industry (etc…) usually needs: very fast solvers that produce fairly
good solutions
• Humans are very, very, very bad at designing and configuring such solvers, but they can often propose good ingredients.
• Directions:– Automated algorithm configuration –very successful, but not necessarily oriented
towards fast solvers– Hyper-heuristics / super-heuristics – very successful– Optimisation via Precomputation – promising ...
• Theoretical issues highly under-explored in each case– E.g. Generalisation performance of solvers (I am looking at computational
learning theory for this)– Instance-distance/Exploitation landscapes around an optimum
![Page 99: Unconventional Optimization David Corne, School of Mathematical & Computer Sciences (MACS) Heriot-Watt University, Edinburgh, UK.](https://reader036.fdocuments.us/reader036/viewer/2022062309/56649d775503460f94a5941f/html5/thumbnails/99.jpg)