Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later...
-
Upload
myra-newman -
Category
Documents
-
view
217 -
download
0
description
Transcript of Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later...
![Page 1: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/1.jpg)
Why are Humans so Smart?
• Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier)
• Application to human intelligence mostly due to Geoffrey Miller
• Geoffrey Miller The Mating Mind: How Sexual Choice Shaped Human Nature (2000)
• This is a theory, but very plausible.
Ronald Fisher
![Page 2: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/2.jpg)
2 inch tail
2.5 inch tail
1.5 inch tail
I like guys with a two inch tail..
• Sexual selection is a big driver of evolution.• The tails of a bird are control by genes, but critically, so is their behavior.• Female choice is an example of a behavior. If a female that likes 2-inch tails has
daughters, it is likely that the daughters will also like 2-inch tails.• Some female choice may be rational, they may choose for strong beaks, or for
good nest making ability, or….• Some (perhaps most) female choices could be arbitrary.
![Page 3: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/3.jpg)
2 inch tail
2.5 inch tail
1.5 inch tail
I like guys with a two inch tail..
• Under certain conditions, the genes for having a trait, and the genes for choosing the same trait, can “take hold” in a population.
• If that happens, it is unlikely to ever break out of the cycle. A male that has a longer or shorter tail simply will not be able find a mate.
![Page 4: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/4.jpg)
2 inch tail
2.5 inch tail
1.5 inch tail
• Suppose the female choice is not for a certain length tail, but for a tail that is longer than average….
I like guys whose tail is longer than average….
![Page 5: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/5.jpg)
2 inch tail
2.5 inch tail
1.5 inch tail
I like guys whose tail is longer than average….
• Now every generation has longer and longer tails….
![Page 6: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/6.jpg)
2.6 inch tail
• Once the genes for liking longer-than-average-tails reach a critical mass, we have a positive feedback cycle….
2.8 inch tail
2.9 inch tail
I like guys whose tail is longer than average….
![Page 7: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/7.jpg)
5.9 inch tail
• …and the tails get longer and longer
• Note that the male would be much better of without the long tail. It costs energy to grow it, it makes it very hard to fly, it make it hard to avoid detection by predators, and hard to evade them… But any male without a long tale will not find a mate. This seems like a theoretical model, but….
6.2 inch tail
5.1 inch tail
I like guys whose tail is longer than average….
![Page 8: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/8.jpg)
The pin-tailed whydah (Vidua macroura)
![Page 9: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/9.jpg)
IQ = 96
IQ = 50
IQ = 90
• Sometime in the last few hundred thousand years, human female choice started to select for guys that where smarter than average (how did the females know who was smart?)
• Human intelligent is just a by-product of this arbitrary accident.
I like guys whose are
smarter than average….
![Page 10: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/10.jpg)
Humans are not that Smart
![Page 11: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/11.jpg)
Converting a continuous problem to a discrete problem
• The problems we considered thus far are intrinsically discrete.
• What happens if our problem space is continuous?
![Page 12: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/12.jpg)
Curiosity was launched from Cape Canaveral on November 26, 2011, and successfully landed on Aeolis Palus in Gale Crater on Mars on August 6, 2012. The Bradbury Landing site[6] was less than 2.4 km (1.5 mi) from the center of the rover's touchdown target after a 563,000,000 km.
![Page 13: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/13.jpg)
When Mars is closest to the Earth, it takes light three minutes to travel between the two planets.
Mars is usually a lot farther away than that. At its greatest distance it is 42 light minutes away
![Page 14: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/14.jpg)
Path Planning Search
target
![Page 15: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/15.jpg)
Path Planning
What is the state space?
This example is by Jean-Claude Latombe
![Page 16: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/16.jpg)
Formulation #1
Cost of one horizontal/vertical step = 1Cost of one diagonal step = 2
![Page 17: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/17.jpg)
Optimal Solution?
This path is the shortest in the discretized state space, but not in the original continuous space(Trade-off: The smaller the grid…The larger the grid..)
![Page 18: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/18.jpg)
Formulation #2sweep-line
![Page 19: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/19.jpg)
Formulation #2
![Page 20: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/20.jpg)
States
![Page 21: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/21.jpg)
Operator: Visit center of adjacent region
![Page 22: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/22.jpg)
Solution Path
A path-smoothing post-processing step is usually needed to shorten the path further
![Page 23: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/23.jpg)
Formulation #3
Cost of one step: length of segment
![Page 24: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/24.jpg)
Formulation #3
Cost of one step: length of segment
Visibility graph
![Page 25: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/25.jpg)
Solution Path
The shortest path in this state space is also the shortest in the original continuous space
![Page 26: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/26.jpg)
A description of the desired state of the world (goal state), could be implicit or explicit.
explicit
implicit
FWDC
XXX 21
X= Xor1=1or2=2
![Page 27: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/27.jpg)
Search to Solve Word Ladders
Before we consider Heuristic Search, let us review a little first
We will begin by considering a new problem space, for Word Ladders….
![Page 28: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/28.jpg)
DOGDOTPOTPOPMOPMAPCAPCAT
Example of a word ladder
Change DOG to CAT. Change ONLY one letter at a time and form a new legal word at each step.
![Page 29: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/29.jpg)
DOG??CAT
What is the depth of the solution?
Since all three letters are different in the two words, and we have to change only one letter at a time, it is clear that we have to take at least three steps.
![Page 30: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/30.jpg)
DOGDOTCOTCAT
As it happens, there is a solution at depth three
![Page 31: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/31.jpg)
What is the diameter of the Word Ladder problem in general?
In other words, what two English words could you give me, that would require the deepest tree?
The two words are “charge” and “comedo”, and the tree is of depth 49.
(Note: this is using a standard English dictionary, no plurals or verb conjugations)
APE
MAN{“charge”, “change”, “chance”, “chancy”, “chanty”, “shanty”, “shanny”, “shinny”, “whinny”, “whiney”, “whiner”, “shiner”, “shiver”, “shaver”, “sharer”, “scarer”, “scaler”, “sealer”, “healer”, “header”, “reader”, “render”, “renter”, “ranter”, “ranker”, “hanker”, “hacker”, “hackee”, “hackle”, “heckle”, “deckle”, “decile”, “defile”, “define”, “refine”, “repine”, “rapine”, “ravine”, “raving”, “roving”, “roping”, “coping”, “coming”, “homing”, “hominy”, “homily”, “homely”, “comely”, “comedy”, “comedo”}
?
![Page 32: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/32.jpg)
Invented by Lewis Carroll
He suggested: APE ARE ERE ERR EAR MAR MAN
But we can do: APE APT OPT OAT MAT MAN
which takes one less move…
1832 –1898
Review point: A problem may have multiple solutions. Different solutions may have different costs. We generally want the cheapest solution, the optimal solution.
![Page 33: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/33.jpg)
UNSPORTSMANLIKE
Some problems may have no solutions
ADVENTUROUSNESS
This problem has no solution
![Page 34: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/34.jpg)
FROG
TOAD
Can you change FROG to TOAD?
![Page 35: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/35.jpg)
FROG
TOAD
This time we are given the tree depth, here it is six.
The branching factor is the number of letters in the word (4), times 25.
100 is a huge branching factor, but the fairly limited tree depth means it might be tenable.
We can use depth-limited search, L = 6
![Page 36: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/36.jpg)
FROG
AROG BROG CROG DROG
TOAD
GOAD
But how do we know the legal paths?
In other words, how do we know what are legal words?
It would be best if we had a dictionary of legal words, but if needed…
![Page 37: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/37.jpg)
AROG BROG CROG FROM ::::
AROG has 1,060,00 hits FROM has 25,270,000,000 hits
Actually 25,270,000,000 is the max Google allows
![Page 38: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/38.jpg)
FROG FROM PROM PRAM GRAD GOAD TOAD
FROG 262,000,000
FROM 25,270,000,000
PROM 224,000,000
PRAM 23,000,000
GRAD 225,000,000
GOAD 5,380,000
TOAD 50,400,000
Number of Google Hits
![Page 39: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/39.jpg)
FROG
AROG 1060000
BROG 3080000
CROG724000
DROG
The “Google hits” strategy suggests a way to do greedy search, or hill-climbing search.
We can expand the nodes with the highest count first
That way we are very unlikely to waste time exploring the: FROG CROG … subtree etc
![Page 40: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/40.jpg)
![Page 41: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/41.jpg)
A
B C
ED
H I K L M
F G
J
Assume we have this tree. We have two goal states (highlighted).To understand all our algorithms, we can ask: “in what order do the nodes get REMOVE-FRONT (dequeued) for a given algorithm.
![Page 42: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/42.jpg)
A
B C
ED
H I K L M
F G
J
I am going to do Depth First Search(Enqueue nodes in LIFO (last-in, first-out) order)You should do all algorithms (except perhaps bi-directional search) and make up new trees etc.
![Page 43: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/43.jpg)
A
B C
ED
H I K L M
F G
J
Depth First Search
ANodes
Before entering the loop, the initial state A is enqueued
We now enter the loop for the first time (next slide)
![Page 44: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/44.jpg)
Depth First Search
Nodes
The front of Nodes is dequeued, it was A
We ask A, are you the goal?Since the answer is no, we expand all A’s children (do every operator) and enqueue them in Nodes.
C B Nodes
We now jump back to the top of the loop…
A
B C
ED
H I K L M
F G
J
![Page 45: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/45.jpg)
Depth First Search
CNodes
The front of Nodes is dequeued, it was B
We ask B, are you the goal?Since the answer is no, we expand all B’s children (do every operator) and enqueue them in Nodes.
C E D Nodes
We now jump back to the top of the loop…
A
B C
ED
H I K L M
F G
J
![Page 46: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/46.jpg)
Depth First Search
C ENodes
The front of Nodes is dequeued, it was D
We ask D, are you the goal?Since the answer is no, we expand all D’s children (do every operator) and enqueue them in Nodes.
C E I HNodes
We now jump back to the top of the loop…
A
B C
ED
H I K L M
F G
J
![Page 47: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/47.jpg)
Depth First Search
C E INodes
The front of Nodes is dequeued, it was H
We ask H, are you the goal?Since the answer is no, we expand all H’s children. As it happens, there are none
C E INodes
We now jump back to the top of the loop…
A
B C
ED
H I K L M
F G
J
![Page 48: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/48.jpg)
Depth First Search
C ENodes
The front of Nodes is dequeued, it was I
We ask I, are you the goal?Since the answer is no, we expand all I’s children. As it happens, there are none
C ENodes
We now jump back to the top of the loop…
A
B C
ED
H I K L M
F G
J
![Page 49: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/49.jpg)
Depth First Search
CNodes
The front of Nodes is dequeued, it was E
We ask E, are you the goal?Since the answer is no, we expand all E’s children (do every operator) and enqueue them in Nodes.
C JNodes
We now jump back to the top of the loop…
A
B C
ED
H I K L M
F G
J
![Page 50: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/50.jpg)
Depth First Search
CNodes
The front of Nodes is dequeued, it was J
We ask J, are you the goal?Since the answer is yes, we report success!
A
B C
ED
H I K L M
F G
J
![Page 51: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/51.jpg)
![Page 52: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/52.jpg)
Heuristic Search The search techniques we have seen so far...
• Breadth first search• Uniform cost search• Depth first search• Depth limited search • Iterative Deepening• Bi-directional Search
...are all too slow for most real world problems
uninformed searchblind search
![Page 53: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/53.jpg)
Sometimes we can tell that some states appear better that others...
1 2 34 5 67 8
7 8 43 5 16 2
FWD
C FW C
D
![Page 54: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/54.jpg)
...we can use this knowledge of the relative merit of states to guide search
Heuristic Search (informed search) A Heuristic is a function that, when applied to a state, returns a number that is an estimate of the merit of the state, with respect to the goal.
In other words, the heuristic tells us approximately how far the state is from the goal state*.
Note we said “approximately”. Heuristics might underestimate or overestimate the merit of a state. But for reasons which we will see, heuristics that only underestimate are very desirable, and are called admissible.
*I.e Smaller numbers are better
![Page 55: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/55.jpg)
Heuristics for 8-puzzle I
•The number of misplaced tiles (not including the blank)
1 2 34 5 67 8
1 2 34 5 67 8
1 2 34 5 67 8
1 2 34 5 67 8
N N NN N NN Y
In this case, only “8” is misplaced, so the heuristic function evaluates to 1.In other words, the heuristic is telling us, that it thinks a solution might be available in just 1 more move.
Goal State
Current State
Notation: h(n) h(current state) = 1
![Page 56: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/56.jpg)
Heuristics for 8-puzzle II
•The Manhattan Distance (not including the blank)
In this case, only the “3”, “8” and “1” tiles are misplaced, by 2, 3, and 3 squares respectively, so the heuristic function evaluates to 8.In other words, the heuristic is telling us, that it thinks a solution is available in just 8 more moves.
3 2 84 5 67 1
1 2 34 5 67 8
Goal State
Current State
3 3
8
8
1
1
2 spaces
3 spaces
3 spaces
Total 8
Notation: h(n) h(current state) = 8
![Page 57: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/57.jpg)
1 2 34 57 8 6
1 2 34 5
7 8 6
1 34 2 57 8 6
1 24 5 37 8 6
1 2 34 5 67 8
1 2 34 57 8 6
1 2 34 8 5
7 6
1 2 34 8 57 6
1 2 34 8 57 6
1 24 8 37 6 5
1 2 34 87 6 5
5
6 4
3
4 2
1 3 3
0 2
We can use heuristics to guide “hill climbing” search.
In this example, the Manhattan Distance heuristic helps us quickly find a solution to the 8-puzzle.
But “hill climbing has a problem...”
h(n)
![Page 58: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/58.jpg)
1 2 34 5 86 7
1 2 34 56 7 8
1 2 34 5 86 7
1 2 34 56 7 8
1 24 5 36 7 8
6
7 5
6 6
In this example, hill climbing does not work!
All the nodes on the fringe are taking a step “backwards”(local minima)
Note that this puzzle is solvable in just 12 more steps.
h(n)
![Page 59: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/59.jpg)
We have seen two interesting algorithms.
Uniform Cost “looks backwards, how far have I come”• Measures the cost to each node.• Is optimal and complete!• Can be very slow.
Hill Climbing “looks forwards, how far to go”• Estimates how far away the goal is.• Is neither optimal nor complete.• Can be very fast.
Can we combine them to create an optimal and complete algorithm that is also very fast?
![Page 60: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/60.jpg)
Uniform Cost SearchEnqueue nodes in order of cost
Intuition: Expand the cheapest node. Where the cost is the path cost g(n)
25 25
1 7
25
1 7
4 5
Hill Climbing SearchEnqueue nodes in order of estimated distance to goal
Intuition: Expand the node you think is nearest to goal. Where the estimate of distance to goal is h(n)
1917 1917
16 14
13 15
1917
16 14
![Page 61: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/61.jpg)
Uniform Cost SearchEnqueue nodes in order of cost (distance to the start)
Intuition: Expand the cheapest node. Where the cost is the path cost g(n)
25
Hill Climbing SearchEnqueue nodes in order of estimated distance to goal
Intuition: Expand the node you think is nearest to goal. Where the estimate of distance to goal is h(n)
1917
2 + 195 + 17
A*SearchEnqueue nodes in order of f(n) = g(n) + h(n)
![Page 62: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/62.jpg)
The A* Algorithm (“A-Star”) Enqueue nodes in order of estimate cost to goal, f(n)
g(n) is the cost to get to a node.h(n) is the estimated distance to the goal.
f(n) = g(n) + h(n)
We can think of f(n) as the estimated cost of the cheapest solution that goes through node n
Note that we can use the general search algorithm we used before. All that we have changed is the queuing strategy.
If the heuristic is optimistic, that is to say, it never overestimates the distance to the goal, then…
A* is optimal and complete!
![Page 63: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/63.jpg)
Informal proof outline of A* completeness• Assume that every operator has some minimum positive cost, epsilon .• Assume that a goal state exists, therefore some finite set of operators lead to it.•Expanding nodes produces paths whose actual costs increase by at least epsilon each time. Since the algorithm will not terminate until it finds a goal state, it must expand a goal state in finite time.
Informal proof outline of A* optimality • When A* terminates, it has found a goal state• All remaining nodes have an estimate cost to goal (f(n)) greater than or equal to that of goal we have found.•Since the heuristic function was optimistic, the actual cost to goal for these other paths can be no better than the cost of the one we have already found.
![Page 64: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/64.jpg)
How fast is A*?A* is the fastest search algorithm. That is, for any given heuristic, no algorithm can expand fewer nodes than A*.
How fast is it? Depends of the quality of the heuristic.
•If the heuristic is useless (ie h(n) is hardcoded to equal 0 ), the algorithm degenerates to uniform cost.
•If the heuristic is perfect, there is no real search, we just march down the tree to the goal.
Generally we are somewhere in between the two situations above. The time taken depends on the quality of the heuristic.
![Page 65: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/65.jpg)
What is A*’s space complexity?A* has worst case O(bd) space complexity, but an iterative deepening version is possible ( IDA* )
![Page 66: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/66.jpg)
A Worked Example: Maze Traversal
1 2 3 4 5
A
B
D
C
E
Problem: To get from square A3 to square E2, one step at a time, avoiding obstacles (black squares).
Operators: (in order)•go_left(n) •go_down(n) •go_right(n) each operator costs 1.
Heuristic: Manhattan distance
![Page 67: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/67.jpg)
Operators: (in order)•go_left(n) •go_down(n) •go_right(n) each operator costs 1.
A2
A3
B3 A4g(A2) = 1h(A2) = 4
g(B3) = 1h(B3) = 4
g(A4) = 1h(A4) = 6
1 2 3 4 5
A
B
D
C
E
A2
B3
A4
![Page 68: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/68.jpg)
Operators: (in order)•go_left(n) •go_down(n) •go_right(n) each operator costs 1.
A2
A3
B3 A4g(A2) = 1h(A2) = 4
g(B3) = 1h(B3) = 4
g(A4) = 1h(A4) = 6
A1 g(A1) = 2h(A1) = 5
1 2 3 4 5
A
B
D
C
E
A2
B3
A1 A4
![Page 69: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/69.jpg)
Operators: (in order)•go_left(n) •go_down(n) •go_right(n) each operator costs 1.
A2
A3
B3 A4g(A2) = 1h(A2) = 4
g(B3) = 1h(B3) = 4
g(A4) = 1h(A4) = 6
C3 B4g(C3) = 2h(C3) = 3
g(B4) = 2h(B4) = 5
A1 g(A1) = 2h(A1) = 5
1 2 3 4 5
A
B
D
C
E
A2
B3
A4A1
C3
B4
![Page 70: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/70.jpg)
Operators: (in order)•go_left(n) •go_down(n) •go_right(n) each operator costs 1.
A2
A3
B3 A4g(A2) = 1h(A2) = 4
g(B3) = 1h(B3) = 4
g(A4) = 1h(A4) = 6
C3 B4g(C3) = 2h(C3) = 3
g(B4) = 2h(B4) = 5
A1 g(A1) = 2h(A1) = 5
1 2 3 4 5
A
B
D
C
E
B1 g(B1) = 3h(B1) = 4
A2
B3
A4A1
B1
C3
B4
![Page 71: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/71.jpg)
Operators: (in order)•go_left(n) •go_down(n) •go_right(n) each operator costs 1.
A2
A3
B3 A4g(A2) = 1h(A2) = 4
g(B3) = 1h(B3) = 4
g(A4) = 1h(A4) = 6
C3 B4g(C3) = 2h(C3) = 3
g(B4) = 2h(B4) = 5
A1 g(A1) = 2h(A1) = 5
1 2 3 4 5
A
B
D
C
E
B1 g(B1) = 3h(B1) = 4
B5 g(B5) = 3h(B5) = 6
A2
B3
A4A1
B1
C3
B4 B5
![Page 72: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/72.jpg)
Here is a larger version of the previous example
The black square is the initial state
The white square is the goal state.
The blue squares are the barriers
In this version, diagonal moves are allowed.
![Page 73: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/73.jpg)
Here are the first four states it expands….
![Page 74: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/74.jpg)
![Page 75: Why are Humans so Smart? Basic idea of runaway evolution due to Ronald Fisher (whom we will later meet as the inventor of the linear classifier) Application.](https://reader036.fdocuments.us/reader036/viewer/2022062413/5a4d1b337f8b9ab05999c004/html5/thumbnails/75.jpg)
Success!
Please watch the videoA* Pathfinding Algorithm Visualizationhttps://www.youtube.com/watch?v=19h1g22hby8