Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment...

74
Sammanfattning ¨ Orjan Ekeberg Maskininl¨ arning

Transcript of Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment...

Page 1: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Sammanfattning

Orjan Ekeberg Maskininlarning

Page 2: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Begreppsinlarning

HypotesrummetRelationen mellan hypotesernaVersion SpaceFind-SCandidate EliminationBias

Restriction BiasPreference Bias

Generalisering

Orjan Ekeberg Maskininlarning

Page 3: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Begreppsinlarning

HypotesrummetRelationen mellan hypotesernaVersion SpaceFind-SCandidate EliminationBias

Restriction BiasPreference Bias

Generalisering

Orjan Ekeberg Maskininlarning

Page 4: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Begreppsinlarning

HypotesrummetRelationen mellan hypotesernaVersion SpaceFind-SCandidate EliminationBias

Restriction BiasPreference Bias

Generalisering

Orjan Ekeberg Maskininlarning

Page 5: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Begreppsinlarning

HypotesrummetRelationen mellan hypotesernaVersion SpaceFind-SCandidate EliminationBias

Restriction BiasPreference Bias

Generalisering

Orjan Ekeberg Maskininlarning

Page 6: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Begreppsinlarning

HypotesrummetRelationen mellan hypotesernaVersion SpaceFind-SCandidate EliminationBias

Restriction BiasPreference Bias

Generalisering

Orjan Ekeberg Maskininlarning

Page 7: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Begreppsinlarning

HypotesrummetRelationen mellan hypotesernaVersion SpaceFind-SCandidate EliminationBias

Restriction BiasPreference Bias

Generalisering

Orjan Ekeberg Maskininlarning

Page 8: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Begreppsinlarning

HypotesrummetRelationen mellan hypotesernaVersion SpaceFind-SCandidate EliminationBias

Restriction BiasPreference Bias

Generalisering

Orjan Ekeberg Maskininlarning

Page 9: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Begreppsinlarning

HypotesrummetRelationen mellan hypotesernaVersion SpaceFind-SCandidate EliminationBias

Restriction BiasPreference Bias

Generalisering

Orjan Ekeberg Maskininlarning

Page 10: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Begreppsinlarning

HypotesrummetRelationen mellan hypotesernaVersion SpaceFind-SCandidate EliminationBias

Restriction BiasPreference Bias

Generalisering

Orjan Ekeberg Maskininlarning

Page 11: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Beslutstrad

Entropi — oforutsagbarhetenInformation GainOverfittingAnpassning till icke-generaliserbara detaljerBeskarning (Pruning)

Orjan Ekeberg Maskininlarning

Page 12: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Beslutstrad

Entropi — oforutsagbarhetenInformation GainOverfittingAnpassning till icke-generaliserbara detaljerBeskarning (Pruning)

Orjan Ekeberg Maskininlarning

Page 13: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Beslutstrad

Entropi — oforutsagbarhetenInformation GainOverfittingAnpassning till icke-generaliserbara detaljerBeskarning (Pruning)

Orjan Ekeberg Maskininlarning

Page 14: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Beslutstrad

Entropi — oforutsagbarhetenInformation GainOverfittingAnpassning till icke-generaliserbara detaljerBeskarning (Pruning)

Orjan Ekeberg Maskininlarning

Page 15: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Beslutstrad

Entropi — oforutsagbarhetenInformation GainOverfittingAnpassning till icke-generaliserbara detaljerBeskarning (Pruning)

Orjan Ekeberg Maskininlarning

Page 16: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Artificiella Neuronnat

EnlagersnatLinjar separeringInlarning via felminimeringFlerlagersnat

Generell klassificeringFunktionsapproximation

Deriverbara troskelfunktionerError BackpropagationKonvergensegenskaper

Orjan Ekeberg Maskininlarning

Page 17: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Artificiella Neuronnat

EnlagersnatLinjar separeringInlarning via felminimeringFlerlagersnat

Generell klassificeringFunktionsapproximation

Deriverbara troskelfunktionerError BackpropagationKonvergensegenskaper

Orjan Ekeberg Maskininlarning

Page 18: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Artificiella Neuronnat

EnlagersnatLinjar separeringInlarning via felminimeringFlerlagersnat

Generell klassificeringFunktionsapproximation

Deriverbara troskelfunktionerError BackpropagationKonvergensegenskaper

Orjan Ekeberg Maskininlarning

Page 19: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Artificiella Neuronnat

EnlagersnatLinjar separeringInlarning via felminimeringFlerlagersnat

Generell klassificeringFunktionsapproximation

Deriverbara troskelfunktionerError BackpropagationKonvergensegenskaper

Orjan Ekeberg Maskininlarning

Page 20: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Artificiella Neuronnat

EnlagersnatLinjar separeringInlarning via felminimeringFlerlagersnat

Generell klassificeringFunktionsapproximation

Deriverbara troskelfunktionerError BackpropagationKonvergensegenskaper

Orjan Ekeberg Maskininlarning

Page 21: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Artificiella Neuronnat

EnlagersnatLinjar separeringInlarning via felminimeringFlerlagersnat

Generell klassificeringFunktionsapproximation

Deriverbara troskelfunktionerError BackpropagationKonvergensegenskaper

Orjan Ekeberg Maskininlarning

Page 22: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Artificiella Neuronnat

EnlagersnatLinjar separeringInlarning via felminimeringFlerlagersnat

Generell klassificeringFunktionsapproximation

Deriverbara troskelfunktionerError BackpropagationKonvergensegenskaper

Orjan Ekeberg Maskininlarning

Page 23: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Artificiella Neuronnat

EnlagersnatLinjar separeringInlarning via felminimeringFlerlagersnat

Generell klassificeringFunktionsapproximation

Deriverbara troskelfunktionerError BackpropagationKonvergensegenskaper

Orjan Ekeberg Maskininlarning

Page 24: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Artificiella Neuronnat

EnlagersnatLinjar separeringInlarning via felminimeringFlerlagersnat

Generell klassificeringFunktionsapproximation

Deriverbara troskelfunktionerError BackpropagationKonvergensegenskaper

Orjan Ekeberg Maskininlarning

Page 25: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Artificiella Neuronnat

EnlagersnatLinjar separeringInlarning via felminimeringFlerlagersnat

Generell klassificeringFunktionsapproximation

Deriverbara troskelfunktionerError BackpropagationKonvergensegenskaper

Orjan Ekeberg Maskininlarning

Page 26: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Statistisk Inlarning

Maximum a’Posteriori (MAP)Den mest sannolika hypotesen givet observerade dataMaximum Likelihood (ML)Den hypotes som har storst sannolikhet att ge de data viserBayes Optimal Classifier

argmaxv

∑h

P (v|h) · P (h|D)

Naive Bayes Classifier

argmaxv

P (v)∏

i

P (ai|v)

Orjan Ekeberg Maskininlarning

Page 27: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Statistisk Inlarning

Maximum a’Posteriori (MAP)Den mest sannolika hypotesen givet observerade dataMaximum Likelihood (ML)Den hypotes som har storst sannolikhet att ge de data viserBayes Optimal Classifier

argmaxv

∑h

P (v|h) · P (h|D)

Naive Bayes Classifier

argmaxv

P (v)∏

i

P (ai|v)

Orjan Ekeberg Maskininlarning

Page 28: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Statistisk Inlarning

Maximum a’Posteriori (MAP)Den mest sannolika hypotesen givet observerade dataMaximum Likelihood (ML)Den hypotes som har storst sannolikhet att ge de data viserBayes Optimal Classifier

argmaxv

∑h

P (v|h) · P (h|D)

Naive Bayes Classifier

argmaxv

P (v)∏

i

P (ai|v)

Orjan Ekeberg Maskininlarning

Page 29: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Statistisk Inlarning

Maximum a’Posteriori (MAP)Den mest sannolika hypotesen givet observerade dataMaximum Likelihood (ML)Den hypotes som har storst sannolikhet att ge de data viserBayes Optimal Classifier

argmaxv

∑h

P (v|h) · P (h|D)

Naive Bayes Classifier

argmaxv

P (v)∏

i

P (ai|v)

Orjan Ekeberg Maskininlarning

Page 30: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Statistisk Inlarning

Maximum a’Posteriori (MAP)Den mest sannolika hypotesen givet observerade dataMaximum Likelihood (ML)Den hypotes som har storst sannolikhet att ge de data viserBayes Optimal Classifier

argmaxv

∑h

P (v|h) · P (h|D)

Naive Bayes Classifier

argmaxv

P (v)∏

i

P (ai|v)

Orjan Ekeberg Maskininlarning

Page 31: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Boosting

Generering av flera klassificerareTranade pa olika traningsdataOmrostning kan ge battre klassificering

Orjan Ekeberg Maskininlarning

Page 32: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Boosting

Generering av flera klassificerareTranade pa olika traningsdataOmrostning kan ge battre klassificering

Orjan Ekeberg Maskininlarning

Page 33: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Boosting

Generering av flera klassificerareTranade pa olika traningsdataOmrostning kan ge battre klassificering

Orjan Ekeberg Maskininlarning

Page 34: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Boosting

Generering av flera klassificerareTranade pa olika traningsdataOmrostning kan ge battre klassificering

Orjan Ekeberg Maskininlarning

Page 35: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Exempelbaserad inlarning

Inlarning ≈ LagringNearest Neighbork-Nearest NeighborViktning (kernel)RegressionRadialbasfunktioner

Orjan Ekeberg Maskininlarning

Page 36: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Exempelbaserad inlarning

Inlarning ≈ LagringNearest Neighbork-Nearest NeighborViktning (kernel)RegressionRadialbasfunktioner

Orjan Ekeberg Maskininlarning

Page 37: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Exempelbaserad inlarning

Inlarning ≈ LagringNearest Neighbork-Nearest NeighborViktning (kernel)RegressionRadialbasfunktioner

Orjan Ekeberg Maskininlarning

Page 38: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Exempelbaserad inlarning

Inlarning ≈ LagringNearest Neighbork-Nearest NeighborViktning (kernel)RegressionRadialbasfunktioner

Orjan Ekeberg Maskininlarning

Page 39: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Exempelbaserad inlarning

Inlarning ≈ LagringNearest Neighbork-Nearest NeighborViktning (kernel)RegressionRadialbasfunktioner

Orjan Ekeberg Maskininlarning

Page 40: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Exempelbaserad inlarning

Inlarning ≈ LagringNearest Neighbork-Nearest NeighborViktning (kernel)RegressionRadialbasfunktioner

Orjan Ekeberg Maskininlarning

Page 41: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Exempelbaserad inlarning

Inlarning ≈ LagringNearest Neighbork-Nearest NeighborViktning (kernel)RegressionRadialbasfunktioner

Orjan Ekeberg Maskininlarning

Page 42: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Reinforcement Learning

Fordrojd beloningTemporal Credit AssignmentVardefunktionPolicyTemporal Difference teknikerQ-LearningSarsa-Learning

Orjan Ekeberg Maskininlarning

Page 43: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Reinforcement Learning

Fordrojd beloningTemporal Credit AssignmentVardefunktionPolicyTemporal Difference teknikerQ-LearningSarsa-Learning

Orjan Ekeberg Maskininlarning

Page 44: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Reinforcement Learning

Fordrojd beloningTemporal Credit AssignmentVardefunktionPolicyTemporal Difference teknikerQ-LearningSarsa-Learning

Orjan Ekeberg Maskininlarning

Page 45: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Reinforcement Learning

Fordrojd beloningTemporal Credit AssignmentVardefunktionPolicyTemporal Difference teknikerQ-LearningSarsa-Learning

Orjan Ekeberg Maskininlarning

Page 46: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Reinforcement Learning

Fordrojd beloningTemporal Credit AssignmentVardefunktionPolicyTemporal Difference teknikerQ-LearningSarsa-Learning

Orjan Ekeberg Maskininlarning

Page 47: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Reinforcement Learning

Fordrojd beloningTemporal Credit AssignmentVardefunktionPolicyTemporal Difference teknikerQ-LearningSarsa-Learning

Orjan Ekeberg Maskininlarning

Page 48: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Reinforcement Learning

Fordrojd beloningTemporal Credit AssignmentVardefunktionPolicyTemporal Difference teknikerQ-LearningSarsa-Learning

Orjan Ekeberg Maskininlarning

Page 49: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Reinforcement Learning

Fordrojd beloningTemporal Credit AssignmentVardefunktionPolicyTemporal Difference teknikerQ-LearningSarsa-Learning

Orjan Ekeberg Maskininlarning

Page 50: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Genetiska algoritmer

OptimeringFitnessfunktionParallell stokastisk gradientfoljningKorsning — utbyte av dellosningarKodningGenetisk programmering

Orjan Ekeberg Maskininlarning

Page 51: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Genetiska algoritmer

OptimeringFitnessfunktionParallell stokastisk gradientfoljningKorsning — utbyte av dellosningarKodningGenetisk programmering

Orjan Ekeberg Maskininlarning

Page 52: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Genetiska algoritmer

OptimeringFitnessfunktionParallell stokastisk gradientfoljningKorsning — utbyte av dellosningarKodningGenetisk programmering

Orjan Ekeberg Maskininlarning

Page 53: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Genetiska algoritmer

OptimeringFitnessfunktionParallell stokastisk gradientfoljningKorsning — utbyte av dellosningarKodningGenetisk programmering

Orjan Ekeberg Maskininlarning

Page 54: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Genetiska algoritmer

OptimeringFitnessfunktionParallell stokastisk gradientfoljningKorsning — utbyte av dellosningarKodningGenetisk programmering

Orjan Ekeberg Maskininlarning

Page 55: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Genetiska algoritmer

OptimeringFitnessfunktionParallell stokastisk gradientfoljningKorsning — utbyte av dellosningarKodningGenetisk programmering

Orjan Ekeberg Maskininlarning

Page 56: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Genetiska algoritmer

OptimeringFitnessfunktionParallell stokastisk gradientfoljningKorsning — utbyte av dellosningarKodningGenetisk programmering

Orjan Ekeberg Maskininlarning

Page 57: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Larbarhetsteori

PAC-LearnableProbably (δ) Approximately (ε) CorrectKomplexitet matt i 1

δ , 1ε och n

Antal traningsexempel

m ≥ 1

ε

[ln |H|+ ln

1

δ

]

VC-dimension

VC(H) ≤ log2 |H| m ≥ 1

ε

[4 log2

2

δ+ 8VC(H) · log2

13

ε

]

Fel under inlarningen

Orjan Ekeberg Maskininlarning

Page 58: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Larbarhetsteori

PAC-LearnableProbably (δ) Approximately (ε) CorrectKomplexitet matt i 1

δ , 1ε och n

Antal traningsexempel

m ≥ 1

ε

[ln |H|+ ln

1

δ

]

VC-dimension

VC(H) ≤ log2 |H| m ≥ 1

ε

[4 log2

2

δ+ 8VC(H) · log2

13

ε

]

Fel under inlarningen

Orjan Ekeberg Maskininlarning

Page 59: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Larbarhetsteori

PAC-LearnableProbably (δ) Approximately (ε) CorrectKomplexitet matt i 1

δ , 1ε och n

Antal traningsexempel

m ≥ 1

ε

[ln |H|+ ln

1

δ

]

VC-dimension

VC(H) ≤ log2 |H| m ≥ 1

ε

[4 log2

2

δ+ 8VC(H) · log2

13

ε

]

Fel under inlarningen

Orjan Ekeberg Maskininlarning

Page 60: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Larbarhetsteori

PAC-LearnableProbably (δ) Approximately (ε) CorrectKomplexitet matt i 1

δ , 1ε och n

Antal traningsexempel

m ≥ 1

ε

[ln |H|+ ln

1

δ

]

VC-dimension

VC(H) ≤ log2 |H| m ≥ 1

ε

[4 log2

2

δ+ 8VC(H) · log2

13

ε

]

Fel under inlarningen

Orjan Ekeberg Maskininlarning

Page 61: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Larbarhetsteori

PAC-LearnableProbably (δ) Approximately (ε) CorrectKomplexitet matt i 1

δ , 1ε och n

Antal traningsexempel

m ≥ 1

ε

[ln |H|+ ln

1

δ

]

VC-dimension

VC(H) ≤ log2 |H| m ≥ 1

ε

[4 log2

2

δ+ 8VC(H) · log2

13

ε

]

Fel under inlarningen

Orjan Ekeberg Maskininlarning

Page 62: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Larbarhetsteori

PAC-LearnableProbably (δ) Approximately (ε) CorrectKomplexitet matt i 1

δ , 1ε och n

Antal traningsexempel

m ≥ 1

ε

[ln |H|+ ln

1

δ

]

VC-dimension

VC(H) ≤ log2 |H| m ≥ 1

ε

[4 log2

2

δ+ 8VC(H) · log2

13

ε

]

Fel under inlarningen

Orjan Ekeberg Maskininlarning

Page 63: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Larbarhetsteori

PAC-LearnableProbably (δ) Approximately (ε) CorrectKomplexitet matt i 1

δ , 1ε och n

Antal traningsexempel

m ≥ 1

ε

[ln |H|+ ln

1

δ

]

VC-dimension

VC(H) ≤ log2 |H| m ≥ 1

ε

[4 log2

2

δ+ 8VC(H) · log2

13

ε

]

Fel under inlarningen

Orjan Ekeberg Maskininlarning

Page 64: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Regelinlarning

Sequential CoveringSuccesiv specialiseringGirig eller Beam-searchHeuristisk sokningInverse ResolutionBottom-up: forklara exempel

Orjan Ekeberg Maskininlarning

Page 65: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Regelinlarning

Sequential CoveringSuccesiv specialiseringGirig eller Beam-searchHeuristisk sokningInverse ResolutionBottom-up: forklara exempel

Orjan Ekeberg Maskininlarning

Page 66: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Regelinlarning

Sequential CoveringSuccesiv specialiseringGirig eller Beam-searchHeuristisk sokningInverse ResolutionBottom-up: forklara exempel

Orjan Ekeberg Maskininlarning

Page 67: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Regelinlarning

Sequential CoveringSuccesiv specialiseringGirig eller Beam-searchHeuristisk sokningInverse ResolutionBottom-up: forklara exempel

Orjan Ekeberg Maskininlarning

Page 68: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Regelinlarning

Sequential CoveringSuccesiv specialiseringGirig eller Beam-searchHeuristisk sokningInverse ResolutionBottom-up: forklara exempel

Orjan Ekeberg Maskininlarning

Page 69: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Metoder vi inte pratat om

Support-Vector MachinesOmkodning av indata ⇒ linjar separerbarhetInlarning av sekvenser/tidsdataHidden Markov ModelsKalman filterOovervakad inlarningSjalvorganiserad avbildningAterkopplade neuronnatHybridmetoder

Orjan Ekeberg Maskininlarning

Page 70: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Metoder vi inte pratat om

Support-Vector MachinesOmkodning av indata ⇒ linjar separerbarhetInlarning av sekvenser/tidsdataHidden Markov ModelsKalman filterOovervakad inlarningSjalvorganiserad avbildningAterkopplade neuronnatHybridmetoder

Orjan Ekeberg Maskininlarning

Page 71: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Metoder vi inte pratat om

Support-Vector MachinesOmkodning av indata ⇒ linjar separerbarhetInlarning av sekvenser/tidsdataHidden Markov ModelsKalman filterOovervakad inlarningSjalvorganiserad avbildningAterkopplade neuronnatHybridmetoder

Orjan Ekeberg Maskininlarning

Page 72: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Metoder vi inte pratat om

Support-Vector MachinesOmkodning av indata ⇒ linjar separerbarhetInlarning av sekvenser/tidsdataHidden Markov ModelsKalman filterOovervakad inlarningSjalvorganiserad avbildningAterkopplade neuronnatHybridmetoder

Orjan Ekeberg Maskininlarning

Page 73: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Metoder vi inte pratat om

Support-Vector MachinesOmkodning av indata ⇒ linjar separerbarhetInlarning av sekvenser/tidsdataHidden Markov ModelsKalman filterOovervakad inlarningSjalvorganiserad avbildningAterkopplade neuronnatHybridmetoder

Orjan Ekeberg Maskininlarning

Page 74: Sammanfattning Orjan Ekeberg - nada.kth.se · F¨ordr ¨ojd bel ¨oning Temporal Credit Assignment V¨ardefunktion Policy Temporal Difference tekniker Q-Learning Sarsa-Learning Orjan

Metoder vi inte pratat om

Support-Vector MachinesOmkodning av indata ⇒ linjar separerbarhetInlarning av sekvenser/tidsdataHidden Markov ModelsKalman filterOovervakad inlarningSjalvorganiserad avbildningAterkopplade neuronnatHybridmetoder

Orjan Ekeberg Maskininlarning


Applied Temporal RDF: Efficient Temporal Querying using SPARQL

Applied Temporal RDF: Efficient Temporal Querying using SPARQL

Generative Music By: Ryan Bone, Andrew Reed, Kevin Ekeberg, Hector Medina- Fetterman, Chase Plante.

Generative Music By: Ryan Bone, Andrew Reed, Kevin Ekeberg, Hector Medina- Fetterman, Chase Plante.

Speaker sex effects on temporal and spectro-temporal ...eprints.whiterose.ac.uk › 98009 › 1 › Herrmann-Cunningham-Whiteside.pdf1.2 Temporal and spectro-temporal measures of speech

Speaker sex effects on temporal and spectro-temporal ...eprints.whiterose.ac.uk › 98009 › 1 › Herrmann-Cunningham-Whiteside.pdf1.2 Temporal and spectro-temporal measures of speech

Temporal Spatial Metaphors Neural Constraints on Temporal ...

Temporal Spatial Metaphors Neural Constraints on Temporal ...

Temporal Logics and Temporal Reasoningcs112/cs112-2004/new...Temporal Logics and Temporal Reasoning Lode Missiaen, 1991 Department of Computer Science, K.U.Leuven Celestijnenlaan 200A,

Temporal Logics and Temporal Reasoningcs112/cs112-2004/new...Temporal Logics and Temporal Reasoning Lode Missiaen, 1991 Department of Computer Science, K.U.Leuven Celestijnenlaan 200A,

Electroclinical Subtype of Temporal Lobe Epilepsy Mesial Temporal Lobe Epilepsy…electroneurodiagnostics.org/styled/files/mesial-temporal... · 2017. 3. 17. · Mesial temporal lobe

Electroclinical Subtype of Temporal Lobe Epilepsy Mesial Temporal Lobe Epilepsy…electroneurodiagnostics.org/styled/files/mesial-temporal... · 2017. 3. 17. · Mesial temporal lobe

Temporal Reasoning for Supporting Temporal Queries in OWL 2.0

Temporal Reasoning for Supporting Temporal Queries in OWL 2.0

Aalborg Universitet Aspects of temporal and spatio-temporal ...

Aalborg Universitet Aspects of temporal and spatio-temporal ...

The Temporal Bone - UCSDspinwarp.ucsd.edu/NeuroWeb/PPT/temporal bone.pdfThe Temporal Bone ... Primary Cholesteatoma Diseases of the Petrous Apex . Cholesterol Granuloma 568 . Temporal

The Temporal Bone - UCSDspinwarp.ucsd.edu/NeuroWeb/PPT/temporal bone.pdfThe Temporal Bone ... Primary Cholesteatoma Diseases of the Petrous Apex . Cholesterol Granuloma 568 . Temporal

Learning Spatio-Temporal Representation With Pseudo-3D ...openaccess.thecvf.com/content_ICCV_2017/papers/Qiu_Learning_Spatio-Temporal... · Learning Spatio-Temporal Representation

Learning Spatio-Temporal Representation With Pseudo-3D ...openaccess.thecvf.com/content_ICCV_2017/papers/Qiu_Learning_Spatio-Temporal... · Learning Spatio-Temporal Representation

TEMPORAL ONTOLOGY AND TEMPORAL REFERENCE

TEMPORAL ONTOLOGY AND TEMPORAL REFERENCE

Hurra for 17. mai og Ekeberg skole · 2017. 5. 5. · Hurra for 17. mai og Ekeberg skole 17mai2009_A5.indd 1 07-05-09 21:11:06 Program for 17. mai 2017 Ekeberg skole Program for 17.

Hurra for 17. mai og Ekeberg skole · 2017. 5. 5. · Hurra for 17. mai og Ekeberg skole 17mai2009_A5.indd 1 07-05-09 21:11:06 Program for 17. mai 2017 Ekeberg skole Program for 17.

Temporal Databases. Outline Spatial Databases Indexing, Query processing Temporal Databases Spatio-temporal ….

Temporal Databases. Outline Spatial Databases Indexing, Query processing Temporal Databases Spatio-temporal ….

The Houses Orjan Pure Olive Oil Soaps - RSCN · campsite, you will find a The Houses Orjan Pure Olive Oil Soaps Handmade Products and Workshops | Guide The Soap House At The Soap

The Houses Orjan Pure Olive Oil Soaps - RSCN · campsite, you will find a The Houses Orjan Pure Olive Oil Soaps Handmade Products and Workshops | Guide The Soap House At The Soap

Temporal Planning Planning with Temporal and Concurrent Actions.

Temporal Planning Planning with Temporal and Concurrent Actions.

Clusters and Cluster Policy in Europe Orjan Solvell

Clusters and Cluster Policy in Europe Orjan Solvell

Provenance in Temporal Databases · temporal databases. Using the snapshot reducibility property of temporal databases we will define a pointwise lineage traceability for temporal

Provenance in Temporal Databases · temporal databases. Using the snapshot reducibility property of temporal databases we will define a pointwise lineage traceability for temporal

V-variable fractals and superfractals - arXiv · V-variable fractals and superfractals Michael Barnsley†, John E Hutchinson†§ and Orjan Stenflo¨ ‡ † Department of Mathematics,

V-variable fractals and superfractals - arXiv · V-variable fractals and superfractals Michael Barnsley†, John E Hutchinson†§ and Orjan Stenflo¨ ‡ † Department of Mathematics,

Temporal Information Extraction and Shallow Temporal Reasoning

Temporal Information Extraction and Shallow Temporal Reasoning

BIBLIOGRAPHY - Shodhgangashodhganga.inflibnet.ac.in/bitstream/10603/26813/12/12_chapter 7.p… · BIBLIOGRAPHY Aaby, K.; Ekeberg, D. and Skredej, G. (2007). Characterization of phenolic

BIBLIOGRAPHY - Shodhgangashodhganga.inflibnet.ac.in/bitstream/10603/26813/12/12_chapter 7.p… · BIBLIOGRAPHY Aaby, K.; Ekeberg, D. and Skredej, G. (2007). Characterization of phenolic