Perceptron Convergence Proof
1 If dataset is separable there is a margin
Margin ylbest direction w't
Kw w HI tyx1w w glint x
215 w 1 8
3 Hw llIHw yall 11 112 4 1Hw H't y4lxH't2y4w x
Hut ll't I O
4 lui WHY KylHulk'll k k
HT 3 Hw ll I w w trial
fkill L
VT trial
78
K f ter B
x zto w O O 2 b 2 a
µx six Y
t I l I I 4Xz X
I T l I O
I l I I O
i t I I 4
what a bat 3 dimensions D lwhat happens to the efficiency in votingtheperceptron updates
what abut K NNwhat about deep networks
Yao can solve the XOR problem
is 1 layers
Averaged Perceptron
Assume bias term in xs
we want
c w dropping ItemWe have
cw c x Coke x4 EckCw v
wa
K l
Z c w c Ix e ex
i i
i
c Krk
U dx t e x'e te x
2 Ic x c c XK
l
c r
k k
ow I xid I t e
2c XK
Ix t e ft c
i i i
Ex c ckx
1,2 13,4 11
l 3 t 2.4 t 12
1.3 I 2 4 I I I
1.3 2.9 t 2.9.24 y l 2 7
I 3 1.9 I 3 2 4 t l 3 l
TF 2 wix 11 real L
LE xi wi 1112
f
It
p.m
ton
Top Related