Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear...
-
Upload
reynold-nash -
Category
Documents
-
view
212 -
download
0
Transcript of Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear...
![Page 1: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/1.jpg)
Fourier Transforms in Computer Science
![Page 2: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/2.jpg)
Can a function [0,2]R be expressed as a linear combination of sin nx, cos nx ?
If yes, how do we find the coefficients?
![Page 3: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/3.jpg)
If f(x)= a exp(2i n x)nn Z
thena = f(x)exp(-2i n x) dx
1
0n
the exp(-2i nx) are orthonormalwith respect to the inner product
<f,g> = f(x)g(x) dx1
0
The reason that this works is that
Fourier’s recipe
![Page 4: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/4.jpg)
Given “good” f:[0,1]C we define its Fourier transform as f:ZC
f(n) = f(x)exp(-2i n x) dx1
0
space offunctions
space offunctions
Fourier Transform
![Page 5: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/5.jpg)
space offunctions
space offunctions
Fourier Transform
L [0,1] L (Z)2 2
<f,g> <f,g>
isometry
||f|| ||f||
=
=
Plancherelformula
Parseval’sidentity 2 2
![Page 6: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/6.jpg)
space offunctions
space offunctions
Fourier Transform
convolution pointwise multiplication
(f*g)(x)= f(y)g(x-y) dy1
0
f*g f g
![Page 7: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/7.jpg)
Can be studied in a more general setting:
interval [0,1]
Lebesgue measure and integral
exp(2i n x)
LCAgroup G
Haar measure and integral
charactersof G
form a topological group G, dual of G
continuoushomomorphisms GC
![Page 8: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/8.jpg)
Fourier coefficients of AC functions0
Linial, Mansour, Nisan ‘93
![Page 9: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/9.jpg)
circuit
AND
OROROR
AND AND
AND
AND
1 2 3x x xx x x3 21
depth=3
size=8
output
Input:
![Page 10: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/10.jpg)
AC0 circuits
AND
OROROR
AND AND
AND
AND
1 2 3x x xx x x3 21
depth=3
size=8
output
Input:
constant depth,polynomial size
![Page 11: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/11.jpg)
Random restriction of a function
f : {0,1} {0,1}n
x1 2 nx x. . .
0 1 x2
p(1-p)/2 (1-p)/2
![Page 12: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/12.jpg)
Fourier transform over Z 2n
characters
(-1)i A
x i for each subsetof {1,...,n}
Fourier coefficients
f(A)= P(f(x)= (x))-P(f(x)= (x))
A(x)=
A A
![Page 13: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/13.jpg)
f AC high Fourier coefficients of a random restriction are zerowith high probability
Hastad switching lemmao
0
1-M(5p s )1/d 1-1/d s
All coefficients of size >s are 0with probability at least
size of the circuit depth
![Page 14: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/14.jpg)
We can express the Fourier coef- ficients of the random restriction of f using the Fourier coefficients of f
E[r(x)]=p f(x)
E[r(x) ]=p f(x+y) (1-p)
|x|
2 2 |y||x|
yx
![Page 15: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/15.jpg)
Sum of the squares of the high Fourier coefficients of an ACFunction is small
0
f(x) < 2M exp(- (t/2) )
|x|>s
1/d1
5e
Learning of AC functions0
2
![Page 16: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/16.jpg)
Influence of variableson Boolean functions
Kahn, Kalai, Linial ‘88
![Page 17: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/17.jpg)
The Influence of variables
The influence of x on f(x ,x , …,x )i
set the other variables randomly
the probability that change of x will change the value of the function
1 2 n
i
I (x )if
Examples: for the AND function of n variables each variable has influence 1/2 for the XOR function of n variables each variable has influence 1
n
![Page 18: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/18.jpg)
The Influence of variables
The influence of x in f(x ,x , …,x )i
set the other variables randomly
the probability that change of x will change the value of the function
1 2 n
i
For balanced f there is a variablewith influence > (c log n)/n
I (x )if
![Page 19: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/19.jpg)
We have a function f such thatI(x )=||f || , and the Fourier coef-ficients of f can be expressed using the Fourier coefficients of f
i
pp
ii
i
f (x)=f(x)-f(x+i)i
f (x) =2f(x) if i is in x = 0 otherwisei
![Page 20: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/20.jpg)
We can express the sum of the influences using the Fourier coefficients of f
I(x )i = 4 |x| f(x) 2
if f has large high Fourier coefficients then we are happy
How to inspect small coefficients?
![Page 21: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/21.jpg)
Beckner’s linear operators
f(x) a f(x)|x|
Norm 1 linear operator
from L (Z ) to L (Z )1+a2 2n n22
a<1
I(x )i4/3
> 4 |x| f(x) (1/2) 2 |x|
Can get bound ignoring high FC
![Page 22: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/22.jpg)
Explicit Expanders
Gaber, Galil ’79 (using Margulis ’73)
![Page 23: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/23.jpg)
Expander
Any (not too big) set of vertices Whas many neighbors (at least (1+a)|W|)
positiveconstant
W
![Page 24: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/24.jpg)
Expander
Any (not too big) set of vertices Whas many neighbors (at least (1+a)|W|)
positiveconstant
WN(W)
|N(W)|>(1+a)|W|
![Page 25: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/25.jpg)
Why do we want explicit expandersof small degree?
sorting networks
extracting randomness
![Page 26: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/26.jpg)
Example of explicit bipartite expanderof constant degree:
Z x Zm m Z x Zm m
(x,y) (x+y,y)(x,y) (x+y+1,y) (x,x+y) (x,x+y+1)
![Page 27: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/27.jpg)
Transform to a continuous problem
For any measurable A one of the transformations s:(x,y)(x+y,y) and t:(x,y)(x,x+y) “displaces” it
T2
M(s(A)-A)+M(t(A)-A)>2cM(A)
measure
![Page 28: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/28.jpg)
Estimating the Rayleigh quotientof an operator on X L(T ) 22
Functions with f(0)=0
(T f) (x,y)=f(x-y,y)+f(x,y-x)
r(T)=sup { |<Tx,x>| ; ||x||=1}
![Page 29: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/29.jpg)
It is easier to analyze the corres-ponding linear operator in Z 2
(S f)(x,y)=f(x+y,y)+f(x,x+y)
Let L be a labeling of the arcs of the graph with vertex set Z x Z and edges (x,y)(x+y,y) and (x,y)(x,x+y) such that L(u,v)=1/L(v,u). Let C bemaximum over all vertices of sum of the labels of the outgoing edges. Then r(S)C.
![Page 30: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/30.jpg)
Lattice Duality: Banaszczyk’s Transference Theorem
Banaszczyk ‘93
![Page 31: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/31.jpg)
Lattice:
given n x n regular matrix B,a lattice is { Bx; x Z }n
![Page 32: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/32.jpg)
Successive minima:
smallest r such that a ballcentered in 0 of diameter rcontains k linearly independent lattice points
k
![Page 33: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/33.jpg)
Dual lattice:
Lattice L with matrix B -T
Transference theorem:
n
*k n-k+1
*
can be used to show that O(n)approximation of the shortestlattice vector in 2-norm is notNP-hard unless NP=co-NP
(Lagarias, H.W. Lenstra, Schnorr’ 90)
![Page 34: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/34.jpg)
Poisson summation formula:
f(x) = f(x)
x Z x Z
f:RCFor “nice”
![Page 35: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/35.jpg)
Define Gaussian-like measureon the subsets of R n
r(A)= exp(-||x|| )x A
2
Prove using Poisson summationformula:
r((L+u)\B)<0.285 r(L)
a ball of diameter (3/4)n centered around 01/2
![Page 36: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/36.jpg)
p(A)= r(A L)/r(L)
Prove using Poisson summationformula:
p(u) = r(L+u)/r(L)
Define Gaussian-like measureon the subsets of R
* *
![Page 37: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/37.jpg)
> n
*k n-k+1If then we have
a vector u perpendicular toall lattice points in L B and L B*
r(L +u)/r(L )* *
small + small
outside ball
inside ball,“moved by u”
p(u)= r(x)exp(-2iu x) Tx L
large
![Page 38: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/38.jpg)
Weight of a function –sum of columns (mod m)
Therien ‘94,
![Page 39: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/39.jpg)
1 2
3
1 3
2
6
1
4
4
3 5
1 2
1 3
2
14
5
1
3
1
2
6
4
4
3
1
2
4
4
Is there a set of columns whichsum to the zero column (mod t) ?
m
n
![Page 40: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/40.jpg)
If m>c n t then there alwaysexists a set of columns whichsum to zero column (mod t)
11/2
wt(f)= number of non-zero Fourier coefficients
w(fg)w(f)w(g)
w(f+g)w(f)+w(g)
![Page 41: Fourier Transforms in Computer Science. Can a function [0,2 ] z R be expressed as a linear combination of sin nx, cos nx ? If yes, how do we find the.](https://reader035.fdocuments.us/reader035/viewer/2022070413/5697bfed1a28abf838cb90ef/html5/thumbnails/41.jpg)
f (x)=g x a 1 i,1 x a m i,m+ ... +
i
If no set of columns sums tothe zero column mod t then
t+1 is a prime
(1-(1-f ) ) it
restricted to B={0,1} is 1 m
0
g=
wt(g 1 ) t (t-1) nBt =
m m