Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft...
-
Upload
andres-enderson -
Category
Documents
-
view
215 -
download
2
Transcript of Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft...
![Page 1: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/1.jpg)
Rabin ’80: APT 1 of 22August 29-30, 2011
Invariance in Property Testing
Madhu SudanMicrosoft Research
Based on: works with/of Eli Ben-Sasson, Elena Grigorescu, Tali Kaufman, Shachar Lovett, Ghid Maatouk, Amir Shpilka.
![Page 2: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/2.jpg)
Rabin ’80: APT 2 of 22
Property Testing
Sublinear time algorithms: Algorithms running in time o(input), o(output).
Probabilistic. Correct on (approximation) to input. Input given by oracle, output implicit.
Crucial to modern context (Massive data, no time).
Property testing: Restriction of sublinear time algorithms to
decision problems (output = YES/NO). Amazing fact: Many non-trivial algorithms exist!
August 29-30, 2011
![Page 3: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/3.jpg)
Rabin ’80: APT 3 of 22
Example 1: Polling
Is the majority of the population Red/Blue Can find out by random sampling. Sample size / margin of error
Independent of size of population
Other similar examples: (can estimate other moments …)
August 29-30, 2011
![Page 4: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/4.jpg)
Rabin ’80: APT 4 of 22
Example 2: Linearity
Can test for homomorphisms: Given: f: G H (G,H finite groups), is f
essentially a homomorphism? Test:
Pick x,y in G uniformly, ind. at random; Verify f(x) ¢ f(y) = f(x ¢ y)
Completeness: accepts homomorphisms w.p. 1 (Obvious)
Soundness: Rejects f w.p prob. Proportional to its “distance” (margin) from homomorphisms.
(Not obvious, [BlumLubyRubinfeld’90])
August 29-30, 2011
![Page 5: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/5.jpg)
Invariance in Property Testing: EPFL 5 of 22July 29, 2011
History (slightly abbreviated) [Blum,Luby,Rubinfeld – S’90]
Linearity + application to program testing [Babai,Fortnow,Lund – F’90]
Multilinearity + application to PCPs (MIP). [Rubinfeld+S.]
Low-degree testing [Goldreich,Goldwasser,Ron]
Graph property testing Since then … many developments
More graph properties, statistical properties, matrix properties, properties of Boolean functions …
More algebraic properties
![Page 6: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/6.jpg)
Rabin ’80: APT 6 of 22
Pictorial Summary
August 29-30, 2011
All properties
StatisticalProperties
LinearityLow-degree Graph Properties
Boolean functions
Testable!
Not-testable
![Page 7: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/7.jpg)
Rabin ’80: APT 7 of 22
Some (introspective) questions
What is qualitatively novel about linearity testing relative to classical statistics?
Why are the mathematical underpinnings of different themes so different?
Why is there no analog of “graph property testing” (broad class of properties, totally classified wrt testability) in algebraic world?
August 29-30, 2011
![Page 8: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/8.jpg)
Invariance in Property Testing: EPFL 8 of 22
Invariance?
Property P µ {f : D R} Property P invariant under permutation (function)
¼: D D, iff 2 P ) f ο ¼ 2 P
Property P invariant under group G if 8 ¼ 2 G, P is invariant under ¼.
Observation: Different property tests unified/separated by invariance class.
July 29, 2011
![Page 9: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/9.jpg)
Rabin ’80: APT 9 of 22
Invariances (contd.)
Some examples: Classical statistics: Invariant under all permutations. Graph properties: Invariant under vertex renaming. Boolean properties: Invariant under variable renaming. Matrix properties: Invariant under mult. by invertible matrix. Algebraic Properties = ?
Goals: Possibly generalize specific results. Get characterizations within each class? In algebraic case, get new (useful) codes?
August 29-30, 2011
![Page 10: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/10.jpg)
Rabin ’80: APT 10 of 22
Abstracting Linearity/Low-degree tests
Affine Invariance: Domain = Big field (GF(2n)) or vector space over small field (GF(2)n). Property invariant under affine transformations
of domain (x A.x + b)
Linearity: Range = small field (GF(2)) Property = vector space over range.
August 29-30, 2011
![Page 11: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/11.jpg)
11 of 22May 23-28, 2011
Bertinoro: Testing Affine-Invariant Properties
Testing Linear Properties
Algebraic Property = Code! (usually)
Universe:{f:D R}
P
Don’t care
Must reject
Must acceptP
R is a field F; P is linear!
![Page 12: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/12.jpg)
Rabin ’80: APT 12 of 22
Why study affine-invariance?
Common abstraction of properties studied in [BLR], [RS], [ALMSS], [AKKLR], [KR], [KL], [JPRZ]. (Variations on low-degree polynomials)
Hopes Unify existing proofs Classify/characterize testability Find new testable codes (w. novel parameters)
Rest of the talk: Brief summary of findings
August 29-30, 2011
![Page 13: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/13.jpg)
Rabin ’80: APT 13 of 22
Basic terminology Local Constraint:
Example: f(1) + f(2) = f(3). Necessary for testing Linear Properties [BHR]
Local Characterization: Example: 8 x, y, f(x) + f(y) = f(x+y) , f 2 P Aka: LDPC code, k-CNF property etc. Necessary for affine-invariant linear properties.
Single-orbit characterization: One linear constraint + implications by affine-
invariance. Feature in all previous algebraic properties.
August 29-30, 2011
![Page 14: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/14.jpg)
14 of 22
t-local constraint
t-characterized
Affine-invariance & testability
May 23-28, 2011 Bertinoro: Testing Affine-Invariant Properties
t-locally testable
t-S-O-C
![Page 15: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/15.jpg)
Rabin ’80: APT 15 of 22
State of the art in 2007
[AKKLR]: k-constraint = k’-testable, for all linear affine-invariant properties?
August 29-30, 2011
![Page 16: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/16.jpg)
16 of 22
t-local constraint
t-characterized
Affine-invariance & testability
May 23-28, 2011 Bertinoro: Testing Affine-Invariant Properties
t-locally testable
t-S-O-C
![Page 17: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/17.jpg)
Invariance in Property Testing: EPFL 17 of 22
Some results
[Kaufman+S.’07]: Single-orbit ) Testable.
July 29, 2011
![Page 18: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/18.jpg)
18 of 22
t-local constraint
t-characterized
Affine-invariance & testability
May 23-28, 2011 Bertinoro: Testing Affine-Invariant Properties
t-locally testable
t-S-O-C [KS’08]
![Page 19: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/19.jpg)
Invariance in Property Testing: EPFL 19 of 22
Some results [Kaufman+S.’07]: Single-orbit ) Testable.
Unifies known algebraic testing results. Converts testability to purely algebraic terms. Yields “Constraints = Char. = Testability” for
vector spaces over small fields. Left open: Domain = Big field. 9 Many “non-polynomial” testable properties
[GKS’08]: Over big fields, Constraint ≠ Char. [BMSS’11]: Over big fields, Char ≠ Testability. [BGMSS’11]: Many questions/conjectures
outlining a possible characterization of affine-invariant properties.
July 29, 2011
![Page 20: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/20.jpg)
Rabin ’80: APT 20 of 22
[BS’10]k-local constraint
k-characterized
Affine-invariance & testability
August 29-30, 2011
k-locally testable
k-S-O-C [KS’08][GKS’08]
[BMSS’11]
weight-k degrees
![Page 21: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/21.jpg)
Rabin ’80: APT 21 of 22
Hopes
Get a complete characterization of locally testable affine-invariant properties.
Use codes of (polynomially large?) locality to build better LTCs/PCPs? In particular move from “domain = vector
space” to “domain = field”.
More broadly: Apply lens of invariance more broadly to property testing.
August 29-30, 2011
![Page 22: Of 22 August 29-30, 2011 Rabin ’80: APT 1 Invariance in Property Testing Madhu Sudan Microsoft Research TexPoint fonts used in EMF. Read the TexPoint manual.](https://reader038.fdocuments.us/reader038/viewer/2022110304/551c4fcd550346a66a8b4b62/html5/thumbnails/22.jpg)
Rabin ’80: APT 22 of 22
Thank You!
August 29-30, 2011