Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington...
-
Upload
bethanie-foster -
Category
Documents
-
view
214 -
download
0
description
Transcript of Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington...
![Page 1: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/1.jpg)
Balance and Filtering in Structured Satisfiability Problems
Henry KautzUniversity of Washington
joint work withYongshao Ruan (UW), Dimitris Achlioptas (MSR),
Carla Gomes (Cornell), Bart Selman (Cornell), Mark Stickel (SRI)
CORE – UW, MSR, Cornell
![Page 2: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/2.jpg)
Speedup Learning Machine learning historically considered
Learning to classify objects Learning to search or reason more efficiently
Speedup Learning Speedup learning disappeared in mid-90’s
Last workshop in 1993 Last thesis 1998
What happened? EBL (without generalization) “solved”
rel_sat (Bayardo), GRASP (Silva 1998), Chaff (Malik 2001) – 1,000,000 variable verification problems
EBG too hard algorithmic advances outpaced any successes
![Page 3: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/3.jpg)
Alternative Path
Predictive control of search and reasoning Learn statistical model of behavior of a problem solver
on a problem distribution Use the model as part of a control strategy to improve
the future performance of the solver Synthesis of ideas from
Phase transition phenomena in problem distributions Decision-theoretic control of reasoning Bayesian modeling
![Page 4: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/4.jpg)
Big Picture
ProblemInstances
Solver
static features
runtime
Learning /Analysis
PredictiveModel
dynamic features
resource allocation / reformulation
control / policy
![Page 5: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/5.jpg)
Case Study: Beyond 4.25
ProblemInstances
Solver
static features
runtime
Learning /Analysis
PredictiveModel
![Page 6: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/6.jpg)
Phase transitions & problem hardness
Large and growing literature on random problem distributions
Peak in problem hardness associated with critical value of some underlying parameter
3-SAT: clause/variable ratio = 4.25 Using measured parameter to predict hardness of
a particular instance problematic! Random distribution must be a good model of actual
domain of concern Recent progress on more realistic random
distributions...
![Page 7: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/7.jpg)
Quasigroup Completion Problem (QCP)
NP-Complete Has structure is similar to that of real-world problems -
tournament scheduling, classroom assignment, fiber optic routing, experiment design, ...
Start with empty grad, place colors randomly Generates mix of sat and unsat instances
![Page 8: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/8.jpg)
Phase Transition
Almost all unsolvable area
Fraction of pre-assignment
Frac
tion
of u
nsol
vabl
e ca
ses
Almost all solvable area
Complexity Graph
Phase transition
42% 50%20%
42% 50%20%
Underconstrained area
Critically constrained area
Overconstrained area
![Page 9: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/9.jpg)
Quasigroup With Holes (QWH) Start with solved problem, then punch holes Generates only SAT instances
Can use to test incomplete solvers Hardness peak at phase transition in size of
backbone (Achlioptas, Gomes, & Kautz 2000)
![Page 10: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/10.jpg)
New Phase Transition in Backbone
% Backbone
% holes
Computationalcost%
of B
ackb
one
![Page 11: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/11.jpg)
Easy-Hard-Easy pattern in local search
% holes
Com
puta
tiona
l Cos
t
WalksatOrder 30, 33, 36
“Over” constrained area
Underconstrained area
![Page 12: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/12.jpg)
Are we ready to predict run times?
Problem: high variance
1.E+00
1.E+01
1.E+02
1.E+03
1.E+04
1.E+05
1.E+06
1.E+07
1.E+08
1.E+09
0.2 0.25 0.3 0.35 0.4 0.45 0.5
log scale
![Page 13: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/13.jpg)
Deep structural features
Rectangular Pattern(Hall 1945)
Aligned Patternnew result! Balanced Pattern
Tractable Very hard
Hardness is also controlled by structure of constraints, not just the fraction of holes
![Page 14: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/14.jpg)
Random versus balanced
BalancedRandom
![Page 15: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/15.jpg)
Random versus balanced
0.E+00
1.E+07
2.E+07
3.E+07
4.E+07
5.E+07
6.E+07
7.E+07
0.2 0.25 0.3 0.35 0.4 0.45 0.5
Balanced
Random
![Page 16: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/16.jpg)
Random vs. balanced (log scale)
1.E+00
1.E+01
1.E+02
1.E+03
1.E+04
1.E+05
1.E+06
1.E+07
1.E+08
1.E+09
0.2 0.25 0.3 0.35 0.4 0.45 0.5
Balanced
Random
![Page 17: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/17.jpg)
Morphing balanced and randomMixed Model - Walksat
0102030405060708090
100
0.00% 20.00% 40.00% 60.00% 80.00% 100.00%
Percent random holes
Tim
e (se
cond
s)
order 33
![Page 18: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/18.jpg)
Considering variance in hole pattern
Mixed Model - Walksat
0102030405060708090
100
0 2 4 6 8
variance in # holes / row
time
order 33
![Page 19: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/19.jpg)
Time on log scale
Mixed Model - Walksat
1
10
100
0 2 4 6 8
variance in # holes / row
time (
seco
nds)
log
scale
order 33
![Page 20: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/20.jpg)
Balanced patterns yield (on average) problems that are 2 orders of magnitude harder than random patterns
Expected run time decreases exponentially with variance in # holes per row or column
Same pattern (differ constants) for DPPL! At extreme of high variance (aligned model) can
prove no hard problems exist
Effect of balance on hardness
2
( ) kE T C
![Page 21: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/21.jpg)
0.1
1
10
0 10 20 30 40 50
variance
time
(sec
onds
)
Morphing random and rectangular
order 36
![Page 22: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/22.jpg)
0.01
0.1
1
10
0 50 100 150 200 250 300
variance in # holes
time
(sec
onds
)Morphing random and rectangular
order 33
artifact of walksatartifact of walksat
![Page 23: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/23.jpg)
Morphing Balanced Random Rectangular
0.1
1
10
100
0 5 10 15 20
variance
time
(sec
onds
)
order 33
![Page 24: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/24.jpg)
Intuitions
In unbalanced problems it is easier to identify most critically constrained variables, and set them correctly
Backbone variables
![Page 25: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/25.jpg)
Are we done?
Not yet... Observation 1: While few unbalanced problems
are hard, quite a few balanced problems are easy To do: find additional structural features that
predict hardness Introspection Machine learning (Horvitz et al. UAI 2001) Ultimate goal: accurate, inexpensive prediction of
hardness of real-world problems
![Page 26: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/26.jpg)
Are we done?
Not yet… Observation 2: Significant differences in the SAT
instances in hardest regions for the QCP and QWH generators
QWH
QCP(sat only)
![Page 27: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/27.jpg)
Biases in Generators
An unbiased SAT-only generator would sample uniformly at random from the space of all SAT CSP problems
Practical CSP generators Incremental arc-consistency introduces dependencies Hard to formally model the distribution
QWH generator Clean formal model Slightly biased toward problems with many solutions Adding balance makes small, hard problems
![Page 28: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/28.jpg)
balanced QCP balanced QWH
random QCP random QWH
1.E+00
1.E+01
1.E+02
1.E+03
1.E+04
1.E+05
1.E+06
1.E+07
1.E+08
1.E+09
0.2 0.25 0.3 0.35 0.4 0.45 0.5
% holes
flips
![Page 29: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/29.jpg)
balanced QCP balanced QWH
random QCP random QWH
1.E+00
1.E+01
1.E+02
1.E+03
1.E+04
1.E+05
1.E+06
1.E+07
1.E+08
1.E+09
0.2 0.25 0.3 0.35 0.4 0.45 0.5
% holes
flips
![Page 30: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/30.jpg)
balanced QCP balanced QWH
random QCP random QWH
1.E+00
1.E+01
1.E+02
1.E+03
1.E+04
1.E+05
1.E+06
1.E+07
1.E+08
1.E+09
0.2 0.25 0.3 0.35 0.4 0.45 0.5
% holes
flips
![Page 31: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/31.jpg)
balanced QCP balanced QWH
random QCP random QWH
1.E+00
1.E+01
1.E+02
1.E+03
1.E+04
1.E+05
1.E+06
1.E+07
1.E+08
1.E+09
0.2 0.25 0.3 0.35 0.4 0.45 0.5
% holes
flips
![Page 32: Balance and Filtering in Structured Satisfiability Problems Henry Kautz University of Washington joint work with Yongshao Ruan (UW), Dimitris Achlioptas.](https://reader035.fdocuments.us/reader035/viewer/2022062905/5a4d1af07f8b9ab05997d95c/html5/thumbnails/32.jpg)
Conclusions
One small part of an exciting direction for improving power of search and reasoning algorithms
Hardness prediction can be used to control solver policy
Noise level (Patterson & Kautz 2001) Restarts (Horvitz et al (CORE team ) UAI 2001)
Lots of opportunities for cross-disciplinary work Theory Machine learning Experimental AI and OR Reasoning under uncertainty Statistical physics