precRec on D2, D3

12
0 0.2 0.4 0.6 0.8 1 0 0.2 0.4 0.6 0.8 1 Precision FR Precision vs. FR D2 (random-threshold) D2 (random-weighted) D3 (random) D2 (uniform-threshold) D2 (uniform-weighted) D3 (uniform)

description

Comparing the performance of precRec on D2 (prob. data) using uniform, random approaches and D3 (deterministic data) using a threshold of 0.5. These graphs are updated after corrections to the source precision & recall of deterministic data.

Transcript of precRec on D2, D3

Page 1: precRec on D2, D3

0

0.2

0.4

0.6

0.8

1

0 0.2 0.4 0.6 0.8 1

Prec

isio

n

FR

Precision vs. FR

D2 (random-threshold)D2 (random-weighted)

D3 (random)D2 (uniform-threshold)

D2 (uniform-weighted)D3 (uniform)

Page 2: precRec on D2, D3

0

0.2

0.4

0.6

0.8

1

60 80 100 120 140 160 180 200

Prec

isio

n

Number of Sources

Precision vs. Number of Sources

D2 (random-threshold)D2 (random-weighted)

D3 (random)D2 (uniform-threshold)

D2 (uniform-weighted)D3 (uniform)

Page 3: precRec on D2, D3

0

0.2

0.4

0.6

0.8

1

500 1000 1500 2000 2500 3000 3500 4000

Prec

isio

n

Number of Tuples

Precision vs. Number of Tuples

D2 (random-threshold)D2 (random-weighted)

D3 (random)D2 (uniform-threshold)

D2 (uniform-weighted)D3 (uniform)

Page 4: precRec on D2, D3

0

0.2

0.4

0.6

0.8

1

0 0.2 0.4 0.6 0.8 1

Prec

isio

n

Truth Fraction (TF)

Precision vs. Truth Fraction

D2 (random-threshold)D2 (random-weighted)

D3 (random)D2 (uniform-threshold)

D2 (uniform-weighted)D3 (uniform)

Page 5: precRec on D2, D3

0

0.2

0.4

0.6

0.8

1

0 0.2 0.4 0.6 0.8 1

Rec

all

FR

Recall vs. FR

D2 (random-threshold)D2 (random-weighted)

D3 (random)D2 (uniform-threshold)

D2 (uniform-weighted)D3 (uniform)

Page 6: precRec on D2, D3

0

0.2

0.4

0.6

0.8

1

60 80 100 120 140 160 180 200

Rec

all

Number of Sources

Recall vs. Number of Sources

D2 (random-threshold)D2 (random-weighted)

D3 (random)D2 (uniform-threshold)

D2 (uniform-weighted)D3 (uniform)

Page 7: precRec on D2, D3

0

0.2

0.4

0.6

0.8

1

500 1000 1500 2000 2500 3000 3500 4000

Rec

all

Number of Tuples

Recall vs. Number of Tuples

D2 (random-threshold)D2 (random-weighted)

D3 (random)D2 (uniform-threshold)

D2 (uniform-weighted)D3 (uniform)

Page 8: precRec on D2, D3

0

0.2

0.4

0.6

0.8

1

0 0.2 0.4 0.6 0.8 1

Rec

all

Truth Fraction (TF)

Recall vs. Truth Fraction

D2 (random-threshold)D2 (random-weighted)

D3 (random)D2 (uniform-threshold)

D2 (uniform-weighted)D3 (uniform)

Page 9: precRec on D2, D3

0

0.2

0.4

0.6

0.8

1

0 0.2 0.4 0.6 0.8 1

F-1

FR

F-1 vs. FR

D2 (random-threshold)D2 (random-weighted)

D3 (random)D2 (uniform-threshold)

D2 (uniform-weighted)D3 (uniform)

Page 10: precRec on D2, D3

0

0.2

0.4

0.6

0.8

1

60 80 100 120 140 160 180 200

F-1

Number of Sources

F-1 vs. Number of Sources

D2 (random-threshold)D2 (random-weighted)

D3 (random)D2 (uniform-threshold)

D2 (uniform-weighted)D3 (uniform)

Page 11: precRec on D2, D3

0

0.2

0.4

0.6

0.8

1

500 1000 1500 2000 2500 3000 3500 4000

F-1

Number of Tuples

F-1 vs. Number of Tuples

D2 (random-threshold)D2 (random-weighted)

D3 (random)D2 (uniform-threshold)

D2 (uniform-weighted)D3 (uniform)

Page 12: precRec on D2, D3

0

0.2

0.4

0.6

0.8

1

0 0.2 0.4 0.6 0.8 1

F-1

Truth Fraction (TF)

F-1 vs. Truth Fraction

D2 (random-threshold)D2 (random-weighted)

D3 (random)D2 (uniform-threshold)

D2 (uniform-weighted)D3 (uniform)