precRec with P1=0.4, P2=0.6

12

Click here to load reader

description

Compare performance of precRec on prob. data with p1=0.4, p2=0.6 and deterministic data with thresholds = {0.1, 0.3. 0.5. 0.7, 0.9}. These graphs are updated after corrections to source precision & recall on deterministic data.

Transcript of precRec with P1=0.4, P2=0.6

Page 1: precRec with P1=0.4, P2=0.6

0

0.2

0.4

0.6

0.8

1

0 0.2 0.4 0.6 0.8 1

Prec

isio

n

FR

Precision vs. FR

threshold=0.1threshold=0.3

threshold=0.5threshold=0.7

threshold=0.9prob. (weighted)

prob. (threshold)

Page 2: precRec with P1=0.4, P2=0.6

0

0.2

0.4

0.6

0.8

1

60 80 100 120 140 160 180 200

Prec

isio

n

Number of Sources

Precision vs. Number of Sources

threshold=0.1threshold=0.3

threshold=0.5threshold=0.7

threshold=0.9prob. (weighted)

prob. (threshold)

Page 3: precRec with P1=0.4, P2=0.6

0

0.2

0.4

0.6

0.8

1

500 1000 1500 2000 2500 3000 3500 4000

Prec

isio

n

Number of Tuples

Precision vs. Number of Tuples

threshold=0.1threshold=0.3

threshold=0.5threshold=0.7

threshold=0.9prob. (weighted)

prob. (threshold)

Page 4: precRec with P1=0.4, P2=0.6

0

0.2

0.4

0.6

0.8

1

0 0.2 0.4 0.6 0.8 1

Prec

isio

n

Truth Fraction (TF)

Precision vs. Truth Fraction

threshold=0.1threshold=0.3

threshold=0.5threshold=0.7

threshold=0.9prob. (weighted)

prob. (threshold)

Page 5: precRec with P1=0.4, P2=0.6

0

0.2

0.4

0.6

0.8

1

0 0.2 0.4 0.6 0.8 1

Rec

all

FR

Recall vs. FR

threshold=0.1threshold=0.3

threshold=0.5threshold=0.7

threshold=0.9prob. (weighted)

prob. (threshold)

Page 6: precRec with P1=0.4, P2=0.6

0

0.2

0.4

0.6

0.8

1

60 80 100 120 140 160 180 200

Rec

all

Number of Sources

Recall vs. Number of Sources

threshold=0.1threshold=0.3

threshold=0.5threshold=0.7

threshold=0.9prob. (weighted)

prob. (threshold)

Page 7: precRec with P1=0.4, P2=0.6

0

0.2

0.4

0.6

0.8

1

500 1000 1500 2000 2500 3000 3500 4000

Rec

all

Number of Tuples

Recall vs. Number of Tuples

threshold=0.1threshold=0.3

threshold=0.5threshold=0.7

threshold=0.9prob. (weighted)

prob. (threshold)

Page 8: precRec with P1=0.4, P2=0.6

0

0.2

0.4

0.6

0.8

1

0 0.2 0.4 0.6 0.8 1

Rec

all

Truth Fraction (TF)

Recall vs. Truth Fraction

threshold=0.1threshold=0.3

threshold=0.5threshold=0.7

threshold=0.9prob. (weighted)

prob. (threshold)

Page 9: precRec with P1=0.4, P2=0.6

0

0.2

0.4

0.6

0.8

1

0 0.2 0.4 0.6 0.8 1

F-1

FR

F-1 vs. FR

threshold=0.1threshold=0.3

threshold=0.5threshold=0.7

threshold=0.9prob. (weighted)

prob. (threshold)

Page 10: precRec with P1=0.4, P2=0.6

0

0.2

0.4

0.6

0.8

1

60 80 100 120 140 160 180 200

F-1

Number of Sources

F-1 vs. Number of Sources

threshold=0.1threshold=0.3

threshold=0.5threshold=0.7

threshold=0.9prob. (weighted)

prob. (threshold)

Page 11: precRec with P1=0.4, P2=0.6

0

0.2

0.4

0.6

0.8

1

500 1000 1500 2000 2500 3000 3500 4000

F-1

Number of Tuples

F-1 vs. Number of Tuples

threshold=0.1threshold=0.3

threshold=0.5threshold=0.7

threshold=0.9prob. (weighted)

prob. (threshold)

Page 12: precRec with P1=0.4, P2=0.6

0

0.2

0.4

0.6

0.8

1

0 0.2 0.4 0.6 0.8 1

F-1

Truth Fraction (TF)

F-1 vs. Truth Fraction

threshold=0.1threshold=0.3

threshold=0.5threshold=0.7

threshold=0.9prob. (weighted)

prob. (threshold)