7/22/2019 RevMan Nov 30 2013

1/42

RevMan Workshop

7/22/2019 RevMan Nov 30 2013

2/42

You should have this one

Review: Smoking Study

Comparison: 01 Affected or not

Outcome: 01 Smoking

Study Unaffected Affected OR (fixed) Weight OR (fixed)

or sub-category n/N n/N 95% CI % 95% CI Year

SABM 47/96 49/96 23.31 0.92 [0.52, 1.62] 2011

SE 65/106 41/106 14.78 2.51 [1.45, 4.37] 2011

SEA 18/71 53/71 36.88 0.12 [0.05, 0.25] 2011

SH 53/96 43/96 17.95 1.52 [0.86, 2.68] 2011

SNS 69/96 27/96 7.08 6.53 [3.48, 12.25] 2011

Total (95% CI) 465 465 100.00 1.36 [1.06, 1.75]

Total events: 252 (Unaffected), 213 (Affected)

Test for heterogeneity: Chi = 71.49, df = 4 (P < 0.00001), I = 94.4%

Test for overall effect: Z = 2.45 (P = 0.01)

0.1 0.2 0.5 1 2 5 10

not bothered bothered

7/22/2019 RevMan Nov 30 2013

3/42

Review: Smoking Study

Comparison: 01 Affected or not

Outcome: 01 Smoking

Study Unaffected Affected OR (fixed) Weight OR (fixed)

or sub-category n/N n/N 95% CI % 95% CI Year

SABM 47/96 49/96 23.31 0.92 [0.52, 1.62] 2011

SE 65/106 41/106 14.78 2.51 [1.45, 4.37] 2011

SEA 18/71 53/71 36.88 0.12 [0.05, 0.25] 2011

SH 53/96 43/96 17.95 1.52 [0.86, 2.68] 2011

SNS 69/96 27/96 7.08 6.53 [3.48, 12.25] 2011

Total (95% CI) 465 465 100.00 1.36 [1.06, 1.75]

Total events: 252 (Unaffected), 213 (Affected)

Test for heterogeneity: Chi = 71.49, df = 4 (P < 0.00001), I = 94.4%

Test for overall effect: Z = 2.45 (P = 0.01)

0.1 0.2 0.5 1 2 5 10

not bothered bothered

This graph needs to be modified

7/22/2019 RevMan Nov 30 2013

4/42

Statistics tab

Random-effects

Display tab

Logarithmic scale

0.01100

7/22/2019 RevMan Nov 30 2013

5/42

Review: Smoking Study

Comparison: 01 Affected or not

Outcome: 01 Smoking

Study Unaffected Affected OR (fixed) Weight OR (fixed)

or sub-category n/N n/N 95% CI % 95% CI Year

SABM 47/96 49/96 23.31 0.92 [0.52, 1.62] 2011

SE 65/106 41/106 14.78 2.51 [1.45, 4.37] 2011

SEA 18/71 53/71 36.88 0.12 [0.05, 0.25] 2011

SH 53/96 43/96 17.95 1.52 [0.86, 2.68] 2011

SNS 69/96 27/96 7.08 6.53 [3.48, 12.25] 2011

Total (95% CI) 465 465 100.00 1.36 [1.06, 1.75]

Total events: 252 (Unaffected), 213 (Affected)

Test for heterogeneity: Chi = 71.49, df = 4 (P < 0.00001), I = 94.4%

Test for overall effect: Z = 2.45 (P = 0.01)

0.1 0.2 0.5 1 2 5 10

not bothered bothered

Review: Smoking Study

Comparison: 01 Affected or not

Outcome: 01 Smoking

Study Unaffected Affected OR (random) Weight OR (random)

or sub-category n/N n/N 95% CI % 95% CI Year

SABM 47/96 49/96 20.19 0.92 [0.52, 1.62] 2011

SE 65/106 41/106 20.23 2.51 [1.45, 4.37] 2011

SEA 18/71 53/71 19.44 0.12 [0.05, 0.25] 2011

SH 53/96 43/96 20.18 1.52 [0.86, 2.68] 2011

SNS 69/96 27/96 19.96 6.53 [3.48, 12.25] 2011

Total (95% CI) 465 465 100.00 1.23 [0.39, 3.88]

Total events: 252 (Unaffected), 213 (Affected)

Test for heterogeneity: Chi = 71.49, df = 4 (P < 0.00001), I = 94.4%

Test for overall effect: Z = 0.36 (P = 0.72)

0.01 0.1 1 10 100

not bothered bothered

7/22/2019 RevMan Nov 30 2013

6/42

Does smoking bother the student population or not?

What is the OR 95% CI?

Review: Smoking Study

Comparison: 01 Affected or not

Outcome: 01 Smoking

Study Unaffected Affected OR (random) Weight OR (random)or sub-category n/N n/N 95% CI % 95% CI Year

SABM 47/96 49/96 20.19 0.92 [0.52, 1.62] 2011

SE 65/106 41/106 20.23 2.51 [1.45, 4.37] 2011

SEA 18/71 53/71 19.44 0.12 [0.05, 0.25] 2011

SH 53/96 43/96 20.18 1.52 [0.86, 2.68] 2011

SNS 69/96 27/96 19.96 6.53 [3.48, 12.25] 2011

Total (95% CI) 465 465 100.00 1.23 [0.39, 3.88]

Total events: 252 (Unaffected), 213 (Affected)

Test for heterogeneity: Chi = 71.49, df = 4 (P < 0.00001), I = 94.4%

Test for overall effect: Z = 0.36 (P = 0.72)

0.01 0.1 1 10 100

not bothered bothered

1.23 (0.393.88)

Analyze Plot

7/22/2019 RevMan Nov 30 2013

7/42

Which of the five schools

are bothered by smoking?are not bothered by smoking?

Review: Smoking Study

Comparison: 01 Affected or not

Outcome: 01 Smoking

Study Unaffected Affected OR (random) Weight OR (random)or sub-category n/N n/N 95% CI % 95% CI Year

SABM 47/96 49/96 20.19 0.92 [0.52, 1.62] 2011

SE 65/106 41/106 20.23 2.51 [1.45, 4.37] 2011

SEA 18/71 53/71 19.44 0.12 [0.05, 0.25] 2011

SH 53/96 43/96 20.18 1.52 [0.86, 2.68] 2011

SNS 69/96 27/96 19.96 6.53 [3.48, 12.25] 2011

Total (95% CI) 465 465 100.00 1.23 [0.39, 3.88]

Total events: 252 (Unaffected), 213 (Affected)

Test for heterogeneity: Chi = 71.49, df = 4 (P < 0.00001), I = 94.4%

Test for overall effect: Z = 0.36 (P = 0.72)

0.01 0.1 1 10 100

not bothered bothered

SE, SH, SNSSEA

Analyze Plot

7/22/2019 RevMan Nov 30 2013

8/42

Effect sizes

NUMBER

Lower CIHigher CI

Quantify CIs

Effect sizes

GRAPHICAL

Summary effect

Review: Smoking Study

Comparison: 01 Affected or not

Outcome: 01 Smoking

Study Unaffected Affected OR (random) Weight OR (random)

or sub-category n/N n/N 95% CI % 95% CI Year

SABM 47/96 49/96 20.19 0.92 [0.52, 1.62] 2011

SE 65/106 41/106 20.23 2.51 [1.45, 4.37] 2011

SEA 18/71 53/71 19.44 0.12 [0.05, 0.25] 2011

SH 53/96 43/96 20.18 1.52 [0.86, 2.68] 2011

SNS 69/96 27/96 19.96 6.53 [3.48, 12.25] 2011

Total (95% CI) 465 465 100.00 1.23 [0.39, 3.88]

Total events: 252 (Unaffected), 213 (Affected)

Test for heterogeneity: Chi = 71.49, df = 4 (P < 0.00001), I = 94.4%

Test for overall effect: Z = 0.36 (P = 0.72)

0.01 0.1 1 10 100

not bothered bothered

7/22/2019 RevMan Nov 30 2013

9/42

Quantify CI

7/22/2019 RevMan Nov 30 2013

10/42

Open ExcelFrom forest plot, enter lower

and higher data for CI

Located below

OR (random)

95% CI

Quantify CI

7/22/2019 RevMan Nov 30 2013

11/42

OR (random)

95% CI

0.92 (0.52, 1.62)

lower higher

Quantify CI

7/22/2019 RevMan Nov 30 2013

12/42

You should have this one

Quantify CI

B C D E

2 95% CI

3 Study Lower Higher CID

4 SABM 0.52 1.62

5 SE 1.45 4.37

6 SEA 0.05 0.25

7 SH 0.86 2.68

8 SNS 3.48 12.25

7/22/2019 RevMan Nov 30 2013

13/42

Cursor to E4Press = key; vertical blinks

Cursor to D4

Press (dash) key- (dash appears after D4)

Cursor to B4

Enter

Quantify CI

7/22/2019 RevMan Nov 30 2013

14/42

Under CIDin cell E4 should be 1.1

This is the CID of SABM

Quantify CI

B C D E

2 95% CI

3 Study Lower Higher CID

4 SABM 0.52 1.62 1.1

5 SE 1.45 4.376 SEA 0.05 0.25

7 SH 0.86 2.68

8 SNS 3.48 12.25

7/22/2019 RevMan Nov 30 2013

15/42

Highlight 1.1

This act will make visible a small black

square on the lower right corner of the

1.1 cell

1.1 Place cursoron this black

square which

will show a

cross

Quantify CI

7/22/2019 RevMan Nov 30 2013

16/42

1.1 Drag this crossdownwards

until you reach

D8

Respective values of CID for

studies 1 to 5 will show filling up

the CID column

Quantify CI

7/22/2019 RevMan Nov 30 2013

17/42

Quantify CI

B C D E

2 95% CI

3 Study Lower Higher CID

4 SABM 0.52 1.62 1.1

5 SE 1.45 4.37 2.92

6 SEA 0.05 0.25 0.2

7 SH 0.86 2.68 1.82

8 SNS 3.48 12.25 8.77

Notice that E4 and E6 have only onedecimal

Highlight E4 to E6, click .00 icon

7/22/2019 RevMan Nov 30 2013

18/42

Quantify CI

B C D E

2 95% CI

3 Study Lower Higher CID

4 SABM 0.52 1.62 1.10

5 SE 1.45 4.37 2.92

6 SEA 0.05 0.25 0.20

7 SH 0.86 2.68 1.82

8 SNS 3.48 12.25 8.77

You should have this

Which school has the least reliable effects (ORs)?

Which school has the most reliable effects (ORs)?

7/22/2019 RevMan Nov 30 2013

19/42

Review: Smoking Study

Comparison: 01 Affected or notOutcome: 01 Smoking

Study Unaffected Affected OR (random) Weight OR (random)

or sub-category n/N n/N 95% CI % 95% CI Year

SABM 47/96 49/96 20.19 0.92 [0.52, 1.62] 2011

SE 65/106 41/106 20.23 2.51 [1.45, 4.37] 2011

SEA 18/71 53/71 19.44 0.12 [0.05, 0.25] 2011

SH 53/96 43/96 20.18 1.52 [0.86, 2.68] 2011

SNS 69/96 27/96 19.96 6.53 [3.48, 12.25] 2011

Total (95% CI) 465 465 100.00 1.23 [0.39, 3.88]Total events: 252 (Unaffected), 213 (Affected)

Test for heterogeneity: Chi = 71.49, df = 4 (P < 0.00001), I = 94.4%

Test for overall effect: Z = 0.36 (P = 0.72)

0.01 0.1 1 10 100

not bothered bothered

1.23 (0.393.88)

What is the overall CID? 3.49

7/22/2019 RevMan Nov 30 2013

20/42

Add Site

7/22/2019 RevMan Nov 30 2013

21/42

Back to tree : Smoking Study

LDC References

LDC References to studies

Sub-tree appears

Add Site

7/22/2019 RevMan Nov 30 2013

22/42

LDC Included studies Sub-tree of the included studies

appears

RC Included studies

Choose

Add

Sub-window titled, Included study

shows

Add Site

7/22/2019 RevMan Nov 30 2013

23/42

Included study sub-window

Study ID, type Grad

Year: type 2011

Choose Unpublished data only

Click OK

Add Site

7/22/2019 RevMan Nov 30 2013

24/42

Tree: Gradnow added under included studies

Compress References

RC Smoking

Choose AddAdd studies sub-window

Grad highlighted in blue

Add Site

7/22/2019 RevMan Nov 30 2013

25/42

Grad highlighted in blueClick Add

LDCGrad

Excel table appears

Enter the following data for Grad322, 1000, 222, 1500

Re-order 1 to 6

Add Site

7/22/2019 RevMan Nov 30 2013

26/42

Save then CloseFigures

Analyses

Summary window

Smoking

Details

Statistics: Random

Display: Log scale: 0.01 - 100

Add Site

7/22/2019 RevMan Nov 30 2013

27/42

Plot should look like thisReview: Smoking StudyComparison: 01 Affected or not

Outcome: 01 Smoking

Study Unaffected Affected OR (random) Weight OR (random)

or sub-category n/N n/N 95% CI % 95% CI Year

Grad 322/1000 222/1500 17.92 2.73 [2.25, 3.32] 2011

SABM 47/96 49/96 16.66 0.92 [0.52, 1.62] 2011

SE 65/106 41/106 16.72 2.51 [1.45, 4.37] 2011

SEA 18/71 53/71 15.69 0.12 [0.05, 0.25] 2011

SH 53/96 43/96 16.65 1.52 [0.86, 2.68] 2011

SNS 69/96 27/96 16.36 6.53 [3.48, 12.25] 2011

Total (95% CI) 1465 1965 100.00 1.43 [0.63, 3.25]

Total events: 574 (Unaffected), 435 (Affected)

Test for heterogeneity: Chi = 86.02, df = 5 (P < 0.00001), I = 94.2%

Test for overall effect: Z = 0.86 (P = 0.39)

0.01 0.1 1 10 100

not bothered bothered

Add Site

Is Grad bothered by smoking?

What is the OR 95% CI?

7/22/2019 RevMan Nov 30 2013

28/42

What is the effect on the overall OR if

SEA were removed from the study?

Effect of omit

SEA is the only school not bothered by

smoking

7/22/2019 RevMan Nov 30 2013

29/42

Omit

Tree: SmokingRC SEA

Choose Deselect

SEA is red XT

Analyses

Smoking

Detail Plot

SEA omitted from plot

7/22/2019 RevMan Nov 30 2013

30/42

Omit

PlotStatistics: Random

What is the overall OR 95% CI now?

2.29 (1.36-3.88)

What does it mean?

7/22/2019 RevMan Nov 30 2013

31/42

Omit

Review: Smoking Study

Comparison: 01 Affected or notOutcome: 01 Smoking

Study Unaffected Affected OR (random) Weight OR (random)

or sub-category n/N n/N 95% CI % 95% CI Year

Grad 322/1000 222/1500 24.07 2.73 [2.25, 3.32] 2011

SABM 47/96 49/96 19.19 0.92 [0.52, 1.62] 2011

SE 65/106 41/106 19.39 2.51 [1.45, 4.37] 2011

SH 53/96 43/96 19.14 1.52 [0.86, 2.68] 2011

SNS 69/96 27/96 18.20 6.53 [3.48, 12.25] 2011

Total (95% CI) 1394 1894 100.00 2.29 [1.36, 3.83]Total events: 556 (Unaffected), 382 (Affected)

Test for heterogeneity: Chi = 24.69, df = 4 (P < 0.0001), I = 83.8%

Test for overall effect: Z = 3.13 (P = 0.002)

0.1 0.2 0.5 1 2 5 10

not bothered bothered

That much of the student population isbothered by smoking and it is significant

7/22/2019 RevMan Nov 30 2013

32/42

Omit

SABM is the only school that is neitherbothered nor unbothered in our study

How would removing SABM and SEA

affect our overall findings?

SABM and SEA effects differ from the restof the schools, these are called outliers

7/22/2019 RevMan Nov 30 2013

33/42

Omit

Tree: Smoking

RC SABM

Choose Deselect

SABM is red Xt

7/22/2019 RevMan Nov 30 2013

34/42

Omit

Analyses

Smoking

Detail PlotBoth SABM and SEA are omitted from plot

Statistics: Random

7/22/2019 RevMan Nov 30 2013

35/42

Omit

Review: Smoking Study

Comparison: 01 Affected or not

Outcome: 01 Smoking

Study Unaffected Affected OR (random) Weight OR (random)

or sub-category n/N n/N 95% CI % 95% CI Year

Grad 322/1000 222/1500 33.19 2.73 [2.25, 3.32] 2011

SE 65/106 41/106 23.14 2.51 [1.45, 4.37] 2011

SH 53/96 43/96 22.67 1.52 [0.86, 2.68] 2011

SNS 69/96 27/96 20.99 6.53 [3.48, 12.25] 2011

Total (95% CI) 1298 1798 100.00 2.82 [1.79, 4.43]

Total events: 509 (Unaffected), 333 (Affected)

Test for heterogeneity: Chi = 11.54, df = 3 (P = 0.009), I = 74.0%

Test for overall effect: Z = 4.49 (P < 0.00001)

0.1 0.2 0.5 1 2 5 10

not bothered bothered

Effect of removing outlier studies

Overall finding: 2.82 95%CI 1.794.43

Highly significant: p < 0.0001

7/22/2019 RevMan Nov 30 2013

36/42

AnalyzeReview: Smoking Study

Comparison: 01 Affected or not

Outcome: 01 Smoking

Study Unaffected Affected OR (random) Weight OR (random)or sub-category n/N n/N 95% CI % 95% CI Year

Grad 322/1000 222/1500 17.92 2.73 [2.25, 3.32] 2011

SABM 47/96 49/96 16.66 0.92 [0.52, 1.62] 2011

SE 65/106 41/106 16.72 2.51 [1.45, 4.37] 2011

SEA 18/71 53/71 15.69 0.12 [0.05, 0.25] 2011

SH 53/96 43/96 16.65 1.52 [0.86, 2.68] 2011

SNS 69/96 27/96 16.36 6.53 [3.48, 12.25] 2011

Total (95% CI) 1465 1965 100.00 1.43 [0.63, 3.25]

Total events: 574 (Unaffected), 435 (Affected)

Test for heterogeneity: Chi = 86.02, df = 5 (P < 0.00001), I = 94.2%Test for overall effect: Z = 0.86 (P = 0.39)

0.01 0.1 1 10 100

not bothered bothered

Review: Smoking Study

Comparison: 01 Affected or not

Outcome: 01 Smoking

Study Unaffected Affected OR (random) Weight OR (random)

or sub-category n/N n/N 95% CI % 95% CI Year

Grad 322/1000 222/1500 33.19 2.73 [2.25, 3.32] 2011

SE 65/106 41/106 23.14 2.51 [1.45, 4.37] 2011

SH 53/96 43/96 22.67 1.52 [0.86, 2.68] 2011

SNS 69/96 27/96 20.99 6.53 [3.48, 12.25] 2011

Total (95% CI) 1298 1798 100.00 2.82 [1.79, 4.43]

Total events: 509 (Unaffected), 333 (Affected)

Test for heterogeneity: Chi = 11.54, df = 3 (P = 0.009), I = 74.0%

Test for overall effect: Z = 4.49 (P < 0.00001)

0.1 0.2 0.5 1 2 5 10

not bothered bothered

N = 6

N = 4

All these

schools are

bothered

7/22/2019 RevMan Nov 30 2013

37/42

Interpret

Results:

We found that smoking bothers

the general student population (OR

1.23, 95% CI 0.393.88)

7/22/2019 RevMan Nov 30 2013

38/42

Interpret

Results:

Of the component sites, only the School of

Engineering and Architecture (SEA) population is notbothered (OR 0.12, 95% CI 0.050.25).

Because of this, removing this site from our analysis

changed our overall findings to increased bother (OR 2.29,95% CI 1.363.83) which became significant (p = 0.002).

7/22/2019 RevMan Nov 30 2013

39/42

Results:

Of the component sites, only the School of

Accountancy and Business Administration (SABM)had a neutral attitude to smoking (OR 0.92).

Interpret

7/22/2019 RevMan Nov 30 2013

40/42

Interpret

Results:

This response along with that of SEA differed

from the other schools.

Because of this, SABM and SEA are

considered outliers.

7/22/2019 RevMan Nov 30 2013

41/42

Results:

Removal of these two sites from our analysis

resulted in a highly significant (p < 0.0001) overalleffect that smoking bothers the student population

(2.82 95%CI 1.794.43)

Interpret

7/22/2019 RevMan Nov 30 2013

42/42

Results:We found that smoking bothers the general student population (OR 1.23, 95%

CI 0.393.88). Of the component sites, only the School of Engineering and Architecture

(SEA) population is not bothered (OR 0.12, 95% CI 0.050.25). Because of this, removingthis site from our analysis changed our overall findings to increased bother (OR 2.29, 95%

CI 1.363.83) which became significant (p = 0.002). Of the component sites, only the

School of Accountancy and Business Administration (SABM)had a neutral attitude tosmoking (OR 0.92). This response along with that of SEA differed from the other schools.

Because of this, SABM and SEA are considered outliers. Removal of these two sites from

our analysis resulted in a highly significant (p < 0.0001) overall effect that smoking bothers

the student population (2.82 95%CI 1.794.43).

Interpret