Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

43
Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Transcript of Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Page 1: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell

Page 2: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

2

What is RRFSS

Rapid Risk Factor SurveillanceSystem

Page 3: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Key Public Health Issues Able to Monitor

Family History

Obesity

Hypertension

Diabetes

Smoking

Page 4: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

to New Public Health Issues Adaptable

Page 5: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

5

Local

Page 6: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Timely

Page 7: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

7

How Can We Use RRFSS?

• To support program planning and evaluation

• To advocate for public policy development

• To improve community awareness of risks for CDs, IDs and injuries

Page 8: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Who Can Join RRFSS?

Any Public Health Unit in Ontario

… but thereis a cost.

Page 9: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

9

When is the Survey Conducted?

• There are three 4-month data cyclesper year.

Page 10: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

10

How is Data Collected

• Institute for Social Research (ISR) at York University

Page 11: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

11

How Long is the Survey?

Page 12: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

12

How is the Questionnaire Organized?

Page 13: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

13

• Decided annually by all participating HUs

• Asked for at least one year

• May rotate alternating years

• Mandatory – CANNOT opt out of these

AGE SEX BMI TOBACCOUSE INCOME

Page 14: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

• Selected by each HU individually

• Can add or delete each cycle

Page 15: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

What are some of the Topics/Modules?

See QMap

Your Turn!Are there any topics you would be interested in? Please circle the topic.

Page 16: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

16

Must We Use the Entire Module?

But …• Must start at the beginning

of a module

• Cannot jump back in once stopped

No

Page 17: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Can We Develop Modules?

Yesbut you must followa process:• Complete Module Submission

Request Form

• Should be applicable to multiple PHUs

• Can work with your own if no other PHU interested

Page 18: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

How to Choose Optional

• Align with health unit’s data needs

• Measure the variable over time(decrease in chronic disease prevalence?)

• Data is not available from other data sources(use and awareness of parenting programs)

Page 19: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

What is the Sample Size?

400 3 1,200interviews/HU cycles/year interviews/year

RRFSS has a larger sample size than the CCHS in some PHUs.

Page 20: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Who is Included in the Sample?

• 18 years of age and older

• English or French speaking

• Reside in private homes

• With landline

* some cell phone numbers were included

Page 21: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

21

Is the Sample Size Big Enough?

Page 22: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

22

Sampling Procedures

• Random selection of households – using random digit dialing

• Random selection of respondent – household member with next birthday

Page 23: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

23

Household Weights

• Maximize ability to generalize the survey results (the sample) to the population

• Probability of selection depends on size of household

Page 24: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Household Weights

Size ofHousehold

ChanceSelected

Weight

1adult

2adults

3adults

100% Given weight of 1

50% Given weight of 2

33.3% Given weight of 3

This helps to prevent under-representation in larger households and over-representation in small households.

Page 25: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Calculations were used to determine sample size for results to be generalizable

So, is it Still Representative?

Page 26: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Is the Survey Valid & Reliable?

• Modeled on the Behavioural Risk Factor Surveillance System (BRFSS) conducted by the Centres for Disease Control and Prevention (CDC) in Atlanta

• Many questions also taken from the CCHS and the National Population Health Survey (NPHS)

• The original design was tested for reliability and validity

Yes!

Page 27: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

How Do We Ensure Accurate Results?

• Confidence intervals & coefficient of variation

Page 28: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

The Confidence Interval (CI)

• How confident are we in the point estimate (i.e., value)?

• E.g., 6% … (85% CI: 3% - 9%). What does 95% mean?

• … based on probability.

Page 29: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

29

Probability

Page 30: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Probability

Page 31: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

31

Probability

Page 32: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

32

Significance Testing

Statistically Significant

NOT Statistically Significant

What does this have to do with the CI?

• Likely happened• The results are probable

• It could have happened by chance alone

Page 33: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Significance Testing

Your Turn!Please complete section one. Circle statistically significant statements.

• We use the CI to determine whether something is statistically significant.

• If the CIs do not overlap than they are SS

• Example: Percentage of females vs males who smoke:Females: 70% (60%-80%)Males: 30% (20%-40%)

Page 34: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

34

Page 35: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Coefficient of Variation

Your Turn!Please circle the asterisk

in the table.

• Refers to the precision of the estimate

• Usually a result of small numbers (i.e., 2/800)

• Interpret with caution presented with an *asterisk

• An empty cell means the value is not precise(in fact, incorrect), so we cannotreport this number

Page 36: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

36

RRFSS is Self-Reported? Are there limitations to this?

Page 37: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

37

Distorted Perceptions

Page 38: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Distorted Perceptions

Page 39: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Hawthorne Effect

In groups of two, please answer the following …

How many times per day, week or month do you drink 100% fruit juices such as orange, grapefruit, or tomato juice?

How often do YOU wear a seatbelt when YOU DRIVE a car, van or truck: Would you say, all of the time, most of the time, about 1/2 the time, less than 1/2 the time, or never or almost never?

Page 40: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Memory Recall

What is the total amount of time you spent sitting, last Wednesday? (hours & minutes)

Page 41: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Sensitivity

In groups of two, please answer the following …

What is your age?

How much do you weigh?

In your lifetime, have youEver had suicidal thoughts?

What is your yearly totalIncome (before taxes)?

Page 42: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

Self-Reported Measures

Page 43: Deanna E. White, Adam Stevens, John Barbaro, Kristy McGill and Lynne Russell.

43

What RRFSS Recall