Kentucky Health Issues Poll,

20
Reflecting the Community: Demographic Variations in Landline and Cell-Only Households for a Statewide Telephone Survey Sarah Walsh, MPH, CHES, Foundation for a Healthy Kentucky Jennifer Chubinski, MS, The Health Foundation of Greater Cincinnati Michelle Vargas, Institute for Policy Research, University of Cincinnati Eric Rademacher, PhD, Institute for Policy Research, University of Cincinnati

description

This presentation reviews how the addition of surveys with the cell-only population can impact the results of traditional landline surveys, and considers the costs and benefits of adding this hard to reach, but growing, population of telephone users. The Kentucky Health Issues Poll (KHIP) is a random digit dialing telephone health opinion survey of more than 1500 adults that has been conducted annually since 2008. A sample of more than 200 cell-only households was included on the 2009 and 2010 KHIP. The demographic characteristics of landline-only samples have been deficient when compared to Census estimates for Kentucky in representation of both younger and non-white respondents. In both 2009 and 2010, as compared to the unweighted landline sample, the unweighted cell-only sample was significantly more likely to be non-white and to be less than 35 years of age. Combining landline-only and cell-only surveys resulted in improved sample coverage, but did this improved coverage impact results? For example, the cell sample permitted the inclusion of considerably more uninsured Kentuckians than would have otherwise been possible with a landline-only sample.

Transcript of Kentucky Health Issues Poll,

Page 1: Kentucky Health Issues Poll,

Reflecting the Community: Demographic Variations in Landline and Cell-Only

Households for a Statewide Telephone Survey

Sarah Walsh, MPH, CHES, Foundation for a Healthy KentuckyJennifer Chubinski, MS, The Health Foundation of Greater CincinnatiMichelle Vargas, Institute for Policy Research, University of Cincinnati

Eric Rademacher, PhD, Institute for Policy Research, University of Cincinnati

Page 2: Kentucky Health Issues Poll,

Presenter Disclosures

The following personal financial relationships with commercial interests relevant to this presentation existed during the past 12 months:

NO RELATIONSHIPS TO DISCLOSE.

Page 3: Kentucky Health Issues Poll,

Kentucky Health Issues Poll (KHIP)

• Questions vary by year, but include:– Health status– Socioeconomic variables– Public opinion on health related topics

• KHIP gives policymakers and advocates valuable data for keeping health on the public agenda.

Page 4: Kentucky Health Issues Poll,

KHIP

Page 5: Kentucky Health Issues Poll,

KHIP Methodology

• Conducted annually, since 2008• Random Digit Dial Telephone survey (RDD)– Cell phone sampling started 2009

• Data collection done by the Institute for Policy Research (IPR) at the University of Cincinnati

• Analysis done by Foundation staff

Page 6: Kentucky Health Issues Poll,

KHIP sample over time

2008 1,632 landline interviewsJanuary 16-February 11, 2008

2009 1,464 landline; 205 cell-only interviewsOctober 8-November 6, 2009

2010 1,469 landline; 208 cell-only interviewsDecember 3-22 and 27-28, 2010

2011 ≈ 1,200 landline; ≈ 300 cell any interviews

September 27-present

Page 7: Kentucky Health Issues Poll,

Cell-only Households, 2009-2010

Blumberg SJ, Luke JV, Ganesh N, et al. Wireless substitution: State-level estimates from the National Health Interview Survey, January 2007-June 2010. National health statistics reports; no 39. Hyattsville, MD: National Center for Health Statistics. 2011. Available at http://www.cdc.gov/nchs/nhis.html

Page 8: Kentucky Health Issues Poll,

Why Cell?

• KY high cell-only state• Vulnerable populations and more likely cell

phone-only users important to our mission– Low-income– Minority– Young adults

• More reliable sample of population

Page 9: Kentucky Health Issues Poll,

UNWEIGHTED Results

Page 10: Kentucky Health Issues Poll,

2009 Unweighted Results

percent Males 34.0% 48.8% 35.8% 48%

Landline Only Cell Only

Combined Sample

Weighted Target

percent Black 5.3% 8.9% 5.8% 7%

percent 18-45 26.5% 71.7% 32.1% 56%

Page 11: Kentucky Health Issues Poll,

2010 Unweighted Results

percent Males 35.0% 45.7% 36.3% 48%

Landline Only Cell Only

Combined Sample

Weighted Target

percent Black 5.6% 8.2% 5.9% 7%

percent 18-45 22.7% 61.5% 27.5% 56%

Page 12: Kentucky Health Issues Poll,

Results (unweighted)

• Cell phone sample increased size (as compared to a landline only sample) of:– Minority (races not white, and Hispanic) ≈ 1%– **Young adults ≈3-4%– Men ≈2%– Low-income adults (under 100 and 200% FPG) ≈1%– Uninsured ≈2%

** strongest effect

Page 13: Kentucky Health Issues Poll,

WEIGHTED Results

Page 14: Kentucky Health Issues Poll,

2009 Results

Currently Uninsured 28.0% 27.5%

Weighted Landline Only

Weighted Combined Sample

Uninsured in Past Year 31.5% 31.7%

Below 100% FPL 27.1% 26.4%

Below 200% FPL 47.4% 47.3%

Page 15: Kentucky Health Issues Poll,

2010 Results

Currently Uninsured 21.3% 22.5%

Weighted Landline Only

Weighted Combined Sample

Uninsured in Past Year 29.8% 31.6%

Below 100% FPL 23.6% 24.7%

Below 200% FPL 48.1% 49.1%

Page 16: Kentucky Health Issues Poll,

Results (weighted)

• Most differences lost in weighting procedure– Weights based on 2008 American Community

Survey (ACS)– Sample weighted on age, race, sex, education,

regional distribution, number of adults and phone lines in the household.

• HOWEVER, the cell phone sample reduced the magnitude of the weights

Page 17: Kentucky Health Issues Poll,

Lessons Learned- KHIP 2011

• Cell sampling changed from cell only to cell mostly

• Larger percentage of cell phones• Larger cost with cell sampling, but cost is

going down– Previously 5x a landline response– Currently 3x a landline response

Page 18: Kentucky Health Issues Poll,

Draw your own conclusions

• Raw data available in free statistical portal– Online Analysis and Statistical Information System

(OASIS) www.oasisdataarchive.org

Page 19: Kentucky Health Issues Poll,

Draw your own conclusions

• Data available for mapping in free mapping portal- HealthLandscape www.healthlandscape.org

Page 20: Kentucky Health Issues Poll,

Questions?

Sarah WalshSenior Program Officer, Local Data for Local Action Initiative

(502) [email protected]

Jennifer ChubinskiDirector of Community Research

(513) [email protected]