Cell phones and Nonsampling Error in the American Time Use Survey

Transcription

1 Cell phones and Nonsampling Error in the American Time Use Survey Brian Meekins Stephanie Denton AAPOR 2012

2 American Time Use Survey (ATUS) A Bureau of Labor Statistics survey, conducted by the U.S. Census Bureau Continuous survey about how, where, and with whom Americans use their time Nationally-representative survey of persons age 15 and over 20-minute computer-assisted interview conducted by telephone 2

3 ATUS Estimates Number and percent of individuals engaging in activities on an average day Average hours spent doing activities Time of day when individuals do the activities 3

4 ATUS Sampling Frame People are selected from households that recently completed the monthly labor force survey the Current Population Survey (CPS) CPS Survey 2 to 5 months after the end of the CPS survey, selected individuals are interviewed for the ATUS survey ATUS Sample ATUS Survey 4

5 ATUS Sample During the 8 th wave of the CPS, the respondent may provide a phone number for recontact If selected for ATUS and no phone number is on file, sampled persons are mailed information to call in and complete the survey Do not know if phone number given is cell phone or landline phone 5

6 Potential Problems with Cell Phone Numbers May result in significant nonresponse bias More difficult to complete Lower levels of cooperation (Link, Battaglia, Frankel, Osborn, Mokdad, 2007; Scott, 2006; Brick, Brick, Dipko, Presser, Tucker, Yuan, 2007) Cell phone households different from landline households Younger, less likely to have children, Hispanic, unmarried (Blumberg, Luke, 2010) 6

7 Potential Problems with Cell Phone Numbers Cell phone numbers typically linked to individuals versus households ~40% of ATUS sample members are not same reference person for CPS Increases amount of effort needed to interview sampled member Greater nonresponse 7

8 Potential Problems with Cell Phone Numbers Underrepresented groups in ATUS similar to those that rely primarily on cell phones ATUS has fewer completed interviews than the CPS with single, young renters (Meekins, Downey, Fricker, 2010) Housholds that do not provide number in CPS may be cell only households May contribute to nonresponse bias from lower response among no number households 8

9 Study Questions What is the impact of calling cell phone numbers on nonresponse? Do cell phone interviews differentially impact the measurement error associated with ATUS estimates? 9

10 Methods ATUS sample from October 2009 to October 2010 matched to existing telephone number database (Marketing Systems) to identify cell phone numbers Two versions of the Telcordia database Multiple versions of Neustar database 35,298 cases total 36% of these were identified as cell phones 10

11 Disposition of Cases CPS ref person Disposition Cell Landline Cell Landline Completion Overall completion rate is 78.5 for landline and 71.5 for cell phone Not CPS ref person Refusal Noncontact Not eligible Unknown eligibility

12 Completion Rate Little difference in rate of refusal Contact is more difficult with cell Cell phones only slightly more likely to complete interview during afternoon Telephone type Hard to Reach Reluctant Landline Cell

13 Results: Nonresponse Effort by telephone type and CPS reference person Telephone type (CPS ref person) Mean Attempts Mean NC Attempts Landline Cell Telephone type (Not CPS ref person) Mean Attempts Mean NC Attempts Landline Cell

14 Demographic Profile Demographic variables from CPS Variable Name Category Cell Landline Housing Tenure Owns Rents Marital Status Married Sep, Div, Wid Never Married HH income Lowest 25 th Middle 50 th Highest 25 th

15 Demographic Profile Variable Name Category Cell Landline Age Under to to to Race White Black/AA Other

16 Demographic Profile Demographic variables from CPS by telephone type and nonresponse Cell Landline Variable Category Response NR Response NR Housing Tenure Marital Status HH income Owns Married Lowest th Middle 50 th Highest th 16

17 Demographic Profile Cell Landline Variable Category Response NR Response NR Age Under to to to Race White Black/AA Other

18 Models: Number of Attempts Model with telephone type only Coefficient (cell=ref) Stat sig <.0001 Model with covariates Coefficient (cell=ref) Stat sig 2.04 <.0001 LS Means Cell Landline Sig interactions: cps ref person, length of int 18

19 Nonresponse Model Proportinoal hazard model Outcome survey completion Time attempts (up to 80) Examine the effect of cell phone after inclusion of demographics and process variables (with interactions) 19

20 NR Model Results Model with telephone type only Hazard ratio Stat sig <.0001 Model including other covariates Hazard ratio Stat sig <.0001

21 Results: Measurement Error Variety of Indicators: Not related with income missing on CPS Just as likely to have common activities Less likely to have earnings allocated Not more likely to have bad activities No more likely to have DK or refusal, in general 21

22 Measurement Error Category Cell Landline Interview time (min) Total number of activities Percent rounding earnings Slightly more likely to round earnings Number of activities is less Interview time only slightly less 22

23 Time Use Estimates (unweighted) Time Use Major Category Cell Landline Personal care* Household activities* Caring for other HH members Work* Education Consumer purchases* Household services Eating and drinking* Socializing* Sports and exercise Religious* Volunteer* Telephone calls Traveling * Statistically significant at

24 Time Use Estimates (weighted) Time Use Major Category Cell Landline Personal care Household activities* Caring for other HH members* Work* Education* Consumer purchases* Household services Eating and drinking Socializing* Sports and exercise Religious Volunteer* Telephone calls Traveling* * Statistically significant at

25 Models: HH Activities Model with telephone type only Coefficient (cell=ref) Stat sig <.0001 Model with covariates Coefficient (cell=ref) Stat sig LS Means Cell Landline Sig interactions: cps ref person, time of day, length of int 25

26 Models: Work Model with telephone type only Coefficient (cell=ref) Stat sig <.0001 Model with covariates Coefficient (cell=ref) Stat sig LS Means Cell Landline Sig interactions: cps ref person, length of int 26

27 Models: Education Model with telephone type only Coefficient (cell=ref) Stat sig 5.83 <.0001 Model with covariates Coefficient (cell=ref) Stat sig <.0001 LS Means Cell Landline Sig interactions: cps ref person, time of day 27

28 Summary Sample members that volunteered cell phone were: Somewhat more difficult to contact Spent slightly less time on phone and provided fewer activities Provided different time use estimates (weighting did not alter this) Nonresponse could not be fully explained by process variables 28

29 Summary Direct effects greatly diminished in models, but interactions with process variables still important resulting in significantly different estimates of time use. Interaction with length of interview always strong enough controls? Interactions with process variables of concern, but not surprising 29

30 Contact Information Brian Meekins