Web Surveys. Megan Daley Enrollment Research and Planning Suffolk University. Nancy Ludwig Institutional Research Northeastern University

Transcription

1 Web Surveys Megan Daley Enrollment Research and Planning Suffolk University Nancy Ludwig Institutional Research Northeastern University

2 Finding the right software What is your price range? How many responses do hope to get? How are you telling people to take your survey? What types of questions does your survey have? How are you analyzing your results? What is your level of expertise? What else should be considered in web surveying?

3 Finding the right software What is your price range? Most survey vendors have a basic (free) program. There are limits Number of responses Number of questions Time data is available

4 Comparison of Basic (Free) Packages Question Options # of Responses # of Surveys Limits Zoomerang 30/Survey 100/Survey Unlimited Responses saved for 10 days only Formsite 50/Survey 50/Month 5 SurveyMonkey 10/Survey 100/Survey Unlimited Basic Survey Options

5 Comparison of Professional Packages Price # of Responses # of Surveys Mass ? Zoomerang $350/yr $99/3 months Unlimited Unlimited Yes Formsite $999.95/yr 99.95/month 5,000 per Survey 50 5,000 per Month SurveyMonkey $200/yr $19.95/month 1,000 per Month Unlimited Yes Vovici EFM $2,195/yr Unlimited Unlimited Yes

6 Finding the right software How are you telling people to take your survey? Mass s Link on webpage (e.g., student portals) Pop-up on webpage Paper mailing with link

7 Finding the right software What types of questions does your survey have? Select one/select Many Matrix Open-Ended Text (Limited or Unlimited) Ranking Data Block Numeric Field Page Break/Branch Questions

8 Types of Questions -Select only one- Can be displayed in three ways Pull-down menu Horizontally Vertically Used when there are a limited number of responses Yes, No, Maybe Gender

9

10 Vertical Horizontal Pull-Down

11 Types of Questions -Select More than One- Usually displayed vertically Used when there is more than one response possible Which characteristics describes Who did you talk to Square Buttons instead of the Radio or Round buttons used for Select only one questions

12

13 Types of Questions -Matrix Displayed as a chart-like box Used when a series of questions share the same answer choices How satisfied are you with How important is Three types One answer per row (radio button) Multiple answers per row (square box) Side-by-Side (combination)

14

15

16

17 Side-By-Side Matrix

18 Types of Questions - Open-Ended Text Used primarily when asking student s opinion. Can have unlimited text i.e. What are the reasons you aren t attending this university? Can have limited text Usually characters Used when a short answer is required and preferred i.e. What was your major?

19 Types of Questions - Rank Order Ranking of a selected list. i.e. preference of study places Can be displayed a couple of ways Pull-down Menu Matrix (radio buttons) Limited text data block

20

21 Pull- Down Data-Block Matrix

22 Types of Questions - Data Block Prompted Information Fill in name, , etc Fill in the blank of a sentence Can be text, numeric or date form

23

24

25 Types of Questions - Numeric Field When looking for a specific numerical unit Hours worked Credits taken Can also be date form

26

27

28 Finding the right software How are you analyzing your results? Report Download from software Charts Cross-tabs Download Data and analyzing on own Excel SPPS

29 Analyzing the Results Pre-Generated Reports Pick and choose which questions you want Usually in chart form Cross-tab various questions Some software will do the data report

30

31

32 Analyzing the Results Download the data Pick and choose which questions you want Download to Excel.XLS form.csv form Download to SPSS.SAV data file Use the Software s Report Option Download to Word or Adobe

33

34

35

36 What else should be considered in web surveying? When selecting a product, consider: Control over: Design Appearance Coding of data Help screens Progress bars Browser compatibility Appropriate for MACs and PCs Control over managing surveys

37 What else should be considered in web surveying? When selecting a product, consider: Ability to print a blank survey utility Authentication Location of survey and data Tech support Using the data

38 What else should be considered in web surveying? Impact of Web-based Surveys on your Office: Staff Training Open to change Shift in work Workload Increased demand Increased pressure to turn-around results More tech issues Data cleanup

39 What else should be considered in web surveying? Survey Burnout Audience Receptivity Response Rates Response Bias Mixed-mode surveys IRB issues

40 References/Resources Best, S. J., & Krueger, B. S. (2004). Internet Data Collection. Thousand Oaks, CA: Sage Publications, Inc. Carini, R. M., Hayek, J. C., Kuh, G. D., Kennedy, J. M., & Quimet, J. A. (2003). College student responses to web and paper surveys: Does mode matter?, Research in Higher Education, 44(1), Couper, M. P., Traugott, M. W., & Lamais, M. J. (2001). Web survey design and administration. Public Opinion Quarterly, 65, Dillman, D. A.. (2002). Mail and Internet Surveys: The Tailored Design Method. New York: John Wiley & Sons. Cheskis-Gold, R., Shepard-Rabadam, E., Loescher, R., & Carroll, B. (2006). Essential steps for web surveys: A guide to designing, administering and utilizing web surveys for university decision-making. AIR Professional File, 102, Hewson, C., Yule, P., Laurent, D., & Vogel, C. (2003). Internet Research Methods. Thousand Oaks, CA: Sage Publications, Inc. Porter, S. R., & Whitcomb, M. E. (2005). subject lines and their effect on web survey viewing and response. Paper presented at the Association for Institutional Research, San Diego, CA. Schonlau, M., Fricker, Jr., R. D., & Elliot, M. N. (2002). Conducting Research Surveys via and the Web. Santa Monica, CA: Rand.

41 Survey Software Home-Pages

42 Questions?