Difficult to write unambiguous items potential. Scale ... Top 10 Question Writing p.
Q g. Guidelines ... design method (2nd ed.). New York: John Wiley & Sons, Inc.
Survey y Question Q Types Question Type
Description
Strengths
Weaknesses
Yes/No
Questions with two possible answers
Wide variety of data analyses
Provide limited information
Multiple Choice
Stem followed by set of answers, pick the option that best describes opinion
Easy to answer, collect factual information
Possibility of not including key response options
Likert Rating Scale
Determine where an answer fits on a scale of carefully ordered categories
Efficient means to information, comparisons among answers
Difficult to write unambiguous items potential items, for biased results
Open-Ended
No formatted response options, compose own answer to a stem
Informative – learn about unanticipated topics or issues
Require more work/effort, time-consuming analysis
Prepared by: Lisa O’Leary Shuler
Associate Director for Assessment and Evaluation
Office of Institutional Research,
[email protected] September 09
15
Designing g g Survey y Questions Does the question require an answer? To what extent do respondents have a
ready-made ready made answer?
Can respondents accurately recall and report
past behaviors?
Are respondents willing to reveal the
information that you’re you re asking for?
Will respondents feel motivated to answer?
Prepared by: Lisa O’Leary Shuler
Associate Director for Assessment and Evaluation
Office of Institutional Research,
[email protected] September 09 16
Top p 10 Q Question Writing g Guidelines 10 Use simple as opposed to specialized terms 10. Exhausted Candid Top priority Leisure Employment Courageous Rectify
Tired Honest Most important Free time Work Brave Correct
Dillman, D.A. (2000). Mail and internet surveys: The tailored design method (2nd ed.). New York: John Wiley & Sons, Inc. Prepared by: Lisa O’Leary Shuler
Associate Director for Assessment and Evaluation
Office of Institutional Research,
[email protected] September 09 17
Top p 10 Q Question Writing g Guidelines 9 Choose as few words as possible to pose the 9.
question
Adapted from: Dillman, D.A. (2000). Mail and internet surveys: The tailored design method (2nd ed.). New York: John Wiley & Sons, Inc.
Prepared by: Lisa O’Leary Shuler
Associate Director for Assessment and Evaluation
Office of Institutional Research,
[email protected] September 09 18
Top p 10 Q Question Writing g Guidelines 8 Avoid vague quantifiers when more precise 8.
estimates can be obtained
Adapted from: Dillman, D.A. (2000). Mail and internet surveys: The tailored design method (2nd ed.). New York: John Wiley & Sons, Inc.
Prepared by: Lisa O’Leary Shuler
Associate Director for Assessment and Evaluation
Office of Institutional Research,
[email protected] September 09 19
Top p 10 Q Question Writing g Guidelines 7 Soften the impact of potentially 7.
objectionable questions
Adapted from: Dillman, D.A. (2000). Mail and internet surveys: The tailored design method (2nd ed.). New York: John Wiley & Sons, Inc.
Prepared by: Lisa O’Leary Shuler
Associate Director for Assessment and Evaluation
Office of Institutional Research,
[email protected] September 09 20
Top p 10 Q Question Writing g Guidelines 6 Avoid asking respondents to say yes in 6.
order to mean no
Adapted from: Dillman, D.A. (2000). Mail and internet surveys: The tailored design method (2nd ed.). New York: John Wiley & Sons, Inc.
Prepared by: Lisa O’Leary Shuler
Associate Director for Assessment and Evaluation
Office of Institutional Research,
[email protected] September 09 21
Top p 10 Q Question Writing g Guidelines 5 Develop response categories that are 5.
mutually exclusive
Adapted from: Dillman, D.A. (2000). Mail and internet surveys: The tailored design method (2nd ed.). New York: John Wiley & Sons, Inc.
Prepared by: Lisa O’Leary Shuler
Associate Director for Assessment and Evaluation
Office of Institutional Research,
[email protected] September 09 22
Top p 10 Q Question Writing g Guidelines 4 Eliminate check-all-that-apply question 4.
formats to reduce primacy effects
Adapted from: Dillman, D.A. (2000). Mail and internet surveys: The tailored design method (2nd ed.). New York: John Wiley & Sons, Inc.
Prepared by: Lisa O’Leary Shuler
Associate Director for Assessment and Evaluation
Office of Institutional Research,
[email protected] September 09 23
Top p 10 Q Question Writing g Guidelines 3 Provide appropriate time references 3.
Adapted from: Dillman, D.A. (2000). Mail and internet surveys: The tailored design method (2nd ed.). New York: John Wiley & Sons, Inc.
Prepared by: Lisa O’Leary Shuler
Associate Director for Assessment and Evaluation
Office of Institutional Research,
[email protected] September 09 24
Top p 10 Q Question Writing g Guidelines 2 Use equal numbers of positive and negative 2.
categories for scaled questions
Adapted from: Dillman, D.A. (2000). Mail and internet surveys: The tailored design method (2nd ed.). New York: John Wiley & Sons, Inc.
Prepared by: Lisa O’Leary Shuler
Associate Director for Assessment and Evaluation
Office of Institutional Research,
[email protected] September 09 25
Top p 10 Q Question Writing g Guidelines 1 Avoid double-barreled questions 1.
Adapted from: Dillman, D.A. (2000). Mail and internet surveys: The tailored design method (2nd ed.). New York: John Wiley & Sons, Inc.
Prepared by: Lisa O’Leary Shuler
Associate Director for Assessment and Evaluation
Office of Institutional Research,
[email protected] September 09 26
