Learning and Evaluation/Archive/Learning modules/3Ranking

From Meta, a Wikimedia project coordination wiki
Jump to page

Part 1: Introduction

Welcome!
Why Survey?
Why Surveys Are Useful
Constructs
Operationalize
Survey instruments
Types of information
Attributes - a special case
Survey Objective and Planning

Part 2: Reliability & Validity

Reliability & Validity
Reliability
Validity
Face Validity
Content Validity
Criterion Validity
Construct Validity

Part 3: Question Construction

Writing Good Questions
Questions from Existing Surveys
Constructing your own Questions
Be Specific
Be Concise
Avoid Double Negatives
Minimize Social Desirability Bias
Avoid Double-barreled questions
Avoid abbreviations, jargon, technical terms, or slang
Avoid leading questions
Avoid loaded questions
Use appropriate wording
Ask useful questions
Rely on second-hand data sparsely
Use caution when asking personal questions

Part 4: Response Options

Question types
Fill-in-the-blank
Dichotomous pairs
Multiple choice
Check all that apply
Ranking
Scales
Choosing response options

Part 5: Questionnaire structure

Important considerations
Questions order
Additional Resources
Feedback

  Wikimedia Training Designing Effective Questions Menu

Ranking

  • Ranking requires clear directions that are kept simple.
  • Ranking allows for assessment of relative importance.
  • Respondents generally do well with identifying the middle and the extremes, but not as well as the items from highest to middle and middle to lowest. For this reason, it is easiest to use ranking on three points; anything beyond five points, in which the 2nd and 4th place may be an obvious result after one identifies the middle and extremes, requires a much higher cognitive demand. In general, ranking is not recommended when there are more than 7 items for comparison.
For example:
How interested are you in the following topics? Put a “1” next to the one that you’d like to see discussed at a future staff meeting, a “2” next to the one you next prefer, and so on. Please, no two numbers should be the same.
__ Wikipedia article format
__ Using templates
__ Working with photos, etc.
__ WP Manual of Style
__ Collaborating constructively with other editors