Learning and Evaluation/Archive/Learning modules/3Content Validity

From Meta, a Wikimedia project coordination wiki
Jump to navigation Jump to search

  Wikimedia Training Designing Effective Questions Menu

Content Validity

Do your questions cover the full range of the quality or value that you are trying to measure ?

Is the choice of questions and number of questions appropriate for each of the phenomenon being measured ?

Objective: A program leader wants to measure their participants' ability to edit Wikipedia in the future.

1. Very poor content validity: You ask only questions about a participant's free time.

2. Poor content validity: You ask questions about a participant's free time, academic resources, and wiki mark up skills to edit Wikipedia.

3. Better content validity: In addition to the above, you include questions about their ability to access the internet and a computer regularly.

Content validity is about making sure that you are asking enough questions, or the right questions, to capture the entirety of the measure you want. Sometimes, you can ask too many questions around a certain topic, which the third example above shows.