Editor engagement experiments/Bucketing

From Meta, a Wikimedia project coordination wiki
Jump to: navigation, search
Correct.svg <translate>

This page is currently a draft.</translate> <translate> More information pertaining to this may be available on the talk page.</translate>

Viable bucketing criteria [edit]

The following data points are cached and are therefore feasible for us to use as bucketing criteria for high-volume experiments. (Use of some of these data points may be restricted for extraneous reasons; their inclusion here reflects their viability from the perspective of engineering only.)

  1. user_id
  2. user_name
  3. user_password
  4. user_newpassword
  5. user_newpass_time
  6. user_email
  7. user_email_authenticated
  8. user_real_name
  9. user_token
  10. user_registration
  11. user_editcount
  12. user_touched

Items on the list correspond to columns on the MediaWiki user table.

Bucket Verification [edit]

We should utilize a non-bucketing debug mode accessible via URL parameters (e.g. debug=true&exp=XYZ&bucket=ABC) to visualize a specific design/condition. Relying upon page refresh and cookie removal until being assigned to the correct bucket is problematic.