Research:Account creation UX/Round three

From Meta, a Wikimedia project coordination wiki

Definitions[edit]

  • Bucket: which version of the account creation page the user received
  • Assignments: bucket assignments
  • Impressions: all tracked page views
  • Impression error: pageview associated with an error
  • Submits: submission attempts on the form
  • Submit error: error generated by submitting the form
  • Creations: successful account creations
  • Conversion: account creations as a percent of dedup'd impressions
  • Success rate: account creations as a percent of dedup'd submits

Data[edit]

Deduplicated by unique token:

+-----------+------------+----------+
| bucket    | event      | count(*) |
+-----------+------------+----------+
| acux_3    | impression |    63764 |
| control_3 | impression |    63164 |
| acux_3    | impression_error |    10195 |
| control_3 | impression_error |    14180 |
| acux_3    | submit |    23784 |
| control_3 | submit |    23278 |
| acux_3    | submit_error |     7877 |
| control_3 | submit_error |    11018 |
| acux_3    | success |     20774 |
| control_3 | success |     18037 |
+-----------+--------------+----------+

Results[edit]

acux_3
impression error = 15.99%
submit = 37.30%
submit error = 33.12%
conversion = 32.56%
control
impression error = 22.45%
submit = 36.85%
submit error = 47.59
conversion = 28.56%