Jump to content

Research talk:Anonymous editor acquisition/Signup CTA experiment/Work log/2014-04-07

Add topic
From Meta, a Wikimedia project coordination wiki

Monday, April 7th

[edit]
The event flow for the two experimental conditions and the control is presented.
Event flow. The event flow for the two experimental conditions and the control is presented.

Wrist is much better today. :) I plan to be more verbose.

So, I'm working on the instrumentation (recording user events) that will be active during the experiment. After looking at this for a bit, I think it will be best if I map out the whole flow of events and then flag the ones that we want to instrument & store. #Event flow depicts the flow I came up with. --Halfak (WMF) (talk) 16:59, 7 April 2014 (UTC)Reply


Events

[edit]
Schema:SignupExpPageLinkClick
Represents activation of edit links (tab or section). Always the first event in a "flow". Helps us understand how the UI is being used.
  • token : string
  • bucket : enum("pre-edit", "post-edit", "control")
  • link : enum("edit page", "edit section", "create account")
  • namespace : int
Schema:SignupExpCTAImpression
Represents a view of a CTA -- both pre- or post- included.
  • token : string
  • cta : enum("pre-edit", "post-edit")
  • namespace : int
Schema:SignupExpCTAButtonClick
Represents activation of buttons in the CTA.
  • token : string
  • cta : enum("pre-edit", "post-edit")
  • button : enum("signup", "edit", "dismiss")
  • namespace : int
Schema:SignupExpAccountCreationComplete
Represents a successful account creation. This will allow us to associate account creations with experimental buckets
  • token : string
  • userId : int
Schema:SignupExpAccountCreationImpression
Represents a successful account creation. This will allow us to associate account attempts with experimental buckets
  • token : string
Schema:TrackedPageContentSaveComplete
Represents a successful change to a page. This will allow us to associate edits with our experimental buckets.
  • token : string
  • revId : int

Now to edit the flow diagram to highlight the events that will be tracked. --Halfak (WMF) (talk) 22:37, 7 April 2014 (UTC)Reply

Note: Potential for issues with assuming bucket based on token. Store bucket too and bucket = enum("pre-edit", "post-edit", "control"). --Halfak (WMF) (talk) 23:13, 7 April 2014 (UTC)Reply

Note: Stop recording create account click -- instead record create account impression. --Halfak (WMF) (talk) 23:16, 7 April 2014 (UTC)Reply


Note: Made some updates to the schemas above after talking to the team. --Halfak (WMF) (talk) 17:18, 8 April 2014 (UTC)Reply