Research talk:Anonymous editor acquisition/Signup CTA experiment/Work log/2014-04-07
Monday, April 7th[edit]
Wrist is much better today. :) I plan to be more verbose.
So, I'm working on the instrumentation (recording user events) that will be active during the experiment. After looking at this for a bit, I think it will be best if I map out the whole flow of events and then flag the ones that we want to instrument & store. #Event flow depicts the flow I came up with. --Halfak (WMF) (talk) 16:59, 7 April 2014 (UTC)
Events[edit]
- Schema:SignupExpPageLinkClick
- Represents activation of edit links (tab or section). Always the first event in a "flow". Helps us understand how the UI is being used.
- token : string
- bucket : enum("pre-edit", "post-edit", "control")
- link : enum("edit page", "edit section", "create account")
- namespace : int
- Schema:SignupExpCTAImpression
- Represents a view of a CTA -- both pre- or post- included.
- token : string
- cta : enum("pre-edit", "post-edit")
- namespace : int
- Schema:SignupExpCTAButtonClick
- Represents activation of buttons in the CTA.
- token : string
- cta : enum("pre-edit", "post-edit")
- button : enum("signup", "edit", "dismiss")
- namespace : int
- Schema:SignupExpAccountCreationComplete
- Represents a successful account creation. This will allow us to associate account creations with experimental buckets
- token : string
- userId : int
- Schema:SignupExpAccountCreationImpression
- Represents a successful account creation. This will allow us to associate account attempts with experimental buckets
- token : string
- Schema:TrackedPageContentSaveComplete
- Represents a successful change to a page. This will allow us to associate edits with our experimental buckets.
- token : string
- revId : int
Now to edit the flow diagram to highlight the events that will be tracked. --Halfak (WMF) (talk) 22:37, 7 April 2014 (UTC)
Note: Potential for issues with assuming bucket based on token. Store bucket too and bucket = enum("pre-edit", "post-edit", "control"). --Halfak (WMF) (talk) 23:13, 7 April 2014 (UTC)
Note: Stop recording create account click -- instead record create account impression. --Halfak (WMF) (talk) 23:16, 7 April 2014 (UTC)
Note: Made some updates to the schemas above after talking to the team. --Halfak (WMF) (talk) 17:18, 8 April 2014 (UTC)