Wikimedia Foundation metrics and activities meetings/Quarterly reviews/Discovery, October 2016

From Meta, a Wikimedia project coordination wiki
Jump to: navigation, search
Correct.svg This page is currently a draft. More information pertaining to this may be available on the talk page.

Translation admins: Normally, drafts should not be marked for translation.

Sadly the note taker for this review was unexpectedly not present, so the notes for this quarterly review are incomplete. If you have any questions about the slides, please contact Dan Garry and he will happily answer any questions.

Quarterly review slides

Notes from the Quarterly Review meeting with the Wikimedia Foundation's Discovery team, 26 October, 11:00–11:45 PDT.

Please keep in mind that these minutes are mostly a rough paraphrase of what was said at the meeting, rather than a source of authoritative information. Consider referring to the presentation slides, blog posts, press releases and other official material

Present: Deb Tankersley, Wes Moran, Maggie Dennis, Dan Garry, Katie Horn, Wes Moran, Yuri Astrakhan, Katherine Maher, Michelle Paulson, Zhou Zhou, Joady Lohr, Lisa Gruwell, Heather Walls, Gretchen Yen

Slide 1[edit]

Quarterly review slides

Dan: Generally, our KPIs (key performance indicators) are trending slowly upwards over time. For the first time we can compute year-on-year statistics. The large increase in satisfaction was due to a combination of an implementation change which artificially inflated the numbers, and gradual increases due to our changes; see slide 14 for more info. The decrease in zero results rate was due to the launch of the completion suggester, and gradual decreases due to our changes.

Slide 2[edit]

Quarterly review slides

Deb: Our first goal was to switch to BM25, which will fix a multitude of relevance issues and improve satisfaction with search results. The tests that were done in Q1 were promising, but not conclusive. This was not achieved in Q1 due to our uncertainty about the impact of the change and whether it would be positive. There was a slight decrease in user satisfaction and increase in zero results rate this quarter, likely due to the school holidays.

Slide 3[edit]

Quarterly review slides

An example of what we internally call TextCat; the language of the user's query is dynamically detected and the results are reordered to match. Refactoring of MediaWiki core was performed to make this possible.

Slide 4[edit]

Quarterly review slides

The Discernatron is a query result ranking tool which helps us discern whether the results that are being shown to users are relevant or not.