Research:New page reviewer impact analysis

From Meta, a Wikimedia project coordination wiki
Jump to: navigation, search
14:18, 23 May 2017 (UTC)
Duration:  2017-05 — ??

This page is an incomplete draft of a research project.
Information is incomplete and is likely to change substantially before the project starts.

In November 2016 new page patrolling was restricted to editors with a newly created user right called New Page Reviewer. The reason given for this change was that inexperienced patrollers were making incorrect judgements: many new articles that should have been marked for deletion were not being marked; others that needed more scrutiny were being marked as reviewed, and in some cases patrollers were behaving in a hostile manner towards good-faith new article creators.

The volume of incorrect review decisions required other new page patrollers to spend excessive amounts of time re-reviewing previously reviewed articles, rather than assessing the stream of new unreviewed articles, which contributed to a large backlog.


In this study, we will assess the impact of this restriction on who is able to review new articles.

We want to know how this new restriction has affected:

  1. the proportion of 'incorrect' review decisions by new page patrollers?
  2. the number of re-reviews that patrollers perform?
  3. the number of people who perform new page patrol?
  4. the number of people eligible to perform new page patrol?
  5. the rate at which new page patrollers can expect to eliminate the current backlog of unreviewed new articles?


According to the New Page Patrol project page, "New Page Review is essentially the first (and only) firewall against totally unwanted content and the place to broadly accept articles that may not be perfect but do not need to be deleted."