Flagged Revisions

From Meta, a Wikimedia project coordination wiki
(Redirected from FlaggedRevs)
Jump to: navigation, search

FlaggedRevs (Flagged Revisions) is an extension of MediaWiki that allows one to flag versions of articles and thus give additional information about quality. This comes with the possibility of changing what an unregistered user sees by default. The technical description can be found at mw:Extension:FlaggedRevs.

The actual usage and configuration of the extension varies a lot; usually, the feature enters into effect on a page only after it's "reviewed" (flagged) at least once, so it takes a committed community (in terms of active editors and guidelines) to actually enable it on a large wiki. For instance, the German Wikipedia uses the feature on 99.99 % articles considering it the default process; while the English Wikipedia uses it on less than 0.05 % articles with a non-standard configuration, for some special cases. More information on this spectrum follows.

Classic Flagged Revisions : German Wikipedia example[edit]

Here we will describe how the concept is used in the test on the German Wikipedia and what it is good for. First of all, there are two types of flags: Sighted and Quality. These come with two new user groups: An editor is able to flag versions as sighted, a reviewer is able to flag as quality.

Sighted means that an article has been looked at and does not contain vandalism. Quality means that a real content check has been done. Because the first check is not a big thing, any admin can give editor rights and there is an automatic process for giving this right. Currently, if you have edited for two months and did 200 edits in the main namespace, then you can get the editor right. The quality flag is much more restrictive and thus only bureaucrats can give this right.

What do flagged revisions accomplish?
  1. Flagged revisions give the reader an indication of the quality of the article.
  2. They assure a basic article quality (someone with basic trust has written this or checked it), if the last sighted version is shown to the reader.
  3. If only the last sighted revision is shown to the reader, they may make vandalism less attractive, although it is disputed whether vandalism decreased due to the adoption of flagged revisions.
  4. Generally, they provide a powerful tool for the control of new edits and patrolling the recent changes becomes more efficient:
    A new edit has to be checked for vandalism only once.
    Multiple edits in a row can be checked.
    If an article was vandalized and subsequently edited by a trusted user, vandalism was often hidden. This is no longer possible.
    No edit is forgotten.
    More people are able to find edits that were not sighted yet.
    Combined with categories, this becomes really powerful, since wikiprojects/portals have the possibility to oversee their whole area for new edits.
  5. They provide a useful system of revision labeling in general, sophisticating the information readers and contributors can derive from the history and about the article.

Edits can wait to be reviewed for a considerable amount of time, up to a month as of 18 June 2013, and 11 days on average (see de:Special:ValidationStatistics). Edits awaiting review can be seen at de:Special:OldReviewedPages.

Pending Changes : English Wikipedia example[edit]

Classic Flagged Revisions were perennially rejected on the English Wikipedia, in 2009-2010 this new proposal emerged as an acceptable compromise for trial, which ended up being adopted on a permanent basis. The principle of pending changes (initially denominated flagged protection) is to allow administrators to enable flagged revisions on selected pages, when they meet criteria specified by the protection policy, typically an excess of vandalism or other policy violating edits.

An important aspect of the feature is that edits by all autoconfirmed users (accounts older than four days and with at least ten edits), and not only reviewers, are automatically reviewed when the previous revision had already been accepted. Since edits by autoconfirmed users who are not reviewers to pages under pending changes with still unreviewed changes are rare, this means that almost always, autoconfirmed users can edit pages under pending changes without restriction. Thus, this is less restrictive than semi-protection. Additionally, there is an option to turn off this automatic reviewing of autoconfirmed non-reviewers, suggested for use on pages heavily targeted by sockpuppeters which on occasion require full protection, however the use of this option has not gained consensus.

As of November 13, 2014, 1,926 of the 4,738,627 articles are under pending changes protection (see en:Special:ValidationStatistics). Edits awaiting review are located at en:Special:PendingChanges, which has most of the time about half a dozen edits, none older than a few hours.

Other forms of Flagged Revisions[edit]

Other wikis may choose to adopt a position intermediary between the German Wikipedia and the English Wikipedia: applying pending changes not by default on all articles, and not only on demonstrably problematic articles, but on a large subset of articles, deemed particularly sensitive.

Flagged Revisions has also been suggested as a way to defer for review edits flagged as suspect by the Abuse Filter, see w:Wikipedia:Deferred revisions.

Passive Flagged Revisions, working on the same principle but without affecting the version viewed by readers, has been suggested to improve patrolled edits, see w:Wikipedia:Patrolled revisions.

Flagged Revisions on Wikimedia projects[edit]

Flagged Revisions has been implemented on several wikis.

Undergoing trials[edit]


None currently

But proposed for no.wikipedia.

Rejected[edit]

Wikis that want to request custom implementation of the feature can use these Bugzilla requests as models for their own requests.

Enabling[edit]

Flagged Revisions is extremely flexible and powerful; as such, it's very hard to configure. As shown above, few to no wikis are adopting it in the last years.

In the past, enabling the extension on a wiki has always proved to be an expensive process, see also below. The German Wikipedia pioneering was supported by Wikimedia Deutschland. The English Wikipedia trial of a light weight form of flagged revisions known as pending changes, which eventually resulted in its permanent implementation, required at least one contractor hired on purpose to tweak and test the configuration, as well as development work involving no less than 8 Wikimedia Foundation persons in a period of 7 months from September 2010 to March 2011, according to reports.

A wiki willing to enable the extension needs to be aware that a similar amount of work (several person-months of full time work) will be needed, and requires a certain amount of committed volunteers to get done. The general process is the usual one for requesting wiki configuration changes, but proposers should also:

  • fully translate the extension and the help page, get all translations reviewed at least once;
  • send a patch for the shell request proposed configuration;
  • get a test wiki for the language created on the beta cluster, test the translation and configuration there to ensure it's as intended;
  • have someone monitor the effects and community response to the wider testing on the actual wiki after the enabling, and report it on bugzilla.

(This is the process followed by a recent adopter like the Finnish Wikipedia.)

Results[edit]

Local[edit]

There is no policy yet for disabling or denying the extension, but it's highly advisable that any wiki adopting it monitors results closely (at least on Wikistats and Special:ValidationStatistics), to ensure the feature is actually helping to reach the intended goals. As an example, a wiki could establish, as local community guideline/goal, documented in the local project page on the feature/process, a minimum "level of service" or "key performance indicators", like

  • no more than X % total articles should be stale,
  • (if applied to a subset of articles, e.g. previously protected) total edits and active editors on flagged articles should increase by Y %,
  • average staleness of unreviewed edits shouldn't be above Z days and median time for review shouldn't be above W days.

Having such a shared understanding of the intended results will help a wiki reach a consensus on the opportunity to have/keep the feature enabled.

General[edit]

General results of Flagged Revisions on various projects are not known: there are few studies.

However, on several wikis, Special:ValidationStatistics shows a clear failure, in that there are peaks where

  • the quota of total articles which have unreviewed edits is over 10 %, or sometimes even a majority of total articles,
  • unreviewed changes are as old as 1000 days or more on average (this metric disregards how fast reviewed changes were reviewed),
  • the time needed for unregistered users to have their edits approved is several days.

The more articles are using Flagged Revisions, the more severe the last two problems are; if only a handful pages are reviewed in the first place, average delays on those few pages are less significant for the wiki as a whole.

Where it's not actively used, the extension should probably be disabled. Regular cross-wiki reports on flagged revisions status have been proposed but not implemented yet. If you are or want to be a tool developer, this would be a nice thing to build and run on Tool Labs.

Reputability achievements[edit]

After enabling FlaggedRevs, the English Wikinews became reliable enough for Google to include Wikinews contents in Google News for example. [citation needed]

Interim reports[edit]

See also[edit]