File:Goodfaith miscalibration pred newcomers and anons.png

From Meta, a Wikimedia project coordination wiki

Original file(1,142 × 703 pixels, file size: 49 KB, MIME type: image/png)

This is a file from the Wikimedia Commons. The description on its description page there is copied below.

Summary

Description
English: ORES is a machine learning system for classifying edits to Wikipedia according to whether they are damaging or goodfaith. This plot shows, for the 25 Wikis on which ORES goodfaith models are deployed, and when the prediction threshold is chosen to maximize overall accuracy, that the model tends to underestimate the incidence of goodfaith edits. We see evidence of systemic bias against such editors in the sense that the models tend to underestimate the probability that their edits are made in good-faith even more than other editors.
Date
Source Own work
Author Groceryheist

Licensing

I, the copyright holder of this work, hereby publish it under the following license:
w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.

Captions

This plot shows the difference between the average prediction by the model and the average true label for the ORES goodfaith models.

Items portrayed in this file

depicts

23 April 2019

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current16:48, 2 May 2019Thumbnail for version as of 16:48, 2 May 20191,142 × 703 (49 KB)GroceryheistImprove title and axes labels.
22:19, 25 April 2019Thumbnail for version as of 22:19, 25 April 20191,142 × 679 (42 KB)GroceryheistChange axis label.
18:51, 24 April 2019Thumbnail for version as of 18:51, 24 April 20191,142 × 679 (43 KB)Groceryheistshow confidence intervals around points.
05:55, 24 April 2019Thumbnail for version as of 05:55, 24 April 20191,142 × 679 (29 KB)GroceryheistUser created page with UploadWizard

Metadata