Machine learning models

From Meta, a Wikimedia project coordination wiki

As part of ongoing work to make open source, transparent, human-centered machine learning, the Wikimedia Foundation is seeking to create on-wiki model cards for every model hosted on WMF servers.

Model cards were originally proposed in Mitchell et. al 2018 to be the primary documentation about a model. They report on the reasons why a model was made, proper and improper use cases, and model evaluation scores, especially for marginalized groups.

Model cards are also the main point of community governance for WMF-hosted machine learning models. The goal is to create an on-wiki space (on the talk page of each model card) where the individuals can discuss and make decisions about the machine learning models that help govern their communities.

ORES data, models, and model training performances are available in the ores-data repository on Gitlab.

What is this page?[edit]

This is a homepage that lists all proposed, production, and deprecated (no longer used) machine learning model cards for models that are hosted by the Wikimedia Foundation.

Articles that are sub-pages of this page serve as centralized, comprehensive, high-level summaries of models. Their talk pages are hubs for conversation about models.

Production models[edit]

These models are currently in production and serving predictions to various services across WMF.

ORES models[edit]

ORES model cards
Project Article quality Draft quality Damaging edit Goodfaith edit Revert risk Article topic Draft topic
arwiki no model no model model card model card no model model card no model
bnwiki no model no model no model no model model card no model no model
bswiki no model no model model card model card no model no model no model
cawiki no model no model model card model card no model no model no model
cswiki no model no model model card model card no model model card no model
dewiki no model no model model card model card no model no model no model
elwiki no model no model no model no model model card no model no model
enwiki model card model card model card model card no model model card model card
enwiktionary no model no model no model no model model card no model no model
eswiki no model no model model card model card no model no model no model
eswikibooks no model no model model card model card no model no model no model
eswikiquote no model no model model card model card no model no model no model
etwiki no model no model model card model card no model no model no model
euwiki model card no model no model no model no model model card no model
fawiki model card no model model card model card no model no model no model
fiwiki no model no model model card model card no model no model no model
frwiki model card no model model card model card no model no model no model
glwiki model card no model no model no model model card no model no model
hewiki no model no model model card model card no model no model no model
hiwiki no model no model model card model card no model no model no model
hrwiki no model no model no model no model model card no model no model
huwiki no model no model model card model card no model model card no model
hywiki no model no model no model no model no model model card no model
idwiki no model no model no model no model model card no model no model
iswiki no model no model no model no model model card no model no model
itwiki no model no model model card model card no model no model no model
jawiki no model no model model card model card no model no model no model
kowiki no model no model model card model card no model model card no model
lvwiki no model no model model card model card no model no model no model
nlwiki model card no model model card model card no model no model no model
nowiki no model no model model card model card no model no model no model
plwiki no model no model model card model card no model no model no model
ptwiki model card model card model card model card no model no model no model
rowiki no model no model model card model card no model no model no model
ruwiki model card no model model card model card no model no model no model
sqwiki no model no model model card model card no model no model no model
srwiki no model no model model card model card no model model card no model
svwiki model card no model model card model card no model no model no model
tawiki no model no model no model no model model card no model no model
trwiki model card no model model card model card no model no model no model
ukwiki model card no model model card model card no model model card no model
viwiki no model no model no model no model model card model card no model
wikidata model card no model model card model card no model model card no model
zhwiki no model no model model card model card no model no model no model

All model cards[edit]

Proposed models[edit]

These models have not yet been put into production but have been proposed by ML contributors.

Deprecated models[edit]

These models were previously in production, but have since been deprecated.


Planned model cards[edit]

Revscoring models (migrated from ORES)[edit]

Model Type Model Name
draftquality enwiki-draftquality, ptwiki-draftquality
reverted bnwiki-reverted, elwiki-reverted, enwiktionary-reverted, glwiki-reverted, hrwiki-reverted, idwiki-reverted, iswiki-reverted, tawiki-reverted, viwiki-reverted

Others[edit]

Model Name Model Class
revertrisk experimental
nsfw experimental

Create a model card[edit]

The input box below provides a shortcut to creating a model card with the required formatting by preloading Machine learning models/Model card template.

For a more permanent version of the model card template that can live outside the wikitext editor, you can make a copy of this Google doc.

Once you are done editing your model card, please reach out to the WMF Machine Learning team for next steps on getting your model into production.

Note: In order to properly follow the prompts in this template, you will need to edit using raw wikitext, not Visual Editor.

Creates a page with the prefix: Machine learning models/Proposed/