Jump to content

Research:Revision scoring as a service/Word lists

From Meta, a Wikimedia project coordination wiki

Below are word lists for many languages. See Objective Revision Evaluation Service/BWDS review for instructions on how to review the words in a list.

Single language wikis

[edit]
ISO code Language Generated list Badwords Informal words Stopwords Dictionary Stemmer Contact person Wiki labels Interface Forms Campaign Needs
af Afrikaans (Wikipedia) 247 - - 228 - - Pgallert requested no no no -aa
ar العربية (Wikipedia) 250 - - 249 - - OsamaK requested no no no -
az azərbaycanca (Wikipedia) 263 82 11 234 - - Wertuose translated no no started [1] -
bg български (Wikipedia) 249 - - 250 - - requested no no no -
be беларуская (Wikipedia) 560 - - - - - requested no no no -
bn বাংলা (Wikipedia) 246 20 17 242 - - requested no no no -
ca català (Wikipedia) 185 78 35 249 - - Townie requested no no no -
ce нохчийн (Wikipedia) 249 - - 250 - - requested no no no -
cs čeština (Wikipedia) 249 147 93 250 - - requested no no no -
da dansk (Wikipedia) 250 - - 250 - - requested no no no -
de Deutsch (Wikipedia) 251 71 180 - - - Distelfinck translated yes yes no Consensus
el Ελληνικά (Wikipedia) 249 - - 249 - - requested no no no -
en English (Wikipedia) 250 78 37 233 enchant.Dict nltk.SnowballStemmer EpochFail fully supported yes yes almost complete [2] post campaign remodeling
eo Esperanto (Wikipedia) 248 89 17 249 enchant.Dict nltk.SnowballStemmer translated no no started [3], not auto-labelled more badwords, informal words
es español (Wikipedia) 250 141 94 nltk.stopwords enchant.Dict nltk.SnowballStemmer Mforns, Lynhg translated yes yes no -
et eesti (Wikipedia) 242 35 31 227 - - Cumbril requested yes yes almost complete [4] -
eu euskara (Wikipedia) 250 - - 250 - - requested no no no -
fa فارسی (Wikipedia) 250 21 - 249 enchant.Dict - Ladsgroup translated yes yes almost complete [5] -
fi suomi (Wikipedia) 252 48 13 249 - - requested no no no -
fr français (Wikipedia) 247 116 33 235 enchant.Dict nltk.SnowballStemmer translated yes yes started [6], not auto-labelled more badwords, informal words
gl galego (Wikipedia) 257 46 7 250 - - requested no no no -
he עברית (Wikipedia) 250 47 32 - enchant.Dict - ערן requested yes yes no stop words, stemmer
hi हिन्दी (Wikipedia) 249 - - 250 - - requested no no no -
hr hrvatski (Wikipedia) 257 103 38 250 - - requested no no no -
hu magyar (Wikipedia) 250 155 34 184 enchant.Dict nltk.SnowballStemmer Tgr requested no no no -
hy հայերեն (Wikipedia) 249 - - 249 - - SusikMkr requested no no no -
id Bahasa Indonesia (Wikipedia) 249 70 - 236 enchant.Dict - Kenrick95 requested yes yes no informal words, stemmer
it italiano (Wikipedia) 248 139 47 232 - - DarTar requested yes yes no -
ja 日本語 (Wikipedia) 250 10 5 250 requested yes yes no -
ka ქართული (Wikipedia) 249 - - 250 - - requested no no no -
kk қазақша (Wikipedia) 279 - - 250 - - requested no no no -
ko 한국어 (Wikipedia) 263 - - 242 - - requested no no no -
la Latina (Wikipedia) 262 - - 250 - - requested no no no -
lt lietuvių (Wikipedia) 247 - - 250 - - requested no no no -
ms Bahasa Melayu (Wikipedia) 249 90 69 248 - - requested no no no -
min Minangkabau (Wikipedia) 248 - - 251 - - requested no no no -
nl Nederlands (Wikipedia) 247 153 102 236 - - translated yes yes no -
pl polski (Wikipedia) 249 155 22 235 - - requested no yes no -
pt português (Wikipedia) 248 124 45 239 enchant.Dict nltk.SnowballStemmer He7d3r translated yes yes complete [7]
ro română (Wikipedia) 249 32 19 231 - - Andrei requested no no no -
ru русский (Wikipedia) 250 103 30 151 - - Drbug requested yes yes no -
sh srpskohrvatski / српскохрватски (Wikipedia) 248 - - 249 - - requested no no no -
simple Simple English (Wikipedia) 250 *(en) *(en) nltk.stopwords enchant.Dict nltk.SnowballStemmer requested no no no -
sk slovenčina (Wikipedia) 249 - - 249 - - requested no no no -
sl slovenščina (Wikipedia) 249 - - 250 - - requested no no no -
sr српски / srpski (Wikipedia) 249 31 29 250 - - requested no no no -
th ไทย (Wikipedia) 249 - - 251 - - requested no no no -
tl Tagalog (Wikipedia) 247 - - 218 - - requested no no no -
tr Türkçe (Wikipedia) 250 145 105 232 - (Zemberek?[8]) とある白い猫 translated yes yes almost complete [9] bad words need to be updated
uk українська (Wikipedia) 249 47 21 249 - - Base, Yakiv Gluck requested yes yes no -
ur اردو (Wikipedia) 250 69 - 251 translated yes yes started [10], not auto-labelled more badwords, informal words
uz oʻzbekcha / ўзбекча (Wikipedia) 250 - 250 - - no no no no -
vi Tiếng Việt (Wikipedia) 246 21 28 220 enchant.Dict - Mxn no no no no -
vo Volapük (Wikipedia) 249 - - 248 - - requested no no no -
zh 中文 (Wikipedia) 250 485 1 250 - - Jianhui67 translated yes yes no -

Multi lingual wikis

[edit]
ISO code Language Generated list Badwords Informal words Stopwords Dictionary Stemmer Contact person Wiki labels Interface Forms Campaign Needs
commons commons (Wikipedia) - - - - - - no no no no -
meta meta (Wikipedia) - - - - - - no no no no -
wikispecies wikispecies (Wikipedia) - - - - - - no no no no -