Research:Improving multilingual support for link recommendation model for add-a-link task/Results round-1
We trained the link recommendation model for 301 different wikis, see the completion report (phab:T336927). Below we report the precision and recall for each model and whether it passed the backtesting evaluation and was published.
Some notes:
- sometimes a wiki was trained a second time (e.g. in case it didnt pass the backtesting at first but we then figured out how to fix the issue). we only report the results of the best model for each wiki.
- some wikis did not yield any values for precision and recall. this is often caused by the fact that the training pipeline did not complete succesfully. we still capture these wikis here to surface that the model should be improved for those wikis.
Results[edit]
wiki_db | precision | recall | passed_backtesting |
---|---|---|---|
abwiki | 0.92 | 0.6 | TRUE |
acewiki | 0.95 | 0.7 | TRUE |
adywiki | 0.9 | 0.56 | TRUE |
afwiki | 0.87 | 0.58 | TRUE |
akwiki | 0.86 | 0.58 | TRUE |
alswiki | 0.86 | 0.68 | TRUE |
amwiki | 0.71 | 0.31 | TRUE |
angwiki | 0.81 | 0.41 | TRUE |
anwiki | 0.87 | 0.54 | TRUE |
arcwiki | 0.74 | 0.31 | TRUE |
arwiki | 0.75 | 0.34 | TRUE |
arywiki | 0.79 | 0.44 | TRUE |
arzwiki | 0.97 | 0.82 | TRUE |
astwiki | 0.86 | 0.57 | TRUE |
aswiki | 0.57 | 0.16 | FALSE |
atjwiki | 0.86 | 0.74 | TRUE |
avwiki | 0.85 | 0.4 | TRUE |
aywiki | 0.97 | 0.41 | TRUE |
azbwiki | 0.96 | 0.79 | TRUE |
azwiki | 0.68 | 0.21 | TRUE |
banwiki | 0.95 | 0.8 | TRUE |
barwiki | 0.88 | 0.61 | TRUE |
bat_smgwiki | 0.8 | 0.36 | TRUE |
bawiki | 0.81 | 0.31 | TRUE |
bclwiki | 0.86 | 0.54 | TRUE |
be_x_oldwiki | 0.86 | 0.63 | TRUE |
bewiki | 0.83 | 0.49 | TRUE |
bgwiki | 0.81 | 0.54 | TRUE |
bhwiki | 0.94 | 0.72 | TRUE |
biwiki | 0.96 | 0.87 | TRUE |
bjnwiki | 0.89 | 0.58 | TRUE |
bmwiki | 0.9 | 0.64 | TRUE |
bnwiki | 0.75 | 0.3 | TRUE |
bowiki | 0 | 0 | FALSE |
bpywiki | 0.99 | 0.83 | TRUE |
brwiki | 0.85 | 0.54 | TRUE |
bswiki | 0.87 | 0.64 | TRUE |
bugwiki | 1 | 0.9 | TRUE |
bxrwiki | 0.72 | 0.32 | TRUE |
cawiki | 0.85 | 0.51 | TRUE |
cbk_zamwiki | 0.9 | 0.65 | TRUE |
cdowiki | 0.93 | 0.47 | TRUE |
cebwiki | 1 | 0.96 | TRUE |
cewiki | 0.99 | 0.45 | TRUE |
chrwiki | 0.86 | 0.66 | TRUE |
chwiki | 0.98 | 0.9 | TRUE |
chywiki | 0.97 | 0.57 | TRUE |
ckbwiki | 0.79 | 0.36 | TRUE |
cowiki | 0.81 | 0.52 | TRUE |
crhwiki | 0.72 | 0.27 | TRUE |
crwiki | 1 | 0.65 | TRUE |
csbwiki | 0.94 | 0.79 | TRUE |
cswiki | 0.78 | 0.44 | TRUE |
cuwiki | 0.72 | 0.48 | TRUE |
cvwiki | 0.84 | 0.41 | TRUE |
cywiki | 0.93 | 0.7 | TRUE |
dawiki | 0.79 | 0.48 | TRUE |
dewiki | 0.8 | 0.48 | TRUE |
dewiki | 0.79 | 0.48 | TRUE |
dinwiki | 0.94 | 0.48 | TRUE |
diqwiki | 0.4 | 0.9 | FALSE |
dsbwiki | 0.89 | 0.66 | TRUE |
dvwiki | 0.67 | 0.02 | FALSE |
dzwiki | - | - | FALSE |
eewiki | 0.93 | 0.82 | TRUE |
elwiki | 0.79 | 0.44 | TRUE |
emlwiki | 0.89 | 0.57 | TRUE |
enwiki | 0.81 | 0.45 | TRUE |
eowiki | 0.82 | 0.51 | TRUE |
eswiki | 0.805 | 0.451 | TRUE |
etwiki | 0.77 | 0.33 | TRUE |
euwiki | 0.86 | 0.37 | TRUE |
extwiki | 0.75 | 0.5 | TRUE |
fawiki | 0.882 | 0.605 | TRUE |
ffwiki | 0.92 | 0.86 | TRUE |
fiu_vrowiki | 0.89 | 0.58 | TRUE |
fiwiki | 0.71 | 0.27 | TRUE |
fjwiki | 0.79 | 0.67 | TRUE |
fowiki | 0.86 | 0.6 | TRUE |
frpwiki | 0.83 | 0.45 | TRUE |
frrwiki | 0.93 | 0.72 | TRUE |
frwiki | 0.815 | 0.459 | TRUE |
furwiki | 0.8 | 0.46 | TRUE |
fywiki | - | - | FALSE |
gagwiki | 0.88 | 0.5 | TRUE |
ganwiki | 0.67 | 0.01 | FALSE |
gawiki | 0.8 | 0.44 | TRUE |
gcrwiki | 0.95 | 0.84 | TRUE |
gdwiki | 0.82 | 0.51 | TRUE |
glkwiki | 0.97 | 0.74 | TRUE |
glwiki | 0.83 | 0.42 | TRUE |
gnwiki | 0.81 | 0.43 | TRUE |
gomwiki | 0.82 | 0.38 | TRUE |
gorwiki | 0.99 | 0.97 | TRUE |
gotwiki | 0.91 | 0.71 | TRUE |
guwiki | 0.84 | 0.32 | TRUE |
gvwiki | 0.82 | 0.52 | TRUE |
hakwiki | 0.92 | 0.75 | TRUE |
hawiki | 0.68 | 0.46 | TRUE |
hawwiki | 0.92 | 0.74 | TRUE |
hewiki | 0.75 | 0.28 | TRUE |
hifwiki | 0.93 | 0.73 | TRUE |
hiwiki | 0.76 | 0.27 | TRUE |
hrwiki | 0.81 | 0.52 | TRUE |
hsbwiki | 0.9 | 0.68 | TRUE |
htwiki | 0.92 | 0.42 | TRUE |
huwiki | 0.891 | 0.449 | TRUE |
hywiki | 0.74 | 0.19 | TRUE |
hywwiki | 0.63 | 0.16 | FALSE |
iawiki | 0.94 | 0.73 | TRUE |
idwiki | 0.84 | 0.55 | TRUE |
iewiki | 0.98 | 0.93 | TRUE |
igwiki | 0.72 | 0.49 | TRUE |
ikwiki | 0.92 | 0.6 | TRUE |
ilowiki | 0.91 | 0.65 | TRUE |
inhwiki | 0.68 | 0.22 | TRUE |
iowiki | 0.89 | 0.53 | TRUE |
iswiki | 0.79 | 0.53 | TRUE |
itwiki | 0.84 | 0.46 | TRUE |
iuwiki | 0.96 | 0.72 | TRUE |
jamwiki | 0.82 | 0.6 | TRUE |
jawiki | 0.32 | 0.01 | FALSE |
jbowiki | 0.7 | 0.29 | TRUE |
jvwiki | 0.87 | 0.61 | TRUE |
kaawiki | 0.77 | 0.34 | TRUE |
kabwiki | 0.82 | 0.65 | TRUE |
kawiki | 0.82 | 0.34 | TRUE |
kbdwiki | 0.8 | 0.41 | TRUE |
kbpwiki | 0.88 | 0.6 | TRUE |
kgwiki | 0.96 | 0.81 | TRUE |
kiwiki | 0.96 | 0.89 | TRUE |
kkwiki | 0.85 | 0.41 | TRUE |
klwiki | 0.74 | 0.35 | TRUE |
kmwiki | 0.7 | 0.21 | TRUE |
knwiki | 0.79 | 0.22 | TRUE |
koiwiki | 0.94 | 0.13 | TRUE |
kowiki | 0.72 | 0.25 | TRUE |
krcwiki | 0.65 | 0.2 | FALSE |
kshwiki | 0.81 | 0.52 | TRUE |
kswiki | 0.98 | 0.83 | TRUE |
kuwiki | 0.88 | 0.4 | TRUE |
kvwiki | 0.82 | 0.38 | TRUE |
kwwiki | 0.83 | 0.53 | TRUE |
kywiki | 0.81 | 0.52 | TRUE |
ladwiki | 0.83 | 0.67 | TRUE |
lawiki | 0.89 | 0.47 | TRUE |
lbewiki | 0.95 | 0.42 | TRUE |
lbwiki | 0.89 | 0.67 | TRUE |
lezwiki | 0.78 | 0.27 | TRUE |
lfnwiki | 0.78 | 0.6 | TRUE |
lgwiki | 0.92 | 0.51 | TRUE |
lijwiki | 0.9 | 0.58 | TRUE |
liwiki | 0.85 | 0.55 | TRUE |
lmowiki | 0.93 | 0.69 | TRUE |
lnwiki | 0.78 | 0.67 | TRUE |
lowiki | 0.76 | 0.3 | TRUE |
lrcwiki | - | - | FALSE |
ltgwiki | 0.83 | 0.55 | TRUE |
ltwiki | 0.79 | 0.47 | TRUE |
lvwiki | 0.84 | 0.52 | TRUE |
maiwiki | 0.91 | 0.24 | TRUE |
map_bmswiki | 0.98 | 0.81 | TRUE |
mdfwiki | 0.84 | 0.24 | TRUE |
mgwiki | 0.97 | 0.76 | TRUE |
mhrwiki | 0.93 | 0.34 | TRUE |
minwiki | 0.97 | 0.96 | TRUE |
miwiki | 0.94 | 0.75 | TRUE |
mkwiki | 0.87 | 0.57 | TRUE |
mlwiki | 0.69 | 0.14 | TRUE |
mnwiki | 0.72 | 0.3 | TRUE |
mnwwiki | 0 | 0 | FALSE |
mrjwiki | 0.93 | 0.54 | TRUE |
mrwiki | 0.97 | 0.67 | TRUE |
mswiki | 0.9 | 0.68 | TRUE |
mtwiki | 0.75 | 0.35 | TRUE |
mwlwiki | 0.84 | 0.56 | TRUE |
myvwiki | 0.79 | 0.32 | TRUE |
mywiki | 0.63 | 0.06 | FALSE |
mznwiki | 0.93 | 0.71 | TRUE |
nahwiki | 0.83 | 0.51 | TRUE |
napwiki | 0.91 | 0.52 | TRUE |
nawiki | 0.95 | 0.86 | TRUE |
nds_nlwiki | 0.82 | 0.55 | TRUE |
ndswiki | 0.89 | 0.44 | TRUE |
newiki | 0.74 | 0.15 | TRUE |
newwiki | 1 | 0.24 | TRUE |
nnwiki | 0.86 | 0.64 | TRUE |
novwiki | 0.88 | 0.61 | TRUE |
nowiki | 0.84 | 0.54 | TRUE |
nqowiki | 0.73 | 0.11 | TRUE |
nrmwiki | 0.87 | 0.56 | TRUE |
nsowiki | 0.96 | 0.4 | TRUE |
nvwiki | 0.99 | 0.8 | TRUE |
nywiki | 0.91 | 0.67 | TRUE |
ocwiki | 0.89 | 0.66 | TRUE |
olowiki | 0.92 | 0.51 | TRUE |
omwiki | 0.84 | 0.53 | TRUE |
orwiki | 0.71 | 0.22 | TRUE |
oswiki | 0.79 | 0.28 | TRUE |
pagwiki | 0.92 | 0.69 | TRUE |
pamwiki | 0.94 | 0.76 | TRUE |
papwiki | 0.88 | 0.6 | TRUE |
pawiki | 0.74 | 0.29 | TRUE |
pcdwiki | 0.92 | 0.75 | TRUE |
pdcwiki | 0.88 | 0.73 | TRUE |
pflwiki | 0.98 | 0.79 | TRUE |
pihwiki | 0.91 | 0.77 | TRUE |
piwiki | 0 | 0 | FALSE |
plwiki | 0.871 | 0.576 | TRUE |
pmswiki | 0.94 | 0.69 | TRUE |
pnbwiki | 0.8 | 0.53 | TRUE |
pntwiki | 0.93 | 0.81 | TRUE |
pswiki | 0.76 | 0.47 | TRUE |
ptwiki | 0.84 | 0.53 | TRUE |
ptwiki | 0.85 | 0.48 | TRUE |
quwiki | 0.75 | 0.16 | TRUE |
rmwiki | 0.84 | 0.65 | TRUE |
rmywiki | 0.89 | 0.76 | TRUE |
rnwiki | 0.98 | 0.67 | TRUE |
roa_rupwiki | 0.76 | 0.57 | TRUE |
roa_tarawiki | 0.97 | 0.76 | TRUE |
rowiki | 0.882 | 0.611 | TRUE |
ruewiki | 0.84 | 0.57 | TRUE |
ruwiki | 0.778 | 0.423 | TRUE |
rwwiki | 0.83 | 0.65 | TRUE |
sahwiki | 0.77 | 0.43 | TRUE |
satwiki | 0.76 | 0.52 | TRUE |
sawiki | 0.75 | 0.13 | TRUE |
scnwiki | 0.91 | 0.56 | TRUE |
scowiki | 0.84 | 0.54 | TRUE |
scwiki | 0.8 | 0.54 | TRUE |
sdwiki | 0.75 | 0.45 | TRUE |
sewiki | 0.95 | 0.69 | TRUE |
sgwiki | 1 | 0.89 | TRUE |
shnwiki | 0.5 | 0.02 | FALSE |
shwiki | 0.9 | 0.51 | TRUE |
simplewiki | 0.79 | 0.45 | TRUE |
simplewiki | 0.79 | 0.44 | TRUE |
siwiki | 0.74 | 0.13 | TRUE |
skwiki | 0.91 | 0.59 | TRUE |
slwiki | 0.83 | 0.53 | TRUE |
smwiki | 0.87 | 0.68 | TRUE |
snwiki | 0.64 | 0.16 | FALSE |
sowiki | 0.71 | 0.39 | TRUE |
sqwiki | 0.89 | 0.58 | TRUE |
srnwiki | 0.98 | 0.77 | TRUE |
srwiki | 0.9 | 0.47 | TRUE |
sswiki | 0.92 | 0.38 | TRUE |
stqwiki | 0.9 | 0.72 | TRUE |
stwiki | 0.99 | 0.82 | TRUE |
suwiki | 0.98 | 0.81 | TRUE |
svwiki | 0.9 | 0.61 | TRUE |
swwiki | 0.88 | 0.63 | TRUE |
szlwiki | 0.96 | 0.81 | TRUE |
szywiki | 0.65 | 0.32 | FALSE |
tawiki | 0.72 | 0.01 | TRUE |
tcywiki | 0.88 | 0.11 | TRUE |
tetwiki | 0.84 | 0.69 | TRUE |
tewiki | 0.79 | 0.13 | TRUE |
tgwiki | 0.9 | 0.61 | TRUE |
thwiki | 0.72 | 0.21 | TRUE |
tiwiki | 0.54 | 0.5 | FALSE |
tkwiki | 0.74 | 0.27 | TRUE |
tlwiki | 0.81 | 0.52 | TRUE |
tnwiki | 0.9 | 0.74 | TRUE |
towiki | 0.94 | 0.73 | TRUE |
tpiwiki | 0.8 | 0.69 | TRUE |
trwiki | 0.75 | 0.35 | TRUE |
tswiki | 0.89 | 0.59 | TRUE |
ttwiki | 0.93 | 0.38 | TRUE |
tumwiki | 0.84 | 0.62 | TRUE |
twwiki | 0.8 | 0.61 | TRUE |
tyvwiki | 0.78 | 0.39 | TRUE |
tywiki | 0.97 | 0.85 | TRUE |
udmwiki | 0.83 | 0.33 | TRUE |
ugwiki | 0.88 | 0.53 | TRUE |
ukwiki | 0.8 | 0.42 | TRUE |
urwiki | 0.62 | 0.23 | FALSE |
uzwiki | 0.8 | 0.3 | TRUE |
vecwiki | 0.96 | 0.75 | TRUE |
vepwiki | 0.87 | 0.38 | TRUE |
vewiki | 0.99 | 0.93 | TRUE |
viwiki | 0.89 | 0.65 | TRUE |
vlswiki | 0.84 | 0.55 | TRUE |
vowiki | 0.98 | 0.43 | TRUE |
warwiki | 0.95 | 0.77 | TRUE |
wawiki | 0.81 | 0.4 | TRUE |
wowiki | 0.83 | 0.54 | TRUE |
wuuwiki | 0 | 0 | FALSE |
xalwiki | 0.99 | 0.6 | TRUE |
xhwiki | 0.83 | 0.32 | TRUE |
xmfwiki | 0.76 | 0.27 | TRUE |
yiwiki | 0.76 | 0.44 | TRUE |
yowiki | 0.96 | 0.83 | TRUE |
zawiki | 0.91 | 0.61 | TRUE |
zeawiki | 0.97 | 0.78 | TRUE |
zh_classicalwiki | 0 | 0 | FALSE |
zh_min_nanwiki | 0.97 | 0.84 | TRUE |
zh_yuewiki | 0.48 | 0 | FALSE |
zhwiki | - | - | FALSE |
zuwiki | 0.97 | 0.8 | TRUE |