Research:Language-Agnostic Topic Classification/Outlink model performance

From Meta, a Wikimedia project coordination wiki
Jump to navigation Jump to search

This page provides details about the current (as of May 2020) model for Wikipedia topic classification based on outlinks (as represented by their corresponding Wikidata IDs):

  • Code: https://github.com/geohci/wikipedia-language-agnostic-topic-classification
  • Model architecture: multi-label fastText supervised model
  • Number of articles by language in training data (% of training data). This was an attempt to balance convenience and coverage. The languages were included in rough proportion to their number of articles with labels (with some dampening of English Wikipedia):
    • Arabic (ar): 662,021 (10.5%)
    • Spanish (es): 854,992 (13.6%)
    • English (en): 2,363,824 (37.5%)
    • French (fr): 1,138,743 (18.1%)
    • Hindi (hi): 62,720 (0.1%)
    • Russian (ru): 707,924 (11.2%)
    • Chinese (zh): 513,292 (8.1%)
  • Epochs: 5
  • Learning rate: 0.1
  • Window size: 20
  • Min count (under which QID is not retained in vocab): 50
  • No pre-trained embeddings used
  • Embeddings dimension: 50
  • Total number of model params: 3200 (50 x 64)
  • Vocab size: 1,527,593
  • Total number of embeddings params: 76,379,650 (vocab size * embeddings dimension)
  • Model size on disk: 317.4 MB

Test Results[edit]

Regarding the test results below, there is a strong limitation in that there is no labeled data for articles that do not have English Wikipedia equivalents. It is very possible that the performance degrades for these articles (assuming they also have outlinks to different types of articles). The test results below do include Swahili (sw) and Japanese (ja), neither of which were in the training data, to give some sense of how well the model extends to other languages without fine-tuning.

language micro precision macro precision micro recall macro recall micro f1 macro f1 micro avg. pre. macro avg. pre.
ar 0.870 0.807 0.770 0.608 0.812 0.687 0.873 0.747
es 0.877 0.838 0.792 0.679 0.829 0.745 0.895 0.808
en 0.857 0.798 0.801 0.696 0.827 0.741 0.884 0.783
fr 0.875 0.838 0.799 0.693 0.833 0.754 0.898 0.816
hi 0.813 0.731 0.684 0.502 0.736 0.583 0.784 0.613
ja 0.862 0.836 0.748 0.628 0.796 0.709 0.866 0.783
ru 0.870 0.835 0.789 0.679 0.825 0.743 0.893 0.810
sw 0.796 0.691 0.578 0.457 0.661 0.528 0.745 0.582
zh 0.886 0.838 0.811 0.695 0.845 0.756 0.902 0.806
topic lang n TP FP TN FN precision recall f1 avg_pre
Culture.Biography.Biography* ar 32590 32035 1007 24793 555 0.970 0.983 0.976 0.991
Culture.Biography.Women ar 3942 1672 1092 53356 2270 0.605 0.424 0.499 0.572
Culture.Food and drink ar 378 222 40 57972 156 0.847 0.587 0.694 0.738
Culture.Internet culture ar 616 456 49 57725 160 0.903 0.740 0.814 0.872
Culture.Linguistics ar 384 230 36 57970 154 0.865 0.599 0.708 0.736
Culture.Literature ar 2071 1105 414 55905 966 0.727 0.534 0.616 0.706
Culture.Media.Books ar 353 215 42 57995 138 0.837 0.609 0.705 0.737
Culture.Media.Entertainment ar 482 191 72 57836 291 0.726 0.396 0.513 0.543
Culture.Media.Films ar 807 640 45 57538 167 0.934 0.793 0.858 0.892
Culture.Media.Media* ar 4776 3086 743 52871 1690 0.806 0.646 0.717 0.816
Culture.Media.Music ar 1661 1005 352 56377 656 0.741 0.605 0.666 0.757
Culture.Media.Radio ar 83 3 8 58299 80 0.273 0.036 0.064 0.140
Culture.Media.Software ar 226 101 34 58130 125 0.748 0.447 0.560 0.621
Culture.Media.Television ar 618 312 61 57711 306 0.836 0.505 0.630 0.659
Culture.Media.Video games ar 435 374 12 57943 61 0.969 0.860 0.911 0.941
Culture.Performing arts ar 363 112 43 57984 251 0.723 0.309 0.432 0.465
Culture.Philosophy and religion ar 1941 959 246 56203 982 0.796 0.494 0.610 0.677
Culture.Sports ar 15979 15261 688 41723 718 0.957 0.955 0.956 0.984
Culture.Visual arts.Architecture ar 568 250 114 57708 318 0.687 0.440 0.536 0.586
Culture.Visual arts.Comics and Anime ar 386 266 33 57971 120 0.890 0.689 0.777 0.801
Culture.Visual arts.Fashion ar 208 113 20 58162 95 0.850 0.543 0.663 0.736
Culture.Visual arts.Visual arts* ar 1785 967 373 56232 818 0.722 0.542 0.619 0.686
Geography.Geographical ar 4631 3691 390 53369 940 0.904 0.797 0.847 0.933
Geography.Regions.Africa.Africa* ar 2064 1403 304 56022 661 0.822 0.680 0.744 0.819
Geography.Regions.Africa.Central Africa ar 0 0 0 58390 0 0 0 0 nan
Geography.Regions.Africa.Eastern Africa ar 75 26 17 58298 49 0.605 0.347 0.441 0.471
Geography.Regions.Africa.Northern Africa ar 977 702 161 57252 275 0.813 0.719 0.763 0.811
Geography.Regions.Africa.Southern Africa ar 140 59 39 58211 81 0.602 0.421 0.496 0.516
Geography.Regions.Africa.Western Africa ar 55 16 9 58326 39 0.640 0.291 0.400 0.421
Geography.Regions.Americas.Central America ar 578 299 106 57706 279 0.738 0.517 0.608 0.677
Geography.Regions.Americas.North America ar 10035 6858 2025 46330 3177 0.772 0.683 0.725 0.839
Geography.Regions.Americas.South America ar 1345 906 259 56786 439 0.778 0.674 0.722 0.802
Geography.Regions.Asia.Asia* ar 8180 6648 783 49427 1532 0.895 0.813 0.852 0.930
Geography.Regions.Asia.Central Asia ar 134 65 18 58238 69 0.783 0.485 0.599 0.684
Geography.Regions.Asia.East Asia ar 1771 1347 247 56372 424 0.845 0.761 0.801 0.875
Geography.Regions.Asia.North Asia ar 191 54 28 58171 137 0.659 0.283 0.396 0.462
Geography.Regions.Asia.South Asia ar 821 534 64 57505 287 0.893 0.650 0.753 0.828
Geography.Regions.Asia.Southeast Asia ar 691 445 44 57655 246 0.910 0.644 0.754 0.826
Geography.Regions.Asia.West Asia ar 4725 4077 369 53296 648 0.917 0.863 0.889 0.955
Geography.Regions.Europe.Eastern Europe ar 1247 817 122 57021 430 0.870 0.655 0.747 0.818
Geography.Regions.Europe.Europe* ar 11055 8178 1693 45642 2877 0.828 0.740 0.782 0.878
Geography.Regions.Europe.Northern Europe ar 3503 2130 481 54406 1373 0.816 0.608 0.697 0.795
Geography.Regions.Europe.Southern Europe ar 2649 1884 311 55430 765 0.858 0.711 0.778 0.876
Geography.Regions.Europe.Western Europe ar 3833 2872 694 53863 961 0.805 0.749 0.776 0.867
Geography.Regions.Oceania ar 2247 1905 135 56008 342 0.934 0.848 0.889 0.925
History and Society.Business and economics ar 1405 657 250 56735 748 0.724 0.468 0.568 0.641
History and Society.Education ar 804 279 93 57493 525 0.750 0.347 0.474 0.528
History and Society.History ar 2568 1159 344 55478 1409 0.771 0.451 0.569 0.645
History and Society.Military and warfare ar 2533 1680 330 55527 853 0.836 0.663 0.740 0.819
History and Society.Politics and government ar 2825 1569 448 55117 1256 0.778 0.555 0.648 0.718
History and Society.Society ar 2660 1047 326 55404 1613 0.763 0.394 0.519 0.599
History and Society.Transportation ar 1212 909 82 57096 303 0.917 0.750 0.825 0.875
STEM.Biology ar 2993 2595 140 55257 398 0.949 0.867 0.906 0.958
STEM.Chemistry ar 388 264 46 57956 124 0.852 0.680 0.756 0.813
STEM.Computing ar 510 337 73 57807 173 0.822 0.661 0.733 0.816
STEM.Earth and environment ar 592 337 77 57721 255 0.814 0.569 0.670 0.743
STEM.Engineering ar 924 600 99 57367 324 0.858 0.649 0.739 0.796
STEM.Libraries & Information ar 101 51 16 58273 50 0.761 0.505 0.607 0.606
STEM.Mathematics ar 97 52 8 58285 45 0.867 0.536 0.662 0.702
STEM.Medicine & Health ar 1784 1373 150 56456 411 0.902 0.770 0.830 0.894
STEM.Physics ar 319 170 70 58001 149 0.708 0.533 0.608 0.653
STEM.STEM* ar 8419 7049 534 49437 1370 0.930 0.837 0.881 0.954
STEM.Space ar 704 627 28 57658 77 0.957 0.891 0.923 0.965
STEM.Technology ar 970 498 157 57263 472 0.760 0.513 0.613 0.687
Culture.Biography.Biography* es 22338 20660 1402 52191 1678 0.936 0.925 0.931 0.975
Culture.Biography.Women es 3875 1742 741 71315 2133 0.702 0.450 0.548 0.651
Culture.Food and drink es 735 523 62 75134 212 0.894 0.712 0.792 0.844
Culture.Internet culture es 1039 827 76 74816 212 0.916 0.796 0.852 0.924
Culture.Linguistics es 788 491 84 75059 297 0.854 0.623 0.720 0.775
Culture.Literature es 2637 1670 374 72920 967 0.817 0.633 0.714 0.802
Culture.Media.Books es 554 355 71 75306 199 0.833 0.641 0.724 0.789
Culture.Media.Entertainment es 931 476 155 74845 455 0.754 0.511 0.609 0.685
Culture.Media.Films es 2069 1810 131 73731 259 0.933 0.875 0.903 0.938
Culture.Media.Media* es 10203 8688 1141 64587 1515 0.884 0.852 0.867 0.936
Culture.Media.Music es 4600 4003 503 70828 597 0.888 0.870 0.879 0.938
Culture.Media.Radio es 96 31 7 75828 65 0.816 0.323 0.463 0.520
Culture.Media.Software es 370 178 91 75470 192 0.662 0.481 0.557 0.606
Culture.Media.Television es 1557 1172 175 74199 385 0.870 0.753 0.807 0.874
Culture.Media.Video games es 811 726 25 75095 85 0.967 0.895 0.930 0.967
Culture.Performing arts es 649 390 86 75196 259 0.819 0.601 0.693 0.749
Culture.Philosophy and religion es 2604 1435 416 72911 1169 0.775 0.551 0.644 0.726
Culture.Sports es 11414 10858 566 63951 556 0.950 0.951 0.951 0.976
Culture.Visual arts.Architecture es 1260 666 248 74423 594 0.729 0.529 0.613 0.673
Culture.Visual arts.Comics and Anime es 702 543 88 75141 159 0.861 0.774 0.815 0.887
Culture.Visual arts.Fashion es 227 115 35 75669 112 0.767 0.507 0.610 0.637
Culture.Visual arts.Visual arts* es 3085 1907 597 72249 1178 0.762 0.618 0.682 0.767
Geography.Geographical es 5271 3202 654 70006 2069 0.830 0.607 0.702 0.788
Geography.Regions.Africa.Africa* es 1801 1172 314 73816 629 0.789 0.651 0.713 0.790
Geography.Regions.Africa.Central Africa es 0 0 0 75931 0 0 0 0 nan
Geography.Regions.Africa.Eastern Africa es 81 45 11 75839 36 0.804 0.556 0.657 0.667
Geography.Regions.Africa.Northern Africa es 388 239 74 75469 149 0.764 0.616 0.682 0.739
Geography.Regions.Africa.Southern Africa es 171 93 20 75740 78 0.823 0.544 0.655 0.725
Geography.Regions.Africa.Western Africa es 120 80 14 75797 40 0.851 0.667 0.748 0.791
Geography.Regions.Americas.Central America es 1577 1164 211 74143 413 0.847 0.738 0.789 0.850
Geography.Regions.Americas.North America es 10072 7925 1162 64697 2147 0.872 0.787 0.827 0.919
Geography.Regions.Americas.South America es 4243 3303 720 70968 940 0.821 0.778 0.799 0.878
Geography.Regions.Asia.Asia* es 6586 5081 694 68651 1505 0.880 0.771 0.822 0.897
Geography.Regions.Asia.Central Asia es 202 128 28 75701 74 0.821 0.634 0.715 0.772
Geography.Regions.Asia.East Asia es 2780 2252 333 72818 528 0.871 0.810 0.840 0.906
Geography.Regions.Asia.North Asia es 371 176 64 75496 195 0.733 0.474 0.576 0.618
Geography.Regions.Asia.South Asia es 945 731 50 74936 214 0.936 0.774 0.847 0.906
Geography.Regions.Asia.Southeast Asia es 983 679 72 74876 304 0.904 0.691 0.783 0.859
Geography.Regions.Asia.West Asia es 1451 1039 152 74328 412 0.872 0.716 0.787 0.862
Geography.Regions.Europe.Eastern Europe es 2822 2240 275 72834 582 0.891 0.794 0.839 0.920
Geography.Regions.Europe.Europe* es 21951 18754 2754 51226 3197 0.872 0.854 0.863 0.944
Geography.Regions.Europe.Northern Europe es 4246 3091 433 71252 1155 0.877 0.728 0.796 0.884
Geography.Regions.Europe.Southern Europe es 6156 4762 801 68974 1394 0.856 0.774 0.813 0.902
Geography.Regions.Europe.Western Europe es 8988 7660 910 66033 1328 0.894 0.852 0.873 0.951
Geography.Regions.Oceania es 1501 1105 138 74292 396 0.889 0.736 0.805 0.867
History and Society.Business and economics es 1728 801 257 73946 927 0.757 0.464 0.575 0.646
History and Society.Education es 747 239 96 75088 508 0.713 0.320 0.442 0.508
History and Society.History es 3702 2107 686 71543 1595 0.754 0.569 0.649 0.716
History and Society.Military and warfare es 3039 2027 425 72467 1012 0.827 0.667 0.738 0.814
History and Society.Politics and government es 2554 1417 416 72961 1137 0.773 0.555 0.646 0.723
History and Society.Society es 3230 1509 464 72237 1721 0.765 0.467 0.580 0.659
History and Society.Transportation es 2196 1851 163 73572 345 0.919 0.843 0.879 0.931
STEM.Biology es 8387 7899 206 67338 488 0.975 0.942 0.958 0.990
STEM.Chemistry es 434 302 70 75427 132 0.812 0.696 0.749 0.834
STEM.Computing es 892 676 155 74884 216 0.813 0.758 0.785 0.856
STEM.Earth and environment es 1185 881 134 74612 304 0.868 0.743 0.801 0.862
STEM.Engineering es 1336 1013 148 74447 323 0.873 0.758 0.811 0.880
STEM.Libraries & Information es 128 43 14 75789 85 0.754 0.336 0.465 0.453
STEM.Mathematics es 138 88 13 75780 50 0.871 0.638 0.736 0.763
STEM.Medicine & Health es 1337 967 110 74484 370 0.898 0.723 0.801 0.877
STEM.Physics es 277 146 62 75592 131 0.702 0.527 0.602 0.610
STEM.STEM* es 15069 13702 713 60149 1367 0.951 0.909 0.929 0.978
STEM.Space es 1100 1012 37 74794 88 0.965 0.920 0.942 0.981
STEM.Technology es 1350 735 253 74328 615 0.744 0.544 0.629 0.724
Culture.Biography.Biography* en 137236 124227 10525 272829 13009 0.922 0.905 0.913 0.960
Culture.Biography.Women en 17235 8339 4466 398889 8896 0.651 0.484 0.555 0.611
Culture.Food and drink en 2861 1941 483 417246 920 0.801 0.678 0.735 0.745
Culture.Internet culture en 3689 2870 368 416533 819 0.886 0.778 0.829 0.890
Culture.Linguistics en 7377 5803 545 412668 1574 0.914 0.787 0.846 0.893
Culture.Literature en 14227 9236 2449 403914 4991 0.790 0.649 0.713 0.777
Culture.Media.Books en 4578 2970 682 415330 1608 0.813 0.649 0.722 0.761
Culture.Media.Entertainment en 4090 2121 870 415630 1969 0.709 0.519 0.599 0.620
Culture.Media.Films en 12506 10640 1463 406621 1866 0.879 0.851 0.865 0.917
Culture.Media.Media* en 55915 46058 8217 356458 9857 0.849 0.824 0.836 0.907
Culture.Media.Music en 21274 17952 3154 396162 3322 0.851 0.844 0.847 0.913
Culture.Media.Radio en 2243 1816 170 418177 427 0.914 0.810 0.859 0.883
Culture.Media.Software en 1283 462 298 419009 821 0.608 0.360 0.452 0.494
Culture.Media.Television en 8158 6035 1351 411081 2123 0.817 0.740 0.777 0.818
Culture.Media.Video games en 2810 2554 119 417661 256 0.955 0.909 0.932 0.960
Culture.Performing arts en 3151 1868 673 416766 1283 0.735 0.593 0.656 0.676
Culture.Philosophy and religion en 11380 6979 2541 406669 4401 0.733 0.613 0.668 0.702
Culture.Sports en 67885 64297 4190 348515 3588 0.939 0.947 0.943 0.973
Culture.Visual arts.Architecture en 12119 8852 1707 406764 3267 0.838 0.730 0.781 0.853
Culture.Visual arts.Comics and Anime en 2361 1793 372 417857 568 0.828 0.759 0.792 0.849
Culture.Visual arts.Fashion en 940 512 251 419399 428 0.671 0.545 0.601 0.590
Culture.Visual arts.Visual arts* en 19986 13975 3565 397039 6011 0.797 0.699 0.745 0.827
Geography.Geographical en 23800 18123 2885 393905 5677 0.863 0.761 0.809 0.878
Geography.Regions.Africa.Africa* en 9478 6693 1599 409513 2785 0.807 0.706 0.753 0.805
Geography.Regions.Africa.Central Africa en 4 0 0 420586 4 0 0.000 0 0.000
Geography.Regions.Africa.Eastern Africa en 548 370 141 419901 178 0.724 0.675 0.699 0.706
Geography.Regions.Africa.Northern Africa en 1560 938 262 418768 622 0.782 0.601 0.680 0.710
Geography.Regions.Africa.Southern Africa en 1485 1022 289 418816 463 0.780 0.688 0.731 0.733
Geography.Regions.Africa.Western Africa en 821 467 187 419582 354 0.714 0.569 0.633 0.618
Geography.Regions.Americas.Central America en 3867 2546 597 416126 1321 0.810 0.658 0.726 0.774
Geography.Regions.Americas.North America en 66125 52109 11354 343111 14016 0.821 0.788 0.804 0.888
Geography.Regions.Americas.South America en 7808 5780 1108 411674 2028 0.839 0.740 0.787 0.845
Geography.Regions.Asia.Asia* en 53691 45654 6040 360859 8037 0.883 0.850 0.866 0.929
Geography.Regions.Asia.Central Asia en 921 583 134 419535 338 0.813 0.633 0.712 0.768
Geography.Regions.Asia.East Asia en 13590 10947 1781 405219 2643 0.860 0.806 0.832 0.889
Geography.Regions.Asia.North Asia en 1120 504 325 419145 616 0.608 0.450 0.517 0.517
Geography.Regions.Asia.South Asia en 18166 15992 1565 400859 2174 0.911 0.880 0.895 0.938
Geography.Regions.Asia.Southeast Asia en 6907 5404 933 412750 1503 0.853 0.782 0.816 0.863
Geography.Regions.Asia.West Asia en 13367 11405 1201 406022 1962 0.905 0.853 0.878 0.932
Geography.Regions.Europe.Eastern Europe en 15325 12553 1578 403687 2772 0.888 0.819 0.852 0.914
Geography.Regions.Europe.Europe* en 85604 68234 13810 321176 17370 0.832 0.797 0.814 0.901
Geography.Regions.Europe.Northern Europe en 32429 24242 5381 382780 8187 0.818 0.748 0.781 0.859
Geography.Regions.Europe.Southern Europe en 15512 11540 2418 402660 3972 0.827 0.744 0.783 0.856
Geography.Regions.Europe.Western Europe en 23023 17227 3838 393729 5796 0.818 0.748 0.781 0.858
Geography.Regions.Oceania en 18048 15696 1194 401348 2352 0.929 0.870 0.899 0.935
History and Society.Business and economics en 10685 5100 2769 407136 5585 0.648 0.477 0.550 0.569
History and Society.Education en 8707 4423 1935 409948 4284 0.696 0.508 0.587 0.596
History and Society.History en 12146 6174 2615 405829 5972 0.702 0.508 0.590 0.626
History and Society.Military and warfare en 16114 12121 2793 401683 3993 0.813 0.752 0.781 0.840
History and Society.Politics and government en 17868 12344 3641 399081 5524 0.772 0.691 0.729 0.791
History and Society.Society en 14801 8538 2775 403014 6263 0.755 0.577 0.654 0.708
History and Society.Transportation en 16729 14459 1493 402368 2270 0.906 0.864 0.885 0.929
STEM.Biology en 37020 35274 1031 382539 1746 0.972 0.953 0.962 0.988
STEM.Chemistry en 1579 1020 294 418717 559 0.776 0.646 0.705 0.775
STEM.Computing en 3070 2209 676 416844 861 0.766 0.720 0.742 0.783
STEM.Earth and environment en 5230 4051 648 414712 1179 0.862 0.775 0.816 0.866
STEM.Engineering en 6303 4676 852 413435 1627 0.846 0.742 0.790 0.837
STEM.Libraries & Information en 795 290 104 419691 505 0.736 0.365 0.488 0.445
STEM.Mathematics en 526 327 95 419969 199 0.775 0.622 0.690 0.690
STEM.Medicine & Health en 5704 3821 1024 413862 1883 0.789 0.670 0.724 0.777
STEM.Physics en 1010 510 247 419333 500 0.674 0.505 0.577 0.585
STEM.STEM* en 65671 58350 4799 350120 7321 0.924 0.889 0.906 0.964
STEM.Space en 2525 2265 156 417909 260 0.936 0.897 0.916 0.950
STEM.Technology en 5453 3039 1243 413894 2414 0.710 0.557 0.624 0.670
Culture.Biography.Biography* fr 33863 32080 2237 65655 1783 0.935 0.947 0.941 0.975
Culture.Biography.Women fr 5340 2811 1030 95385 2529 0.732 0.526 0.612 0.703
Culture.Food and drink fr 810 563 97 100848 247 0.853 0.695 0.766 0.821
Culture.Internet culture fr 1530 1318 88 100137 212 0.937 0.861 0.898 0.946
Culture.Linguistics fr 1162 694 114 100479 468 0.859 0.597 0.705 0.756
Culture.Literature fr 3726 2428 619 97410 1298 0.797 0.652 0.717 0.791
Culture.Media.Books fr 912 562 149 100694 350 0.790 0.616 0.693 0.745
Culture.Media.Entertainment fr 1127 579 182 100446 548 0.761 0.514 0.613 0.660
Culture.Media.Films fr 4063 3665 276 97416 398 0.930 0.902 0.916 0.953
Culture.Media.Media* fr 14273 12178 1523 85959 2095 0.889 0.853 0.871 0.938
Culture.Media.Music fr 5192 4383 631 95932 809 0.874 0.844 0.859 0.924
Culture.Media.Radio fr 154 52 18 101583 102 0.743 0.338 0.464 0.508
Culture.Media.Software fr 476 193 89 101190 283 0.684 0.405 0.509 0.601
Culture.Media.Television fr 1871 1462 236 99648 409 0.861 0.781 0.819 0.881
Culture.Media.Video games fr 1280 1220 33 100442 60 0.974 0.953 0.963 0.985
Culture.Performing arts fr 908 538 136 100711 370 0.798 0.593 0.680 0.711
Culture.Philosophy and religion fr 3511 2165 593 97651 1346 0.785 0.617 0.691 0.755
Culture.Sports fr 16184 15450 932 84639 734 0.943 0.955 0.949 0.980
Culture.Visual arts.Architecture fr 1889 1107 349 99517 782 0.760 0.586 0.662 0.726
Culture.Visual arts.Comics and Anime fr 897 676 119 100739 221 0.850 0.754 0.799 0.869
Culture.Visual arts.Fashion fr 300 180 41 101414 120 0.814 0.600 0.691 0.729
Culture.Visual arts.Visual arts* fr 4588 2979 932 96235 1609 0.762 0.649 0.701 0.782
Geography.Geographical fr 6058 4206 819 94878 1852 0.837 0.694 0.759 0.833
Geography.Regions.Africa.Africa* fr 3136 2203 429 98190 933 0.837 0.702 0.764 0.846
Geography.Regions.Africa.Central Africa fr 0 0 0 101755 0 0 0 0 nan
Geography.Regions.Africa.Eastern Africa fr 171 122 15 101569 49 0.891 0.713 0.792 0.820
Geography.Regions.Africa.Northern Africa fr 711 458 97 100947 253 0.825 0.644 0.724 0.754
Geography.Regions.Africa.Southern Africa fr 283 180 34 101438 103 0.841 0.636 0.724 0.779
Geography.Regions.Africa.Western Africa fr 147 88 18 101590 59 0.830 0.599 0.696 0.794
Geography.Regions.Americas.Central America fr 1088 689 131 100536 399 0.840 0.633 0.722 0.797
Geography.Regions.Americas.North America fr 11825 8797 1706 88224 3028 0.838 0.744 0.788 0.888
Geography.Regions.Americas.South America fr 2631 1924 235 98889 707 0.891 0.731 0.803 0.891
Geography.Regions.Asia.Asia* fr 9512 7471 908 91335 2041 0.892 0.785 0.835 0.913
Geography.Regions.Asia.Central Asia fr 284 152 39 101432 132 0.796 0.535 0.640 0.719
Geography.Regions.Asia.East Asia fr 4277 3522 361 97117 755 0.907 0.823 0.863 0.929
Geography.Regions.Asia.North Asia fr 454 198 82 101219 256 0.707 0.436 0.540 0.621
Geography.Regions.Asia.South Asia fr 1416 1083 89 100250 333 0.924 0.765 0.837 0.898
Geography.Regions.Asia.Southeast Asia fr 1232 893 103 100420 339 0.897 0.725 0.802 0.867
Geography.Regions.Asia.West Asia fr 2068 1450 232 99455 618 0.862 0.701 0.773 0.859
Geography.Regions.Europe.Eastern Europe fr 6448 5463 342 94965 985 0.941 0.847 0.892 0.957
Geography.Regions.Europe.Europe* fr 34205 28884 4549 63001 5321 0.864 0.844 0.854 0.940
Geography.Regions.Europe.Northern Europe fr 6487 4500 789 94479 1987 0.851 0.694 0.764 0.864
Geography.Regions.Europe.Southern Europe fr 6953 5384 740 94062 1569 0.879 0.774 0.823 0.911
Geography.Regions.Europe.Western Europe fr 14722 12009 2081 84952 2713 0.852 0.816 0.834 0.919
Geography.Regions.Oceania fr 2209 1685 177 99369 524 0.905 0.763 0.828 0.893
History and Society.Business and economics fr 2468 1359 464 98823 1109 0.745 0.551 0.633 0.688
History and Society.Education fr 1089 410 181 100485 679 0.694 0.376 0.488 0.531
History and Society.History fr 4848 2775 845 96062 2073 0.767 0.572 0.655 0.723
History and Society.Military and warfare fr 4795 3495 623 96337 1300 0.849 0.729 0.784 0.864
History and Society.Politics and government fr 4007 2517 610 97138 1490 0.805 0.628 0.706 0.786
History and Society.Society fr 4337 2176 616 96802 2161 0.779 0.502 0.610 0.681
History and Society.Transportation fr 3762 3312 271 97722 450 0.924 0.880 0.902 0.948
STEM.Biology fr 7518 6976 307 93930 542 0.958 0.928 0.943 0.981
STEM.Chemistry fr 568 412 97 101090 156 0.809 0.725 0.765 0.842
STEM.Computing fr 1017 805 176 100562 212 0.821 0.792 0.806 0.867
STEM.Earth and environment fr 1162 803 149 100444 359 0.843 0.691 0.760 0.807
STEM.Engineering fr 1806 1407 169 99780 399 0.893 0.779 0.832 0.891
STEM.Libraries & Information fr 173 69 33 101549 104 0.676 0.399 0.502 0.495
STEM.Mathematics fr 178 110 38 101539 68 0.743 0.618 0.675 0.688
STEM.Medicine & Health fr 1356 964 180 100219 392 0.843 0.711 0.771 0.848
STEM.Physics fr 408 206 91 101256 202 0.694 0.505 0.584 0.619
STEM.STEM* fr 15845 14071 936 84974 1774 0.938 0.888 0.912 0.967
STEM.Space fr 1330 1246 58 100367 84 0.956 0.937 0.946 0.980
STEM.Technology fr 1785 1042 274 99696 743 0.792 0.584 0.672 0.751
Culture.Biography.Biography* hi 1345 999 282 3869 346 0.780 0.743 0.761 0.830
Culture.Biography.Women hi 251 94 56 5189 157 0.627 0.375 0.469 0.492
Culture.Food and drink hi 80 32 10 5406 48 0.762 0.400 0.525 0.532
Culture.Internet culture hi 44 19 12 5440 25 0.613 0.432 0.507 0.433
Culture.Linguistics hi 104 67 33 5359 37 0.670 0.644 0.657 0.719
Culture.Literature hi 187 66 57 5252 121 0.537 0.353 0.426 0.436
Culture.Media.Books hi 36 13 18 5442 23 0.419 0.361 0.388 0.328
Culture.Media.Entertainment hi 49 10 13 5434 39 0.435 0.204 0.278 0.256
Culture.Media.Films hi 333 263 42 5121 70 0.862 0.790 0.824 0.866
Culture.Media.Media* hi 601 398 131 4764 203 0.752 0.662 0.704 0.764
Culture.Media.Music hi 56 15 11 5429 41 0.577 0.268 0.366 0.328
Culture.Media.Radio hi 11 1 1 5484 10 0.500 0.091 0.154 0.143
Culture.Media.Software hi 50 19 11 5435 31 0.633 0.380 0.475 0.501
Culture.Media.Television hi 68 35 24 5404 33 0.593 0.515 0.551 0.543
Culture.Media.Video games hi 9 4 2 5485 5 0.667 0.444 0.533 0.591
Culture.Performing arts hi 24 7 7 5465 17 0.500 0.292 0.368 0.262
Culture.Philosophy and religion hi 469 246 70 4957 223 0.778 0.525 0.627 0.676
Culture.Sports hi 540 455 22 4934 85 0.954 0.843 0.895 0.917
Culture.Visual arts.Architecture hi 89 28 25 5382 61 0.528 0.315 0.394 0.411
Culture.Visual arts.Comics and Anime hi 18 6 0 5478 12 1.000 0.333 0.500 0.691
Culture.Visual arts.Fashion hi 21 5 1 5474 16 0.833 0.238 0.370 0.375
Culture.Visual arts.Visual arts* hi 160 43 42 5294 117 0.506 0.269 0.351 0.391
Geography.Geographical hi 511 277 83 4902 234 0.769 0.542 0.636 0.713
Geography.Regions.Africa.Africa* hi 130 72 26 5340 58 0.735 0.554 0.632 0.678
Geography.Regions.Africa.Central Africa hi 0 0 0 5496 0 0 0 0 nan
Geography.Regions.Africa.Eastern Africa hi 20 7 1 5475 13 0.875 0.350 0.500 0.721
Geography.Regions.Africa.Northern Africa hi 29 11 3 5464 18 0.786 0.379 0.512 0.593
Geography.Regions.Africa.Southern Africa hi 36 19 8 5452 17 0.704 0.528 0.603 0.592
Geography.Regions.Africa.Western Africa hi 6 6 1 5489 0 0.857 1.000 0.923 1.000
Geography.Regions.Americas.Central America hi 44 22 7 5445 22 0.759 0.500 0.603 0.584
Geography.Regions.Americas.North America hi 268 132 41 5187 136 0.763 0.493 0.599 0.671
Geography.Regions.Americas.South America hi 45 21 8 5443 24 0.724 0.467 0.568 0.639
Geography.Regions.Asia.Asia* hi 3006 2666 268 2222 340 0.909 0.887 0.898 0.953
Geography.Regions.Asia.Central Asia hi 44 23 6 5446 21 0.793 0.523 0.630 0.679
Geography.Regions.Asia.East Asia hi 125 76 14 5357 49 0.844 0.608 0.707 0.731
Geography.Regions.Asia.North Asia hi 25 7 6 5465 18 0.538 0.280 0.368 0.313
Geography.Regions.Asia.South Asia hi 2581 2315 210 2705 266 0.917 0.897 0.907 0.950
Geography.Regions.Asia.Southeast Asia hi 155 106 16 5325 49 0.869 0.684 0.765 0.793
Geography.Regions.Asia.West Asia hi 144 93 12 5340 51 0.886 0.646 0.747 0.772
Geography.Regions.Europe.Eastern Europe hi 56 17 10 5430 39 0.630 0.304 0.410 0.442
Geography.Regions.Europe.Europe* hi 447 237 71 4978 210 0.769 0.530 0.628 0.696
Geography.Regions.Europe.Northern Europe hi 162 87 26 5308 75 0.770 0.537 0.633 0.673
Geography.Regions.Europe.Southern Europe hi 118 55 22 5356 63 0.714 0.466 0.564 0.601
Geography.Regions.Europe.Western Europe hi 125 42 17 5354 83 0.712 0.336 0.457 0.567
Geography.Regions.Oceania hi 121 77 15 5360 44 0.837 0.636 0.723 0.735
History and Society.Business and economics hi 200 76 42 5254 124 0.644 0.380 0.478 0.492
History and Society.Education hi 121 35 24 5351 86 0.593 0.289 0.389 0.372
History and Society.History hi 295 104 41 5160 191 0.717 0.353 0.473 0.504
History and Society.Military and warfare hi 193 67 38 5265 126 0.638 0.347 0.450 0.484
History and Society.Politics and government hi 395 190 62 5039 205 0.754 0.481 0.587 0.637
History and Society.Society hi 353 132 54 5089 221 0.710 0.374 0.490 0.508
History and Society.Transportation hi 167 116 32 5297 51 0.784 0.695 0.737 0.788
STEM.Biology hi 232 157 37 5227 75 0.809 0.677 0.737 0.790
STEM.Chemistry hi 113 77 14 5369 36 0.846 0.681 0.755 0.812
STEM.Computing hi 97 64 17 5382 33 0.790 0.660 0.719 0.739
STEM.Earth and environment hi 105 51 25 5366 54 0.671 0.486 0.564 0.557
STEM.Engineering hi 119 66 29 5348 53 0.695 0.555 0.617 0.671
STEM.Libraries & Information hi 16 8 2 5478 8 0.800 0.500 0.615 0.444
STEM.Mathematics hi 15 6 0 5481 9 1.000 0.400 0.571 0.528
STEM.Medicine & Health hi 208 106 35 5253 102 0.752 0.510 0.607 0.691
STEM.Physics hi 80 33 18 5398 47 0.647 0.412 0.504 0.516
STEM.STEM* hi 1103 861 112 4281 242 0.885 0.781 0.829 0.905
STEM.Space hi 104 90 15 5377 14 0.857 0.865 0.861 0.931
STEM.Technology hi 244 130 40 5212 114 0.765 0.533 0.628 0.682
Culture.Biography.Biography* ja 12574 11328 1322 24380 1246 0.895 0.901 0.898 0.948
Culture.Biography.Women ja 1905 917 290 36081 988 0.760 0.481 0.589 0.694
Culture.Food and drink ja 524 407 66 37686 117 0.860 0.777 0.816 0.870
Culture.Internet culture ja 865 599 41 37370 266 0.936 0.692 0.796 0.894
Culture.Linguistics ja 543 310 70 37663 233 0.816 0.571 0.672 0.723
Culture.Literature ja 1886 1239 414 35976 647 0.750 0.657 0.700 0.752
Culture.Media.Books ja 301 111 43 37932 190 0.721 0.369 0.488 0.520
Culture.Media.Entertainment ja 604 287 120 37552 317 0.705 0.475 0.568 0.614
Culture.Media.Films ja 1622 1287 114 36540 335 0.919 0.793 0.851 0.917
Culture.Media.Media* ja 6404 5053 646 31226 1351 0.887 0.789 0.835 0.913
Culture.Media.Music ja 2581 2100 274 35421 481 0.885 0.814 0.848 0.912
Culture.Media.Radio ja 49 11 3 38224 38 0.786 0.224 0.349 0.465
Culture.Media.Software ja 311 163 59 37906 148 0.734 0.524 0.612 0.698
Culture.Media.Television ja 730 408 63 37483 322 0.866 0.559 0.679 0.771
Culture.Media.Video games ja 709 539 23 37544 170 0.959 0.760 0.848 0.932
Culture.Performing arts ja 387 197 28 37861 190 0.876 0.509 0.644 0.709
Culture.Philosophy and religion ja 1373 770 212 36691 603 0.784 0.561 0.654 0.720
Culture.Sports ja 6570 6222 316 31390 348 0.952 0.947 0.949 0.977
Culture.Visual arts.Architecture ja 595 252 92 37589 343 0.733 0.424 0.537 0.585
Culture.Visual arts.Comics and Anime ja 867 658 143 37266 209 0.821 0.759 0.789 0.831
Culture.Visual arts.Fashion ja 156 88 17 38103 68 0.838 0.564 0.674 0.705
Culture.Visual arts.Visual arts* ja 2015 1234 299 35962 781 0.805 0.612 0.696 0.751
Geography.Geographical ja 1651 766 190 36435 885 0.801 0.464 0.588 0.724
Geography.Regions.Africa.Africa* ja 661 386 114 37501 275 0.772 0.584 0.665 0.744
Geography.Regions.Africa.Central Africa ja 0 0 0 38276 0 0 0 0 nan
Geography.Regions.Africa.Eastern Africa ja 42 14 4 38230 28 0.778 0.333 0.467 0.724
Geography.Regions.Africa.Northern Africa ja 148 74 15 38113 74 0.831 0.500 0.624 0.702
Geography.Regions.Africa.Southern Africa ja 65 39 8 38203 26 0.830 0.600 0.696 0.733
Geography.Regions.Africa.Western Africa ja 29 14 4 38243 15 0.778 0.483 0.596 0.681
Geography.Regions.Americas.Central America ja 378 181 30 37868 197 0.858 0.479 0.615 0.724
Geography.Regions.Americas.North America ja 4127 2562 591 33558 1565 0.813 0.621 0.704 0.819
Geography.Regions.Americas.South America ja 633 366 74 37569 267 0.832 0.578 0.682 0.770
Geography.Regions.Asia.Asia* ja 9227 7736 1294 27755 1491 0.857 0.838 0.847 0.909
Geography.Regions.Asia.Central Asia ja 161 90 21 38094 71 0.811 0.559 0.662 0.741
Geography.Regions.Asia.East Asia ja 7130 6066 1026 30120 1064 0.855 0.851 0.853 0.905
Geography.Regions.Asia.North Asia ja 241 80 51 37984 161 0.611 0.332 0.430 0.467
Geography.Regions.Asia.South Asia ja 489 345 48 37739 144 0.878 0.706 0.782 0.839
Geography.Regions.Asia.Southeast Asia ja 794 604 47 37435 190 0.928 0.761 0.836 0.896
Geography.Regions.Asia.West Asia ja 603 350 58 37615 253 0.858 0.580 0.692 0.800
Geography.Regions.Europe.Eastern Europe ja 998 606 112 37166 392 0.844 0.607 0.706 0.796
Geography.Regions.Europe.Europe* ja 7456 5460 948 29872 1996 0.852 0.732 0.788 0.887
Geography.Regions.Europe.Northern Europe ja 1779 962 231 36266 817 0.806 0.541 0.647 0.765
Geography.Regions.Europe.Southern Europe ja 2071 1579 153 36052 492 0.912 0.762 0.830 0.912
Geography.Regions.Europe.Western Europe ja 2850 1984 377 35049 866 0.840 0.696 0.761 0.851
Geography.Regions.Oceania ja 616 414 47 37613 202 0.898 0.672 0.769 0.836
History and Society.Business and economics ja 1396 649 181 36699 747 0.782 0.465 0.583 0.678
History and Society.Education ja 584 206 68 37624 378 0.752 0.353 0.480 0.553
History and Society.History ja 2060 1069 336 35880 991 0.761 0.519 0.617 0.696
History and Society.Military and warfare ja 2668 1976 317 35291 692 0.862 0.741 0.797 0.880
History and Society.Politics and government ja 1542 785 257 36477 757 0.753 0.509 0.608 0.690
History and Society.Society ja 2155 1029 276 35845 1126 0.789 0.477 0.595 0.683
History and Society.Transportation ja 3385 3115 222 34669 270 0.933 0.920 0.927 0.962
STEM.Biology ja 1835 1549 112 36329 286 0.933 0.844 0.886 0.945
STEM.Chemistry ja 480 348 64 37732 132 0.845 0.725 0.780 0.874
STEM.Computing ja 770 613 100 37406 157 0.860 0.796 0.827 0.888
STEM.Earth and environment ja 548 341 66 37662 207 0.838 0.622 0.714 0.776
STEM.Engineering ja 1100 831 116 37060 269 0.878 0.755 0.812 0.871
STEM.Libraries & Information ja 74 34 4 38198 40 0.895 0.459 0.607 0.602
STEM.Mathematics ja 116 80 10 38150 36 0.889 0.690 0.777 0.826
STEM.Medicine & Health ja 902 648 100 37274 254 0.866 0.718 0.785 0.874
STEM.Physics ja 246 130 37 37993 116 0.778 0.528 0.630 0.682
STEM.STEM* ja 6959 5976 438 30879 983 0.932 0.859 0.894 0.959
STEM.Space ja 832 757 39 37405 75 0.951 0.910 0.930 0.965
STEM.Technology ja 1174 726 165 36937 448 0.815 0.618 0.703 0.794
Culture.Biography.Biography* ru 20910 19761 1460 40600 1149 0.931 0.945 0.938 0.974
Culture.Biography.Women ru 3263 1878 561 59146 1385 0.770 0.576 0.659 0.750
Culture.Food and drink ru 503 327 54 62413 176 0.858 0.650 0.740 0.806
Culture.Internet culture ru 943 779 56 61971 164 0.933 0.826 0.876 0.937
Culture.Linguistics ru 1098 670 110 61762 428 0.859 0.610 0.714 0.801
Culture.Literature ru 2243 1357 335 60392 886 0.802 0.605 0.690 0.786
Culture.Media.Books ru 558 350 63 62349 208 0.847 0.627 0.721 0.787
Culture.Media.Entertainment ru 702 297 115 62153 405 0.721 0.423 0.533 0.613
Culture.Media.Films ru 2211 1985 135 60624 226 0.936 0.898 0.917 0.953
Culture.Media.Media* ru 8441 7099 788 53741 1342 0.900 0.841 0.870 0.940
Culture.Media.Music ru 3218 2702 343 59409 516 0.887 0.840 0.863 0.929
Culture.Media.Radio ru 56 9 7 62907 47 0.562 0.161 0.250 0.293
Culture.Media.Software ru 385 173 74 62511 212 0.700 0.449 0.547 0.644
Culture.Media.Television ru 1145 886 93 61732 259 0.905 0.774 0.834 0.888
Culture.Media.Video games ru 750 706 18 62202 44 0.975 0.941 0.958 0.984
Culture.Performing arts ru 582 293 75 62313 289 0.796 0.503 0.617 0.676
Culture.Philosophy and religion ru 2526 1532 437 60007 994 0.778 0.606 0.682 0.750
Culture.Sports ru 10382 9927 464 52124 455 0.955 0.956 0.956 0.983
Culture.Visual arts.Architecture ru 935 436 166 61869 499 0.724 0.466 0.567 0.634
Culture.Visual arts.Comics and Anime ru 531 444 38 62401 87 0.921 0.836 0.877 0.936
Culture.Visual arts.Fashion ru 199 108 29 62742 91 0.788 0.543 0.643 0.702
Culture.Visual arts.Visual arts* ru 2490 1528 375 60105 962 0.803 0.614 0.696 0.788
Geography.Geographical ru 3288 2136 542 59140 1152 0.798 0.650 0.716 0.794
Geography.Regions.Africa.Africa* ru 1318 843 190 61462 475 0.816 0.640 0.717 0.802
Geography.Regions.Africa.Central Africa ru 0 0 0 62970 0 0 0 0 nan
Geography.Regions.Africa.Eastern Africa ru 84 44 15 62871 40 0.746 0.524 0.615 0.677
Geography.Regions.Africa.Northern Africa ru 311 179 33 62626 132 0.844 0.576 0.685 0.757
Geography.Regions.Africa.Southern Africa ru 161 92 16 62793 69 0.852 0.571 0.684 0.781
Geography.Regions.Africa.Western Africa ru 49 20 7 62914 29 0.741 0.408 0.526 0.640
Geography.Regions.Americas.Central America ru 584 382 58 62328 202 0.868 0.654 0.746 0.818
Geography.Regions.Americas.North America ru 5336 3726 855 56779 1610 0.813 0.698 0.751 0.848
Geography.Regions.Americas.South America ru 1776 1503 180 61014 273 0.893 0.846 0.869 0.933
Geography.Regions.Asia.Asia* ru 7372 5749 882 54716 1623 0.867 0.780 0.821 0.904
Geography.Regions.Asia.Central Asia ru 516 361 78 62376 155 0.822 0.700 0.756 0.823
Geography.Regions.Asia.East Asia ru 2517 2095 201 60252 422 0.912 0.832 0.871 0.933
Geography.Regions.Asia.North Asia ru 923 416 243 61804 507 0.631 0.451 0.526 0.574
Geography.Regions.Asia.South Asia ru 1003 798 70 61897 205 0.919 0.796 0.853 0.909
Geography.Regions.Asia.Southeast Asia ru 787 578 60 62123 209 0.906 0.734 0.811 0.893
Geography.Regions.Asia.West Asia ru 1852 1377 254 60864 475 0.844 0.744 0.791 0.868
Geography.Regions.Europe.Eastern Europe ru 4549 3380 665 57756 1169 0.836 0.743 0.787 0.877
Geography.Regions.Europe.Europe* ru 20332 17103 2886 39752 3229 0.856 0.841 0.848 0.932
Geography.Regions.Europe.Northern Europe ru 4234 3083 572 58164 1151 0.844 0.728 0.782 0.868
Geography.Regions.Europe.Southern Europe ru 4660 3739 480 57830 921 0.886 0.802 0.842 0.922
Geography.Regions.Europe.Western Europe ru 7303 6069 927 54740 1234 0.867 0.831 0.849 0.932
Geography.Regions.Oceania ru 1062 777 80 61828 285 0.907 0.732 0.810 0.881
History and Society.Business and economics ru 1498 793 294 61178 705 0.730 0.529 0.614 0.661
History and Society.Education ru 617 202 76 62277 415 0.727 0.327 0.451 0.492
History and Society.History ru 3737 2181 639 58594 1556 0.773 0.584 0.665 0.736
History and Society.Military and warfare ru 4130 2914 658 58182 1216 0.816 0.706 0.757 0.841
History and Society.Politics and government ru 2360 1302 386 60224 1058 0.771 0.552 0.643 0.726
History and Society.Society ru 6766 4786 938 55266 1980 0.836 0.707 0.766 0.858
History and Society.Transportation ru 2418 2127 165 60387 291 0.928 0.880 0.903 0.950
STEM.Biology ru 3724 3375 187 59059 349 0.948 0.906 0.926 0.969
STEM.Chemistry ru 464 327 58 62448 137 0.849 0.705 0.770 0.846
STEM.Computing ru 969 794 132 61869 175 0.857 0.819 0.838 0.891
STEM.Earth and environment ru 747 498 86 62137 249 0.853 0.667 0.748 0.816
STEM.Engineering ru 1220 933 123 61627 287 0.884 0.765 0.820 0.877
STEM.Libraries & Information ru 85 28 12 62873 57 0.700 0.329 0.448 0.423
STEM.Mathematics ru 149 97 21 62800 52 0.822 0.651 0.727 0.749
STEM.Medicine & Health ru 1065 753 108 61797 312 0.875 0.707 0.782 0.855
STEM.Physics ru 366 204 71 62533 162 0.742 0.557 0.637 0.698
STEM.STEM* ru 10098 8826 599 52273 1272 0.936 0.874 0.904 0.964
STEM.Space ru 1116 1036 35 61819 80 0.967 0.928 0.947 0.976
STEM.Technology ru 1461 875 233 61276 586 0.790 0.599 0.681 0.765
Culture.Biography.Biography* sw 633 311 72 1721 322 0.812 0.491 0.612 0.807
Culture.Biography.Women sw 70 8 10 2346 62 0.444 0.114 0.182 0.248
Culture.Food and drink sw 26 8 1 2399 18 0.889 0.308 0.457 0.528
Culture.Internet culture sw 11 5 2 2413 6 0.714 0.455 0.556 0.561
Culture.Linguistics sw 402 290 19 2005 112 0.939 0.721 0.816 0.864
Culture.Literature sw 67 27 16 2343 40 0.628 0.403 0.491 0.464
Culture.Media.Books sw 4 1 9 2413 3 0.100 0.250 0.143 0.098
Culture.Media.Entertainment sw 10 2 4 2412 8 0.333 0.200 0.250 0.156
Culture.Media.Films sw 21 9 1 2404 12 0.900 0.429 0.581 0.582
Culture.Media.Media* sw 166 93 27 2233 73 0.775 0.560 0.650 0.757
Culture.Media.Music sw 97 66 6 2323 31 0.917 0.680 0.781 0.866
Culture.Media.Radio sw 2 0 0 2424 2 0 0.000 0 0.011
Culture.Media.Software sw 12 1 1 2413 11 0.500 0.083 0.143 0.366
Culture.Media.Television sw 22 10 2 2402 12 0.833 0.455 0.588 0.530
Culture.Media.Video games sw 5 2 0 2421 3 1.000 0.400 0.571 0.601
Culture.Performing arts sw 20 1 2 2404 19 0.333 0.050 0.087 0.172
Culture.Philosophy and religion sw 206 159 51 2169 47 0.757 0.772 0.764 0.753
Culture.Sports sw 193 128 10 2223 65 0.928 0.663 0.773 0.833
Culture.Visual arts.Architecture sw 20 0 58 2348 20 0.000 0.000 0 0.025
Culture.Visual arts.Comics and Anime sw 7 1 0 2419 6 1.000 0.143 0.250 0.200
Culture.Visual arts.Fashion sw 7 1 1 2418 6 0.500 0.143 0.222 0.222
Culture.Visual arts.Visual arts* sw 43 4 30 2353 39 0.118 0.093 0.104 0.118
Geography.Geographical sw 445 210 44 1937 235 0.827 0.472 0.601 0.761
Geography.Regions.Africa.Africa* sw 404 278 67 1955 126 0.806 0.688 0.742 0.795
Geography.Regions.Africa.Central Africa sw 0 0 0 2426 0 0 0 0 nan
Geography.Regions.Africa.Eastern Africa sw 28 16 3 2395 12 0.842 0.571 0.681 0.843
Geography.Regions.Africa.Northern Africa sw 35 19 7 2384 16 0.731 0.543 0.623 0.831
Geography.Regions.Africa.Southern Africa sw 21 8 5 2400 13 0.615 0.381 0.471 0.531
Geography.Regions.Africa.Western Africa sw 22 15 28 2376 7 0.349 0.682 0.462 0.333
Geography.Regions.Americas.Central America sw 24 12 2 2400 12 0.857 0.500 0.632 0.694
Geography.Regions.Americas.North America sw 235 159 24 2167 76 0.869 0.677 0.761 0.864
Geography.Regions.Americas.South America sw 60 37 2 2364 23 0.949 0.617 0.747 0.775
Geography.Regions.Asia.Asia* sw 390 292 73 1963 98 0.800 0.749 0.774 0.824
Geography.Regions.Asia.Central Asia sw 9 4 3 2414 5 0.571 0.444 0.500 0.555
Geography.Regions.Asia.East Asia sw 109 59 19 2298 50 0.756 0.541 0.631 0.741
Geography.Regions.Asia.North Asia sw 15 1 2 2409 14 0.333 0.067 0.111 0.315
Geography.Regions.Asia.South Asia sw 53 39 14 2359 14 0.736 0.736 0.736 0.676
Geography.Regions.Asia.Southeast Asia sw 83 65 40 2303 18 0.619 0.783 0.691 0.631
Geography.Regions.Asia.West Asia sw 139 112 5 2282 27 0.957 0.806 0.875 0.928
Geography.Regions.Europe.Eastern Europe sw 44 8 2 2380 36 0.800 0.182 0.296 0.485
Geography.Regions.Europe.Europe* sw 465 312 38 1923 153 0.891 0.671 0.766 0.874
Geography.Regions.Europe.Northern Europe sw 130 60 7 2289 70 0.896 0.462 0.609 0.750
Geography.Regions.Europe.Southern Europe sw 102 41 10 2314 61 0.804 0.402 0.536 0.655
Geography.Regions.Europe.Western Europe sw 189 111 7 2230 78 0.941 0.587 0.723 0.887
Geography.Regions.Oceania sw 152 117 8 2266 35 0.936 0.770 0.845 0.914
History and Society.Business and economics sw 47 14 7 2372 33 0.667 0.298 0.412 0.391
History and Society.Education sw 32 11 5 2389 21 0.688 0.344 0.458 0.390
History and Society.History sw 244 140 52 2130 104 0.729 0.574 0.642 0.696
History and Society.Military and warfare sw 68 9 7 2351 59 0.562 0.132 0.214 0.352
History and Society.Politics and government sw 115 33 30 2281 82 0.524 0.287 0.371 0.407
History and Society.Society sw 179 66 77 2170 113 0.462 0.369 0.410 0.454
History and Society.Transportation sw 22 10 12 2392 12 0.455 0.455 0.455 0.322
STEM.Biology sw 107 70 30 2289 37 0.700 0.654 0.676 0.760
STEM.Chemistry sw 29 15 0 2397 14 1.000 0.517 0.682 0.793
STEM.Computing sw 12 4 2 2412 8 0.667 0.333 0.444 0.707
STEM.Earth and environment sw 38 15 8 2380 23 0.652 0.395 0.492 0.505
STEM.Engineering sw 25 9 7 2394 16 0.562 0.360 0.439 0.382
STEM.Libraries & Information sw 5 4 1 2420 1 0.800 0.800 0.800 0.804
STEM.Mathematics sw 23 22 0 2403 1 1.000 0.957 0.978 0.998
STEM.Medicine & Health sw 70 42 6 2350 28 0.875 0.600 0.712 0.763
STEM.Physics sw 28 3 5 2393 25 0.375 0.107 0.167 0.297
STEM.STEM* sw 355 248 28 2043 107 0.899 0.699 0.786 0.877
STEM.Space sw 34 28 1 2391 6 0.966 0.824 0.889 0.907
STEM.Technology sw 40 13 7 2379 27 0.650 0.325 0.433 0.405
Culture.Biography.Biography* zh 8838 7960 926 35918 878 0.896 0.901 0.898 0.946
Culture.Biography.Women zh 1245 571 269 44168 674 0.680 0.459 0.548 0.608
Culture.Food and drink zh 429 283 45 45208 146 0.863 0.660 0.748 0.776
Culture.Internet culture zh 756 563 64 44862 193 0.898 0.745 0.814 0.891
Culture.Linguistics zh 480 341 76 45126 139 0.818 0.710 0.760 0.795
Culture.Literature zh 1535 1057 229 43918 478 0.822 0.689 0.749 0.824
Culture.Media.Books zh 298 159 44 45340 139 0.783 0.534 0.635 0.683
Culture.Media.Entertainment zh 382 158 78 45222 224 0.669 0.414 0.511 0.523
Culture.Media.Films zh 1056 875 98 44528 181 0.899 0.829 0.862 0.911
Culture.Media.Media* zh 4220 3304 568 40894 916 0.853 0.783 0.817 0.896
Culture.Media.Music zh 1093 802 164 44425 291 0.830 0.734 0.779 0.849
Culture.Media.Radio zh 42 13 8 45632 29 0.619 0.310 0.413 0.449
Culture.Media.Software zh 369 195 95 45218 174 0.672 0.528 0.592 0.651
Culture.Media.Television zh 708 528 105 44869 180 0.834 0.746 0.787 0.834
Culture.Media.Video games zh 549 476 26 45107 73 0.948 0.867 0.906 0.954
Culture.Performing arts zh 188 72 28 45466 116 0.720 0.383 0.500 0.533
Culture.Philosophy and religion zh 1691 1034 257 43734 657 0.801 0.611 0.693 0.767
Culture.Sports zh 4144 3778 193 41345 366 0.951 0.912 0.931 0.965
Culture.Visual arts.Architecture zh 880 443 203 44599 437 0.686 0.503 0.581 0.643
Culture.Visual arts.Comics and Anime zh 644 541 57 44981 103 0.905 0.840 0.871 0.922
Culture.Visual arts.Fashion zh 124 61 15 45543 63 0.803 0.492 0.610 0.605
Culture.Visual arts.Visual arts* zh 1948 1245 341 43393 703 0.785 0.639 0.705 0.774
Geography.Geographical zh 4663 3216 610 40409 1447 0.841 0.690 0.758 0.842
Geography.Regions.Africa.Africa* zh 868 580 115 44699 288 0.835 0.668 0.742 0.814
Geography.Regions.Africa.Central Africa zh 0 0 0 45682 0 0 0 0 nan
Geography.Regions.Africa.Eastern Africa zh 78 49 9 45595 29 0.845 0.628 0.721 0.740
Geography.Regions.Africa.Northern Africa zh 167 99 29 45486 68 0.773 0.593 0.671 0.671
Geography.Regions.Africa.Southern Africa zh 75 41 5 45602 34 0.891 0.547 0.678 0.735
Geography.Regions.Africa.Western Africa zh 26 13 5 45651 13 0.722 0.500 0.591 0.588
Geography.Regions.Americas.Central America zh 503 375 32 45147 128 0.921 0.746 0.824 0.861
Geography.Regions.Americas.North America zh 4809 3921 499 40374 888 0.887 0.815 0.850 0.929
Geography.Regions.Americas.South America zh 1650 1473 65 43967 177 0.958 0.893 0.924 0.963
Geography.Regions.Asia.Asia* zh 10424 9186 1179 34079 1238 0.886 0.881 0.884 0.943
Geography.Regions.Asia.Central Asia zh 200 113 30 45452 87 0.790 0.565 0.659 0.724
Geography.Regions.Asia.East Asia zh 7370 6597 872 37440 773 0.883 0.895 0.889 0.940
Geography.Regions.Asia.North Asia zh 219 76 51 45412 143 0.598 0.347 0.439 0.512
Geography.Regions.Asia.South Asia zh 964 797 28 44690 167 0.966 0.827 0.891 0.939
Geography.Regions.Asia.Southeast Asia zh 1171 941 109 44402 230 0.896 0.804 0.847 0.894
Geography.Regions.Asia.West Asia zh 728 507 100 44854 221 0.835 0.696 0.760 0.805
Geography.Regions.Europe.Eastern Europe zh 1752 1417 123 43807 335 0.920 0.809 0.861 0.917
Geography.Regions.Europe.Europe* zh 12152 10839 758 32772 1313 0.935 0.892 0.913 0.973
Geography.Regions.Europe.Northern Europe zh 1931 1386 228 43523 545 0.859 0.718 0.782 0.866
Geography.Regions.Europe.Southern Europe zh 2787 2360 170 42725 427 0.933 0.847 0.888 0.949
Geography.Regions.Europe.Western Europe zh 5830 5316 223 39629 514 0.960 0.912 0.935 0.980
Geography.Regions.Oceania zh 1036 820 62 44584 216 0.930 0.792 0.855 0.897
History and Society.Business and economics zh 1253 695 253 44176 558 0.733 0.555 0.632 0.692
History and Society.Education zh 632 333 123 44927 299 0.730 0.527 0.612 0.660
History and Society.History zh 1783 989 269 43630 794 0.786 0.555 0.650 0.718
History and Society.Military and warfare zh 1906 1261 243 43533 645 0.838 0.662 0.740 0.817
History and Society.Politics and government zh 1843 1141 309 43530 702 0.787 0.619 0.693 0.770
History and Society.Society zh 2825 1755 356 42501 1070 0.831 0.621 0.711 0.777
History and Society.Transportation zh 2385 2158 169 43128 227 0.927 0.905 0.916 0.957
STEM.Biology zh 3644 3395 131 41907 249 0.963 0.932 0.947 0.982
STEM.Chemistry zh 479 387 42 45161 92 0.902 0.808 0.852 0.910
STEM.Computing zh 825 632 124 44733 193 0.836 0.766 0.799 0.857
STEM.Earth and environment zh 1651 1437 110 43921 214 0.929 0.870 0.899 0.939
STEM.Engineering zh 808 592 94 44780 216 0.863 0.733 0.793 0.856
STEM.Libraries & Information zh 86 44 14 45582 42 0.759 0.512 0.611 0.581
STEM.Mathematics zh 135 87 19 45528 48 0.821 0.644 0.722 0.792
STEM.Medicine & Health zh 779 532 93 44810 247 0.851 0.683 0.758 0.824
STEM.Physics zh 289 157 55 45338 132 0.741 0.543 0.627 0.675
STEM.STEM* zh 9940 9072 497 35245 868 0.948 0.913 0.930 0.978
STEM.Space zh 1290 1241 27 44365 49 0.979 0.962 0.970 0.989
STEM.Technology zh 1111 685 230 44341 426 0.749 0.617 0.676 0.746