Research talk:Ideas/The effect of abuse filter

From Meta, a Wikimedia project coordination wiki

Portuguese Wikipedia experience[edit]

I have made some researches in Portuguese Wikipedia about filters, I created a graph that shows the filter actions in the last 30 days in toollabs:ptwikis/Filtros, this tool works for other languages and projects too, e.g. toollabs:ptwikis/Filtros:enwiki. I have also made a list of most catch bad words by anti-vandalism filters in here. And I also made this search in dumps using the bad words regex of disallow anti-vandalism filters, searching for pages where the some terms are valid entries, as these terms can be potential false positives. Other Portuguese Wikipedia users have also made some researches in filters, like registration of false positives and other very interesting researches. Danilo.mac talk 19:40, 9 November 2013 (UTC) Sorry english mistakes[reply]

Quick timeseries for enwiki.[edit]

Monthly abuse filter counts are plotted for action="edit" by the actions provided in the English Wikipedia.
Monthly abuse filter counts are plotted for action="edit" by the actions provided in the English Wikipedia.
Data table
1   2009-03-01       edit              24412
2   2009-03-01       edit        warn  74596
3   2009-04-01       edit        warn 112200
4   2009-04-01       edit         tag  23785
5   2009-04-01       edit              43169
6   2009-05-01       edit        warn 129652
7   2009-05-01       edit              39430
8   2009-05-01       edit         tag  42797
9   2009-06-01       edit        warn 101976
10  2009-06-01       edit              17228
11  2009-06-01       edit         tag  59972
12  2009-07-01       edit         tag  72495
13  2009-07-01       edit        warn  84293
14  2009-07-01       edit               4205
15  2009-08-01       edit         tag  85433
16  2009-08-01       edit        warn  59665
17  2009-08-01       edit              10688
18  2009-08-01       edit    disallow   6495
19  2009-09-01       edit        warn  95902
20  2009-09-01       edit         tag 110106
21  2009-09-01       edit               7200
22  2009-10-01       edit        warn 119025
23  2009-10-01       edit         tag 107840
24  2009-11-01       edit         tag  96872
25  2009-11-01       edit        warn  99814
26  2009-11-01       edit    disallow  13542
27  2009-12-01       edit         tag  65526
28  2009-12-01       edit        warn  84517
29  2009-12-01       edit    disallow  16463
30  2010-01-01       edit         tag 103469
31  2010-01-01       edit        warn  59775
32  2010-01-01       edit               6345
33  2010-01-01       edit    disallow  23787
34  2010-02-01       edit         tag  92313
35  2010-02-01       edit        warn 114067
36  2010-03-01       edit        warn  75719
37  2010-03-01       edit    disallow  24374
38  2010-03-01       edit         tag 111734
39  2010-03-01       edit               5265
40  2010-04-01       edit        warn  70445
41  2010-04-01       edit         tag 121740
42  2010-04-01       edit    disallow   5198
43  2010-05-01       edit         tag  83322
44  2010-05-01       edit              11209
45  2010-05-01       edit    disallow  43703
46  2010-05-01       edit        warn  68588
47  2010-06-01       edit         tag 103993
48  2010-06-01       edit               9926
49  2010-06-01       edit    disallow  12837
50  2010-06-01       edit        warn  19408
51  2010-07-01       edit         tag  79880
52  2010-07-01       edit        warn  39751
53  2010-07-01       edit    disallow   3370
54  2010-07-01       edit               4686
55  2010-08-01       edit         tag  74574
56  2010-08-01       edit        warn  36437
57  2010-08-01       edit    disallow  13302
58  2010-08-01       edit              14024
59  2010-09-01       edit        warn  67993
60  2010-09-01       edit         tag  85040
61  2010-09-01       edit               3919
62  2010-09-01       edit    disallow  17764
63  2010-10-01       edit        warn  69894
64  2010-10-01       edit         tag 116966
65  2010-10-01       edit    disallow  19888
66  2010-11-01       edit         tag 123614
67  2010-11-01       edit        warn  54314
68  2010-11-01       edit    disallow  17424
69  2010-12-01       edit        warn  31029
70  2010-12-01       edit    disallow  25456
71  2010-12-01       edit         tag 101299
72  2011-01-01       edit         tag 112073
73  2011-01-01       edit        warn  57391
74  2011-01-01       edit    disallow  11675
75  2011-02-01       edit         tag 108955
76  2011-02-01       edit        warn  41565
77  2011-02-01       edit    disallow  22742
78  2011-03-01       edit         tag 109714
79  2011-03-01       edit        warn  57322
80  2011-03-01       edit    disallow  10511
81  2011-04-01       edit         tag  82658
82  2011-04-01       edit        warn  55277
83  2011-04-01       edit    disallow  10249
84  2011-04-01       edit              12535
85  2011-05-01       edit        warn  43417
86  2011-05-01       edit         tag  95221
87  2011-05-01       edit    disallow  12505
88  2011-05-01       edit              22379
89  2011-06-01       edit         tag  66788
90  2011-06-01       edit        warn  46254
91  2011-06-01       edit              26848
92  2011-06-01       edit    disallow   3823
93  2011-07-01       edit         tag  67346
94  2011-07-01       edit        warn  35004
95  2011-07-01       edit              21601
96  2011-07-01       edit    disallow   9316
97  2011-08-01       edit               4181
98  2011-08-01       edit         tag  67439
99  2011-08-01       edit        warn  41202
100 2011-08-01       edit    disallow  21205
101 2011-09-01       edit        warn  75337
102 2011-09-01       edit         tag  68987
103 2011-09-01       edit               9118
104 2011-09-01       edit    disallow  18563
105 2011-10-01       edit         tag  54431
106 2011-10-01       edit        warn 123396
107 2011-10-01       edit    disallow  30159
108 2011-10-01       edit              16680
109 2011-11-01       edit        warn  68458
110 2011-11-01       edit         tag  93988
111 2011-11-01       edit              10274
112 2011-11-01       edit    disallow  38538
113 2011-12-01       edit        warn  36972
114 2011-12-01       edit         tag  89705
115 2011-12-01       edit    disallow  35044
116 2011-12-01       edit              13751
117 2012-01-01       edit         tag  98417
118 2012-01-01       edit    disallow  26456
119 2012-01-01       edit        warn  67273
120 2012-02-01       edit         tag  64489
121 2012-02-01       edit        warn  78794
122 2012-02-01       edit    disallow  36739
123 2012-02-01       edit              17110
124 2012-03-01       edit         tag  68398
125 2012-03-01       edit        warn  77407
126 2012-03-01       edit    disallow  24733
127 2012-03-01       edit              13546
128 2012-04-01       edit        warn  72450
129 2012-04-01       edit         tag  62058
130 2012-04-01       edit    disallow  27518
131 2012-04-01       edit              11829
132 2012-05-01       edit        warn  76645
133 2012-05-01       edit    disallow  64548
134 2012-05-01       edit         tag  36812
135 2012-06-01       edit        warn  63197
136 2012-06-01       edit         tag  23802
137 2012-06-01       edit    disallow  15344
138 2012-06-01       edit              16704
139 2012-07-01       edit         tag  65621
140 2012-07-01       edit        warn  34001
141 2012-07-01       edit    disallow  11288
142 2012-08-01       edit        warn  56521
143 2012-08-01       edit         tag  34766
144 2012-08-01       edit    disallow  20188
145 2012-08-01       edit               8106
146 2012-09-01       edit        warn  62204
147 2012-09-01       edit         tag  53762
148 2012-09-01       edit    disallow  31015
149 2012-09-01       edit               5815
150 2012-10-01       edit    disallow  69244
151 2012-10-01       edit         tag  48167
152 2012-10-01       edit        warn  78452
153 2012-11-01       edit         tag  71631
154 2012-11-01       edit    disallow  55209
155 2012-11-01       edit        warn  60151
156 2012-12-01       edit        warn  45614
157 2012-12-01       edit         tag  60734
158 2012-12-01       edit    disallow  29443
159 2013-01-01       edit         tag  51863
160 2013-01-01       edit    disallow  31014
161 2013-01-01       edit        warn  50864
162 2013-01-01       edit              12053
163 2013-02-01       edit    disallow  33765
164 2013-02-01       edit         tag  79915
165 2013-02-01       edit        warn  72690
166 2013-03-01       edit         tag  48021
167 2013-03-01       edit    disallow  44962
168 2013-03-01       edit        warn  51380
169 2013-04-01       edit    disallow  23088
170 2013-04-01       edit         tag  39377
171 2013-04-01       edit               5108
172 2013-04-01       edit        warn  78925
173 2013-05-01       edit    disallow  56560
174 2013-05-01       edit        warn  53004
175 2013-05-01       edit         tag  34253
176 2013-05-01       edit               6561
177 2013-06-01       edit        warn  37337
178 2013-06-01       edit         tag  37615
179 2013-06-01       edit    disallow  28917
180 2013-06-01       edit               2585
181 2013-07-01       edit        warn  50679
182 2013-07-01       edit         tag  35820
183 2013-07-01       edit    disallow  11221
184 2013-07-01       edit               8752
185 2013-08-01       edit    disallow  20384
186 2013-08-01       edit        warn  47887
187 2013-08-01       edit         tag  40671
188 2013-09-01       edit        warn  41324
189 2013-09-01       edit         tag  41440
190 2013-09-01       edit    disallow  39606
191 2013-10-01       edit        warn  82054
192 2013-10-01       edit         tag  52120
193 2013-10-01       edit    disallow  17689
194 2013-10-01       edit              11223
195 2013-11-01       edit         tag  14515
196 2013-11-01       edit               3011
197 2013-11-01       edit    disallow  12504
198 2013-11-01       edit        warn   6512

--EpochFail (talk) 22:03, 9 November 2013 (UTC)[reply]

Evaluations[edit]

I made a comparison between the amount of disallowed edits by filters, reverts by users and by bots and found out the filters were responsible for avoiding 38% of bad faith actions by IPs during last 2º trimester. I think we could improve this comparison to evaluete how relevant abusefilter is.OTAVIO1981 (talk) 16:39, 11 November 2013 (UTC)[reply]

Edit Filter on EN[edit]

I was involved in some discussions about this on EN wiki a couple of years ago when I was trying to work out how much higher editing figures would be if we didn't have these. A few points emerged:

  1. On EN we had renamed the abuse filter the edit filter because it wasn't just being used to prevent abuse such as vandalism. I suspect this includes changes from one version of English to another but don't know how bitey such revision would be. In theory not being able to do something is less bitey than being able to do something that was not allowed and then being reverted and warned.
  2. In terms of raw edit count the edit filter loses you as many "good" edits as bad. Not from overkill but because we lose the vandal reverting and vandal warning edits.
  3. The greying of the pedia with the community ageing by more than a year a year is not just down to our recruiting more silver surfers, it is also because we have not just lost most of our vandalism, we have also lost the vandal fighters that it recruited.
  4. the effect on vandals was different - they behave differently if they can't replace a paragraph with the word poop than if they can but it doesn't last long.
  5. While it isn't easy to work out how much higher the adjusted editing figure in 2011 would have been than the actual figure, it was obviously going to have been higher than any previous year, including the raw peak year of 2007.

Great to see someone taking on an uber complex but uber important project. WereSpielChequers (talk) 07:14, 30 July 2014 (UTC)[reply]