Jump to content

User:Quiddity (WMF)/massmessage tone check

From Meta, a Wikimedia project coordination wiki

Tone Check coming this week

Hello. Tone Check is an Edit Check that uses a small language model trained on Wikipedia edits to prompt people adding promotional, derogatory, or otherwise subjective language to consider "neutralizing" the tone of what they are writing.

This feature was tested at your wiki last year, after community members helped to evaluate the model. The research results were positive, indicating an improved rate of constructive edits (edits that were not reverted) by +6.2% relative to the control group, across the three wikis where it was measured (French, Japanese, and Portuguese). Tone Check appears especially effective at increasing the constructive edit rate of registered new contributors, where the team observed a +14.8% increase in constructive edit rates.

By default, Tone Check is shown to editors who have published 100 or fewer edits locally - This can be changed by administrators via Special:EditChecks. When a user matching this requirement writes content that the language model detects as matching these terms, Tone Check highlights the paragraph and encourages users to change it. All edits will be tagged when the editor publishes the change, no matter which action was taken. The goal is to allow experienced users to understand the context of the edit, and to verify if the tone fits the local policies.

This feature will be released here as a default feature later this week. Thank you again for helping to test it.