Research:Participatory Auditing AI Tools for Information Verifiability
This page documents a research project in progress.
Information may be incomplete and change as the project progresses.
Please contact the project lead before formally citing or reusing results from this page.
A significant barrier to reaping the benefits of predictive and generative AI is their unassessed potential for harms. Hence, AI auditing has become imperative, in line with existing and impending regulatory frameworks. Yet, AI auditing has been haphazard, unsystematic, and left solely in the hands of experts. Our project, bringing together a consortium of 7 academic institutions and over 20 partner organisations, aims to fix this fundamental challenge through the novel concept of participatory AI auditing where a diverse set of stakeholders without a background in AI, such as domain experts, regulators, decision subjects and end-users, undertake audits of predictive and generative AI, either individually or collectively. More information about our larger project can be found at our website.
Our team at King's College London grounds this research through exploring participatory auditing of AI tools to improve verifiability of content across Wikipedia and Wikidata platforms. Our stakeholder research will be conducted in two phases. The first phase involves recruiting editors across Wikipedias and Wikidata to understand existing challenges and practices towards ensuring verifiability of content.
The insights of this work will go towards designing, updating, and evaluating tools that assist with verifiability of content across these platforms.
Methods
[edit]We will be recruiting editors with a range of experience in the English Wikipedia and Wikidata communities for workshops to be held in the months of March and April. These workshops will be held online, will be conducted in English, and they and will last for 2 hours each for the following dates and times:
English Wikipedia: Friday, 20th of March from 16:00-18:00 GMTEnglish Wikipedia: Tuesday, 24th of March from 16:00-18:00 GMTEnglish Wikipedia: Thursday, 9th of April from 16:00-18:00 BSTWikidata: Thursday, 26th of March from 16:00-18:00 GMTWikidata: Wednesday, 8th of April from 16:00-18:00 BST- Wikidata: Monday, 20th of April from 16:00-18:00 BST
- Wikidata: Wednesday, 22nd of April from 16:00-18:00 BST
If you have experience editing any of these platforms and are interested in taking part in one of our workshops, please indicate your interest here. If you express interest and we feel that you would be a good fit for participation, then we will reach out to you.
We are also hosting workshops for Portuguese Wikipedia that will be conducted in Portuguese on the following dates and times:
- Portuguese Wikipedia: Monday, 27th of April from 16:00-18:00 BST
- Portuguese Wikipedia: Thursday, 7th of May from 16:00-18:00 BST
If you have experience editing Portuguese Wikipedia and are interested in taking part in one of our workshops, please indicate your interest here. If you express interest and we feel that you would be a good fit for participation, then we will reach out to you.