OpenRefine
OpenRefine is a free data wrangling tool that can be used to process, manipulate and clean tabular (spreadsheet) data and connect it with knowledge bases ("spreadsheets on steroids" / "a swiss army knife for data"). It is widely used by librarians, in the cultural sector, by journalists and scientists, and is taught in many curricula and workshops around the world.
- OpenRefine is a popular tool for Wikidata batch editing since 2018.
- OpenRefine supports Wikimedia Commons batch editing and uploading, thanks to a Wikimedia grant, since 2022.
- OpenRefine can also be used to batch import and edit data items and media files in Wikibases.
OpenRefine is a community-supported open source project, licensed under the BSD license. It has a graphical user interface in more than 15 languages.
.svg){kind=logo}
- General links
- OpenRefine's website: https://www.openrefine.org/
- Download OpenRefine: https://openrefine.org/download.html
- Download and install the Wikimedia Commons extension for OpenRefine: https://github.com/OpenRefine/CommonsExtension
- General OpenRefine documentation: https://openrefine.org/docs
- Talk about OpenRefine with its community and with Wikimedia users
- Ask questions on OpenRefine's community forum: https://forum.openrefine.org
- Telegram group for Wikimedians who use OpenRefine: https://t.me/+Qc23Jlay6f4wOGQ0
- Bug reports and feature requests
- On GitHub (for OpenRefine in general): https://github.com/OpenRefine/OpenRefine/issues
- On Wikimedia Phabricator (mainly for Wikimedia Commons reconciliation): https://phabricator.wikimedia.org/tag/openrefine/
OpenRefine for Wikimedians[edit]
Cloud version of OpenRefine (on PAWS) for Wikimedians[edit]
Is it difficult for you to run OpenRefine on your own computer?
Run OpenRefine in PAWS on Wikimedia’s Cloud Services (you need a Wikimedia account and an internet connection): https://hub-paws.wmcloud.org/
OpenRefine for Wikidata[edit]
- OpenRefine for Wikidata editing: info, tutorials... https://www.wikidata.org/wiki/Wikidata:Tools/OpenRefine
OpenRefine for Wikimedia Commons[edit]
- There is a Wikimedia Commons extension for OpenRefine. It is recommended to install this (download and install) for additional helpful features to work with Wikimedia Commons (thumbnail previews of Commons files; load files from Commons categories; specific GREL scripts).
- OpenRefine for Wikimedia Commons editing: info, how-tos... https://commons.wikimedia.org/wiki/Commons:OpenRefine
- How-to: add structured data to files on Commons with OpenRefine 3.6+ https://commons.wikimedia.org/wiki/Commons:OpenRefine/Adding_structured_data_with_OpenRefine or as a video: https://www.youtube.com/watch?v=kv8bDtO4cq8
- How-to: upload files to Commons with OpenRefine 3.7+ (under construction / experimental) https://docs.google.com/document/d/19eiMeq3XssiPrT9b04E-8XyE-desBEzYNgygLDYKP4o/edit# or as a video: https://www.youtube.com/watch?v=sc6aNNmsNCI
Related tools[edit]
OpenRefine edits on Wikidata and Wikimedia Commons can be undone with the EditGroups tool.
- EditGroups on Wikidata: https://editgroups.toolforge.org/
- EditGroups on Wikimedia Commons: https://editgroups-commons.toolforge.org/ (note: is not able to undo uploads; only edits to existing files)
OpenRefine for Wikibase[edit]
Reconciliation[edit]
- Wikidata’s reconciliation service https://wikidata.reconci.link/
- Wikimedia Commons’ reconciliation service https://commonsreconcile.toolforge.org/
- Setting up reconciliation services for Wikibases: https://openrefine-wikibase.readthedocs.io/en/latest/
- Various (other) reconciliation services via the Reconciliation Testbench: https://reconciliation-api.github.io/testbench/