Jump to content

Wiki Loves Living Heritage/How to import an inventory

From Meta, a Wikimedia project coordination wiki

How to import an inventory

[edit]

Edit article metadata on Wikidata.

Before starting

[edit]

Work together

[edit]

Collaboration with the focal point or the inventory maintainer (governmental organization or NGO) is important in order to create sustainable partnerships. Their help is essential for releasing the data managed by the office, institution or organization, and their expertise is needed in identifying existing elements on Wikidata and translating labels and descriptions. They can introduce the project to the heritage communities to engage them in deciding in which scope and pace to publicize information and materials about their heritage.

Wikimedians should get together with their local affiliate or alternatively an affiliate in the region to coordinate the work together. Use information on the Contacts page or get in touch with the project organizers to help establishing contact.

The import can either be carried out by the local teams or by the support team.

Discuss open sharing

[edit]

Before uploading information, discuss what effects making the information openly available can have. Opening can help in many ways to safeguard intangible cultural heritage and on the other hand it may expose some secret or sensitive information. Copyright is only one aspect of rights related to the materials, personality rights or collective rights such as indigenous rights also need to be addressed. The Ethical sharing page on the project pages is a central place to refer these questions. The article Benefits of opening content on Wikimedia projects will inform partners as well as Wikimedians working on making materials openly available. You can also refer to the FAQ, which is created especially for the safeguarding organizations.

When information is added to Wikidata, it is merged with existing information about the heritage element, and data coming from different sources. The information about an inscribed element in an inventory becomes only one aspect of the heritage element's Wikidata item. For this reason, the name or scope of the element may change in the process. Different nominations for the same heritage element should be kept in the same Wikidata item.

Make sure you have agreed on the data being openly available as public domain data (CC0). It is not necessary for the focal point to relicense the entire database, the CC0 waiver can apply to only those pieces of information that are used. Usually, the pieces of data are not copyrightable either.

Process overview

[edit]

Get the data

[edit]

Read the data

[edit]
In collaboration with the ICH focal point, read the data from the website or database into a spreadsheet format (excel or csv). This can be used by all the tools. Hover for more information
For an inventory, the data to import would include
  • The name of the inventory and a short description at least in the original language and English so that the information can be translated to other languages more easily.
  • The organization maintaining it and the country or jurisdiction of the inventory
  • Where the data can be found online
  • The year the inventory was established and the number of elements it contains at a given time
  • The geographic area the inventory covers

For the heritage elements, the data to import would include

  • The name and description of the element as well as the variations, at least in the original language and English. The information in the dataset should be appended to an existing Wikidata entry whenever possible, and the label in the dataset may change when added to Wikidata, and it may be merged with information about similar items in other sources.
  • Information specific to the heritage element, such as the type of heritage the element represents and a specific family of traditions, a superclass, if available, as well as the geographic scope and practitioners, for example.
  • Information specific to the dataset entry: Link to the inventory with information about when it was included, what is the inventory number and web page, name in the dataset, language of the entry in the dataset, the geographic scope of the entry and other possible information depending on the dataset.
  • Further information and resources on Wikimedia projects and online.
Read more about what data would be published in Wikidata.

Prepare the data

[edit]

Model the data

[edit]

Model your data according to the guidelines for structure and properties on this page and format data such as dates according to the requirements of your tool and Wikidata. Each tool gives you information about the right format.

Basic structure
What differs from how monuments (built heritage) are modeled is that whereas monuments have designation items created using heritage designation (P1435), living heritage elements are directly linked to inventories via intangible cultural heritage status (P3259). This was created for living heritage to avoid complexity and clutter.

What causes additional confusion is that sometimes inventories are described in Wikidata as Wikimedia list article (Q13406463) with the property instance of (P31), instead of one of the inventory types. The same article may be a "normal" Wikipedia article in some languages, and a list article in others. See further below how to disambiguate articles about lists and Wikimedia list articles.

Secondly, the type Template:Intangible cultural heritage is not used directly on an item. The fact that something is intangible cultural heritage is inferred via the inscription in an inventory, or that an item is nominated by any used, using the property.

See a model statement for an inscription.
Properties
See a listing of suggested properties for inventories and heritage elements further on the page.

Transform the data for Wikidata

[edit]

The format of the data depends also on the tool you choose to use for the import.

Labels and descriptions
A big part of the work is providing labels and descriptions in the original language and English for all the elements. Do not override the existing labels and descriptions unless you have good reason to do so. See this section for more tips.
Formatting data
Your data must be formatted in a way that Wikidata understands it. Specific properties expect specific data types as value. If you want to refer to another Wikidata item, you must use the QID of that item. External IDs and URLs are strings. Specific data types require distinct formatting. Hover for more information
Dates
  • Format: Wikidata uses the ISO 8601 date format (YYYY-MM-DD). For example, "2024-08-17" would represent August 17, 2024.
  • Precision: Precision (year, month, day) is set with the last digit in the date string, eg. 11 represents precision of a day: +2024-08-17T00:00:00Z/11
  • Tools: OpenRefine and QuickStatements support this format natively.

Coordinates

  • Format: Coordinates should be in the format of decimal degrees, where latitude and longitude are separated by a comma, e.g., 51.5074, -0.1278.
  • Globe: In Wikidata, each coordinate needs to be associated with a globe (default is Earth, Q2). This is especially important for non-Earth coordinates.
  • Tools: Both OpenRefine and QuickStatements can handle coordinates in this format, with the option to specify the globe in QuickStatements.

Quantities

  • Format: Quantities are expressed as a number, potentially with a unit, e.g., 42[+1] for a quantity with uncertainty. Units are referenced by their Wikidata Q-ID, like Q11573 for meters.
  • Tools: OpenRefine and QuickStatements also support importing quantities, as long as they are formatted correctly.
Formatting the data for QuickStatements

Reconciliation

[edit]

When you import data to Wikidata, you will either append information to an existing data item or create a new one.

Reconciling is the operation of finding matches and making a decision whether your data will be appended to it, or if a new item is needed. Intangible cultural heritage elements often require careful manual matching.

Tactics to find already existing heritage elements on Wikidata

[edit]
Search Wikidata by name
Search Wikidata for the element you want to edit. Use Wikidata's text search to search by name. Try this example.
Search Wikidata with SPARQL
If you know any authority ID for the heritage element, such as the UNESCO ICH ID, you can use the Wikidata Query Builder to find the item. See this example.
Find information on Wikipedias
Wikipedia articles contain a lot of information. As every Wikipedia article links to a Wikidata item, you can often find the Wikidata QID you are looking for by following that link. Hover for more information
Check if there is a Wikipedia article for your inventory, or if the items have been listed in a more generic article on ICH in your country. The mentions are often linked to articles about the heritage elements. Check carefully, as the linked articles might not represent the heritage elements, but they could represent related places of concepts.

You can also find links inside the Wikipedia articles, traverse category trees and interwiki links to find existing articles and the corresponding Wikidata items.

Try also making an internet search by limiting your query to Wikipedias. This is powerful for finding information across languages. Example: "hommes-panthères site:*wikipedia.org"

Sometimes the Wikidata item might not match the article perfectly, and you would need to correct either the Wikidata item, the link, or the article.
Find information on Wikimedia Commons
Wikimedia Commons has categories and images for elements. There's also a lot of information about heritage elements that have no articles or data about them. Hover for more information
You can search Wikimedia Commons directly, use Openverse search for open images or use an internet search by limiting responses to Wikimedia Commons.

You often find images that represent the heritage element. It may not be categorized into a category that represents that element. Wikimedia Commons are linked to Wikidata items in several ways. Here are the most important ones.

  • One image is selected to represent the heritage element in Wikidata property image (P18).
  • In addition, all images representing the same heritage element can be added into one category on Wikimedia Commons and the category can be linked from Wikidata with property Commons category (P373).
  • Images in Wikimedia Commons can be tagged with Wikidata items. This is referred to as SDC statements.
When you have created your new items in Wikidata, consider creating respective categories in Wikimedia Commons for the images and linking them to the items.
Use machine translation and generative AI
Sometimes the item you are looking for has been added in some other language. You can use machine translation or generative AI to assist in finding information across languages. Hover for more information
Install a translation plugin to your browser to translate pages or selected text into your language. Use the Wikipedia article tactics described above in the other language. Use generative AI to search entries, for example: "Find if hommes-panthères has a Wikipedia article in any language." I would not trust generative AI to be able to provide the correct Wikidata item, so follow the Wikidata link from the article to Wikidata yourself.

Reconciliation with different tools

[edit]

When you have more than a few items in your dataset, more automatic matching methods will be welcome.

OpenRefine
OpenRefine is the go-to tool for data imports to Wikidata. You can do the data-wrangling, data reconciliation and import all inside the same tool. You can download OpenRefine to your computer or use the online instance at Wikimedia PAWS. The reconciliation API used by OpenRefine finds possible matches for each row in your dataset based on a textual match and it can use additional other properties, such as location or authority IDs to find the best candidates.
Wikipedia and Wikidata tools
Wikipedia and Wikidata tools extension for Google Sheets allows you to create formulas that read Wikidata. Hover for more information
The plugin is really useful for small and simple datasets.

Functions: WIKIDATAQID finds the QID for a given article, WIKIDATALABELS finds the label for an items in a given language or all entered languages and WIKIDATADESCRIPTIONS does the same for descriptions, WIKIDATAFACTS retrieves values for Wikidata properties as text, WIKIDATALOOKUP, WIKIDATASEARCH

The downsides are that the extension is not actively maintained, and that the amount of queries it fires at Wikidata every time any small changes are done in the spreadsheet, cause the queries to be blocked at Wikidata's end.
Mix'n'Match
Mix'n'Match tool lets you upload the dataset online for collaborative matching. See the Import guide for more information.

Add or edit Wikidata items

[edit]

Add inventory item to Wikidata manually

[edit]
Search Wikidata for an existing item about your inventory
View an editable list of existing inventories. Use Wikidata search or google for it. Check to see if you find information about your inventory in a list we have collected.
Add information to the inventory item
If the inventory has a Wikidata item, check that it has all the necessary information in the section Data to import for an inventory. Tip: Add an image to the Wikidata item of your inventory to make it appear higher on the list. The image needs to be uploaded to Wikimedia Commons and be free to use.
Add a missing inventory
If a Wikidata item for the inventory does not exist, use this Cradle form to create a new item.
Add the inventory to these pages
Go to the Inventories page and run Listeria to update the list and see your inventory listed.

Add heritage elements to Wikidata one by one

[edit]
Add new Wikidata items
If the inventory does not have too many elements, you can add the information about its elements one by one by using this Cradle form. The form cannot add qualifiers or source statements, and you must add them manually in Wikidata.
Edit existing items
If the item exists already, use the list Data to import for an element to add all the necessary pieces of information.

Batch import heritage elements

[edit]

You can also import all data at once. This requires more technical skills, but you do not necessarily need to do this by yourself. The support team will help you, whether you just want support or wish to have someone else do the import. However, subject matter expertise is needed to identify existing matching heritage element items in Wikidata and deciding whether to merge or create a new Wikidata item.

You should apply for a bot account when you make mass edits.

Import data to Wikidata with OpenRefine
In OpenRefine, you create a schema for the import. That tells which columns in your data go to which properties in Wikidata. You will log into Wikidata with your bot account and process the import. It is easy to add more information to the same items afterwards using the same OpenRefine project.
Import data to Wikidata with QuickStatements
You can use QuickStatements in combination with many different tools. QuickStatements is a web-based interface and a syntax for upload statements. Hover for more information
Different scenarios
  • Format data with a spreadsheet tool and create QuickStatements statements from the data.
  • Read, reconcile and format your data with OpenRefine, and export to QuickStatements for upload.

Basic structure

[edit]

Inventory

[edit]

Here are the most important statements for inventories. More information can be found below in Data to import for an inventory.

instance of (P31)
Normal rank It is also possible to add inventories and registers that are not part of the UNESCO system. In this case, or other further situations, use the broad class of heritage register of intangible cultural heritage (Q116056897).
0 references
add reference


add value
maintained by (P126)
Normal rank Add the office or organization that maintains the inventory, most often an office at the ministry of culture or a dedicated NGO. Create an item for it, if it is missing, and add all the relevant data.
0 references
add reference


add value
country (P17).
Normal rank Add the country. For sub-national or cross-border inventories, add also the geographic extent of the inventory with operating area (P2541).
0 references
add reference


add value
maintained by WikiProject (P6104)
Normal rank Always add WikiProject Intangible Cultural Heritage (Q112898263). This secures that the inventory is displayed in Wiki Loves Living Heritage.
0 references
add reference


add value

Heritage element

[edit]

Here are the most important statements for heritage elements. More information can be found below in Data to import for an element.

instance of (P31)
Normal rank Add the most appropriate type. Do not add intangible cultural heritage (Q59544).

Examples

0 references
add reference


add value
subclass of (P279)
Normal rank Add the most appropriate class. Do not add intangible cultural heritage (Q59544).

Examples

Ideally classes for both instance of (P31) and subclass of (P279) would form a class hierarchy under intangible cultural heritage (Q59544), but because of the amalgamate nature of living heritage, it is likely not going to succeed. So ignore warnings regarding this in the Wikidata interface.
0 references
add reference


add value
intangible cultural heritage status (P3259)
Normal rank For items in a national inventory or register, use the QID of the inventory/register. Example value: National Inventory of Intangible Cultural Heritage in Malaysia (Q113768320)
start time (P580) The qualifier is mandatory according to 'Required qualifier constraint' in intangible cultural heritage status (P3259).
country (P17). Also applies to jurisdiction (P1001) has been used. For items in national inventories, adding the country of the inventory is redundant, because that information is stated in the data of the inventory.

For international lists and inventories, such as UNESCO Intangible Cultural Heritage Lists (Q4435332), optionally add the geographic scope or jurisdiction of the element.

Add information about the geographic scope of the heritage element in a separate property, such as country (P17), country of origin (P495), indigenous to (P2341), culture (P2596), location (P276), or located in the administrative territorial entity (P131). See a section discussing this.
title (P1476) Add the title of the item in the register in all the available languages. Add the language as well. This is not entirely a correct property, but it it the only one that is monolingual. This can alternatively be added in the reference statement.
inventory number (P217) Add the ID of the heritage element in the inventory, if it exists. Alternatively (or additionally) you can create a Wikidata property for the ID, if it is persistent.
described at URL (P973) It is difficult to find a best practice for adding a URL that points to the correct web resource of the inventory entry in each of the recorded languages. Adding described at URL (P973) in the intangible cultural heritage status (P3259) statement is experimental, and should be replaced with a better practice that takes different languages into account.
1 reference
stated in (P248) Add the item of the inventory
language of work or name (P407) Add a source reference for all language versions in the inventory website
reference URL (P854) Add the webpage address for the language version. If an ID exists, it can be used instead.
ID, for example UNESCO ICH ID (P10221) Adding the exact URL or ID is beneficial for locating the source information. Add this also as a separate statement.
retrieved (P813) The date of retrieval is useful even if some say it is unnecessary.
add reference


add value
maintained by WikiProject (P6104)
Normal rank Always add WikiProject Intangible Cultural Heritage (Q112898263). Belonging to a intangible cultural heritage inventory or using this property designates an item as intangible cultural heritage.
0 references
add reference


add value


Properties to use

[edit]

Data to import for an inventory

[edit]
  • label – add the most commonly used name as the label, and add additional names or abbreviations as aliases. Add all the available translations as well. Note: An English label in the form "Intangible Cultural Heritage of <country name>" will cause trouble on these pages, please avoid that in translations.
  • description – the description is not a sentence but a passage without a full stop at the end.
  • aliases – add alternative names as aliases, in the corresponding language
  • inception (P571) – Date or year of establishing the inventory
  • Wikidata property (P1687) – The property created in Wikidata for the ID in the national inventory. If your national inventory has a stable ID, you can consider creating a property for it.
  • Commons category (P373) – Wikimedia Commons category for images related to the inventory
  • country (P17) – The country / jurisdiction of the list
  • operating area (P2541) – The region or country that the inventory covers. You can use this to designate a subnational or a transnational area.
    • For national inventories, use the country.
    • For subnational, use the subregion(s).
    • For transnational, use the region or several regions or countries.

Data to import for an element

[edit]
  • label – the name of the element, the best-known title. Add it in all languages that you know and in English. Providing the English label is necessary to allow translating it to other languages. See the recommendations about writing the labels.
  • description – the description is not a sentence but a passage without a full stop at the end. Providing the English description is necessary to allow translating it to other languages.
  • aliases – Add alternative names as aliases, in the corresponding language.
  • instance of (P31) – Choose the type or heritage element in question. Do not use intangible cultural heritage (Q59544), but the most precise type you can find in Wikidata for the element. You can also create it, if you are confident a proper one does not exist. Use the keywords and categories of the inventory as an inspiration. Ideally, the type is hierarchically related to intangible cultural heritage (Q59544), but this is not always the case. See more about keywords.
  • subclass of (P279) – Usually it is useful to add the heritage element to a hierarchy of elements, such as in the case of a local variant of a tradition. You can also create subclasses to the element you are adding. Read more in the section for related elements. Do not use intangible cultural heritage (Q59544) as a value here.
  • intangible cultural heritage status (P3259) – Use the inventory item as the value. Add also the following qualifiers:
    • country (P17) – The country that has included the element in the inventory. // Not to be used for national inventories, only international ones.
    • start time (P580) – The year or date when the element was added to the inventory.
    • title (P1476) – Add all the titles in the different languages that have been used in the inventory.
    • inventory number (P217) – If the inventory has an ID for the element, but it does not have a property in Wikidata.217
    • described at URL (P973) – Although this is repetition, this clearly associates the web page of the heritage element to the designation. Language cannot be expressed when using this property as a qualifier, so one needs to pick one of the languages, English preferred. Adding the information here is experimental. The source statement may also have the same url as reference URL (P854), see the section below.
  • described at URL (P973) – The page of the element in the inventory website. For all of the language versions, add the following qualifiers:
  • The possible ID in an inventory or list, such as UNESCO ICH ID (P10221).
  • maintained by WikiProject (P6104): WikiProject Intangible Cultural Heritage (Q112898263)
  • image (P18) Image about the element, if you have already uploaded it to Wikimedia Commons.
  • Commons category (P373) Image category on Wikimedia Commons where all the images about the element will be placed. You can create add this information later.

Data not to import

[edit]
  • You should find out if the elements contain sensitive data that might require community consent to be shared.
  • You should never include personal data without the consent of the person in question. See the guidelines on Wikidata.
  • You should be careful not to expose the exact location of elements that can be vulnerable to looting or destruction if the location is widely known.

Labels, descriptions and aliases

[edit]

Each item needs a label

  • Choose the most most commonly known name for the label of the item in each language.
  • Labels are added to each language separately. To make the item translatable to other languages, please make sure that you also provide the label in English. When you see a label Q-something on these pages, it means that the label does not exist in your browsing language or English.
  • A label only starts with a capital letter when it is a proper noun, a name of something.
  • The label should not have any additional text added, like the profession or country in parenthesis or separated with a comma.
  • The label is not necessarily unique. The combination of the label and the description must be unique.

Give context with a description

  • Descriptions are important for distinguishing between namesakes.
  • The description is not a sentence, it is a descriptive phrase that does not start with a capital letter and does not end in a full stop.
  • Wikipedia's opening sentences are a perfect starting point for description phrases, when you leave out the article topic's name from the beginning: Xxx is <this part is an excellent description>.
  • The combination of the label and the description must be unique.

Aliases

  • When you choose one of the possible names as the label, you can add the others as aliases.
  • Only add aliases from the same language. If you have labels in other languages, add them to those languages as labels or aliases.
  • Aliases help in search, so you can also add some common misspellings.

Official name or the title of the entry in a catalogue

[edit]

Geographic dimension

[edit]

The inventories give a lot of information about where the different traditions are practiced or where they originate from. These definitions may be highly contested and prone to misinterpretation. Following is the current recommendation, but we need more community discussion about expressing the "origin" or places where the living heritage elements are practiced.

  • Use primarily country (P17) to express the geographic occurrence of a tradition. Using country of origin (P495) is much more sensitive and prone to disagreements, whereas country (P17) can be understood as "the sovereign state within which this tradition is observed". It is also a more commonly used property.
    • When adding information, please remember to add source reference to the statement. Remember that Wikidata displays the accumulated information from different sources which may be conflicting. The geographic occurrence is not supposed to be exclusive. Further statements may be added.
    • If an element is globally spread, a list of all countries may not be useful, and we must find a way to express that.
  • Use location (P276) when the tradition can be located in places, buildings, sites etc. or located in the administrative territorial entity (P131), when these places are cities, towns, villages. Use these in combination with country (P17).
  • Additionally, add where applicable. These can be sensitive or contested.
    • indigenous to (P2341) – Places, cities, regions and people can all be added with this property. This is where the element is common.
    • culture (P2596) – Use for specific culture, possibly spanning countries.
    • country of origin (P495) – Use with caution, when this information is generally accepted.

Source statements

[edit]

Pay attention to providing good source statements to the data added. This allows anyone to check the data and use the link to read a richer description of the element. For each piece of information, add

  • stated in (P248) – the Wikidata item for the inventory. In this project, all inventories should be in Wikidata, and this property should be used. You can add either the webpage or the id in the inventory as a qualifier to mark the exact source location.
[edit]

What if the exact element is missing but a related elements exist. Sometimes a heritage element represents a group of items in Wikidata, such as all festivals of a certain type. It is only fair that all the single elements are credited in Wikipedia articles and displayed on these pages as being part of that designation.

Subclass of an existing item
The existing Wikidata item is a broader type of the same heritage element than the element you are adding.
Add subclass of (P279) : the existing Wikidata item to the element you are adding.
Part of an existing item
The heritage element you are adding is part of a broader existing element.
Add part of (P361) : the existing Wikidata item to the element you are adding.
Parent class of an existing item
There are several Wikidata items that are more precise in scope than the element you are adding. Make the existing items subclass of your new, more generic element.
Add subclass of (P279) : the element you are adding to the existing element(s).
Existing sibling items
There exist other variant(s) of the element you wish to add.
Add another new item as a superclass for both the existing item and the new item you wish to add.
Add subclass of (P279) : the new parent element to the element you are adding and the existing element(s).
[edit]

Add information of the ICH designation (lists, registers, inventories) also to the related elements

Also all the other information about the designation should be repeated

Add main statements when applicable

Keywords

[edit]

Keywords used in the inventory represent many different types of information that need to be added to their dedicated properties. It may be difficult to add them all – don't let perfect be the enemy of good! Here are the most common ones:

And if you feel energized, you can add more information

[edit]

The topic of the heritage element is suited for many different properties. Pick the most fitting one, or use several:

  • main subject (P921) – primary topic of a work (see also P180: depicts)
  • named after (P138) – entity or event that inspired the subject's name, or namesake (in at least one language). Qualifier "applies to name" (P5168) can be used to indicate which one
  • commemorates (P547) – what the place, monument, memorial, or holiday, commemorates
  • dedicated to (P825) – person or organization to whom the subject was dedicated
  • patron saint (P417) – patron saint adopted by the subject

Additionally, the heritage element links to different contexts around it through different properties. Here are some ideas of what they could be:

Find more properties for specific use cases

Add list and element pages to Wiki Loves Living Heritage

[edit]

Add an entry for the inventory in the Inventories pages

[edit]

When you have added information about the inventory and marked the item with instance of (P31): national inventory of intangible cultural heritage (Q113040113) (or one of the alternetives) and maintained by WikiProject (P6104): WikiProject Intangible Cultural Heritage (Q112898263), you will be able to see it listed in the Inventories page. When you add an image (P18) or logo image (P154) to the entry, the entry will be featured higher on the list.

Navigate to the page and click on Manually update list at the top of the list to refresh it.

Create a page for the inventory

[edit]

When you have both the inventory and elements on Wikidata, you are ready to create a page for your inventory. You can only create the page after you also have heritage elements in Wikidata that are linked to your inventory.

Go to the Inventories page to your inventory listing. The button in your inventory listing has three possible states:

  • No elements yet Inventory exists in Wikidata but there are no heritage elements to display. The button takes you to this page.
  • Browse the elements The inventory page already exists and you can enter the page by clicking on the button.
  • Create the page The inventory has been added to Wikidata and there are heritage elements related to it. You can click the button to create the inventory page.

Click on the Create page button to create the page.

  • You will enter a preloaded template that looks rather scary. When you save that, your new page will be created.
  • Click on Manually update list at the top of the list to create it.

You can add or change the header image, if an image was not automatically added or if you wish to change the existing image

  • Enter edit mode for the page. Click on the top part where you have the menu and the image if it exists. You get an Edit button.
  • In the template editing window, you can make changes to the header part.
    • Keep the value of the Menu item as Elements.
    • Add or change the image link. The image must exist on Wikimedia Commons. Keep the prefix File:

Create a Living Heritage page

[edit]

TBC