Research:Structured data/Metrics
 |  This page is currently a draft. More information pertaining to this may be available on the talk page. Translation admins: Normally, drafts should not be marked for translation. |
Measures of success[edit]
Quantitative measurements[edit]
| Area | Hypothesis | Proposed metrics | Broken down | Expected behavior of metrics | Existing data? | Notes |
|---|---|---|---|---|---|---|
| All | Structured data makes it easier to find files to illustrate Wikimedia sites (especially in languages other than English) | number of files added to pages on Wikimedia sites | by language, to see the impact on non-English languages | should increase over time | GlobalUsage | |
| Upload | Structured data makes it easier to classify files during upload. |
|
should decrease over time | CategorizationBot's logs | Measuring tool will need to be adapted to take Topics into account once they're on Commons. | |
| Editing | Structured data makes it easier to add and fix file information. | number of unique editors per file page | should increase | File page history | ||
| number of active editors on Commons | should increase over time | Wikistats / Report card | ||||
| Search | Structured data makes it easier to find files on Commons. | search queries for media files |
|
? | ? | How is this different from search volume? |
| search volume for media files | ? | ? | Users might use the search more if it's great, but they might also do less follow-up search if the results are better the first time (less refining is needed). | |||
| percentage of successful searches for media files | should increase over time | ? | How do you define a "successful search"? | |||
| Viewing | Structured data makes it easier to view file pages | number of page views per file page | should increase over time | ? | (limited) | |
| Re-use | Structured data makes it easier to re-use files. | volume of API use | should increase over time | ? | ||
| Structured data makes it easier to provide correct attribution for re-used files. | number of incoming links to file pages | should increase over time | ? | magical tokens, #reuse URL parameter |
Qualitative measurements[edit]
Method: Task performance measurement (UX testing with clear pass/fail criteria; measure success & speed, success/fail ratios)
Hypotheses to test:
- Structured data makes it easier to add information to the file during and after upload.
- Structured data makes it easier to fix, add and translate file information.
- Structured data makes it easier to find files about a topic of interest, in the user's language.
- Structured data makes it easier to add an image from Commons to a blog post with proper attribution.
Measures of progress[edit]
| Proposed metrics | Broken down | Expected behavior of metrics | Existing data? | Notes |
|---|---|---|---|---|
| number of files with Data properties |
|
should increase over time | ||
| percentage of newly-uploaded files using only Data properties | should increase over time | |||
| percentage of parameterless template calls | should increase over time | |||
| number of MediaViewer views without metadata | should decrease over time | MediaViewer logs | Intersect with file page views |