Jump to content

Global metrics/Review/cs

From Meta, a Wikimedia project coordination wiki
This page is a translated version of the page Global metrics/Review and the translation is 100% complete.

Thank you everyone who provided feedback on updating Global Metrics! Global Metrics has been updated based on all the community feedback received. A summary of the new grant metrics requirement and a summary of all the feedback (and changes made based on the feedback) can be found here.

The new page for grant metrics now up as well.


Přehled projektu

Globální metriky je soubor šesti metrik (a jedné otázky), které musí od září 2014 vykazovat všichni příjemci grantů nadace Wikimedia Foundation (WMF) - IEG, PEG, SAPG, APG - pokud jsou relevantní pro jejich grantové aktivity a cíle.

Vzhledem k tomu, že na konci prosince 2015 skončil první celý rok, kdy všichni příjemci grantů vykazovali globální metriky, tým Community Resources ve spolupráci s týmem Program Capacity and Learning se věnuje retrospektivě a aktualizaci globálních metrik s cílem:

  1. Pochopit, jak jsou současné metriky užitečné pro členy výboru, příjemce grantů a příslušné pracovníky WMF.
  2. Pochopit hlavní problémy.
  3. Pochopit, jak by tyto problémy mohly být řešeny.
Časová osa projektu

  • Fáze 1: Sběr zpětné vazby - únor 2016 až 25. března 2016
  • Fáze 2: Návrh řešení - 24. dubna až konec května 2016.
    • Hlasování a shromažďování zpětné vazby: 6. června až konec června 2016.
  • Fáze 3: Aktualizace - červenec 2016
    • Shrnutí požadavku na nové grantové metriky a souhrn všech připomínek (a změn provedených na základě připomínek) naleznete zde.
Phase 1: Collecting feedback - COMPLETE

The first phase of the project involves collecting feedback from across all grant programs, Committee members, and relevant WMF staff. This feedback can be provided in three ways:

  • Publicly, through the discussion page
  • Privately, through a Qualtrics survey
  • Privately, through interviews in small groups

This first phase will result in a report of the summarized feedback that will include:

  • A more detailed history on the development of Global Metrics, and lessons learned from past mistakes
  • The benefits and issues associated with the current form Global Metrics
Phase 2: Designing solutions and voting - COMPLETE

The second phase of the project focus on addressing the issues raised in Phase 1, by brainstorming and designing solutions openly on Meta based on ideas and suggestions gathered in Phase 1.

A proposal has been drafted on IdeaLab, with a three pronged solution:

  1. Simplify the requirement of Global Metrics, i.e. the structure, the measures used, and the way it is included in grant proposals and reports. The goal of simplifying the information requested by WMF is that it will hopefully provide more space for the other metrics and data that grantees find useful. As Global Metrics will never be comprehensive, it will aways need to complement other measures and data.
  2. Update, simplify and integrate the extensive existing documentation and resources (e.g. the learning patterns), as well a create a new resource: The Metrics Library. This library will aggregate the many quantitative metrics and qualitative measures for capturing outputs & outcomes, that have already been used by current or past grantees, as well as link to the relevant grant or tool (if it exists). This new resource aims to answer the commonly reported issue of "What could I be capturing for my project? How could I do it? Who has done it before?", by aggregating the collective knowledge in grants and moving toward a community of practice.
  3. Update Wikimetrics to become the primary tool for collecting Global Metrics, e.g. resolve long-standing user-interface issues, update the metrics included and their definition, etc.

While it is these three solutions together that can address the three problems stated, the second and third parts depend on the first, and need a longer timeframe to implement. As such, right now we are collecting feedback on the first part of the solution: simplifying and updating the requirement of Global Metrics.

Go to the IdeaLab page on redesigning Global Metrics to learn more and give feedback either publicly or privately.

Phase 3: Update - IN PROGRESS

A summary of the new grant metrics requirement and a summary of all the feedback (and changes made based on the feedback) can be found here.

Next steps include:

  • Emailing Project and Annual Plan Grantees, notifying them about the upcoming changes and timeline.
  • Update Collecting Global Metrics learning pattern - August 12th
  • Update grant proposal and reporting templates - Will vary by grant program, according to the dates the grant rounds start.
  • Begin scoping the Metrics Library project - August 15th
  • Begin scoping the tool for shared metrics project - September 5th
  • Select the final replacement for Global Metrics
    • Communicating this updated "Global Metrics", including Q&A