Wikimédia France/Indicateurs (Metrics)/2018-2019

From Meta, a Wikimedia project coordination wiki
Impact&Metrics
Courrielremy.gerbet(_AT_)wikimedia.fr
Référent·esRémy Gerbet WMFr
Sous-pages
Indicateurs (Métrics 2018-2019)
Indicateurs (Métrics 2019-2020)
Outils

Impacts et indicateurs[edit]

Pour l'année 2018 - 2019, en matière d'évaluation, sont mis en place trois indicateurs communs à tous les chapitres et définis par la Fondation, et des indicateurs définis par chaque chapitre.

Indicateurs partagés[edit]

Les trois indicateurs partagés par tous les chapitres (shared metrics) sont :

  1. nombre de participants à une action (un participant n'est pas un organisateur) ;
  2. nombre de nouveaux comptes utilisateurs créés (jusqu'à 2 semaines avant l'action) ;
  3. nombre de médias, articles, entrées.. créés et/ou améliorés sur l'ensemble des projets Wikimédia

Indicateurs Wikimédia France spécifiques :[edit]

Les deux indicateurs définis par l'association (grantee-defined measures) sont :

  1. nombre d'heures bénévoles ;
  2. satisfaction des partenaires (évaluée une fois par an à l'aide d'un questionnaire)

Indicateurs Wikimédia France spécifiques par action[edit]

D'autres indicateurs permettant de mesurer l'impact des actions menées ont été définies par thématique et action (liste non-exhaustive) :

  • nombre d’actions visant à réduire le faussé des genres sur les projets Wikimedia soutenues par WMFr
  • nombre de partenaires linguistiques impliqués
  • nombre d’actions organisées à l’initiative d’un groupe local
  • nombre de fois que l’espace contributeur est utilisé.
  • nombre d’accréditations accordées lors d'un évènement international
  • nombre de photos réutilisées dans le cadre des concours photo
  • nombre d’établissements scolaires qui mènent une action utilisant les projets Wikimédia


Page de travail recensant les indicateurs utilisés par Wikimedia France qui servira également à rassembler les métrics pour le process FDC

Progress Report 2018-2019[edit]

Axe 1: Partnerships and Content improvement[edit]

Axe 1: Partnerships and Content improvement
Metrics 2018/19 Target Progress (at end of Q2) Projected (end of year) Explanation
Participants 8,075 1,083 Opportunity for improvement The delay accumulated on certain projects and in particular in terms of communication has impacted the participation of the general public (Ma Commune Wikipedia, Lingua Libre). We expect to make up most of this delay in the next 6 months with concrete actions in this direction.
Newly registered editors 500 322 On track We plan to reach our goal by creating new accounts via the Lingua Libre project but also by GLAM activities already planned.
Pages added/improved 94,600 84,911 On track We should reach and exceed the intended goal because some content-providing actions have not yet been realized. In the same way, Lingua Libre workshops should still produce tens of thousands of contents.
Volunteer hours 1,745 1,092 On track We have included participation in working meetings, activities carried out within GLAM partner organisations and the time required for a photo competition jury.
Partners satisfaction 85% To be evaluated in June 2019 On track This result will be collected by means of an annual survey sent out to all partners having supported a contribution-related activity during the year.
Images/media added to Commons 90,600 84,911 On track As explained above, we should exceed our goal. Even if the number of partnerships has not substantially increased, the number of contributions belonging to GLAM projects on Wikimedia commons has exceeded our expectations.
% uploaded media used in content pages 50% 50.5% Achieved Among the GLAM activities, the photo competitions, Lingua Libre and Ma Commune Wikipedia, we have set a target of 50% of files reused in other Wikimedia projects. This figure is based on an average between the reuse rates of these different projects
Leading volunteers (WLM+WLE) 11 14 Achieved Here, we take account of people involved in the organisation of the competition, the selection of photos and participation in the jury’s decisions. We managed to mobilize new people in the organization of competitions
Numbers of page views of Lingua Libre 2,000/days 135/days (32500/6 month) On track We have modified this indicator to take into account the number of pages viewed on Lingua Libre, which seems to us, all the same, indicative of the traffic generated by the site. The number of visitors required the setting up of an ethically problematic tracking system.
Numbers of recording session with Lingua Libre 10 4 On track Wikimédia France has committed to organising 10 recording workshops in various languages on its premises.
Number of photo accreditation granted 10 3 On track Some shows and public event are coming
Leading GLAM partners of WMFr 5 3 On track We currently have three partners involved as ambassadors for the movement. We would like to see two other partners take on this role thanks to the organisation of a GLAM meeting conférence.
Contributing activities organized within a GLAM partnership 24 23 Achieved We have already achieved this goal and should therefore exceed it.

Axe 2: Working with communities[edit]

Axe 2. Working with Communities
Indicator 2018/19 Target
Progress (at end of Q2) Projected (end of year) Comments
Participants 700 356 On track The photographic competition devoted to Overseas France and Wikiconvention francophone 2018 are the two main actions that brought the most participation.
Newly registered editors 330 70 On track The delays in the minority languages program and the difficulty of measuring the activities of local groups will certainly not allow us to achieve the expected objective. On the other hand, actions such as the Wiki4women or the month of the francophone contribution that will take place in March 2019 attract new contributors.
Pages added/improved 15,000 1,051 Attention required The decision taken by Wikimedia France to stop its partnership with Signes de Sens deprives us of a gift of 10,000 videos in French sign languages which will not allow us to achieve our goal.
Volunteer hours 1,950 1,020 On track The organization of the Wikiconvention francophone 2018, the jury of the photo competition dedicated to Overseas, contribution activities related to gender gap but also the involvement of the members of the micro-financing commission are the main activities requiring time volunteer.
Partners satisfaction 85% To be evaluated in June 2019 On track This result will be obtained by means of an annual survey sent out to all partners having supported at least one contribution-related activity during the year.
Contribution activities to reduce the gender gap on Wikimedia projects 25 11 On track The Wikisource contribution workshops organized at Wikimedia France or the workshops conducted by the Sans Pages in Paris and Marseille bring new dynamics of beneficial contribution to the association.
Number of contributors involved in the Languages of France project 10 10 On track The working group around the languages of France is dynamic and voluntary for new projects. We lack a direction of development because the group can not engage with the sixty linguistic communities existing in France. There is a real need for prioritization.
numbers of local leading volunteer organizers 35 20 On track We currently have 20 leading volunteers in France, they organize, coordinate or run a large part of the contribution activities in France. These volunteers will be meeting in 2019 in Paris to discuss with them the relationship between the chapter and local groups.
Numbers of events organized by local groups 100 71 On track We count all the activities listed in the agenda of Wikimedia France. We incorporate activities in the main objective is not necessarily the contribution but participates in the consistency of groups and the reception of potential new members.
Numbers of volunteers granted 60 25 On track The enlargement of the micro-financing commission has allowed us to improve transparency on the use of the funds of the association. We note, however, that some volunteers are reluctant to use the microfinance commission or ignore its existence. We need to improve this for the next six months while creating a real reporting system.
Contribution activities organized into Cléry contributor space 30 21 On track The contributor area of Wikimedia France is occupied very regularly for contribution activities (Archeotopia, Wikisource, the Sans Pages ...). This is a real asset for the community that has seized this space to organize both convivial and contributory events but has also brought the salaried team closer to the volunteers.
Number of document package requested 60 20 On track The month of francophone contribution is a moment of strong demand. In addition, some local groups participate in forums in the period from January to June and request documentation at that time.
Percentage of contributors claiming to have been supported by Wikimédia France 55% To be evaluated in June 2019 On track During the survey carried on February 2018, of the 172 respondents 43.9% stated that they received support from Wikimedia France. We would like to increase this figure to 55% in 2018-2019.

Axe 3: Education et Formation[edit]

Axe 3. Education and Training
Metric 2018/19 Target
Progress (at end of Q2) Projected (end of year) Explanation
Participants 5,300 2,438 On track This number includes WikiMOOC subscribers until December 31, 2018. The MOOC currently counts 8 registrations per day which allows us to project a figure for the next 6 months. We did not count participants in the Wikiconcours high school student.
Newly registered editors 1,350 200 On track We have included WikiMOOC participants who have created an account on Wikipedia and plan to exceed the target set due to the large number of Wikiconcours high school students.
Pages added/improved 21,500 4,805 On track We expect to achieve the goal in view of the expected contributions in the WikiMOOC and Wikiconcours high school student.
Volunteer hours 460 194 On track Via the Wikiconcours which should see its number of registered participants increase and a MOOC which will not require new filming, the number of volunteer hours reflects the long-term involvement linked to support for teachers’ educational projects.
Partners satisfaction 85% to be evaluated in June 2019 On track This result will be collected by means of an annual survey sent out to partners having supported at least one contribution-related activity during the year.
Numbers of educational establishment using Wikipedia in a educational project 70 73 Achieved As part of the Wikiconcours high school student, 70 institutions are registered and lead a teaching project with Wikipedia. 3 other institutions are also conducting a pedagogical project. We are in conversation with 2 other institutions that should integrate a project in the next 6 months.
Numbers of volunteers involved into Wikiconcours 10 To be evaluated in June 2019 On track We would like to get non-member contributors more involved, in the same way as Wiki Loves Monuments and the checkers.
Numbers of diploma courses integrating the contribution to Wikimedia projects 5 3 On track Calculating the integration of contributions to Wikimedia projects in diploma courses is a relevant indicator regarding the efforts made by the association.
Numbers of consultation of the educational kit 4,800 3,000 On track The number of visits has increased significantly from 3,000 visits per year to 3,000 visits every 6 months.
Numbers of participants having completed the Wikimooc 3 400 To be evaluated in June 2019 On track Based on data from the previous years, but in view of the new format chosen this year, we hope to reach this goal.
Numbers of new editors still editing Wikimedia project a year after completed the Wikimooc 40 to be evaluated in June 2019 On track Based on data from the previous years, we believe that 40 people will continue contributing a year after the MOOC ends, i.e.10%
Percentage of volunteers expressing an increased level of skills 75% to be evaluated in June 2019 On track A survey will be sent out to volunteers having completed a training course run by Wikimedia France. We estimate that three quarters of the participants will declare that they have acquired new skills during the year.


Impact report 2018-2019[edit]

Axe 1[edit]

Axe 1: Partnerships and Content improvement
Metrics 2018/19 Target Progress (at end of Q2) Impact report (end of year) Explanation
Participants 8,075 1,083 1346 We stopped working on Ma Commune Wikipedia and Lingua Libre has seen significant improvements. A major communication campaign will be initiated around Lingua Libre in early 2020.
Newly registered editors 500 322 543 We reached our goal by creating new accounts via the Lingua Libre project but also by GLAM activities already planned.
Pages added/improved 94,600 84,911 195518 The goal has been exceeded, especially because of Lingua Libre which generated more than 100,000 new audio files in the space of 6 months.
Volunteer hours 1,745 1,092 1758 We have included participation in working meetings, activities carried out within GLAM partner organisations and the time required for a photo competition jury.
Partners satisfaction 85% To be evaluated in June 2019 83% This result comes from an annual survey sent out to all partners having supported a contribution-related activity during the year.
Images/media added to Commons 90,600 84,911 185232 As explained above, we should exceed our goal. Even if the number of partnerships has not substantially increased, the number of contributions belonging to GLAM projects on Wikimedia commons has exceeded our expectations.Lingua Libre is particularly responsible for this result
% uploaded media used in content pages 50% 50.5% 58% Among the GLAM activities, the photo competitions, Lingua Libre and Ma Commune Wikipedia, we have set a target of 50% of files reused in other Wikimedia projects. This figure is based on an average between the reuse rates of these different projects
Leading volunteers (WLM+WLE) 11 14 24 Here, we take account of people involved in the organisation of the competition, the selection of photos and participation in the jury’s decisions. We managed to mobilize new people in the organization of competitions
Numbers of recording session with Lingua Libre 10 4 10 Wikimédia France has committed to organising 10 recording workshops in various languages on its premises.
Number of photo accreditation granted 10 3 7
Leading GLAM partners of WMFr 5 3 3 We currently have three partners involved as ambassadors for the movement. We would like to see two other partners take on this role thanks to the organisation of a GLAM meeting conférence.
Contributing activities organized within a GLAM partnership 24 23 55 We have already achieved this goal in January but other actions carried out during the period lead us to far exceed our forecasts.


Axe 2[edit]

Axe 2. Working with Communities
Indicator 2018/19 Target
Progress (at end of Q2) Impact (end of year) Comments
Participants 700 356 1.069 The photographic competition devoted to Overseas France and Wikiconvention francophone 2018 are the two main actions that brought the most participation.
Newly registered editors 330 70 247 The delays in the minority languages program and the difficulty of measuring the activities of local groups will certainly not allow us to achieve the expected objective. On the other hand, actions such as the Wiki4women or the month of the francophone contribution that will take place in March 2019 attract new contributors.
Pages added/improved 15,000 1,051 3.415 The decision taken by Wikimedia France to stop its partnership with Signes de Sens deprives us of a gift of 10,000 videos in French sign languages which not allow us to achieve our goal.
Volunteer hours 1,950 1,020 3273 The organization of the Wikiconvention francophone 2018, the jury of the photo competition dedicated to Overseas, contribution activities related to gender gap but also the involvement of the members of the micro-financing commission are the main activities requiring time volunteer.
Partners satisfaction 85% To be evaluated in June 2019 83% This result comes from our annual survey sent out to all partners have supported at least one contribution-related activity during the year.
Contribution activities to reduce the gender gap on Wikimedia projects 25 11 43 The Wikisource contribution workshops organized at Wikimedia France or the workshops conducted by the Sans Pages in Paris and Marseille bring new dynamics of a beneficial contribution to the association.
Number of contributors involved in the Languages of France project 10 10 10 The working group around the languages of France is dynamic and voluntary for new projects. We lack a direction of development because the group can not engage with the sixty linguistic communities existing in France. There is a real need for prioritization.
numbers of local leading volunteer organizers 35 20 25 We currently have 25 leading volunteers in France, they organize, coordinate or run a large part of the contribution activities in France. These volunteers have met in 2019 in Paris to discuss with them the relationship between the chapter and local groups.
Numbers of events organized by local groups 100 71 134 We count all the activities listed in the agenda of Wikimedia France. We incorporate activities in the main objective is not necessarily the contribution but participates in the consistency of groups and the reception of potential new members.
Numbers of volunteers granted 60 25 86 The enlargement of the micro-financing commission has allowed us to improve transparency on the use of the funds of the association. We note, however, that some volunteers are reluctant to use the microfinance commission or ignore its existence. We don't succeed yet to create a clear reporting system but we are working on it.
Contribution activities organized into Cléry contributor space 30 21 33 The contributor area of Wikimedia France is occupied very regularly for contribution activities (Archeotopia, Wikisource, the Sans Pages ...). This is a real asset for the community that has seized this space to organize both convivial and contributory events but has also brought the salaried team closer to the volunteers.
Number of document package requested 60 20 40
Percentage of contributors claiming to have been supported by Wikimédia France 55% To be evaluated in June 2019 40.2% We have not been able to increase this percentage this year, and this is partly unaccounted for on the date used to send this form (July 2019) and the few answers received to the questionnaire about 70 or 100 less than the last year


Axe 3[edit]

Axe 3. Education and Training
Metric 2018/19 Target
Progress (at end of Q2) Impact (end of year) Explanation
Participants 5,300 2,438 5350 This number includes all WikiMOOC participants and the participants into the Wikiconcours high school student.
Newly registered editors 1,350 200 1077 We have included WikiMOOC participants who have created an account on Wikipedia and students who have been engaged in the Wikiconcours in high school
Pages added/improved 21,500 4,805 23,328
Volunteer hours 460 194 575 Volunteers participated by correcting and annotating students' productions and also by offering advice to WikiMOOC participants
Partners satisfaction 85% to be evaluated in June 2019 83% This result comes from the annual survey sent out to partners having supported at least one contribution-related activity during the year.
Numbers of educational establishment using Wikipedia in an educational project 70 73 73 As part of the Wikiconcours high school student, 70 institutions led a teaching project with Wikipedia. 3 other institutions have conducted a pedagogical project.
Numbers of volunteers involved into Wikiconcours 10 To be evaluated in June 2019 8 We
Numbers of diploma courses integrating the contribution to Wikimedia projects 5 3 3 Despite the opportunities and ongoing issues, there have been no new trainings initiated this year. Several projects are awaiting validation by the academies.
Numbers of consultation of the educational kit 4,800 3,000 5569 The number of visits has increased significantly from 3,000 visits per year to 3,000 visits every 6 months. This demonstrates the need for teachers to be accompanied
Numbers of participants having completed the Wikimooc 3 400 To be evaluated in June 2019 467 This is a very good result compared to the other MOOCs hosted by the FUN platform
Numbers of new editors still editing Wikimedia project a year after completing the Wikimooc 40 to be evaluated in June 2019 not evaluated yet
Percentage of volunteers expressing an increased level of skills 75% to be evaluated in June 2019 not evaluated yet A survey will be sent out to volunteers having completed a training course run by Wikimedia France.