Wikimédia France/Indicateurs (Metrics)/2018-2019

From Meta, a Wikimedia project coordination wiki
Jump to navigation Jump to search

Wikimedia-logo black.svg Wikimédia France Actions Soutien aux bénévoles Groupes de travail Documents Gouvernance Finances

Impact&Metrics
Courriel qualite@lists.wikimedia.fr
Référent·e·s PierreSelim
MatsWMFr
Sous-pages

Red.svg Impacts et indicateurs[edit]

Pour l'année 2018 - 2019, en matière d'évaluation, sont mis en place trois indicateurs communs à tous les chapitres et définis par la Fondation, et des indicateurs définis par chaque chapitre.

Indicateurs partagés[edit]

Les trois indicateurs partagés par tous les chapitres (shared metrics) sont :

  1. nombre de participants à une action (un participant n'est pas un organisateur) ;
  2. nombre de nouveaux comptes utilisateurs créés (jusqu'à 2 semaines avant l'action) ;
  3. nombre de médias, articles, entrées.. créés et/ou améliorés sur l'ensemble des projets Wikimédia

Indicateurs Wikimédia France spécifiques :[edit]

Les deux indicateurs définis par l'association (grantee-defined measures) sont :

  1. nombre d'heures bénévoles ;
  2. satisfaction des partenaires (évaluée une fois par an à l'aide d'un questionnaire)

Indicateurs Wikimédia France spécifiques par action[edit]

D'autres indicateurs permettant de mesurer l'impact des actions menées ont été définies par thématique et action (liste non-exhaustive) :

  • nombre d’actions visant à réduire le faussé des genres sur les projets Wikimedia soutenues par WMFr
  • nombre de partenaires linguistiques impliqués
  • nombre d’actions organisées à l’initiative d’un groupe local
  • nombre de fois que l’espace contributeur est utilisé.
  • nombre d’accréditations accordées lors d'un évènement international
  • nombre de photos réutilisées dans le cadre des concours photo
  • nombre d’établissements scolaires qui mènent une action utilisant les projets Wikimédia


Page de travail recensant les indicateurs utilisés par Wikimedia France qui servira également à rassembler les métrics pour le process FDC

Proposal form 2017/2018 round 2[edit]

Global metrics:

Axe 1: Partnerships and Content improvement[edit]

Axe 1: Partnerships and Content improvement
Indicator 2018/19 Target Explanation
Participants 8,075 This includes participants in the GLAM Projects but above all those in the photographic competitions and users of tools like Ma Commune Wikipedia and Lingua Libre, which will be entering an operational phase involving a great deal of communication and workshops organised around them.
Newly registered editors 500 Lingua Libre and the photographic competitions should generate most of the new accounts registered.
Pages added/improved 94,600 This includes the files uploaded from the photographic competition but also those regularly uploaded by members supported by Wikimedia France throughout the year, combined with the uploading of audio clips produced during the recording workshops with Lingua Libre.
Volunteer hours 1,745 We have included participation in working meetings, activities carried out within GLAM partner organisations and the time required for a photo competition jury.
Partners satisfaction 85% This result will be collected by means of an annual survey sent out to all partners having supported a contribution-related activity during the year.
Images/media added to Commons 90,600 Wikimedia Commons will be one of the main beneficiaries of the actions carried out in this area.
% uploaded media used in content pages 50% Among the GLAM activities, the photo competitions, Lingua Libre and Ma Commune Wikipedia, we have set a target of 50% of files reused in other Wikimedia projects.
Leading volunteers (WLM+WLE) 11 Here, we take account of people involved in the organisation of the competition, the selection of photos and participation in the jury’s decisions
Numbers of visitors/users of Ma Commune Wikipedia 5,000 We would like to measure the usage level of Ma Commune Wikipedia. With targeted communication aimed at local authorities, we hope to increase the use of Ma Commune Wikipedia as a gateway into contributing.
Numbers of visitors/users of Lingua Libre 2,000 This will concern everyone using Lingua Libre at least once during the year in France. Specific statistics concerning its use globally will be introduced during the year.
Numbers of recording session with Lingua Libre 10 Wikimédia France has committed to organising 10 recording workshops in various languages on its premises.
Number of photo accreditation granted 10
Leading GLAM partners of WMFr 5 We currently have three partners involved as ambassadors for the movement. We would like to see two other partners take on this role during the next financial year.
Contributing activities organized within a GLAM partnership 24 We aim to continue the process underway for the last two years by focusing on the diversity of the types of actions performed. For example, being more of a means than an end, the edit-a-thon model is showing its limits in terms of getting partners involved and guaranteeing long-term collaborations.

Axe 2: Working with communities[edit]

Axe 2. Working with Communities
Indicator 2018/19 Target
Explanation
Participants 700 We have included all participants in events organised or supported by Wikimédia France, including among others the major conferences such as the French language Wikiconvention and the Wikisource conference but also the major contribution days linked to highly engaging initiatives to promote a more diverse community.
Newly registered editors 330 The contribution days are the main events leading to account creations for Wikimedia projects. Thanks to more regular use of the dashboard we aim to be better able to keep track of these new contributors, to support them with their integration within the movement.
Pages added/improved 15,000 Although the French language contribution month and the major contribution days generally result in the creation of numerous articles, this is not the case for an event such is the French language Wikiconvention. For its part, the sign language project should result in the creation of a major video database (10,000).
Volunteer hours 1,950 The commitment of our volunteers is important when organising and running workshops. For an international event such as the French language Wikiconvention this time can triple (grants, preparatory meetings, programme design, reception activities and the running of the events themselves, etc.).
Partners satisfaction 85% This result will be obtained by means of an annual survey sent out to all partners having supported at least one contribution-related activity during the year.
Contribution activities to reduce the gender gap on Wikimedia projects 25 Based on the dynamism seen last year, we hope to support the organisation of 25 contribution workshops aimed at reducing the gender gap on Wikimedia projects. These events are welcomed favourably by the general public and receive significant media coverage.
Number of contributors involved in the Languages of France project 10 More precisely this is the number of contributors involved in the working group aimed at supporting contributions to projects in regional and minority languages. This working group will seek to be as representative as possible of the different communities.
numbers of local leading volunteer organizers 35 By “leading volunteer” we are referring to contributors involved in the organisation of contribution-related events in the regions or organising meetings of Wikimedians (representatives of local groups and volunteers involved locally in specific contribution themes).
Numbers of events organized by local groups 100 We would like to be better able to report back on the dynamism of the local groups in France, particularly thanks to resources such as the Wikilettre (newsletter of WMFr) and the events calendar feature on Meta-Wiki.
Numbers of volunteers granted 60 The changes made to improve the micro-financing committee enable us to be better able to monitor those volunteers having received financial support, including the context in which this occurred (local groups’ activities, travel costs to participate in Wikimedia events, the purchasing of equipment, etc.).
Contribution activities organized into Cléry contributor space 30 The creation of a genuine area for the community within the premises of Wikimédia France should make it possible to facilitate meetings of Wikimedians living in the Paris region but also the organisation of contribution workshops with the equipment provided (book scanner, photo studio, computers, bibliographical resources).
Number of document package requested 60 We are frequently asked for documentary sources, particularly for workshops and training sessions focusing on Wikimedia projects. Drawing up a precise list of the requests, the recipients and the reasons would in our opinion provide interesting information to have on record, particularly to underline the role of Wikimedia France as an activity facilitator
Percentage of contributors claiming to have been supported by Wikimédia France 55% During the survey carried out last February, of the 172 respondents 43.9% stated that they received support from Wikimedia France. We would like to increase this figure to 55% in 2018-2019

Axe 3: Education et Formation[edit]

Axe 3. Education and Training
Indicator 2018/19 Target
Explanation
Participants 5,300 By repeating the MOOC and the Wikiconcours lycéen, we envisage consolidating a long-term trainee base as numerous as in previous years. The new activities planned for next year including new stakeholders not yet included in the figures are now are now incorporated.
Newly registered editors 1,350 These come mainly from the MOOC, the Wikiconcours and any possible contribution days.
Pages added/improved 21,500 These come mainly from the MOOC, the Wikiconcours and any possible contribution days.
Volunteer hours 460 Via a Wikiconcours (wikicompetition) which should see its number of registered participants increase and a MOOC which will not require new filming, the number of volunteer hours reflects the long-term involvement linked to support for teachers’ educational projects.
Partners satisfaction 85% This result will be collected by means of an annual survey sent out to partners having supported at least one contribution-related activity during the year.
Numbers of educational establishment using Wikipedia in a educational project 70 The Wikiconcours lycéen already makes it possible to identify educational establishments using Wikipedia in the classroom and we are targeting an increase in registered participants in addition to improved identification of the establishments carrying out educational projects.
Numbers of volunteers involved into Wikiconcours 10 We would like to get non-member contributors more involved, in the same way as Wiki Loves Monuments and the checkers.
Numbers of diploma courses integrating the contribution to Wikimedia projects 5 Calculating the integration of contributions to Wikimedia projects in diploma courses is a relevant indicator regarding the efforts made by the association.
Numbers of consultation of the educational kit 4,800 Currently, the number of visitors (per year) varies between 3,500 and 4,000. With the new educational kits, we hope for greater visibility.
Numbers of participants having completed the Wikimooc 3 400 Based on data from the previous years, we believe that 400 people will complete the MOOC.
Numbers of new editors still editing Wikimedia project a year after completed the Wikimooc 40 Based on data from the previous years, we believe that 40 people will continue contributing a year after the MOOC ends, i.e.10%
Percentage of volunteers expressing increased level of skills 75% A survey will be sent out to volunteers having completed a training course run by Wikimedia France. We estimate that three quarters of the participants will declare that they have acquired new skills during the year.

Progress report 2017/2018[edit]

Axe 1[edit]

Axe 1: Partnerships and Content improvement
Metrics 2018/19 Target Progress (at end of Q2) Projected (end of year) Explanation
Participants 8,075 1,083 Opportunity for improvement The delay accumulated on certain projects and in particular in terms of communication has impacted the participation of the general public (Ma Commune Wikipedia, Lingua Libre). We expect to make up most of this delay in the next 6 months with concrete actions in this direction.
Newly registered editors 500 322 On track We plan to reach our goal by creating new accounts via the Lingua Libre project but also by GLAM activities already planned.
Pages added/improved 94,600 84,911 On track We should reach and exceed the intended goal because some content-providing actions have not yet been realized. In the same way, Lingua Libre workshops should still produce tens of thousands of contents.
Volunteer hours 1,745 1,092 On track We have included participation in working meetings, activities carried out within GLAM partner organisations and the time required for a photo competition jury.
Partners satisfaction 85% To be evaluated in June 2019 On track This result will be collected by means of an annual survey sent out to all partners having supported a contribution-related activity during the year.
Images/media added to Commons 90,600 84,911 On track As explained above, we should exceed our goal. Even if the number of partnerships has not substantially increased, the number of contributions belonging to GLAM projects on Wikimedia commons has exceeded our expectations.
% uploaded media used in content pages 50% 50.5% Achieved Among the GLAM activities, the photo competitions, Lingua Libre and Ma Commune Wikipedia, we have set a target of 50% of files reused in other Wikimedia projects. This figure is based on an average between the reuse rates of these different projects
Leading volunteers (WLM+WLE) 11 14 Achieved Here, we take account of people involved in the organisation of the competition, the selection of photos and participation in the jury’s decisions. We managed to mobilize new people in the organization of competitions
Numbers of page views of Lingua Libre 2,000/days 135/days (32500/6 month) On track We have modified this indicator to take into account the number of pages viewed on Lingua Libre, which seems to us, all the same, indicative of the traffic generated by the site. The number of visitors required the setting up of an ethically problematic tracking system.
Numbers of recording session with Lingua Libre 10 4 On track Wikimédia France has committed to organising 10 recording workshops in various languages on its premises.
Number of photo accreditation granted 10 3 On track Some shows and public event are coming
Leading GLAM partners of WMFr 5 3 On track We currently have three partners involved as ambassadors for the movement. We would like to see two other partners take on this role thanks to the organisation of a GLAM meeting conférence.
Contributing activities organized within a GLAM partnership 24 23 Achieved We have already achieved this goal and should therefore exceed it.

Axe 2[edit]

Axe 2. Working with Communities
Indicator 2018/19 Target
Progress (at end of Q2) Projected (end of year) Comments
Participants 700 356 On track The photographic competition devoted to Overseas France and Wikiconvention francophone 2018 are the two main actions that brought the most participation.
Newly registered editors 330 70 On track The delays in the minority languages program and the difficulty of measuring the activities of local groups will certainly not allow us to achieve the expected objective. On the other hand, actions such as the Wiki4women or the month of the francophone contribution that will take place in March 2019 attract new contributors.
Pages added/improved 15,000 1,051 Attention required The decision taken by Wikimedia France to stop its partnership with Signes de Sens deprives us of a gift of 10,000 videos in French sign languages which will not allow us to achieve our goal.
Volunteer hours 1,950 1,020 On track The organization of the Wikiconvention francophone 2018, the jury of the photo competition dedicated to Overseas, contribution activities related to gender gap but also the involvement of the members of the micro-financing commission are the main activities requiring time volunteer.
Partners satisfaction 85% To be evaluated in June 2019 On track This result will be obtained by means of an annual survey sent out to all partners having supported at least one contribution-related activity during the year.
Contribution activities to reduce the gender gap on Wikimedia projects 25 11 On track The Wikisource contribution workshops organized at Wikimedia France or the workshops conducted by the Sans Pages in Paris and Marseille bring new dynamics of beneficial contribution to the association.
Number of contributors involved in the Languages of France project 10 10 On track The working group around the languages of France is dynamic and voluntary for new projects. We lack a direction of development because the group can not engage with the sixty linguistic communities existing in France. There is a real need for prioritization.
numbers of local leading volunteer organizers 35 20 On track We currently have 20 leading volunteers in France, they organize, coordinate or run a large part of the contribution activities in France. These volunteers will be meeting in 2019 in Paris to discuss with them the relationship between the chapter and local groups.
Numbers of events organized by local groups 100 71 On track We count all the activities listed in the agenda of Wikimedia France. We incorporate activities in the main objective is not necessarily the contribution but participates in the consistency of groups and the reception of potential new members.
Numbers of volunteers granted 60 25 On track The enlargement of the micro-financing commission has allowed us to improve transparency on the use of the funds of the association. We note, however, that some volunteers are reluctant to use the microfinance commission or ignore its existence. We need to improve this for the next six months while creating a real reporting system.
Contribution activities organized into Cléry contributor space 30 21 On track The contributor area of Wikimedia France is occupied very regularly for contribution activities (Archeotopia, Wikisource, the Sans Pages ...). This is a real asset for the community that has seized this space to organize both convivial and contributory events but has also brought the salaried team closer to the volunteers.
Number of document package requested 60 20 On track The month of francophone contribution is a moment of strong demand. In addition, some local groups participate in forums in the period from January to June and request documentation at that time.
Percentage of contributors claiming to have been supported by Wikimédia France 55% To be evaluated in June 2019 On track During the survey carried on February 2018, of the 172 respondents 43.9% stated that they received support from Wikimedia France. We would like to increase this figure to 55% in 2018-2019.

Axe 3[edit]

Axe 3. Education and Training
Metric 2018/19 Target
Progress (at end of Q2) Projected (end of year) Explanation
Participants 5,300 2,438 On track This number includes WikiMOOC subscribers until December 31, 2018. The MOOC currently counts 8 registrations per day which allows us to project a figure for the next 6 months. We did not count participants in the Wikiconcours high school student.
Newly registered editors 1,350 200 On track We have included WikiMOOC participants who have created an account on Wikipedia and plan to exceed the target set due to the large number of Wikiconcours high school students.
Pages added/improved 21,500 4,805 On track We expect to achieve the goal in view of the expected contributions in the WikiMOOC and Wikiconcours high school student.
Volunteer hours 460 194 On track Via the Wikiconcours which should see its number of registered participants increase and a MOOC which will not require new filming, the number of volunteer hours reflects the long-term involvement linked to support for teachers’ educational projects.
Partners satisfaction 85% to be evaluated in June 2019 On track This result will be collected by means of an annual survey sent out to partners having supported at least one contribution-related activity during the year.
Numbers of educational establishment using Wikipedia in a educational project 70 73 Achieved As part of the Wikiconcours high school student, 70 institutions are registered and lead a teaching project with Wikipedia. 3 other institutions are also conducting a pedagogical project. We are in conversation with 2 other institutions that should integrate a project in the next 6 months.
Numbers of volunteers involved into Wikiconcours 10 To be evaluated in June 2019 On track We would like to get non-member contributors more involved, in the same way as Wiki Loves Monuments and the checkers.
Numbers of diploma courses integrating the contribution to Wikimedia projects 5 3 On track Calculating the integration of contributions to Wikimedia projects in diploma courses is a relevant indicator regarding the efforts made by the association.
Numbers of consultation of the educational kit 4,800 3,000 On track The number of visits has increased significantly from 3,000 visits per year to 3,000 visits every 6 months.
Numbers of participants having completed the Wikimooc 3 400 To be evaluated in June 2019 On track Based on data from the previous years, but in view of the new format chosen this year, we hope to reach this goal.
Numbers of new editors still editing Wikimedia project a year after completed the Wikimooc 40 to be evaluated in June 2019 On track Based on data from the previous years, we believe that 40 people will continue contributing a year after the MOOC ends, i.e.10%
Percentage of volunteers expressing an increased level of skills 75% to be evaluated in June 2019 On track A survey will be sent out to volunteers having completed a training course run by Wikimedia France. We estimate that three quarters of the participants will declare that they have acquired new skills during the year.