Grants:APG/Proposals/2016-2017 round 2/Wikimédia France/Impact report form
Purpose of the report
This form is for organizations receiving Annual Plan Grants to report on their results to date. For progress reports, the time period for this report will the first 6 months of each grant (e.g. 1 January - 30 June of the current year). For impact reports, the time period for this report will be the full 12 months of this grant, including the period already reported on in the progress report (e.g. 1 January - 31 December of the current year). This form includes four sections, addressing global metrics, program stories, financial information, and compliance. Please contact APG/FDC staff if you have questions about this form, or concerns submitting it by the deadline. After submitting the form, organizations will also meet with APG staff to discuss their progress.
- 1 Purpose of the report
- 2 Global metrics overview - all programs
- 3 Overview
- 4 Telling your program stories - all programs
- 5 THEME 1 - CONTENT DEVELOPMENT
- 5.1 Item A: Focusing on heritage
- 5.2 Item B: Activities involving schools and universities
- 5.3 Item C: Languages
- 6 THEME 2: WORKING WITH THE COMMUNITIES
- 7 THEME 3: PROMOTING AND PROTECTING PROJECTS
- 7.1 Item A: Training target audiences (schools, volunteers and professionals)
- 7.2 Item B: Open Content
- 7.3 Item C: Open Data
- 8 Revenues received during this period (6 month for progress report, 12 months for impact report)
- 9 Spending during this period (6 month for progress report, 12 months for impact report)
- 10 Compliance
- 11 Signature
- 12 Resources
Global metrics overview - all programs
We are trying to understand the overall outcomes of the work being funded across our grantees' programs. Please use the table below to let us know how your programs contributed to the Global Metrics. We understand not all Global Metrics will be relevant for all programs, so feel free to put "0" where necessary. For each program include the following table and
- Next to each required metric, list the outcome achieved for all of your programs included in your proposal.
- Where necessary, explain the context behind your outcome.
- In addition to the Global Metrics as measures of success for your programs, there is another table format in which you may report on any OTHER relevant measures of your programs success
For more information and a sample, see Global Metrics.
The table below shows our results for all programmes. Due to the various changes experienced by Wikimedia France during these last six months we are not able to detail these results by program. This will be done for the impact report and in anticipation of the next FDC application. In fact, a broad reflection will be conducted in February with the members of the chapter to better measure the impact of our actions and to collectively draw a development strategy for the coming year.
|Metrics||Halfyears metrics||Results for the period January-June 2018||Total for the year||End of the Year Targets||Explanation|
|Participants GM1||1,319||3,085||4,404||9,965||This metrics includes all WLM and WLE participants, those present at the French Wikicon 2017, participants to the Lingua Libre project. and to the month of francophone contribution. We also added people who participated in editathons since last July like the Wiki4women and people trained. The difference between the objective and the results in progress report is explained by two differents things. First of all, an estimation error on our part, cumulated with the problems encountered by Wikimedia France this year. Moreover the Wikimooc 3 (which began in September 2018) was planned for this time period.
Useful link :
|Newly registed editors GM2||178||937||1,115||2,720||As Wikimooc 3 finally started in September 2018 and will spread over a year we could not reach our goal.|
|Articles added/improved GM3||31,348 (whose 29,064 are images and 3,729 reused (12,8%) + ?||66,783 (of which 21,136 have been reused)||98,131 (of which 21,136 have been reused)||16,700 (and 10,550 reuse on the Wikimedia projects)||We can only note that we have totally underestimated this metric. The success of Lingua Libre and the photo contest explains that we have largely exceeded this objective. But it's also telling that Wikimedia France has never really managed to plan specific goals. This is about to change.
|Volunteers hours||3,051||2,475||5,526||not planned|
|Partners satisfaction||81.4%||not planned||To the following question "On a scale of 1 to 10, how would you rate the partnership as a whole?" Respondents gave an average of 8,14/10 (93% of respondents gave a score greater than or equal to 7/10).|
For six months, Board and staff have launched a number of projects to restore confidence and rebuild a solid foundation for the French chapter. In order to strengthen the links between the members and the association, in this period of great changes, it became necessary to produce a report in June for volunteers. The objective was to list the various actions launched. Since most of the initiated projects will not be transcribed in the Impact report's plan, we thought it necessary to translate it in order to include it in this document. A year later, the association has undergone profound changes and most of the work started will not be completed until 2019.
To restructure the organization, the Board decided to do all the necessary changes during the year, so that the next year, all our efforts will be dedicated to our programs. The main goals of 2017-2018 were:
- lower operating costs,
- increase transparency,
- clarify the role of each institution (Board, staff, Audit Committee, Grant Committee, General Assembly) within the organization,
- improve our capabilities in strategy and impact measurement,
- better tools that allow us to work effectively.
A timeline was realised to show all the major reforms done during the year.
Telling your program stories - all programs
THEME 1 - CONTENT DEVELOPMENT
Although little progress has been made this year and especially towards projects like my Wikipedia Community, we still managed to organize an edition of Wiki loves Earth. A new photo contest that was linked in August 2017 was also organized during this period, in partnership with the Ministry of Overseas and the French Development Agency. This new contest was exclusively dedicated to the ultra-marine territories. We also got closer to associations interacting with local communities, like the ADDULACT, to develop joint approaches in favour of data release. In 2019, we will seriously rethink our partnership approach towards municipalities and define clearer objectives especially by working closely with cities already seriously engaged in this process.
For the last four years, Wikimedia France has been inviting everyone to participate in Wiki Loves Earth, the Earth photography competition organized throughout the whole of May, with the goal of putting the spotlight on biodiversity on Wikipedia. The overriding aim is to showcase natural French heritage and make it accessible on the Internet. Photographing nature is a good way to make the French people aware of the natural heritage around them and to bring Wikimedia projects to the attention of the general public. Since the third international event in 2013, the French version of Wiki Loves Earth has made it possible to put 7,303 photos online imported by 666 different people. Each year, Wikimedia France’s volunteers donate an average of 320 hours of their time to organize, sort and select the winning photos and to assist with organisation. Unfortunately, the number of contributions and participants has been tailing off since 2017. The volunteers on the organisational committee and more widely the association staff had begun to wonder whether there was any value in continuing the competition. After numerous discussions with the working group members and the community, it was finally decided to continue organizing the competition, which remains one of the association's most effective actions, with 101 new accounts created in 2017. Unfortunately, following the particularly difficult context the association experienced in 2017 with the loss of confidence from the volunteers and the reduction of funds allocated to our actions, the launch of the competition almost didn't go ahead. The fourth Wiki Loves Earth France competition was launched in early March with a team of half dozen volunteers. For this 2018 event, three jury members, amateur photographers and contributors to Wikimedia projects participated in three selection rounds to choose the best from the thousands of competing images. Ten of these were selected, listed in order of preference, earning the authors recognition for their volunteer work and photographic talents.
With the last campaign taking place in a particularly difficult internal context at Wikimedia France, a significant fall in participation was noted (998 photos). On a positive note, these photos were posted online by 121 photographers, 77% of whom are new contributors to Wikimedia projects.
The chapter’s activities in the educational and teaching fields include teaching people about the media and the provision of information aimed at helping people develop a critical state of mind and encouraging teamwork among pupils and students. To achieve this, we regularly provide “training for trainers” at various levels (teachers and teacher-documentalists) enabling them to carry out educational projects within an establishment. They can also have their project included within a reference framework for several months via the Wikiconcours lycéen, a competition which is aimed at high schools. Regularly updated resources are made available to everyone, including among others the educational kit launched in September 2015. The association has also been officially recognised since 2014 by the Ministry of National Education as an educational association complementary to public education.
Over the last twelve months, we have consequently trained teachers in the use of Wikimedia projects in the classroom and in contribution, as part of the training sessions provided ahead of the Wikiconcours lycéen (high school Wikicompetition). The latest version of this competition was organised once again with the Ministry of National Education (CLEMI/CANOPE) in late November 2017. Teachers and teacher-documentalists were also supported in their efforts to introduce Wikimedia-based educational projects. Concerning the Wikiconcours lycéen (high school Wikicompetition), the organisational team has been joined by two teachers who are contributors to Wikipedia. Thanks to their dual role, they possess extensive technical knowledge of the tool and also of the educational aspects. We are delighted that they were prepared to participate once again in organising and monitoring the competition. Contributions to the Wikiconcours lycéen were chiefly made between January and May 2018, resulting in the creation and modification of 450 articles. For the first time since this initiative was launched, we are proud to have added a prize-giving evening to the programme, which was held in June 2018 at the Centre Georges Pompidou in Paris, attended by 50 people including the winning pupils and their teachers from this latest event. Video clips of both the teachers and the pupils were produced and were imported into Wikimedia Commons.
- Wikiconcours lycéen:
- The first time a prize-giving event was held for the Wikiconcours lycéen
- 22 participating educational authorities, 38 establishments enrolled, 840 participants, 450 articles created and modified.
With the focus being placed on developing Lingua Libre over the last six months, the other regional and minority language projects have been delayed. A new subsidy received recently means that we can envisage completing the project concerning the incorporation of sign language into Wikipedia by 2019. The development of a web extension making it easy to read Wikipedia articles accompanied by the uploading of 20,000 videos in sign language to Wikimedia Commons will enable the French version of Wikipedia to take an initial step toward greater inclusiveness. Concerning the actions aimed at the Wikimedian community in minority languages, a poll was organised for them to establish a transparent working relationship between the chapter and the dozen or so linguistic communities existing in France. We are expecting significant progress in the coming months. However, the most important developments have centred on the Lingua Libre project.
Lingua Libre is a tool which seeks to facilitate oral contributions to Wikimedia projects. Thanks to the grant obtained by Antoine Lamielle, the development of this tool took a decisive step forward during the last six months. Indeed, Lingua Libre is now connected to Wikimedia Commons and thousands of recordings have already been added to the media library but also to other projects. As Lingua Libre has become fully operational, we will be able to launch a huge recording programme, aimed initially at regional and minority languages. Based on Mediawiki and Wikibase technology, Lingua Libre is therefore now a wiki, capable of running on a stand-alone basis and therefore of forming the basis for the development of a new community of users. Bi-monthly meetings have enabled the original team to monitor the development of the tool, to contribute ideas and to test the developments introduced. Thanks to the work carried out, we will be able to promote the circulation of this tool and its use during major contribution events. We have already increased the size of the server to meet the requirements of the new website. We are particularly proud of the rapid internationalization of the tool and its use by Wikimedians around the world as shown by the tutorial made by an Indian contributor.
- Link to the website = lingualibre.fr
- Participants: 90
- Number of content items created or improved: 41,883
- Content items reused on other Wikimedia projects: 16,290 (38.8%)
- Volunteer hours: 350 hours
THEME 2: WORKING WITH THE COMMUNITIES
The work to encourage greater cooperation between the chapters and the Francophone user group is still being prepared. The meetings held in Berlin and at Wikimania made it possible to identify areas which will need to be approved during the Francophone Wikiconvention 2018 to be held in Grenoble from October 5-7. The aim is to come up with a new model for cooperation and dialogue between the movement's Francophone organisations: logistical and financial support, training, exchanges of best practices or the production of joint tools and resources. The redesign of the Meta page presenting Wikifranca is part of this collaborative work undertaken over the last six months. Since January, Wikimedia France has financially and logistically supported the organisation of contribution workshops by the Francophone user groups, particularly during Francophone contribution month, an international event whose success has been clearly demonstrated.
Since 2013, Wikifranca has been coordinating the Francophone contribution month. Events were organised all over the French-speaking world throughout March. This year, once again, participation was high. However, certain limitations have also appeared this year, especially the fact that the general organisation chiefly fell to the Wikifranca coordinator. We need to find a better way to distribute tasks between the Wikimedian organisations. This year, Wikimedia France was particularly involved in order to support contribution activities in different countries (Benin, Cameroon, Congo) but also in France, with 23 workshops throughout the whole of March.
- 70 contributors’ workshops
- 15 countries
- 40 towns
- 200 articles created (France)
- 400 participants (France)
The crisis in Wikimedia France severely disrupted local activities. Since January 2018, a great deal has been done to repair the relationship between local communities and Wikimedia France. The financing of local groups has been transferred entirely to the micro-fi committee to avoid any confusion or any lack of transparency. A common diary on Meta enables everyone to have a shared overview of the activities. A contributors area worthy of its name has been set up on Wikimedia France’s premises and we are very proud of the fact that contribution activities and meetings are often being held there.
In January 2018, the premises of Wikimedia France were rearranged to make room for a real space reserved for contributors. In addition, the method of financing local groups has been redesigned for greater transparency, in particular by increasing the role of the micro-grant committee. The establishment of a common agenda on Meta has also made it possible to centralize information on activities organized by local groups. Thus, communication between local groups but also between local groups and employees has been facilitated. We decided to temporarily stop our desire to create local groups in order to focus on supporting and monitoring existing groups. The referral role will be removed to the benefit of a more horizontal and direct organization between volunteers and the association. The new contributor area in Cléry has made it possible to carry out numerous contribution activities. For this report, we have chosen to highlight the work done by the association "Georges2etexte" to digitize the works of women authors for Wikisource. Some of the transcribed texts came from the partnership with the Nationale Library of France.
- 20 workshops organized in the contributors area
- included 10 workshops dedicated to Wikisource.
- 50 participants
- 20 books posted on Wikimedia Commons and transcribed on Wikisource
THEME 3: PROMOTING AND PROTECTING PROJECTS
The association is regularly asked to organise training in contributing to Wikimedia projects (mainly Wikipedia, Wikidata and Wikimedia Commons). The audiences are diverse and usually depend on the theme and the context concerned. The training sessions can be organised at the initiative of a partner or of the association in order to train contributors to future edit-a-thons or volunteers from the association keen to improve their skills. Over the last 12 months, we’ve seen an increase in the amount of training designed and produced by the association. The initial target audience is teachers, who have expressed a demand for training, mainly in the use of Wikipedia and its deployment in the classroom with the launch of educational projects.
One particular characteristic should be noted this year compared to previous years: we have been asked to help combat fake news and to foster a critical spirit. These points were covered during previous training but we are seeing greater focus on this by trainees at the start of the training. This is clearly linked to current events and also to the priorities of the National Education Ministry. In keeping with this theme, we have provided training for teachers during two Journées des communs (Commoners’ co-working days) and an inter-education authority workshop. In addition to the usual target audiences, who are teachers, documentalists and librarians, etc., we also trained around a dozen association task officers as part of an initiative with Greenpeace.
As part of the contribution days carried out in partnership with the town of Sevran (93) for the last three years, we had an opportunity to train numerous inhabitants of all ages from the town in contributing to Wikimedia projects (particularly Wikipedia and Commons). At the end of these contribution days, an evaluation with the partner led us to organise day of training for trainers/supervisors which was held in January 2018 over a complete day, and which involved 2 supervisors and 12 participants. The participants were a mixed group of former and new contributors. The supervisors firstly explained the basics of the Wikipedia project and of Wikimedia Commons, before giving a presentation of the projects in the Wikimedia environment. The participants were then invited to create a presentation page in the visual editor and to play around at leaving messages on a discussion page in code and to sign their messages there. After lunch (provided by a local association), the focus was placed on the prerequisites for creating an article and its difficulties (the admissibility criteria for the articles and awareness-related criteria), by getting them to create a draft sub-page in their personal area concerning a particular subject.
- 12 supervisors trained
- A long-term partnership which has been going for more than two years with numerous contribution days and training sessions
The end of 2017 ended with the implementation of a decision to thoroughly review our vision of partnerships with cultural institutions, the context and the objectives in which they fit. Since then, the strategy of our new GLAM project has emerged on the basis of the assessment completed in early 2018. We have worked at the same time on prospecting and managing partnerships. We have prepared partnerships with new partners such as Latmos,CNES or Bibliothèque Interuniversitaire de la Sorbonne, trained cultural agents such as the Musée Bourdelle, launched edit-a-thons or other workshops such as the Louvre Lens, Opéra Comique de Paris, the municipal library of Bordeaux, the media library of Strasbourg or continued our in-depth work with broader partnerships as with the city of Toulouse. We will come back to this collaboration further below. A datathon on March 10 also enriched our collaboration with the National Archives with which we were trying to set up a "Wikipedian in residence". This is one of the priorities for the coming year. Beyond the implementation of the strategic axes, defined by suitable actions, the WIR will be a focus for this year in order to combine the constraints of volunteers availabilities with the issue of credibility and notoriety within our cultural environment. The next few months will see our first implementation with partners as part of our GLAM project. This work will also benefit from the movement feedbacks because it will be presented at the GLAMWiki Conference 2018 in Tel Aviv in early November.
In 2010, the City of Toulouse and Wikimedia France signed a partnership to encourage open content initiatives and partnerships with the city’s different cultural institutions. Since then, activities have been carried out with the Natural History Museum as part of the Phoebus project, the municipal archives for the contribution of several collections, the municipal library and the Musée des Augustins for training, edit-a-thons and contributions. This cooperation has continued over the last year with the involvement of volunteers from the region and of partners. Christelle Molinié, who represented the Musée des Augustins in the region, has continued her involvement in Wikimedia projects with the Musée Saint Raymond. The contribution of images and 3-D models from the museum which began in March 2017 has continued up to the present date with more than 200 uploads. The exhibition "Rituels Grecs, une expérience sensible" made it possible to add 99 images sur commons. The museum also hosted a Wikimedia commons workshop on 2017 September 2nd which made it possible to add 392 images.
The Musée Saint Raymond also organised a contribution workshop for the Journées Nationales de l'Archéologie (national archaeology days) on June 16, 2018 with partner institutions: the Musée Paul-Dupuy, the regional archaeology department and the Direction Régionale des Affaires Culturelles (regional cultural affairs department), Toulouse’s municipal archives and the Natural History Museum. This day made it possible to upload a collection of 200 high definition photos from Toulouse’s archive by 11 contributors, create 8 articles, edit 42 articles, contribute 229 images, 199 images from the municipal archives during the workshop and 85 images previously from the DRAC-Occitanie, Natural History Museum, Musée Paul-Dupuy and Musée Saint-Raymond.
Additionally, the work with the City of Toulouse’s municipal archives continued with the addition of collections from the City of Toulouse’s André Cros collection. The 5 volunteers’ work yielded : 7,000 press photos from the 1950s, 1960s, 1970s and 1980s (B&W). Finally, the actions carried out at the start of the partnership have continued with involvement of volunteers, for example with the Musée du vieux Toulouse, the Bemberg foundation, the Musée des Augustins or the Phoebus project, for which one or several images are categorised as QI or VI concerning ornithology, entomology, or ethnology.
- 4 workshops organized
- 29 participants
- 8048 uploads and improved contents
- A sustainable partnership
Wikimédia France has been involved in supporting open data in general and Wikdata in particular since 2012. This includes both training editors and helping institutions to open their data and contents. Our goal is to increase awareness of Wikidata amongs cultural institutions. Open data is currently a major goal for them, as the French loi Numérique (Digital law) forces all French administrations to publish their databases that present "economical, social, sanitary or environmental interest" before October 2018.
While we had initially planed to work on organizing a meeting about open data and Wikidata, this event was postponed to 2019 due to lack of financial and human resources.
This year, we experimented with a new type of workshop, known as datathons. These workshops involve aligning institutions’ databases with Wikidata, using the Mix'n'Match tool created by Magnus Manske. The idea is to directly train specialists in this field in the use of Mix'n'Match and of Wikidata, and to highlight one of Wikidata’s key benefits, that of being a central hub for linked data. Two workshops of this type have been organized, with different types of data. The first was held in Aix-en-Provence to align the PACTOLS thesaurus of the Magna Grecia Open Data project, containing around 30,000 terms related to archaeology and the ancient world (individuals, places, periods, works, peoples, etc.). The second was held at the national archives and concerned this institution’s authority records. As the national archives have many notices for people which can be difficult to identify, work to select the best documented entries took place upstream, resulting the selection of approximately 2,500 people and 680 organisations. In view of this tool’s limitations, this type of workshop makes it possible to welcome around fifteen participants, including two or three experienced Wikimedians to answer questions from the experts concerning the aligned database. Apart from the alignment itself, this makes it possible to raise awareness of the question of homonyms and duplicate entries, and to show how to complete the basic information concerning Wikidata entries, particularly regarding people.
- 2 workshops
- 30 people trained
- 2000 edits on 1600 items
- Trained people are now autonomous and capable of making datathons independantly
Revenues received during this period (6 month for progress report, 12 months for impact report)
Please use the exchange rate in your APG proposal. 1 € = 1.05939 $
Table 2 Please report all spending in the currency of your grant unless US$ is requested.
- Please also include any in-kind contributions or resources that you have received in this revenues table. This might include donated office space, services, prizes, food, etc. If you are to provide a monetary equivalent (e.g. $500 for food from Organization X for service Y), please include it in this table. Otherwise, please highlight the contribution, as well as the name of the partner, in the notes section.
Revenue source Currency Anticipated Q1 Q2 Q3 Q4 Cumulative Anticipated ($US)* Cumulative ($US)* Explanation of variances from plan Memberships fees € 8,500 - 112 567 - 679 9,005 719 Renewal of memberships is mostly in Q4 APG € 343,000 - 200,083 142,917 - 343,000 363,371 363,371 Donations € 364,000 23,650 215,616 62,087 - 301,353 385,618 319,250 Not enough time to correctly prepare the fundraising of the end of 2017. Projects Grants € 100,000 - 31,653 3,400 - 35,053 105,939 37,315 Including Sponsorship, Call for project and Charity products. Miscellaneous revenus € 2,000 1,046 - - - 1,046 2,118 1,108 Other incomes € 22,760 - 1 1,859 - 1,860 24,111 1,970 Included in Grants. Assumption of liability € 12,784 12,784 - - - 12,784 13,543 13,543 - Costs transfer € 3,705 8,938 3,866 4,356 - 17,160 18,179 3,925 TOTAL € 856,749 46,419 451,330 214,629 - 712,378 907,631 754,687 In-kind donations € - - - - 98,087 98,087 - 103,912 Arbitrary add in-kind donations on the Q4. TOTAL with in-kind donations € 856,749 46,419 451,330 214,629 98,087 810,465 907,631 858,599
* Provide estimates in US Dollars
Table 2 notes:
Q4: We are finalising and certifying our accounts. We will be able to communicate the results of Q4 in October.
In-kind donations: in-kind donations are still not included in our official book keeping, but started to track and evaluate our in-kind donations. You can find an overview here. We are aware that the amount of in-kind donations can't be compared to the same amount in cash revenues at a 1:1 ratio as it was mentionned in the 2015-2016 proposal form of Wikimedia Österreich. But more investigations on this subject should be done to choose a good ratio.
Spending during this period (6 month for progress report, 12 months for impact report)
Please use the exchange rate in your APG proposal.
Table 3 Please report all spending in the currency of your grant unless US$ is requested.
- (The "budgeted" amount is the total planned for the year as submitted in your proposal form or your revised plan, and the "cumulative" column refers to the total spent to date this year. The "percentage spent to date" is the ratio of the cumulative amount spent over the budgeted amount.)
Expense Currency Budgeted Q1 Q2 Q3 Q4 Cumulative Budgeted ($US)* Cumulative ($US)* Percentage spent to date Explanation of variances from plan Theme 1: Content development € 165,730 35,515 47,420 27,605 110,540 205,871 129,847 50% - Theme 2- Working with communities € 224,694 65,886 74,851 39,312 - 180,049 279,334 211,497 63% - Theme 3 - Promoting and protecting projects € 167,196 55,877 47,252 28,066 - 131,195 207,885 154,110 62% - Theme 4 - Fundraising € 42,115 12,669 16,789 24,596 - 54,053 52,351 63,494 70% - Theme 5 - Overhead cost € 375,998 83,927 277,825 61,310 - 423,061 467,358 496,955 96% - TOTAL € 975,732 253,873 464,137 180,888 - 898,898 1,212,951 1,055,905 74% N/A
* Provide estimates in US Dollars
Is your organization compliant with the terms outlined in the grant agreement?
As required in the grant agreement, please report any deviations from your grant proposal here. Note that, among other things, any changes must be consistent with our WMF mission, must be for charitable purposes as defined in the grant agreement, and must otherwise comply with the grant agreement.
Are you in compliance with all applicable laws and regulations as outlined in the grant agreement? Please answer "Yes" or "No".
Are you in compliance with provisions of the United States Internal Revenue Code (“Code”), and with relevant tax laws and regulations restricting the use of the Grant funds as outlined in the grant agreement? Please answer "Yes" or "No".
- Once complete, please sign below with the usual four tildes.
Resources to plan for measurement
- Global metrics are an important starting point for grantees when it comes to measuring programmatic impact (Learning Patterns and Tutorial) but don’t stop there.
- Logic Models provide a framework for mapping your pathway to impact through the cause and effect chain from inputs to outputs to outcomes. Develop a logic model to map out your theory of change and determine the metrics and measures for your programs.
- Importantly, both qualitative and quantitative measures are important so consider both as you determine measures for your evaluation and be sure to ask the right questions to be sure to capture your program stories.