Learning and Evaluation/Archive/Connect/Questions/Archives/2014-01

From Meta, a Wikimedia project coordination wiki

Have you created or collected surveys for your program implementations?

Program leaders have been inquiring about survey design since the creation of the Program Evaluation and Design team here at the Wikimedia Foundation.

We’re excited to let you know that we are proceeding with exploring how we can support your efforts to survey participants in your programs. In order to proceed, we need your help! We would like you to share any surveys that you have sent and collected with our team.

This will allow us to learn more about what types of information you are collecting through surveying, and the types of surveys you are producing. This will also allow us to work with you to build tools for better evaluation and surveying!

Surveys are important tools in evaluation!
  1. You can email your surveys in text or as attachments (eval@wikimedia.org)
  2. You can email a link to your survey (eval@wikimedia.org)
  3. You can post a link to you survey on wiki in response to this post.
  4. It can be in any language

We’ve already identified a number of survey priorities, and while survey development will be ongoing, we want to be sure to include the interests of everyone in our planning process. As we identify, prioritize, and begin to take steps to meet the survey needs of you and other program leaders, the more you are able to share the better we can learn from what you’ve done, and the better we can respond to everyone’s needs. If you have developed or used surveys to help tell the story of your program, please send them our way so we are sure to review and consider everyone's interests.

We look forward to your sharing and thank you for your time and amazing work. -- SarahStierch (talk) 23:57, 11 December 2013 (UTC)

Hi, the main feedback form for training events/editathons that we use is this: wmuk:File:Event_feedback_form_template.pdf. We have it set up in Survey Monkey so that data can be input and we are able to run summary reports to analyse the results. The form was seen previously by the PE&D team and the feedback was very useful! Daria Cybulska (WMUK) (talk) 09:03, 12 December 2013 (UTC)
A copy of the only survey TWG has done so far can be found here. The results have been used in two pieces of research we have done to identify costs related to our work- --LauraHale (talk) 18:30, 15 December 2013 (UTC)
Great, thanks User:LauraHale and User:Daria Cybulska (WMUK)! SarahStierch (talk) 19:26, 16 December 2013 (UTC)

CIS-A2K Evaluation Forms

Hi, we at CIS-A2K have recently recruited a person into the team. As part of this I have used this evaluation form to seek feedback from the community members. Will share some more soon :) --Visdaviva (talk) 06:54, 21 December 2013 (UTC)

Wikimedia Train the Trainer Program participant feedback form —unsigned by Visdaviva (talk)
Great! Thanks User:Visdaviva! Two questions: Would you like feedback for improvement (if needed) from our team? Second, if so, do you have a deadline for one or both of the surveys that you would need that feedback by? Thanks again for sharing! SarahStierch (talk) 17:15, 23 December 2013 (UTC)
Sorry for this delayed revert SarahStierch. Been swamped :( Would appreciate feedback. No hurry, do take your time.--Visdaviva (talk) 17:22, 8 January 2014 (UTC)

Dutch Evaluation Forms

To respond to the question about surveys: We are quite busy with streamlining our entire workflow from idea to evaluation for events. It all starts with a checklist, more of a grocery list with the forms that are needed for an activity. These depend on:

  • Is there financial support needed for the activity?
    • If yes: you need a google spreadsheet for the costs
  • Is support from the office needed in organising the activity?
    • If yes: We need to reserve and monitor the hours of staff involved
  • Will there be a training for new editors?
    • If yes: you need two surveys and two project pages (work in progress). The first survey should be held during event and the second survey after a couple of months. The project pages are on our chapter wiki and on the Dutch Wikipedia. The project page on our chapter wiki consists of all the basic information (type of activity, date, location, etc.). The project page on Wikipedia consists of the Wikipedia related information (articles to write, articles that need improvement, who's working on the article, etc.)
  • Do people have to register to attend?
    • If yes: you need a registration form (currently a google form, this will be a form linked to our CRM in the near future)

Once someone has filled in the grocery list we help them setting up the documents. The forms for the costs, surveys and registration just have to duplicated by a staff member and shared with the volunteers that help with the activity. The reasons that a staff member duplicates these forms are:

  1. Surveys can not be made public available (downloadable) like spreadsheets and text documents.
  2. This way we - the staff members- always can get to the information and fill in the information fields that we don't expect volunteers to do (for example: every event will get a unique identifier that needs to filled in on all documents).

All the forms and documents mentioned and linked above are in Dutch, please let me know if you want anything translated. Ter-burg (talk) 13:30, 12 December 2013 (UTC)

Thanks User:Ter-burg, we will let you know if we have any questions. Are you seeking any feedback for your survey questions? SarahStierch (talk) 19:27, 16 December 2013 (UTC)
Yes, Sarah. If you have any tips for our surveys that would be great. I'm especially interested if there is specific data that would make our events internationally comparable. I've made a lot of progress since this post. We now have a "manual" on events that leads a volunteer through all necessary steps of setting up an event with a lot of templates and standard forms. These surveys are part of this process.


Oh, and I do have a question. Can you translate the following questions from survey one for me? Thank you.
  1. Was vooraf duidelijk wat het evenement in zou houden? informatie via website, facebook, email
Translation: Did you know up front what the event would be like? Sometimes visitors come to our events with different expectations. With this question we hope to determine if we've managed their expectations in a good way.
  1. "MEE BEZIG gebruikt bij artikelen" (from Wat heeft u tijdens de edit-a-thon kunnen doen?)
Translation: I've used the template that indicates I'm still working on the article. We have a template that (new) users can add to a page to indicatie that they're working on it at that exact moment to hold off more experienced and faster editors that might delete their edits before they even have the chance to finish their work. We ask all the participants at an edit-a-thin to use this template, but sometimes they forget to use it.
  1. "Een afbeelding geplaatst" (from Wat heeft u tijdens de edit-a-thon kunnen doen?)
Translation: I've added an image to an article
SarahStierch (talk) 01:03, 17 December 2013 (UTC)
Ter-burg (talk) 10:05, 17 December 2013 (UTC)