Learning and Evaluation/Archive/Grantmaking and Programs/Learning & Evaluation portal/Project plan
|This page is currently a draft. More information pertaining to this may be available on the talk page.
Translation admins: Normally, drafts should not be marked for translation.
The Learning & Evaluation portal is intended to help us all learn more from experience and share what we learn more effectively to achieve the greatest possible impact on our global mission. Our priorities are:
- Evangelize. Demonstrate and spread the word about the value of evaluating, sharing and learning together as a movement.
- Empower. Empower community members to evaluate and reflect on their own activities, and encourage iteration and innovation.
- Engage. Foster a global and diverse community around learning and evaluation activities: to make it a new way to contribute, a new way to edit.
Our initial development effort will focus on identifying and supporting the Learning & Evaluation needs of our primary stakeholders: Wikimedia grant-funded entities, programs and established community initiatives that perform activities that are closely aligned with the strategic priorities of the Wikimedia Movement. Our ultimate goal is to create a scalable, sustainable framework for supporting Learning & Evaluation across the movement. We will support that goal in the following ways:
- Connect community members with high quality, targeted information resources. There are many resources available to our current and potential stakeholders, but they are often hard to find, out of date, incomplete, or inapplicable. We will focus our efforts on creating and curating a small set of information resources—such as report templates, technical tutorials and guidelines—that will support the specific L&E activities that grantees and programs engage in.
- Involve community members in L&E activities. The number of grant-funded entities and volunteer projects is already substantial and expected to grow. A small number of staff cannot provide individual support to every project, but we do not want to leave projects to fend for themselves. Involving community members in content development, mentorship, and research activities is both a practical necessity and a desirable outcome in itself.
- Support outreach, education, innovation and engagement efforts of all shapes and sizes. Funded entities of all sizes—from participation support grantees to Chapters—can benefit from the same tools and training, but smaller projects are less likely to have the necessary experience and resources for evaluation. We believe we can make these resources accessible in a way that serves large and small entities alike.
- Support projects on all Wikimedia projects. We aim to support initiatives in all languages of all Wikimedia projects (current and future). We intend to be a central hub for cross-project knowledge sharing, cross-pollination of ideas, and creative synthesis of strategies from all parts of our global movement.
- Synthesize outcomes into actionable recommendations. We will identify strategies that work and strategies that need work based on past activities and their outcomes, and provide concrete suggestions of alternate approaches and next steps.
Users and stakeholders
Who will use our resources directly?
- IEG program. proposal submitters, grant recipients, proposal reviewers, program director
- WMF Grants program. grant recipients, reviewers
- Global Education Program. ??
- Thematic orgs. e.g. WikiMed
- Chapters. e.g. Norwegian chapter
Who is interested in the synthesized outcomes of L&E?
Scenarios of use
Components and features
Curated information resources
- Tutorials and Guidelines
- how to conduct surveys
- how to use user UserMetrics API
- how to use Limn/Dashboards(?)
- Event best-practices (Edit-a-thons, contests, conferences)
- how to communicate findings (blog post, social media, message boards)
- some overview of what metrics to use
- list of project-related artifacts to include in project reports
- Templates and examples
- example surveys
- example reports (standardized, but adapted for different kinds of projects)
- message templates
- plain language explanation of our movement strategic targets, goals, priorities ...with examples
- legal/ethical considerations (NOT legal advice)
Important non-resource pages
- clear goals and scope of L&E portal
- centralized evaluation request board
- suggestions of resources to use for different kinds of activities (workflow model or static page?)
- some examples of ways to participate (as a volunteer)
- participation guidelines
- a user-friendly index of project reports, etc.
- Profiles :)
- a space/mechanism for noting and discussing common themes, synthesizing, finding common ground
- translation/localization task force
- notifications feed (not Echo)
- featured content
- hook into IdeaLab, IEG, other portals (research index?)
- a semi-automated tool for categorizing/sorting/searching reports (similar to a delsort script?)
- set up database logging of on-portal activity, resource usage
- messaging script (for newsletter? inviting IEG participants to stop by? careful not to duplicate functionality of Echo/Flow)
- decision-tree workflow for connecting people with the right resources (similar to dispute resolution request form?)