Jump to content

WikiLearn - Introduction to Partnership Building (computer-graded exercises) - video: Evaluating our evaluation

From Meta, a Wikimedia project coordination wiki
@metadata
sourceLanguage"en"
priorityLanguages
"es"
"fr"
"ar"
"ru"
"zh"
allowOnlyPriorityLanguagestrue
description"video in Introduction to Partnership Building (computer-graded exercises) - Basics of partnership building for Wikimedia volunteers, with computer-graded exercises."
label"WikiLearn - Introduction to Partnership Building (computer-graded exercises) - video: Evaluating our evaluation"
display_name"Evaluating our evaluation"
subtitle-270-10240-1"The last point I want to make about evaluation,"
subtitle-12890-22670-2"is that we should also occasionally evaluate our evaluation because our"
subtitle-22670-26840-3"evaluation mechanism itself may not be serving us very well."
subtitle-26960-31160-4"So again, not every day, not every week, not after every event, but at the end of a"
subtitle-31160-36860-5"certain cycle or year or something, occasionally, it may be useful to think about"
subtitle-36860-40940-6"how we evaluate and give that an assessment."
subtitle-41780-47330-7"Are these indicators that we've been working with, are they actually helping us understand"
subtitle-47330-48650-8"the impact of our project?"
subtitle-48650-50060-9"Are they good indicators?"
subtitle-50060-51620-10"Maybe we should be measuring different things."
subtitle-52820-58910-11"So if they're not good or if they're not, we feel that we may have impact, that we kind of"
subtitle-58910-62030-12"feel, but it's not captured in the numbers."
subtitle-62990-64280-13"Then what do we need to change?"
subtitle-64280-68960-14"What do we need to add so that we do capture this impact that we kind of feel?"
subtitle-70610-72830-15"So maybe we need to collect different data."
subtitle-72860-76100-16"Maybe we need to collect additional data that we're not collecting today."
subtitle-78390-81200-17"So this is a useful process to do."
subtitle-81210-83040-18"Again, not every day, not every week."
subtitle-83040-88620-19"But remember that having made an evaluation plan doesn't mean this is, from now on, the"
subtitle-88620-93360-20"only way we will ever evaluate the project and those of you who've been around for a"
subtitle-93360-96990-21"while and maybe who have done a number of grants with the Foundation, know that the"
subtitle-96990-103080-22"Foundation itself changed its mind about what are the most useful ways to evaluate"
subtitle-103350-104460-23"Wikimedia activity."
subtitle-104480-107850-24"It's actually a sophisticated field."
subtitle-107850-111120-25"It's a complicated problem evaluating such work."
subtitle-111930-116310-26"And there's a lot to to learn and develop and iterate on."
subtitle-116310-121950-27"So don't expect to get it perfect or right the first time."
subtitle-123090-125940-28"Any questions about evaluation?"
subtitle-126970-128080-29"Before we move on."
subtitle-131930-137600-30"Again, this was knowingly somewhat superficial because there is a lot of"
subtitle-137600-142670-31"existing training material specifically on that from Learning Days and other"
subtitle-142670-147500-32"opportunities, including video lectures already on Commons."
subtitle-148040-152930-33"But I hope it was enough for you to think about your partnership and the evaluation"
subtitle-152930-156530-34"angle of the work that your partnership would include."
subtitle-158030-160880-35"And this leads us to the penultimate assignment."