Wikimedia Foundation Annual Plan/2023-2024/Reports/Core Metrics Q3
Q3 Core Metrics Report
Quarterly metrics are intended to measure progress toward the Foundation’s Annual Plan goals. Reviewing and publishing these core metrics throughout the year will allow us to evaluate which work streams and interventions have been most impactful and make data-driven decisions about what to prioritize through the remainder of the year. These reports will also allow the movement to track the progress we make with the many initiatives we’re running. The current report summarizes Core Metrics for Q3. The report includes comparisons to Q3 last year, as well as progress towards Annual Plan year-end targets.
What is Q3? Quarter 3 (Q3) refers to January, February, and March.
What is FY 23-24? Fiscal Year (FY) 23-24 refers to July 2023 through June 2024.
What are Core Metrics? Core Metrics are small, well-defined set of measurements used to guide strategic decisions.[1] As part of this year's Annual Plan, four Core Metric areas were developed: "Contributors", "Content", "Relevance", and "Effectiveness". During Q3, we made progress toward the Contributors and Effectiveness metrics, detailed below. We have not completed work that we expect to have impacted the Content and Relevance metrics yet–those metrics remain at baseline. We expect to see progress on these through interventions in the coming quarters.
Contributors[edit]
While we develop a more comprehensive metric to measure the health of our contributors, we aim to improve and maintain the health of the Movement's communities of contributors by delivering at least one significant intervention per quarter that supports editors with extended rights.
| Status: On track |
|---|
In Q3, the Mobile Apps team released a new feature in the Android app: Edit Patrol.
- What? Edit Patrol allows patrollers to monitor recent changes on the go from the Android app and warn, thank, undo and rollback edits, and post talk page messages.
- Why? Community members have asked for moderation tools that are fair and unbiased across language wikis. The Android team has received requests from various language communities to improve the quality of edits made through the app.
- So what? This anti-vandalism tool will help moderators, across languages, patrol from their mobile device. Read more about this new feature on the Steward's noticeboard.
Edit Patrol is in production for some wikis, but not for all. We are considering it deployed because it is reaching substantial numbers of users, and that number will increase as the feature is spread more widely.
Content[edit]
We aim to increase quality and reliability of encyclopedic content by increasing the percentage of Wikipedia articles that are in high-impact topic areas (beginning with gender and geography) and meet a shared quality standard.
| Status: On track |
|---|
In Q3 the Wikimedia Foundation's Campaigns and Community Growth teams worked on 4 projects that supported community-led initiatives related to geography and/or gender:
- Event discovery experiment: In Q3, the Campaigns team conducted an experiment to learn more about Event Invitations in relation to the Event Discovery tool; the tool aims to help editors discover community-led events on the wikis, such as those related to high-impact topics such as geography and gender.
- Celebrate Women support: In Q3, the Community Growth team provided support to the Celebrate Women campaign. The community-led campaign focused on gender gaps related to biographies, citations, pictures, perspectives of women and non-binary people on Wikipedia.
- ¡Alto! Mujeres haciendo historia support: In Q3, the Community Growth team provided support to ¡Alto! Mujeres haciendo historia, a community-led campaign focused on improving content about women and their history on Spanish Wikipedia, Portuguese Wikipedia, and Wikimedia Commons.
- Wikimedia Indonesia's Wiki Women's Month support: In Q3, the Community Growth team provided support to Wikimedia Indonesia's Wiki Women's Month. The community-led campaign focused, this year, on the topic of Sexual Reproductive Health (SRH), addressing the pressing need for reliable SRH information in Indonesia, particularly for girls and young women.
The size of the Event Discovery experiment would not be enough to impact the topline Content metric, so the changes showcased below are related initiatives not led by the Foundation. Do you have ideas about community activities or external factors that might be impacting the Content metric? Let us know on the talk page!
Geography[edit]
In Q3, 30% of new quality articles about geographic content were about underrepresented regions.
- 30% is a 1 percentage point increase from Q3 last year.
- Not all regional content had an increase. View breakdowns by region.
- Not all Wikipedia editions had an increase. View breakdowns by Wikipedia language edition.
- Product interventions focused on improving contributor experiences are planned to launch throughout Q3 and Q4. These interventions are targeting a +1% impact on this geographic content metric by the end of the 2023–2024 fiscal year.
Which regions are "underrepresented"? The following regions are classified as underrepresented within the Content metric area: East, Southeast Asia, and Pacific; Latin America and the Caribbean; Middle East and North Africa; South Asia; and Sub-Saharan Africa. Content about these five regions is underrepresented on Wikipedia when compared to global population distributions.
Gender[edit]
As part of our annual plan goals around gender equity, we aim to create "more inclusive, gender-equitable and safe spaces to contribute intersectional content on women's biographies and material that women want to read." This fiscal year, we will support, and report on the outcomes of, two community-led initiatives aimed at closing gender gaps in article content.
In Q3 the Wikimedia Foundation's Community Growth team supported 3 community-led initiatives related to gender:
Relevance[edit]
We aim to ensure our relevance and sustainability to a broad audience world-wide by increasing the number of unique devices accessing Wikipedia. Unique devices refer to the number of distinct electronic devices (e.g. mobile phones, desktop computers) that visited, in this case, Wikipedia sites. Learn more about unique devices here.
| Status: On track |
|---|
In Q3, the Data Center Operations team continued work on the new Magru data center in São Paolo, Brazil. The data center is scheduled to start operating in Q4, and should bring better performance for readers and contributors in South America, including reduced load times and reduced editing wait times. Based on previous research, we expect to see +5.1M unique devices in Latin America and the Caribbean (0.3% increase to global unique devices) as a result of the new data center.
Because the new data center is not yet deployed, the increase in unique devices showcased below is likely related to initiatives not led by the Foundation. Do you have ideas about community activities or external factors that might be impacting the Relevance metric? Let us know on the talk page!
In Q3, Wikipedia was accessed by 1.65 billion unique devices per month.
- 1.65 billion is an increase of approximately 30 million monthly unique devices compared to Q3 last year.
- Monthly unique devices increased in some Wikipedia editions, and decreased in others. View breakdowns by Wikipedia language edition here or visit Wiki Stats to explore language-edition trends further!
- Monthly unique devices increased in some regions, and decreased in others. View breakdowns by region here.
- 1.65 billion is approximately 50 million above our Annual Plan year-end target of 1.60 billion unique devices per month. We expect fluctuation of this number to occur between now and the end of the fiscal year, and will continue to monitor our progress towards our year-end target in Q4.
Effectiveness[edit]
We aim to ensure our long-term sustainability by improving how the Foundation operates and scales. One way we aim to do this is by increasing our programmatic expense ratio, which is the proportion of budget that funds work that directly supports our mission.
| Status: On track |
|---|
Last FY, 76% of our budget went to programmatic expenses. We set a target of increasing that number by 1 percentage point this year, which represents a substantial financial increase towards programmatic work to support our mission.
Based on Q3 data, we are currently on track to reach our 77% target by the end of Q4.