Community Resources and Partnerships/India General Support Project/Evaluation of AI generated Wikipedia content

statusNot funded

India General Support Project

Evaluation of AI generated Wikipedia content

proposed start date2026-01-01

proposed end date2026-12-31

amount requested (INR)1496350 INR

amount requested (USD)17806.56 USD

applicant• Pavanaja

organization (if applicable)• N/A

Universal Code of Conduct

Applicant information

Organization name or Wikimedia Username for individuals. (required)

Pavanaja

Are you a first-time applicant? (required)

You are applying as a(n). (required)

Individual

Are your group or organization legally registered in your country? (required)

N/A

Please provide links to the following documents if they are available

These documentation can be provided in your local language(s), no translations required.

• Organizational website
• Detailed financial reporting and/or audits
• Documentation of the governance structure, board list, governance processes
• Documentation of the general assembly decision on your plan

Main proposal

1. Please state the title of your proposal. This will also be a title for the Meta-Wiki page. (required)

Evaluation of AI generated Wikipedia content

3. Proposed start date. (required)

2026-01-01

4. Proposed end date. (required)

2026-12-31

5. Does your organization or group have an Affiliate or Organizational Annual Plan that can help us understand your proposal? If yes, please provide it. (required)

No

6. Does your affiliate, organization or group have a Strategic Plan that can help us understand your proposal? If yes, please provide it. (required)

No

7.1. Where will this proposal be implemented? (required)

India

7.2. If your project includes in-person activities, are there any international participants travelling to India for them? (required)

No

7.2.1. List all countries of participation. (required)

N/A

7.3. Will the project be transferring funds to any international participants? (required)

No

7.3.1. List all international participants receiving funding and their countries. (required)

N/A

8. What are your programs, approaches, and strategies? What are the challenges that you are trying to address and how will your strategies support you in addressing these challenges? (required)

'Executive Summary: 'I want to do quantified evaluation of Wikipedia article creation by AI. I will ask AI to create an article for Kannada Wikipedia on a topic article about which is not present in English Wikipedia. AI will create the draft article. I will correct it where needed, improve it, add missing info, add infobox, etc. and finalise it. I want to compare between the initial draft and the final version. I want to quantify this.

Programs, Approaches, and Strategies

1. Structured Article Creation and Evaluation Program:

• The project will run at the Government Women’s College, Udupi, involving about 20 undergraduate girl students from rural Karnataka.
• Each student will use an AI tool to generate a draft article for Kannada Wikipedia on topics not available in English Wikipedia (representing local knowledge and bridging content gaps).
• Students will revise, improve, fact-check, and finalize the articles, adding missing information, appropriate infoboxes, references, and adhering to Wikipedia's style and neutrality guidelines.
• Both the AI draft and human-improved final version will be systematically evaluated and compared using quantitative rubrics (covering accuracy, completeness, language, referencing, structure, etc.).

2. Capacity-Building Workshops:

• Hands-on training sessions for rural girl students to use computers, the internet, AI tools, and Wikipedia's editing tools.
• Workshops on information literacy, evaluating AI-generated content, and Wikipedia policies.

3. Rigorous Quantitative Evaluation:

• Develop and apply a detailed, criteria-based rubric to assess both drafts and final articles, enabling quantitative analysis of AI's effectiveness and editors' improvements.

4. Knowledge-Sharing and Community Engagement:

• Share results and the developed evaluation methodology with the Wikimedia community, especially Kannada Wikipedia and AI–wiki initiatives, promoting further innovation.
• Encourage continued contributions by students and build local Wikipedia capacity.

'

Challenges and How These Strategies Address Them

Challenge 1: Low Article Count and Quality on Kannada Wikipedia

• Strategy: AI-assisted article generation, coupled with human review, will rapidly increase the quantity and quality of local-language articles on underrepresented topics.
• Impact: Boosts Kannada-language free knowledge and demonstrates scalable approaches for other small wikis.

Challenge 2: Evaluating AI Effectiveness for Wikipedia Article Creation

• Strategy: Use side-by-side rubric-based quantitative evaluation of AI vs. human-improved articles, focusing on factual accuracy, completeness, style, neutrality, referencing, and community standards.
• Impact: Provides evidence-based insights into AI’s strengths/weaknesses for Wikipedia, informing guidelines and future projects.

Challenge 3: Gender Gap in Wikipedia Editing

• Strategy: Exclusively involving rural undergraduate women directly addresses Wikipedia’s well-documented gender imbalance.
• Impact: Empowers a new cohort of female editors with valuable digital and informational skills, encouraging ongoing participation.

Challenge 4: Digital Divide for Rural Students (Lack of Access to Computers/Internet)

• Strategy: Leverage institution’s computer lab and internet, providing full technical support so students can participate despite personal access limitations.
• Impact: Reduces barriers to entry for rural students, facilitating digital inclusion.

Challenge 5: Lack of Local Knowledge on Global Platforms

• Strategy: Prioritize topics not covered in English Wikipedia, encouraging documentation of regional, cultural, and community knowledge.
• Impact: Helps decolonize content, boosts relevance of Wikipedia for Kannada readers, and enhances global diversity in free knowledge.

Challenge 6: Sustainable Digital Literacy and Community Engagement

• Strategy: Build editing, research, and critical AI literacy skills that students can use beyond the project, and foster ongoing Kannada Wikipedia participation through mentorship and peer support.
• Impact: Supports long-term community growth and student empowerment in digital spaces.

'

In summary: Our program carefully combines capacity-building, structured AI use, rigorous outcome evaluation, gender equity, and a focus on locally relevant content. These strategies are directly designed to tackle content gaps, gender imbalance, digital exclusion, and the need for AI evaluation—delivering impact for both the Wikimedia movement and the local community.

9. What categories are your main programs and related activities under? Please select all that apply. (required)

Category	Yes/No
Education	Yes
Culture, heritage or GLAM	No
Gender and diversity	Yes
Community support and engagement	Yes
Participation in campaigns and contests	No
Other	No

Education

9.1.1. Select all your programs and activities for Education. (required)

Wiki Club, Wiki Camp, Editing Wikipedia Training, Research, Wikimedia Commons programs, Other Wikimedia project programs

Other programs and activities if any: N/A

9.1.2. Select all relevant audience groups for Education. (required)

Vocational, tertiary, or higher education

Other groups if any: N/A

Gender and diversity

9.3. Select all your programs and activities for Gender and diversity.

Bringing in women and/or gender diverse participants and editors, Focusing on knowledge equity by bringing in contributors from underrepresented communities

Other programs and activities if any: N/A

Community support and engagement

9.4. Select all your programs and activities for Community support and engagement.

On-wiki training of community members, Off-wiki training of community members, Organizing meetups, conferences, and community events, Supporting community members' participation in events and conferences

Other programs and activities if any: N/A

10. Please include a link to or upload a timeline (operational calendar) for your programs and activities. (required)

Timeline / Operational Calendar

Month 1: Project Initiation and Preparation

• Recruit and enroll 20 undergraduate girl students from the Government Women’s College, Udupi.
• Set up college computer lab and ensure all required software, internet access, and AI tools are ready.
• Orient students and faculty to project goals, expectations, and the overall plan.

Month 2: Training and Capacity Building

• Conduct workshops on Wikipedia editing basics, content policies, digital skills, and use of AI tools for article generation.
• Provide sessions on evaluating sources, adding citations, and referencing in Wikipedia.
• Assign initial article topics to each student, emphasizing subjects not covered in English Wikipedia.

Months 3–4: AI Drafting and First Review

• Students use AI tools to draft initial Kannada Wikipedia articles on their topics in the college lab.
• Faculty and mentors provide feedback on these drafts, highlighting key areas for improvement.

Months 5–7: Human Editing, Improvement, and Finalization

• Students refine and enhance their articles:
  • Correct and supplement AI drafts.
  • Add infoboxes, references, and missing information.
  • Ensure articles adhere to Kannada Wikipedia guidelines for quality, neutrality, and verifiability.
• Correct and supplement AI drafts.
• Add infoboxes, references, and missing information.
• Conduct peer-review sessions where students evaluate and give feedback on each other’s articles.

Months 8–9: Quantitative Evaluation & Data Collection

• Apply the rubric to both the AI-generated drafts and the human-improved final articles.
• Collect and tabulate evaluation scores and feedback.
• Document challenges, best practices, and notable case studies.

Month 10: Community Sharing and Reporting

• Prepare interim and final reports for Wikimedia Foundation, highlighting results, learnings, and impact.
• Organize a local event or online meetup to present outcomes to the Kannada Wikipedia and wider Wikimedia community.
• Share methodologies and findings (quantitative rubric, workshop materials) openly.

Months 11–12: Sustainability and Follow-up

• Encourage ongoing student participation as editors, with mentorship and support.
• Evaluate overall project goals (article growth, skill development, gender participation, AI evaluation outcomes).
• Plan for scaling up or replicating the initiative in future academic years.

Evaluation:

Quality rubric:

Criterion Weight AI Draft FinalNotes / Evidence Content coverage & depth 20       Verifiability & citations 20       Language quality (Kannada grammar, clarity, neutrality) 15       Infobox presence & completeness 10       Structure & wiki markup (sections, templates, categories) 10       Lead quality (concise, summary of key facts) 5       Internal links & categories 5       Images/media & licensing 5       Topic notability & scope (sourcing justifies topic) 5       Maintenance issues (tags avoided, policy compliance) 5       

Quality Metrics:

Field Value (AI Draft) Value (Final) Notes Characters (approx.)       Citations (<ref>...</ref>) count       Internal links (...))       External links (http/https)       Infobox present? (0/1)       Infobox fields count      

11. Describe your team. (required)

Name: Dr. U.B. Pavanaja

Role: Principal Researcher and project manager (Paid staff)Username: Pavanaja. Responsibilities: Overall management and coordination of the project activities. Manage the budget, finance, spending, accounting and reporting. Design and roll out the program. Design the program structure, train the students, conduct the training program, design the evaluation rubrics, supervise and guide the team. Will generate the final report.

Name: Prajna. Role: Resource person (Paid per assignment). Responsibilities: Many training programs will be held during the course of the program.Resource person will help in the training program. his person will help in suggesting topics for article creation, running the rubrics for evaluation.

Volunteers from the community may be involved in suggesting articles, correcting the articles, suggesting topics for editathons, etc. Mostly these will be done online.

12. Will you be working with any internal (Wikimedia) or external partners? Describe the characteristics of these partnerships and bring a few examples of the most significant partnerships. (required)

I will be working with Govt Women's College, Udupi. They will provide the computer lab with Internet connection needed for editathon. Student participants form these institution will be briefed on use of Wikipedia as a platform of learning and those interested will be recruited as participants. Additionally, members of Karavali Wikimedians User Group will be participating in the editathons to guide the students.

13. In what ways do you think your proposal most contributes to the Movement Strategy 2030 recommendations. Select all that apply. (required)

Increase the Sustainability of Our Movement, Invest in Skills and Leadership Development, Innovate in Free Knowledge, Evaluate, Iterate, and Adapt

Metrics

Wikimedia Metrics

14. Please select and fill out Wikimedia Metrics for your proposal. (recommended)

14.1. Number of participants, editors, and organizers.

All metrics provided are optional, please fill them out if they are aligned with your programs and activities.

Participants, editors, and organizers

Metrics name	Target	Description
Number of all participants	25	N/A
Number of all editors	25	N/A
Number of new editors	20
Number of retained editors	5
Number of all organizers	2	N/A
Number of new organizers	0

14.2. Number of new content contributions to Wikimedia projects. (recommended)

Contributions to Wikimedia projects

Wikimedia project	Created	Edited or improved
Wikipedia	200	0
Wikimedia Commons	40	0
Wikidata	200	0
Wiktionary
Wikisource
Wikimedia Incubator
Translatewiki
MediaWiki
Wikiquote
Wikivoyage
Wikibooks
Wikiversity
Wikinews
Wikispecies
Wikifunctions / Abstract Wikipedia

Description for Wikimedia projects contributions metrics. (optional)

Other Metrics

15. Do you have other quantitative and qualitative targets for your project (other metrics)? (required)

No

Other Metrics	Description	Target
N/A	N/A	N/A
N/A	N/A	N/A
N/A	N/A	N/A
N/A	N/A	N/A
N/A	N/A	N/A

Budget

16. Will you have any other revenue sources when implementing this proposal (e.g. other funding, membership contributions, donations)? (required)

No

16.1. List other revenue sources. (required)

N/A

16.2. Approximately how much revenue will you have from other sources in your local currency? (required)

N/A

17. Local currency

Indian Rupees (INR)

18. What is the requested amount in Indian Rupees? (required)

1496350 INR

Requested amount in USD

17806.56 USD

19. Does this proposal include compensation for staff or contractors? (required)

Yes

19.1. How many paid staff members and contractors do you plan to cover with this General Support Project? (required)

2

19.2. How many FTEs (full-time equivalents) in total will be covered with this General Support Project? (required)

2

19.3. Describe any staff or contractor changes compared to the current year / ongoing General Support Project if any. (required only for returning applicants)

NA

20. Please provide an overview of your overall budget categories in your local currency. The budget breakdown should include only the amount requested with this General Support Project. (required)

Budget category	Amount in local currency
Staff and contractor costs	780000
Operational costs	716350
Programmatic costs	1496350

21. Please upload your budget for this proposal or indicate the link to it. (required)

[1]

Additional information

22. In this optional space you can add any other additional information about your proposal or organization that you think can help us when reviewing your proposal. (optional)

1. This project was discussed and approved in the community meetup. Details [[2] here].
2. A presentation on creating Kannada Wikipedia article using Generative AI was done to the community by me. Details [[3] here]. 
3. A blog titled "Creating Kannada Wikipedia Article using Generative AI" was written and is available [[4] here].

---

By submitting this proposal request you agree with the Institutional Partner Privacy Policy, Application Privacy Statements, WMF Friendly Space Policy and Universal Code of Conduct.

Yes

---

This is an automatically generated Meta-Wiki page. The page was copied from Fluxx, the web service of Wikimedia Foundation Funds, where the user has submitted their application. Please do not make any changes to this page because all changes will be removed after the next update. Use the discussion page for your feedback. The page was created by CR-FluxxBot.