Grants:IEG/Semi-automatically generate Categories for Vietnamese Wikipedia/Final

This project is funded by an Individual Engagement Grant

Welcome to this project's final report! This report shares the outcomes, impact and learnings from the Individual Engagement Grantee's 6-month project.

Part 1: The Project

• Vietnamese project

Summary

In a few short sentences, give the main highlights of what happened with your project. Please include a few key outcomes or learnings from your project in bullet points, for readers who may not make it all the way through your report.

The project helped us to understand the category taxonomy in Wikipedia projects, including Vietnamese Wikipedia (viwiki) and English Wikipedia (enwiki). We learn that most of the editors of Vietnamese Wikipedia refer to the category taxonomy to English Wikipedia to create new categories and organize them by a hierarchy structure. Any category name can be converted to a pattern that is used to translate to other languages based on the partition translation and then combine results before comparing it to a set of predefined category names to decide the best name.

Methods and activities

What did you do in project?

Please list and describe the activities you've undertaken during this grant. Since you already told us about the setup and first 3 months of activities in your midpoint report, feel free to link back to those sections to give your readers the background, rather than repeating yourself here, and mostly focus on what's happened since your midpoint report in this section.

• Community online discussion
• Ideas from a professor
• Use AWB to restructure category names
• Create translation tool and perform and improve the translation quality
• Firstly, I wrote and used my tool (Alphama Category) to scan all Vietnamese categories which have interlinks with English categories at Wikidata. I also organized an online discussion at wiki and a professor's ideas for naming conventions, translations and category standards. Then, I wrote a short summary of this discussion and update these standards. Be sure that you have a very deep conversation with your community (viwiki) about the category standards and ask many members or related stakeholders if you can. I invited more than 1000 editors by message and e-mail but just over 27 members giving me their opinions.

Restructure Vietnamese category names based on new standards

• From restructured list above, I used AWB and AlphamaBot (talk · contribs) to redirect old categories (Vietnamese colum) to new categories (Vietnamese fixes) and update related children and parent categories. I did not change interlinks at Wikidata because I just received the bot flag at Wikidata recently and still learn how to use pywikibot. I will do this task soon. Many editors will ask you why you change the category names, thus you have to give the change reason in summary box and link you your project. If they have any opinions, that may help the project a lot. There are many triples (categories/pages---belongto---categories/pages) so make sure that you restructure all triples which you have.

• For the translation, you need to have as much buffer data (temp data) as you can, you can get them directly from Wikidata, Wikipedia or even DBPedia. In my project, I use my program to collect buffer data (even in the running time) because I just want to use which data I really need for the project and filter out the garbage data. Remember that, the capacity of data affects a lot the timing of translation processes. Because I interact with Wikidata, Wikipedia by their APIs so be sure you have a good Internet speed and several laptops/machines (or hire some cloud computers) to help you boosting the execution.

Database Diagram

• For improving the quality of translation, you have to create a function which allows to change the results, patterns and prefered names of categories. Beside, suggest an similar translation case and the matching score (0-1) between this similar one and your translation.

Name analysis of an English category translated to Vietnamese

• To manage categories, AlphamaCategory also offers CategoryManagement module.

Category management module

Outcomes and impact

Outcomes

What are the results of your project?

• Alphama Category tool

Alphama Category 1.0.9

Please discuss the outcomes of your experiments or pilot, telling us what you created or changed (organized, built, grew, etc) as a result of your project.

• New naming conventions: We had many discussions about the naming conventions for categories in viwiki [1] and update the page vi:Wikipedia:Thể loại (Wikipedia:Category).
• Collect more than 47k categories which has interwiki links with English categories.
• Grants:IEG/Semi-automatically generate Categories for Vietnamese Wikipedia/Data
• Translation tool: The tool now is used to translate new category names and is a tool for researching in viwiki.

Progress towards stated goals

Please use the below table to:

1. List each of your original measures of success (your targets) from your project plan.
2. List the actual outcome that was achieved.
3. Explain how your outcome compares with the original target. Did you reach your targets? Why or why not?

Planned measure of success (include numeric target, if applicable)	Actual result	Explanation
Update new naming conventions for viwiki	We update at page vi:Wikipedia:Thể loại	We put the word "năm" (year) into every category related to years to clarify the meaning of the category. For example, Thể loại:Khoa học năm 1990 is used instead of Thể loại:Khoa học 1990. We use categories related countries in Vietnamese instead of using its English names, Australia --> Úc, Italy, Italia --> Ý. In the case of prepositions, we use some like "of, in, by" but by different cases.
Gain the attention of viwiki	There are 33 members involve to the discussions to improve the category names in viwiki	Since the category taxonomy does not pay attention from the community. This project is a good one for seeking collaboration in viwiki and gain awareness of editors about the needed of category names. Our discussion can be found in this link [2]
To create semi-automatically new categories for Vietnamese Wikipedia, help to reduce the manual tasks related to category classification and to create more fine-grained category taxonomy for Vietnamese Wikipedia	Integral the category taxonomy to our bot (AlphamaBot), running by AWB (AutoWiki Browser, a semi-automatically tool). Since then, the category taxonomy in viwiki now is very mature compare to many other projects	AlphamaBot can work well now, for new articles in viwiki, it can be translated and put into new articles.

Think back to your overall project goals. Do you feel you achieved your goals? Why or why not? We already archived our goal since then this project help to us update our category taxonomy and created many new category names in viwiki.

Global Metrics

We are trying to understand the overall outcomes of the work being funded across all grantees. In addition to the measures of success for your specific program (in above section), please use the table below to let us know how your project contributed to the "Global Metrics." We know that not all projects will have results for each type of metric, so feel free to put "0" as often as necessary.

1. Next to each metric, list the actual numerical outcome achieved through this project.
2. Where necessary, explain the context behind your outcome. For example, if you were funded for a research project which resulted in 0 new images, your explanation might be "This project focused solely on participation and articles written/improved, the goal was not to collect images."

For more information and a sample, see Global Metrics.

Metric	Achieved outcome	Explanation
1. Number of active editors involved	33 members	They involve to the discussion about category names. A few members are interested to propose some ideas in technical issues.
2. Number of new editors	a few members	This is a technical project so we only gain some members to work with us in the Bot project [3]
3. Number of individuals involved	33 individuals	They involve to the discussion about category names. A few members are interested to propose some ideas in technical issues.
4. Number of new images/media added to Wikimedia articles/pages
5. Number of articles added or improved on Wikimedia projects	about 4000 new categories	The list can be found here [4] [5]
6. Absolute value of bytes added to or deleted from Wikimedia projects	about 4000 new categories	The full list can be found here [6] [7]

Learning question

Did your work increase the motivation of contributors, and how do you know?

• Yes, since our project, we realize that the number of categories in Vietnamese increasing, from 137k to now is 240k [8].

Indicators of impact

Do you see any indication that your project has had impact towards Wikimedia's strategic priorities? We've provided 3 options below for the strategic priorities that IEG projects are mostly likely to impact. Select one or more that you think are relevant and share any measures of success you have that point to this impact. You might also consider any other kinds of impact you had not anticipated when you planned this project.

Option A: How did you increase participation in one or more Wikimedia projects?

Option B: How did you improve quality on one or more Wikimedia projects?

Option C: How did you increase the reach (readership) of one or more Wikimedia projects?

• We choose option B. Our project helps to improve the quality of category taxonomy in viwiki and may apply for small and medium other projects who need to create and classify many important and needed categories.

Project resources

Please provide links to all public, online documents and other artifacts that you created during the course of this project. Examples include: meeting notes, participant lists, photos or graphics uploaded to Wikimedia Commons, template messages sent to participants, wiki pages, social media (Facebook groups, Twitter accounts), datasets, surveys, questionnaires, code repositories... If possible, include a brief summary with each link.

Learning

The best thing about trying something new is that you learn from it. We want to follow in your footsteps and learn along with you, and we want to know that you took enough risks in your project to have learned something really interesting! Think about what recommendations you have for others who may follow in your footsteps, and use the below sections to describe what worked and what didn’t.

We learn a lot about the nature of category taxonomy and how to analyze these category names to translate to other languages, such as in our case, Vietnamese. We realize that by using this way we can reduce man efforts of amatuer editors in Wikipedia who are struggling with creating new category names and confused about which one is the better option to translate.

What worked well

What did you try that was successful and you'd recommend others do? To help spread successful strategies so that they can be of use to others in the movement, rather than writing lots of text here, we'd like you to share your finding in the form of a link to a learning pattern.

• Your learning pattern link goes here

The translation works very well with popular categories or categories containing popular terms inside. These terms already appear in the dictionary and in the interlinking structure of Wikidata so our duty just to combine it and check for the best option by our NLP algorithm, the similarity of terms.

What didn’t work

What did you try that you learned didn't work? What would you think about doing differently in the future? Please list these as short bullet points.

• For a category name contains terms (words) do not appear in the dictionary. It is very hard and tricky when on the Internet, there are many versions that were translated not from the experts and even experts sometimes argue about the translated names.

Other recommendations

If you have additional recommendations or reflections that don’t fit into the above sections, please list them here.

• We mention about using Deep Learning and other NLP algorithms to improve the translation quality.

Next steps and opportunities

Are there opportunities for future growth of this project, or new areas you have uncovered in the course of this grant that could be fruitful for more exploration (either by yourself, or others)? What ideas or suggestions do you have for future projects based on the work you’ve completed? Please list these as short bullet points.

Think your project needs renewed funding for another 6 months?

Part 2: The Grant

Finances

Actual spending

Please copy and paste the completed table from your project finances page. Check that you’ve listed the actual expenditures compared with what was originally planned. If there are differences between the planned and actual use of funds, please use the column provided to explain them.

Remaining funds

Do you have any unspent funds from the grant?

Please answer yes or no. If yes, list the amount you did not use and explain why.

• No

If you have unspent funds, they must be returned to WMF. Please see the instructions for returning unspent funds and indicate here if this is still in progress, or if this is already completed:

Documentation

Did you send documentation of all expenses paid with grant funds to grantsadminwikimedia.org, according to the guidelines here?

Please answer yes or no. If no, include an explanation.

• No. Since we create a project based on technical and online collaborations, we do not know how to grant the receipt.

Confirmation of project status

Did you comply with the requirements specified by WMF in the grant agreement?

Please answer yes or no.

• Yes

Is your project completed?

Please answer yes or no.

• Yes

Grantee reflection

We’d love to hear any thoughts you have on what this project has meant to you, or how the experience of being an IEGrantee has gone overall. Is there something that surprised you, or that you particularly enjoyed, or that you’ll do differently going forward as a result of the IEG experience? Please share it here!

Expense	Approved amount	Actual funds spent	Difference
Translation and collect NLP patterns	1000 USD	1000 USD	0 (compare to the mid-term we gain more 500 USD to hire translators to check the correctness of category names)
Design & building program	4500 USD	4500 USD	0
Hire machines to hang out to retrieve data from Wikipedia by APIs	500 USD	500 USD	0
Support discussions, research solutions (or make some surveys)	1000 USD	1000 USD	0