Abstract Wikipedia/Updates/2022-10-05

Abstract Wikipedia Updates

Catching up

As you may have noticed, for a while we stopped posting our updates. This was mostly because Denny was traveling. Apologies for being so quiet without prior notice. We will improve that in the future.

The travel was mostly work related: some of us spent one week in Zürich on an off-site to which Google.org invited us with their fellows. It was great for the fellows and for us to meet each other in person, and to discuss how the fellowship is going and the plans for the future. We also had the pleasure to listen to a tech talk by Professor Maria Keet from the University of Cape Town particularly on the challenges of Niger Congo B languages in Natural Language Generation. Given that some of the fellows are offboard during these weeks, we will soon publish a newsletter with an update on the fellowship, discussing some results and the future work. It was amazing to meet the fellows, and as much as we are used to remote working, it was great to catch up in person with each other.

The second trip was to Germany. Denny attended a Dagstuhl seminar on “Knowledge Graphs and their Role in the Knowledge Engineering of the 21st Century”, where Wikidata was an important topic, and where he also discussed the extensions we plan with Wikifunctions. A report of the seminar is being written and will be published later this year. Denny wants to thank my co-organizers Elena Simperl, Marieke van Erp, and Paul Groth.

In Berlin, the Wikimedia movement first met for the Wikimedia Summit, and then a meeting of the Tech and Product departments of the Wikimedia Foundation. It was brilliant to meet so many old friends again, and to make new friends. It was the first time that Adam and Denny met each other, and it allowed us to get a picture of the original Abstract Wikipedia team of James, Adam, and Denny:

Weekly updates[edit]

We also used to publish the weekly progress on the individual workstreams in the newsletters. In order to pick up that habit again, you can find below the weekly updates that we skipped. We will re-start publishing them weekly.

August 12: Officially invited users to Beta![edit]

This week, our team reached one of the major milestones of the project. We officially invited users to the Wikifunctions Beta. In the weekly newsletter, we described what works and what doesn't work on Beta and encouraged users to report issues via Phabricator. A lot of team members recorded short presentations in preparation for a Wikimania slot about Wikiunctions on Sunday.

Performance:

Started performance analysis methodology documentation
Set up health-check API endpoint for Wikilambda

Natural Language Generation:

Not too much progress due to team members' vacation time. Started adding noun class information for isiZulu, Mboshi, Kiswahili

Meta-data:

Finished display of metadata dialog on tester page
Created some new PHP utilities for ZMaps

Experience:

Fixed and merged Beta launch blockers
Made great progress on fixing various bugs
Began researching diffing options

August 19: First Deep Dives session with Selena and Wikimania presentation[edit]

The Abstract Wikipedia team had the first Deep Dives session with new Foundation CTPO (Chief Technology and Product Officer) Selena Deckelman and gave an overview of the project. Despite technical problems with the Pheedloop platform, the team was happy about the Wikifunctions presentation during Wikimania. We had a relatively large number of attendees and received good questions. Elena Tonkovidova drafted the QA (Quality Assurance) Abstract Wikipedia playbook in preparation for the new QTE (Quality and Test Engineer) hire.

Performance:

Removed mutex locks and async references in function schemata
Migrated Beta Cluster monitoring from Uptimerobot to Wikimedia infra

Natural Language Generation:

Drafted initial proposal of the Abstract Representation

Meta-data:

Finished the work for showing tester status & adding metadata dialog to the implementation table
Implemented DB schema for caching tester results in MediaWiki

Experience:

Finished pagination in implementations/testers table
Fixed more front-end bugs

August 26: In person Google.org offsite in Zurich[edit]

This week, all Google.org fellows and a few members of the AW team gathered in Zürich for an in-person offsite. As a result, the progress for the Performance and NLG workstreams has been paused. Members of the remaining workstreams participated in some offsite sessions virtually.

Performance:

Paused due to offsite

Natural Language Generation:

Paused due to offsite

Meta-data:

Finished setZMapValue PHP utility
Added validation errors & actual / expected test values into metadata

Experience:

Merged “impactful change” dialog and pagination in implementations/testers table
Fixed more front-end bugs

September 2[edit]

Performance

Started on benchmarking performance before and after the async removal (T296841)
Productive discussions around validation, have some ideas about how to improve performance (T315027) but still needs more work
Started ideating on architecture review
Sent CL for logging improvements (I7126a1d49)
Productive discussions around validation, have some ideas about how to improve performance (T315027) but still needs more work.
Added sections to function model formalization doc

Natural Language Generation

Offsite in Zurich (TechTalk by Maria Keet & NLG UI session)
Drafted DIFF blogpost & sent to team for review
Started defining NLG-related types in Wikifunctions Beta
Started prototyping the NLG system

Metadata

Finished i18n coding for validation errors & actual / expected test values
Adapted metadata dialog code to work with updated dialog components
Analysis / discussion / tickets about modal-dialog implementation strategy

Experience

Fixed function “input” field as placeholder instead of literal
Using Cdx input field in function page
MOBILE: confirmation dialog, function page, implementation and test tables
Fixed ZObjectSelector behavior issues (T314401)
Update language selector to match designs (T315919)
[Ongoing research] refactoring/renaming zobject store module
Fix Z3K1/value type initialization on type creation (T314945)
Fix ZObjectSelector jumpiness
Detail requirements for zobjectDiffing algorithm
Wrote initial ZObjectDiff, ZObjectMapDiff and ZObjectListDiff
Wrote initial ZObjectDiffTest to ease development

September 9[edit]

Performance:

Resolved performance issue in aysnc patch (T296841)
Fixed Beta Cluster issues

Natural Language Generation:

Reviewed the initial proposal of the Abstract Representation
Made good progress on prototyping the NLG system through Scribunto and exploring prototype on Wikifunctions beta
Drafted documentation for basic lexicographic information on Wikidata for isiZulu (and similar languages)

Meta-data:

Progress is paused due to vacation plans

Experience:

Fixed more front-end bugs
Refactored modal dialog
Finished the initial version of ZObjectDiffer

September 16[edit]

A few members of the team had a chance to join the Inclusive Product Development V2 Kickoff. Rebecca Wambua will be driving this initiative in our team. Adam, Denny, and James are in Berlin this week for the Product & Tech Leadership Summit.

Performance:

Started drafting a document on how to improve validation
Initial patch sent for creating benchmark suite
Shared first draft of the semantics proposal

Natural Language Generation:

Conducted Abstract Representation Discussion
Drafted post-NLG ideas gathered during the offsite
Drafted internal document to clarify some aspects of architectures
NLG Scribunto prototype has all needed basic capabilities

Meta-data:

Adapted metadata dialog code to work with recent re-factoring patches

Experience:

Fixed more front-end bugs
Identified the critical user journeys that should have strong test coverage
Reviewed and discussed default component designs
Fixed CI-flagged issues
Created ZObjectDiffer tests

September 23: DIFF post about representing abstract content in natural languages[edit]

Members of the Natural Language Generation workstream published this month's DIFF post about representing abstract content in natural languages. The first 6-month cycle of the Google fellowship program is coming to an end. Next week will be the last week for two fellows. And the remaining members of the first cohort will finish the fellowship in October (different dates). Fellows are putting together a detailed handoff plan.

Performance:

Propagated the no-async validator changes to orchestrator
Landed benchmark suite for orchestrator

Natural Language Generation:

Added sub-template support in the NLG prototype
Discussed refining the template language specification

Meta-data:

Finished refinements & testing of validation errors & actual/expected test values
Investigated adding backend server id(s) to metadata
Corrected element key names in ZTypedPair (patch)

Experience:

Fixed more front-end bugs
Iterated on default component designs
Designed proposals for the mode switcher, publish component, and an "Aliases" input field

September 30: Fix-it Week and welcomed Stef Dunlap to the team[edit]

September 26 – 30 was a ‘Fix-it’ week for the Abstract Wikipedia team. During this week, the team paused the development of new features and focused on tasks related to technical debt. We welcomed Stef Dunlap, Staff Software Engineer in Test, to the team. On September 29th, the team had the Inclusive Product Development Playbook V2 Kickoff. September 30th was the last day for two Google.org fellows.