Community Wishlist Survey 2022/Bots and gadgets/Fix ListeriaBot memory issues

From Meta, a Wikimedia project coordination wiki

Fix ListeriaBot memory issues

  • Problem: Since the release of ListeriaBot v2, there is a problem with lists with many links to big entities (for example, links to countries), which make the list generation fail. See some previous discussions: 1, 2. The issue is reported in the official repository: magnusmanske/listeria_rs#66.
  • Proposed solution: Fix the issue with loading big external entities, possibly a caching problem.
  • Who would benefit: ListeriaBot is used to automatically maintain lists of Wikidata items in various Wikipedias. It is used intensively by Women in Red in various languages, as well as other projects (3,204 lists in English, 1,152 in French).
  • More comments:
  • Phabricator tickets:
  • Proposer: MarioGom (talk) 19:49, 10 January 2022 (UTC)[reply]

Discussion

  • I'm afraid this might be out of scope, although I'm not sure. Listeria is a tool by Magnus Manske. If the issue is the tool running low on memory or resources, this should probably be addressed by Toolforge and/or Cloud VPS admins (if it runs there) and ask them to increase the memory quotas. If the issue is with the tool code itself, however, I'm afraid this can only be fixed by Magnus. I note that the repository does not have any license (Issue #80) so contributing patches over there might not be possible or advisable either. CC: MusikAnimal (WMF). Best regards, —MarcoAurelio (talk) 12:27, 11 January 2022 (UTC)[reply]
    I haven't done much investigation but I assume we'd be able to help in some way, either assisting the bot operator or building something new from scratch, if we have to. Perhaps a job queue system needs to be introduced, or assuming it lives on Toolforge, maybe this is deserving to move to VPS where we have more memory to work with. Or maybe it's a simple as giving the bot more memory on Toolforge. So while there is a reliance on Magnus Manske, I wouldn't necessarily say this is out of scope, in my view. MusikAnimal (WMF) (talk) 14:27, 11 January 2022 (UTC)[reply]
    I agree, this should go to the bot operator himself to correct the code. Some bots are controlled by the community, I think... Thingofme (talk) 02:36, 12 January 2022 (UTC)[reply]
    most bots are —TheDJ (talkcontribs) 10:52, 12 January 2022 (UTC)[reply]

Voting