Community Wishlist Survey 2023/Archive/Fix ListeriaBot memory issues
Fix ListeriaBot memory issues
Merged with Bots and gadgets/A more performant bot to replace ListeriaBot
- Problem: Since the release of ListeriaBot v2, there is a problem with lists with many links to big entities (for example, links to countries), which make the list generation fail. See some previous discussions: 1, 2. The issue is reported in the official repository: magnusmanske/listeria_rs#66.
- Proposed solution: Fix the memory issues, which are probably a caching problem.
- Who would benefit: ListeriaBot is used to automatically maintain lists of Wikidata items in various Wikipedias. It is used intensively by Women in Red in various languages, as well as other projects (3,204 lists in English, 1,152 in French).
- More comments: Fix the issue with loading big external entities, possibly a caching problem.
- Phabricator tickets:
- Proposer: MarioGom (talk) 15:14, 28 January 2023 (UTC)
Discussion
- There is an alternative proposal to create a new bot: Community Wishlist Survey 2023/Bots and gadgets/A more performant bot to replace ListeriaBot. I suspect fixing ListeriaBot is easier than re-writing it from scratch, possibly with a new set of bugs. But I think we need a fixed tool, whether it's fixed ListeriaBot, or a new bot. MarioGom (talk) 15:16, 28 January 2023 (UTC)
- @MarioGom Don't worry about finding the solution. If the issue is solely memory, we'd focus on that. If it needs to be rewritten, then so be it :) In other words, I do not think it's necessary to have two proposals. Do you mind if we archive this one in favor of the other? I will also make some changes to the other more clearly indicate that memory limitation is the primary issue we're trying to fix, but also that it may involve a complete rewrite. It doesn't really matter in the eyes of the voters, I would assume. MusikAnimal (WMF) (talk) 19:38, 30 January 2023 (UTC)
- MusikAnimal (WMF): Yeah, I'm ok with archiving this one as long as it's clear what's the primary problem with ListeriaBot. Best, MarioGom (talk) 21:41, 30 January 2023 (UTC)
- Done, thank you! MusikAnimal (WMF) (talk) 05:27, 31 January 2023 (UTC)
- MusikAnimal (WMF): Yeah, I'm ok with archiving this one as long as it's clear what's the primary problem with ListeriaBot. Best, MarioGom (talk) 21:41, 30 January 2023 (UTC)
- @MarioGom Don't worry about finding the solution. If the issue is solely memory, we'd focus on that. If it needs to be rewritten, then so be it :) In other words, I do not think it's necessary to have two proposals. Do you mind if we archive this one in favor of the other? I will also make some changes to the other more clearly indicate that memory limitation is the primary issue we're trying to fix, but also that it may involve a complete rewrite. It doesn't really matter in the eyes of the voters, I would assume. MusikAnimal (WMF) (talk) 19:38, 30 January 2023 (UTC)
- Just for the record, link to thhe 2022 year proposal: Community Wishlist Survey 2022/Bots and gadgets/Fix ListeriaBot memory issues. MarioGom (talk) 15:19, 28 January 2023 (UTC)
- I'm voting now. We/re told that computing capacity doubles every few years. Can we squirt a bit of that benefit in Listeria bots direction pls? Victuallers (talk) 18:48, 28 January 2023 (UTC)