Wikipedia:Bots/Requests for approval/CleanupWorklistBot

The following discussion is an archived debate. Please do not modify it. To request review of this BRFA, please start a new section at WT:BRFA. The result of the discussion was

Withdrawn by operator.

CleanupWorklistBot

Operator: Bamyers99 (talk · contribs · SUL · edit count · logs · page moves · block log · rights log · ANI search)

Time filed: 01:36, Sunday June 1, 2014 (UTC)

Automatic, Supervised, or Manual: Automatic

Programming language(s): PHP

Source code available: Github

Function overview: Creates WikiProject cleanup lists. Replacement for User:Svick/WikiProject cleanup listing.

Links to relevant discussions (where appropriate):

Edit period(s): Weekly

Estimated number of pages affected: 600 subpages of CleanupWorklistBot

Exclusion compliant (Yes/No): No

Already has a bot flag (Yes/No):

Function details: For each configured WikiProject, determine which articles associated with the project are in one or more cleanup categories. Generate an alphabetic list by title, by category list, csv file, history list. Only the 'by category list' is stored in a Wikipedia user page to allow section transclusion/watching. The other lists are hosted on Labs as static files. The list of cleanup categories (Github)

The bot requests page contains my migration announcement. All of the proposed enhancements have been implemented.

Some of the 'by category' pages are greater than the maximum wiki page size of 2 M. For those pages, a stub wiki page is written with a link to a full html version on Labs. Example: Physics

Update the {{WikiProject cleanup listing}} template.

Discussion

Rational for rewriting bot: Svick (talk · contribs) has not responded to a query about bot migration or requests to have projects added. Toolserver is supposedly going to be taken offline on June 30, 2014. Rewrote because Svick source code (Github) is not open source unless you consider the initials PD in some of the files to mean Public Domain.

Trial run: Index page Comparing Michigan: Svick - CleanupWorklistBot

I have done a full run on Labs of all 600 projects with wiki updating turned off to test memory usage, etc. 768 M memory, 11 hour runtime. The runtime is partially do to the copying of data from enwiki to tools-db to avoid long running SQL inserts on enwiki per replica server Caution. --Bamyers99 (talk) 01:36, 1 June 2014 (UTC)[reply]

Bamyers99 Could you add WikiProject Martial arts to the list. Is this the right place to ask.?Peter Rehse (talk) 20:02, 5 June 2014 (UTC)[reply]

I have already added it. I watch User talk:Svick/WikiProject cleanup listing. I don't know when the next run of the new bot will be. --Bamyers99 (talk) 20:28, 5 June 2014 (UTC)[reply]

Brilliant - thanks. Right now I get the message Could not select project: but I will wait for a week or so.Peter Rehse (talk) 20:39, 5 June 2014 (UTC)[reply]

I notice when I use the WikiProject cleanup listing template, whether for boxing, mixed martial arts, or just martial arts, it still points to Svick's cleanup listing. Should I be using a different template?Peter Rehse (talk) 15:21, 8 June 2014 (UTC)[reply]

I haven't updated that template yet. I plan on doing another test run on Tuesday June 10 creating html pages instead of wiki pages. The url will be Martial arts by cat listing when the run is finished. --Bamyers99 (talk) 17:40, 8 June 2014 (UTC)[reply]

OK I sometimes forget that patience is a virtue. I will wait. Cheers.Peter Rehse (talk) 18:03, 8 June 2014 (UTC)[reply]

Approved for trial (50 edits). Please provide a link to the relevant contributions and/or diffs when the trial is complete. Magioladitis (talk) 20:23, 22 June 2014 (UTC)[reply]

Trial complete. Edits, no issues. --Bamyers99 (talk) 18:58, 25 June 2014 (UTC)[reply]

Bamyers99 are you sure the data in "Categories" are correct? For instance, what does "... (July 2010)" mean? -- Magioladitis (talk) 12:18, 28 June 2014 (UTC)[reply]

@Magioladitis: The ... represents the current category name. This was done to save space, instead of repeating the current category name for each article. I have added a message to the top of the listings. Sample: Australian law --Bamyers99 (talk) 18:46, 28 June 2014 (UTC)[reply]

Bamyers99 are all related projects aware of this discussion? -- Magioladitis (talk) 22:38, 28 June 2014 (UTC)[reply]

@Magioladitis: I am not aware of anyone notifying the 600 projects. --Bamyers99 (talk) 23:25, 28 June 2014 (UTC)[reply]

Bamyers99 On that page I see something "=> Singapore" What does that mean? -- Magioladitis (talk) 05:22, 29 June 2014 (UTC)[reply]

It means that articles for Wikipedia:SGpedians' notice board can be found in subcategories of Category:Singapore articles by quality. For most of the projects, the mapping is trivial (e.g. Wikipedia:WikiProject .NET has Category:.NET articles by quality), but when it isn't, it has to be specified somehow. User<Svick>.Talk(); 11:56, 29 June 2014 (UTC)[reply]

As the author of the original bot, I apologize for my inactivity in the past months and I welcome this bot, especially the improvements over the original. My code was meant to be open-source, sorry for not making that clear (but as I understand it, that doesn't matter now). User<Svick>.Talk(); 11:56, 29 June 2014 (UTC)[reply]

Withdrawn by operator. Unfortunately the approval process took to long to ensure a smooth transition to wiki pages by June 30. When it became obvious that BAG was short-handed, I implemented plan B to generate html pages hosted on Labs. Thus there will be no ability to watch a wiki page or transclude sections. --Bamyers99 (talk) 13:44, 29 June 2014 (UTC)[reply]

Bamyers99, User<Svick>. I was about to approve the bot. I am a BAG member since 2014-06-21. So I think my responses were fast enough. -- Magioladitis (talk) 14:00, 29 June 2014 (UTC)[reply]

Bamyers99 so shall I close this? -- Magioladitis (talk) 15:24, 29 June 2014 (UTC)[reply]

The above discussion is preserved as an archive of the debate. Please do not modify it. To request review of this BRFA, please start a new section at WT:BRFA.