Wikipedia:Bots/Requests for approval/Dexbot 8

The following discussion is an archived debate. Please do not modify it. To request review of this BRFA, please start a new section at WT:BRFA. The result of the discussion was

Approved.

Dexbot 8

Operator: Ladsgroup (talk · contribs · SUL · edit count · logs · page moves · block log · rights log · ANI search)

Time filed: 19:41, Sunday, September 25, 2016 (UTC)

Automatic, Supervised, or Manual: Automatic

Programming language(s): python

Source code available: based on pywikibot. Simple.

Function overview: Clean up proxy links to direct links

Links to relevant discussions (where appropriate): User talk:Ladsgroup#proxy urls

Edit period(s): One time run

Estimated number of pages affected: less than 10K I guess

Exclusion compliant (Yes/No): Yes

Already has a bot flag (Yes/No): Yes

Function details: See the discussion in my talk page made by User:AManWithNoPlan. I also made some edits already [1] :)Ladsgroup^overleg 19:41, 25 September 2016 (UTC)[reply]

Discussion

Might have to do again later, if I find an organization that using a proxy with a different name, and there are way to many to do by hand AManWithNoPlan (talk) 13:46, 26 September 2016 (UTC)[reply]

Approved for trial (200 edits). Please provide a link to the relevant contributions and/or diffs when the trial is complete. This seems fine. Although it's ideal to ask first, I didn't see any errors anyway. I would like to see one more test set just in case, but I bet there won't be any issues. --slakr^\ talk / 23:42, 26 September 2016 (UTC)[reply]

Please more fully document your function above, people reviewing this in the future may want more information. Feel free to link to permalinks. — xaosflux ^Talk 02:17, 27 September 2016 (UTC)[reply]

such as https://en.wikipedia.org/w/index.php?title=John_W._Baumgartner&diff=prev&oldid=741160192 AManWithNoPlan (talk) 02:53, 27 September 2016 (UTC)[reply]

Non-perma link to me doing a bunch by hand https://en.wikipedia.org/w/index.php?title=Special:Contributions/AManWithNoPlan&offset=&limit=500&target=AManWithNoPlan AManWithNoPlan (talk) 01:48, 30 September 2016 (UTC)[reply]

Some perma-links to existing examples for the record:

https://en.wikipedia.org/w/index.php?title=Wilder_W._Hartley&diff=prev&oldid=741160124
https://en.wikipedia.org/w/index.php?title=Roy_Hampton&diff=prev&oldid=741160101 
https://en.wikipedia.org/w/index.php?title=John_W._Shenk&diff=prev&oldid=741159973
https://en.wikipedia.org/w/index.php?title=History_of_Ohio_State_Buckeyes_football&diff=prev&oldid=741804058

Basically turning institution specific URLs in the world accessible URLs (assuming you have a library card in many cases) AManWithNoPlan (talk) 01:48, 30 September 2016 (UTC)[reply]

200 edits done now [2] :)Ladsgroup^overleg 21:53, 1 October 2016 (UTC)[reply]

I see no problems with any of them. AManWithNoPlan (talk) 03:10, 6 October 2016 (UTC) Trial complete.[reply]

Your edits look OK, but the task description and scope above are a bit light, can you detail the specifics of what is going to be addressed (function detail above) by this task? — xaosflux ^Talk 18:38, 9 October 2016 (UTC)[reply]

URLs are having site specific portions of the URL removed. For example:

http://search.proquest.com.ezproxy.lapl.org/hnplatimes/docview/156556449/13145432ADE65B3DE43/1?accountid=6749 to:
http://search.proquest.com/hnplatimes/docview/156556449/13145432ADE65B3DE43/1?accountid=6749

http://time-proxy.yaga.com/time/archive/preview/0,10987,860305,00.html to:
http://time.com/time/archive/preview/0,10987,860305,00.html

http://www.anb.org.proxy.cc.uic.edu/articles/15/15-00191.html to:
http://www.anb.org/articles/15/15-00191.html

This allows user all around the world to access the URL. I am the requester of these edits AManWithNoPlan (talk) 23:00, 9 October 2016 (UTC)[reply]

I see your examples, but it is very broad - if you intend to have an open-ended task to remove every/any proxy of ever/any type this will need more input - do you have a specific list that this task can be constrained to? Also for all of the links that you are adding - how are you verifying that they are working links with the relevant content? — xaosflux ^Talk 23:59, 9 October 2016 (UTC)[reply]

Ladsgroup has the list. The more complex ones I do by hand. AManWithNoPlan (talk) 02:08, 10 October 2016 (UTC)[reply]

Operator Assistance is Needed see above. — xaosflux ^Talk 02:26, 10 October 2016 (UTC)[reply]

@Xaosflux: For start I want to do only the ones mentioned in my talk page. I have no plan on moving to other proxies but I can do it upon request. :)Ladsgroup^overleg 15:14, 11 October 2016 (UTC)[reply]

Here they are, so people don't have to go looking for them: AManWithNoPlan (talk) 17:08, 11 October 2016 (UTC)[reply]

Removing .ezproxy.lapl.org and .proxy.cc.uic.edu from these:
http://search.proquest.com.ezproxy.lapl.org
http://proquest.umi.com.ezproxy.lapl.org
http://www.anb.org.proxy.cc.uic.edu
http://www.jstor.org.proxy.cc.uic.edu
http://hdl.handle.net.proxy.cc.uic.edu
http://www.oxforddnb.com.proxy.cc.uic.edu
http://muse.jhu.edu.proxy.cc.uic.edu
http://purl.dlib.indiana.edu.proxy.cc.uic.edu
http://time-proxy.yaga.com/ convert to  http://time.com/

Sorry there is a backlog at BRFA right now - I'd like to see one more large run under the trial:

Approved for extended trial (1000 edits). Please provide a link to the relevant contributions and/or diffs when the trial is complete. — xaosflux ^Talk 05:06, 2 November 2016 (UTC)[reply]

Trial complete. @Xaosflux and AManWithNoPlan: I did all of them (including time yoga) and it was about 500 cases. Tell me if it's more to do. :)Ladsgroup^overleg 18:20, 6 November 2016 (UTC)[reply]

@Ladsgroup: initial review looks OK, like to hold this for 48 hours for any feedback then will move forward. Please update the User:Dexbot page to include a description of your enwiki tasks and approvals (these are outside of the global bot policy). — xaosflux ^Talk 18:32, 6 November 2016 (UTC)[reply]

Done :)Ladsgroup^overleg 20:34, 6 November 2016 (UTC)[reply]

Looks good. Still some proquest.umi.com.ezproxy.lapl.org hanging around. AManWithNoPlan (talk) 02:05, 7 November 2016 (UTC)[reply]

Approved. Task approved. — xaosflux ^Talk 23:22, 8 November 2016 (UTC)[reply]

The above discussion is preserved as an archive of the debate. Please do not modify it. To request review of this BRFA, please start a new section at WT:BRFA.