DYKHousekeepingBot appears to have gone MIA

DYKHousekeepingBot's last edit was at 21:51, March 4, 2015 (UTC). There have been two edits to Template talk:Did you know since then that should have prompted an update to Wikipedia:Did you know/DYK hook count. The Labs-l mailing list shows no obvious indications of a problem that might have affected the bot. ‎Please check on the bot when you get a chance. --Allen3 talk 00:36, 5 March 2015 (UTC)

Looks like Wikipedia's generated HTML changed, which is throwing off DYKHousekeepingBot. Fixing... Shubinator (talk) 05:36, 5 March 2015 (UTC)
Fixed! Shubinator (talk) 06:02, 5 March 2015 (UTC)

DYKHousekeepingBot part deux

We may have had a repeat. DYKHousekeepingBot last updated at 22:22 17 March 2015 (UTC). This edit at 00:00 18 March 2015 (UTC) should have prompted an update of Wikipedia:Did you know/DYK hook count. No obvious issues showing on the Labs mailing list while ‎DYKUpdateBot appears to be working just fine. ‎Please check on the bot when you get a chance. --Allen3 talk 01:52, 18 March 2015 (UTC)

Definitely a repeat. It's been over twenty hours since the last DYKHousekeepingBot update at 22:22 UTC yesterday. Thanks, Shubinator, for anything you can do to get it working again. BlueMoonset (talk) 18:58, 18 March 2015 (UTC)
Back up and running! It looks like the HTML changes were reverted, breaking the bot a second time. I've now tweaked the code to handle both versions of HTML we've seen this month. Sorry for the delay, and thanks for letting me know! Shubinator (talk) 09:28, 19 March 2015 (UTC)

NFS maintenance scheduled on Labs

I don't know if you saw this, but Labs is scheduled to undergo maintenance for the next two days (Wikipedia:Village pump (technical)/Archive 135#Labs is going to be slow and [1]). Probably a good thing long term, but if past experience is any guide the NFS outage scheduled for 22:00 on March 26 might affect DYKUpdateBot. It is nice to receive a little advance notice however. --Allen3 talk 23:54, 24 March 2015 (UTC)

Good to know, I'll check in tomorrow. Thanks! Shubinator (talk) 04:07, 26 March 2015 (UTC)

DYKUpdateBot and DYKHousekeepingBot could use a restart

The maintenance scheduled for March 26 has taken place, just 4 days later than advertized.[2] Both bots appear to be MIA. A manual update has been performed for the 00:00 31 March (UTC) update. Please check their status at year earliest convenience. --Allen3 talk 00:20, 31 March 2015 (UTC)

The Labs servers are being odd, and aren't holding open a connection long enough for me to start up the bots. I'll try again in the morning. Shubinator (talk) 06:24, 31 March 2015 (UTC)
Thanks for trying, Shubinator. We hope it works in the morning, since we're about to go through a three-set day on April 1 (for April Fool's) before reverting to twice a day, and it will be much easier if we (that is, Allen3) don't have to each one manually. BlueMoonset (talk) 06:39, 31 March 2015 (UTC)
And we're back up and running. I'm still intermittently getting disconnected from the Labs login server, but I managed to stay connected long enough to start up both bots. The bots run on different servers, and so hopefully will be unaffected by whatever's plaguing the login server. Thanks both! Shubinator (talk) 23:37, 31 March 2015 (UTC)

Module:NewDYKnomination

Hello Shubinator! I thought I should let you know that I've just switched Template:NewDYKnomination to use Module:NewDYKnomination. I've tried to make the output pretty much identical to the old template, so it shouldn't have any effect on the bot. (But if it does, then you know what to suspect.) I've also got a couple of questions.

At the moment, the credits are made with code like {{DYKmake|article1|author1}}. What happens if the article name or the author name has an equals sign in it? In a normal template this would mess things up, as whatever was before the equals sign would be interpreted as a parameter name, but I realise this might not be the case with the bot, depending on how it processes the parameters. If you like, I can get the module to prefix parameters containing equals signs with 1=, 2=, etc. I've already done something similar with the {{DYK nompage links}} invocation, so it wouldn't be hard to do.

Also, for multiple articles and multiple authors, there is a lot of extra information generated in the DYKmake/DYKnom invocations that isn't really needed. For example, with three articles and three authors, we get:

* {{DYKmake|article1|author1}} 
* {{DYKmake|article1|author2}} 
* {{DYKmake|article1|author3}} 
* {{DYKmake|article2|author1}} 
* {{DYKmake|article2|author2}} 
* {{DYKmake|article2|author3}} 
* {{DYKmake|article3|author1}} 
* {{DYKmake|article3|author2}} 
* {{DYKmake|article3|author3}} 

In the interests of saving the WMF some storage space, how about making this something like:

* {{DYKarticles|article1|article2|article3}} 
* {{DYKauthors|author1|author2|author3}} 

The current template should keep working as it has done before, so this isn't urgent at all, but if you want to implement something like this just let me know and I can fix the Lua side of things. Best — Mr. Stradivarius ♪ talk ♪ 06:29, 1 April 2015 (UTC)

Thanks for improving the template! Feel free to look at parseCredits() in the bot code to see what DYKUpdateBot supports and its quirks. For equals signs, it looks like the bot interprets anything before the first equal sign as a parameter name. Judging by the bot code, workarounds are to either HTML-encode the equals sign or use 1=, 2=, etc. If you could tweak the module to add 1=, 2= in those cases, that would be great! For multiple article nominations, the bot has to be able to associate articles with authors, and the current DYKmake/DYKnom gives the bot this mapping. When the bot is updating, it'll look at all of the templates for that set, and it won't be able to figure out which DYKarticles go with which DYKauthors. Plus the current DYKmake/DYKnom is easier for manual updating as the updater can click on the generated links and save. Shubinator (talk) 05:46, 2 April 2015 (UTC)
Ok, the credit code is now updated to add number prefixes where appropriate. Fair enough about the DYKmake and DYKnom templates - I see your point there. — Mr. Stradivarius ♪ talk ♪ 09:34, 19 April 2015 (UTC)

00:10 16 April 2015 update missed by ‎DYKUpdateBot

DYKUpdateBot missed the update scheduled for 00:10 16 April 2015. Manual update performed. There is some banter on the Labs-l mailing list, but nothing that would obviously cause the bot to fail. ‎DYKHousekeepingBot has not updated Wikipedia:Did you know/DYK hook count despite edits that should have produced an update, so the cause of the outage is probably server related. Please take a look at things when you get a chance. --Allen3 talk 00:34, 16 April 2015 (UTC)

Odd. Both bots stopped logging at around 21:10, with no indication of something wrong. Anyways, they're both up and running again. Thanks for pinging me! Shubinator (talk) 06:44, 17 April 2015 (UTC)
Thanks for getting them back on line, Shubinator. DYKHousekeepingBot has already been updating, and DYKUpdateBot just began the next main page update. BlueMoonset (talk) 08:00, 17 April 2015 (UTC)
Happy to help :) Shubinator (talk) 04:37, 20 April 2015 (UTC)

DYKcheck.js

I hope you don't mind, but I've updated User:Shubinator/DYKcheck.js to escape user input and to replace deprecated code. Normally I would ask before doing something like this, but the escaping issues meant that the script was vulnerable to XSS, and I didn't want to make anyone aware of that before it was necessary. I'm still not positive that I've removed all the XSS vectors, but I've got the most obvious ones, anyway. Updating the API calls to use mw.api also seems like it's made the script much faster. I haven't managed to find any differences in functionality caused by the changes, but let me know if you notice any. Best — Mr. Stradivarius ♪ talk ♪ 21:40, 17 April 2015 (UTC)

Thanks! In the future, for code updates, please split out style updates into a separate edit. In general I prefer to start with the least contentious stuff and then work myself up to the more debatable changes. Shubinator (talk) 04:39, 20 April 2015 (UTC)

DYKHousekeepingBot hors de combat

Shubinator, it would appear that DYKHousekeepingBot last did an update on April 24 at 13:06 UTC; it's now been 17 hours without an update, and there have been over a dozen new nominations added in that period (not to mention a new date). DYKUpdateBot seems to be fine; its most recent activity was on April 24 at 23:33, right on schedule.

Please check the DYKHousekeepingBot, and start it up again as soon as possible. Many thanks. BlueMoonset (talk) 06:15, 25 April 2015 (UTC)

Done :) Shubinator (talk) 16:45, 26 April 2015 (UTC)
Great! Thank you. BlueMoonset (talk) 12:00, 27 April 2015 (UTC)

Another week another Labs outage to halt ‎DYKUpdateBot

The Labs-l mailing list reports both hardware problems and a software change. At least one of these has apparently caused DYKUpdateBot to go MIA. A manual update has been performed for the 00:00 30 April 2015 (UTC) update. Please check on the bot at your earliest convenience. --Allen3 talk 00:20, 30 April 2015 (UTC)

Labs servers aren't letting me log in, it's failing with "Algorithm negotiation failed." Which is quite odd, considering I just logged into Labs a few days ago the same way. I'll try again tomorrow. Shubinator (talk) 07:14, 1 May 2015 (UTC)
I hope you have better luck today! Thanks, Shubinator, for keeping on top of this. BlueMoonset (talk) 17:38, 2 May 2015 (UTC)
And we're back in action. Something in the way I was connecting to Labs isn't supported any longer. I'm not entirely surprised, that's the way I logged into Toolserver back when I started running DYKUpdateBot. Revved up to the latest and greatest authentication, and Labs is letting me login again. Thanks for pinging me! Shubinator (talk) 00:12, 3 May 2015 (UTC)