[07:58:11] <moritzm>	 ok to reboot dborch1001 now or is it a bad time?
[08:01:49] * Emperor has no objections, but would expect maroste.gui or Amir.1 to be more likely to be using it for something, sorry  
[08:03:15] <moritzm>	 thanks, there's no hurry, I'll just wait for their ack
[08:38:04] <jynus>	 should I merge https://gerrit.wikimedia.org/r/c/operations/puppet/+/798467 or should I wait for more reviews?
[08:38:32] <marostegui>	 I am going to rename the revision_actor_temp on s3, it will take around 8h (being done directly on the master)
[08:38:37] <marostegui>	 jynus: go for it
[08:39:02] <jynus>	 ok, as it as been "bad" for a long time, if I did something wrong, it can be amended later :-)
[09:01:45] <Amir1>	 moritzm: it's fine with me, we probably need to restart apache afterwards 
[09:03:49] <moritzm>	 really? the reboot would bring up Apache just like any other service?
[09:09:10] <Amir1>	 can't say for sure, just was saying better safe than sorry D:
[09:09:42] <marostegui>	 Sorry moritzm missed it, go ahead and reboot it when you want yeah
[09:12:29] <moritzm>	 ack, doing that now
[09:19:30] <moritzm>	 it's back
[09:21:33] <Amir1>	 moritzm: works fine. Thanks!
[09:26:43] <Amir1>	 marostegui: do you think I can run this schema change on master of a couple of sections? T298555 logging table doesn't get much writes but the change is pretty big
[09:26:44] <stashbot>	 T298555: Fix mismatching field type of logging.log_timestamp on wmf wikis - https://phabricator.wikimedia.org/T298555
[09:27:22] <marostegui>	 Amir1: that's going to lock the table
[09:28:09] <Amir1>	 with the usual options? lock_wait_timeout, etc.
[09:30:46] <marostegui>	 Amir1: yes, it is not an online change
[09:30:56] <Amir1>	 :(
[09:31:14] <Amir1>	 we need a round of switchovers then
[09:31:26] <marostegui>	 yep
[22:08:19] <icinga-wm>	 PROBLEM - MariaDB sustained replica lag on s7 on db2122 is CRITICAL: 107 ge 2 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db2122&var-port=9104
[22:17:19] <icinga-wm>	 RECOVERY - MariaDB sustained replica lag on s7 on db2122 is OK: (C)2 ge (W)1 ge 0 https://wikitech.wikimedia.org/wiki/MariaDB/troubleshooting%23Replication_lag https://grafana.wikimedia.org/d/000000273/mysql?orgId=1&var-server=db2122&var-port=9104