[00:01:33] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for phorge171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:01:43] <icinga-miraheze>	 PROBLEM - cp36 Disk Space on cp36 is CRITICAL: DISK CRITICAL - free space: / 5120MiB (5% inode=98%);
[00:01:45] <icinga-miraheze>	 PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN
[00:02:37] <icinga-miraheze>	 PROBLEM - cp37 Disk Space on cp37 is CRITICAL: DISK CRITICAL - free space: / 5027MiB (5% inode=98%);
[00:03:13] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[00:03:28] <icinga-miraheze>	 PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is WARNING: WARNING - NGINX Error Rate is 50%
[00:03:45] <icinga-miraheze>	 PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 50%
[00:04:35] <icinga-miraheze>	 RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 20695MiB (23% inode=98%);
[00:05:34] <icinga-miraheze>	 RECOVERY - cp36 Disk Space on cp36 is OK: DISK OK - free space: / 20580MiB (23% inode=98%);
[00:05:45] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw152 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8114
[00:07:46] <icinga-miraheze>	 PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is CRITICAL: CRITICAL - NGINX Error Rate is 67%
[00:08:06] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8119
[00:08:59] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8115
[00:09:16] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw182 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8120
[00:09:27] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw171 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[00:11:06] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw152 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:11:08] <icinga-miraheze>	 PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is CRITICAL: CRITICAL - NGINX Error Rate is 60%
[00:13:03] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mwtask181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8160
[00:13:07] <icinga-miraheze>	 RECOVERY - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is OK: OK - NGINX Error Rate is 13%
[00:13:59] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=iowiki --no-updates /home/universalomega/ImportDump/iowiki-20240209001249.xml (START)
[00:14:26] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:14:59] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=iowiki --no-updates /home/universalomega/ImportDump/iowiki-20240209001249.xml (END - exit=0)
[00:15:00] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=iowiki (START)
[00:15:04] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw161 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:15:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:15:08] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=iowiki (END - exit=0)
[00:15:09] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=iowiki --active --update (END - exit=0)
[00:15:34] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:16:01] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:16:10] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw182 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:16:28] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:21:34] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:23:05] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for matomo151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8203
[00:23:18] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for test151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8181
[00:23:28] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[00:25:25] <icinga-miraheze>	 RECOVERY - cp41 Disk Space on cp41 is OK: DISK OK - free space: / 26351MiB (28% inode=98%);
[00:25:28] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mwtask181 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[00:25:29] <botifico>	 [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/aa8266a3ba1f...87089743cad9
[00:25:32] <botifico>	 [02miraheze/dns] 07Universal-Omega 038708974 - Add io.wikitide.org to Miraheze
[00:27:02] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for phorge171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8202
[00:28:32] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/c05098042302...6f6339b572de
[00:28:34] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for reports171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8205
[00:28:35] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 036f6339b - Also iowiki
[00:29:28] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for test151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:29:31] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for matomo151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:30:01] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:31:12] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw162 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8116
[00:31:34] <icinga-miraheze>	 PROBLEM - cp41 Disk Space on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[00:32:17] <MirahezeLSBot>	 !log [@mwtask181] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all
[00:32:25] <MirahezeLSBot>	 !log [@mwtask181] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all - SUCCESS in 8s
[00:32:44] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:33:11] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:33:59] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for phorge171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:34:54] <miraheze-github>	 miraheze/MirahezeMagic - Universal-Omega the build passed.
[00:35:26] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for reports171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:37:18] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw162 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:37:32] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw152 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8114
[00:45:20] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8115
[00:45:47] <icinga-miraheze>	 PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 58%
[00:47:48] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw152 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[00:50:39] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8207
[00:52:13] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw161 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:53:56] <MirahezeLSBot>	 !log [@test151] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to test151
[00:53:57] <MirahezeLSBot>	 !log [@test151] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s
[00:54:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:54:06] <MirahezeLSBot>	 !log [@test151] starting deploy of {'folders': '1.42/extensions/MirahezeMagic'} to test151
[00:54:07] <MirahezeLSBot>	 !log [@test151] finished deploy of {'folders': '1.42/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s
[00:54:32] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:54:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:54:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:56:21] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw162 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8116
[00:57:37] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:00:46] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8207
[01:03:16] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw162 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:04:03] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for puppet181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8204
[01:04:04] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[01:06:03] <icinga-miraheze>	 RECOVERY - cp41 Disk Space on cp41 is OK: DISK OK - free space: / 26349MiB (28% inode=98%);
[01:07:07] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy171 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[01:07:16] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw152 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8114
[01:10:01] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for puppet181 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[01:10:23] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:10:24] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8207
[01:13:01] <icinga-miraheze>	 PROBLEM - cp41 Disk Space on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:14:02] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8119
[01:17:23] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:18:51] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[01:19:22] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw181 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[01:19:46] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw152 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:21:59] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8119
[01:22:06] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for reports171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8205
[01:25:43] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:26:35] <icinga-miraheze>	 RECOVERY - cp41 Current Load on cp41 is OK: LOAD OK - total load average: 0.16, 0.10, 0.03
[01:27:45] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query.
[01:28:08] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for reports171 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[01:28:33] <icinga-miraheze>	 RECOVERY - cp41 conntrack_table_size on cp41 is OK: OK: nf_conntrack is 0 % full
[01:28:43] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[01:29:03] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw182 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8120
[01:30:59] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw172 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8118
[01:32:36] <icinga-miraheze>	 PROBLEM - cp41 Current Load on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[01:33:47] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw171 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[01:34:56] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw182 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[01:35:47] <icinga-miraheze>	 PROBLEM - cp41 conntrack_table_size on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:36:31] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw172 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[01:37:09] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[01:37:46] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8113
[01:38:38] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:38:40] <icinga-miraheze>	 RECOVERY - cp41 Disk Space on cp41 is OK: DISK OK - free space: / 26347MiB (28% inode=98%);
[01:39:00] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw152 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8114
[01:40:06] <icinga-miraheze>	 RECOVERY - cp41 SSH on cp41 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u2 (protocol 2.0)
[01:41:08] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw172 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8118
[01:41:12] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8207
[01:42:14] <icinga-miraheze>	 RECOVERY - cp41 ferm_active on cp41 is OK: OK ferm input default policy is set
[01:42:22] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for reports171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8205
[01:42:38] <icinga-miraheze>	 RECOVERY - cp41 Current Load on cp41 is OK: LOAD OK - total load average: 0.04, 0.05, 0.01
[01:43:22] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for matomo151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8203
[01:43:49] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:44:25] <icinga-miraheze>	 PROBLEM - cp41 SSH on cp41 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[01:44:58] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=dpl3wiki --no-updates /home/universalomega/ImportDump/dpl3wiki-20240209014358.xml (START)
[01:45:14] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:45:38] <icinga-miraheze>	 PROBLEM - cp41 Disk Space on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:47:23] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw172 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:48:10] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:48:27] <icinga-miraheze>	 RECOVERY - cp41 SSH on cp41 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u2 (protocol 2.0)
[01:49:02] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for matomo151 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[01:49:02] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw182 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8120
[01:49:03] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for reports171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:49:08] <icinga-miraheze>	 PROBLEM - cp41 ferm_active on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:49:08] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=dpl3wiki --no-updates /home/universalomega/ImportDump/dpl3wiki-20240209014358.xml (END - exit=0)
[01:49:09] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=dpl3wiki (START)
[01:49:18] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:49:25] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:49:37] <icinga-miraheze>	 PROBLEM - cp41 Current Load on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:49:41] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=dpl3wiki (END - exit=0)
[01:49:42] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=dpl3wiki --active --update (END - exit=0)
[01:49:48] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:49:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:49:58] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for test151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8181
[01:51:19] <botifico>	 [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/87089743cad9...d119996235b6
[01:51:20] <botifico>	 [02miraheze/dns] 07Universal-Omega 03d119996 - Add dpl3.wikitide.org to Miraheze
[01:51:30] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for reports171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8205
[01:52:02] <icinga-miraheze>	 RECOVERY - cp41 conntrack_table_size on cp41 is OK: OK: nf_conntrack is 0 % full
[01:52:09] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for matomo151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8203
[01:52:46] <icinga-miraheze>	 PROBLEM - cp41 SSH on cp41 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[01:53:35] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw152 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:53:44] <icinga-miraheze>	 RECOVERY - cp41 Disk Space on cp41 is OK: DISK OK - free space: / 26345MiB (28% inode=98%);
[01:56:24] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for puppet181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8204
[01:56:51] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw152 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8114
[01:56:52] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[01:57:22] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for test151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:57:38] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw182 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[01:58:31] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:58:47] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for reports171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:58:54] <icinga-miraheze>	 PROBLEM - cp41 conntrack_table_size on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:02:20] <icinga-miraheze>	 RECOVERY - cp41 Current Load on cp41 is OK: LOAD OK - total load average: 0.02, 0.03, 0.00
[02:02:34] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw171 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[02:03:22] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for puppet181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:03:29] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8113
[02:04:24] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8207
[02:05:12] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for matomo151 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[02:06:14] <icinga-miraheze>	 PROBLEM - wiki.andreijiroh.uk.eu.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.andreijiroh.uk.eu.org' expires in 15 day(s) (Sun 25 Feb 2024 01:50:36 AM GMT +0000).
[02:06:22] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for puppet181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8204
[02:07:30] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for test151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8181
[02:09:21] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for reports171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8205
[02:09:28] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw151 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[02:11:01] <icinga-miraheze>	 PROBLEM - cp41 Disk Space on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:11:15] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:12:38] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for puppet181 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[02:13:04] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw152 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:13:07] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for test151 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[02:13:58] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[02:15:24] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for reports171 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[02:15:40] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8113
[02:15:40] <icinga-miraheze>	 RECOVERY - cp41 Disk Space on cp41 is OK: DISK OK - free space: / 26343MiB (28% inode=98%);
[02:16:09] <icinga-miraheze>	 PROBLEM - cp41 Current Load on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:18:31] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw152 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8114
[02:18:45] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for puppet181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8204
[02:20:17] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:20:21] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw182 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8120
[02:21:18] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw151 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[02:21:44] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for phorge171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8202
[02:21:49] <icinga-miraheze>	 PROBLEM - cp41 Disk Space on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:23:40] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8113
[02:24:31] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw152 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[02:24:44] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8206
[02:24:55] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for test151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8181
[02:25:38] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for puppet181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:26:30] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw182 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[02:26:31] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw162 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8116
[02:29:22] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:29:45] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw172 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8118
[02:29:58] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw152 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8114
[02:30:29] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for reports171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8205
[02:30:49] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[02:30:55] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for phorge171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:31:52] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for test151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:32:48] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw162 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:33:36] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8113
[02:34:21] <icinga-miraheze>	 RECOVERY - cp41 ferm_active on cp41 is OK: OK ferm input default policy is set
[02:34:58] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for test151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8181
[02:35:13] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw172 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[02:36:17] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw152 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:36:49] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw171 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[02:36:53] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy161 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:37:03] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for reports171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:39:11] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for puppet181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8204
[02:39:52] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8206
[02:40:18] <icinga-miraheze>	 RECOVERY - cp41 SSH on cp41 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u2 (protocol 2.0)
[02:40:51] <icinga-miraheze>	 PROBLEM - cp41 ferm_active on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:41:01] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:41:44] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for test151 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[02:42:11] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw152 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8114
[02:42:41] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for matomo151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8203
[02:44:18] <icinga-miraheze>	 PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is WARNING: WARNING - NGINX Error Rate is 40%
[02:44:37] <icinga-miraheze>	 PROBLEM - cp41 SSH on cp41 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[02:44:46] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for puppet181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:45:03] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8115
[02:46:29] <MirahezeRelay>	 <songngu.xyz> Anyone available here for image dump importing?
[02:47:04] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy161 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:48:24] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8207
[02:48:48] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for matomo151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:50:58] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw152 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[02:51:08] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8119
[02:51:11] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw161 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:53:22] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for test151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8181
[02:54:42] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:55:19] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for matomo151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8203
[02:55:48] <icinga-miraheze>	 RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp36.wikitide.net - CNAME OK
[02:56:19] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[02:57:30] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for puppet181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8204
[02:57:34] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:57:54] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mwtask181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8160
[02:58:44] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw162 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8116
[02:59:41] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8119
[03:00:35] <icinga-miraheze>	 RECOVERY - cp41 conntrack_table_size on cp41 is OK: OK: nf_conntrack is 0 % full
[03:01:58] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for phorge171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8202
[03:02:49] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw171 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[03:03:22] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw162 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[03:04:47] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for matomo151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[03:04:52] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mwtask181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[03:05:45] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw181 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[03:06:31] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for test151 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[03:07:27] <icinga-miraheze>	 PROBLEM - cp41 conntrack_table_size on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[03:07:39] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for matomo151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8203
[03:08:56] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for phorge171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[03:09:05] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for test151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8181
[03:11:36] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for puppet181 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[03:12:51] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw152 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8114
[03:12:56] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mwtask181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8160
[03:13:26] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for reports171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8205
[03:14:07] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8119
[03:14:18] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw182 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8120
[03:15:53] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for test151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[03:19:04] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw152 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[03:19:04] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw172 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8118
[03:19:53] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mwtask181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[03:20:10] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw182 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[03:20:10] <icinga-miraheze>	 RECOVERY - cp41 ferm_active on cp41 is OK: OK ferm input default policy is set
[03:20:51] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[03:21:34] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for matomo151 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[03:23:11] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for reports171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[03:24:54] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw172 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[03:26:30] <icinga-miraheze>	 PROBLEM - cp41 ferm_active on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[03:26:44] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[03:28:59] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[03:30:08] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw162 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8116
[03:31:19] <botifico>	 [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/d119996235b6...5406ead251ae
[03:31:22] <botifico>	 [02miraheze/dns] 07Universal-Omega 035406ead - Add cosmos.wikitide.org to Miraheze
[03:33:16] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for matomo151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8203
[03:35:04] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8115
[03:35:20] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw182 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8120
[03:37:53] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[03:39:59] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for matomo151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[03:40:04] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8207
[03:40:35] <botifico>	 [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/5406ead251ae...cfe59950ab46
[03:40:37] <botifico>	 [02miraheze/dns] 07Universal-Omega 03cfe5995 - Switch mwcosmos.com to Miraheze cps
[03:41:29] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw172 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8118
[03:41:31] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw162 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[03:41:35] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw182 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[03:41:53] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/64f3473e8703...fa3ddf621643
[03:41:56] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot 03fa3ddf6 - Bot: Add SSL cert for mwcosmos.com
[03:42:02] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw161 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[03:44:36] <botifico>	 [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/fa3ddf621643...56e317a8cd9e
[03:44:38] <botifico>	 [02miraheze/ssl] 07Universal-Omega 0356e317a - Add www.mwcosmos.com redirect
[03:44:45] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[03:45:56] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy171 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[03:46:51] <icinga-miraheze>	 PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[03:47:37] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw172 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[03:48:25] <icinga-miraheze>	 RECOVERY - cp41 Current Load on cp41 is OK: LOAD OK - total load average: 0.07, 0.06, 0.01
[03:52:57] <icinga-miraheze>	 RECOVERY - cp41 ferm_active on cp41 is OK: OK ferm input default policy is set
[03:54:08] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw152 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8114
[03:54:14] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for matomo151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8203
[03:54:25] <icinga-miraheze>	 PROBLEM - cp41 Current Load on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[03:59:23] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for matomo151 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[03:59:38] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for test151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8181
[03:59:54] <icinga-miraheze>	 PROBLEM - cp41 ferm_active on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:00:45] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for reports171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8205
[04:01:27] <icinga-miraheze>	 RECOVERY - cp41 conntrack_table_size on cp41 is OK: OK: nf_conntrack is 0 % full
[04:02:29] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8207
[04:02:35] <icinga-miraheze>	 PROBLEM - cp41 NTP time on cp41 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[04:03:25] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8113
[04:04:01] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw152 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:04:09] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for phorge171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8202
[04:05:30] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8115
[04:05:34] <icinga-miraheze>	 PROBLEM - cp41 NTP time on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:06:52] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for puppet181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8204
[04:07:03] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for reports171 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[04:07:58] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:08:18] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8206
[04:08:19] <icinga-miraheze>	 PROBLEM - cp41 conntrack_table_size on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:08:38] <icinga-miraheze>	 RECOVERY - cp41 Current Load on cp41 is OK: LOAD OK - total load average: 0.08, 0.05, 0.01
[04:09:43] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:09:47] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for test151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:10:51] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for phorge171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:11:37] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw161 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:12:19] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw152 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8114
[04:13:49] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8207
[04:13:53] <icinga-miraheze>	 PROBLEM - cp41 Current Load on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[04:14:25] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for puppet181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:16:10] <icinga-miraheze>	 RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000.
[04:17:10] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for puppet181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8204
[04:18:01] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw152 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:18:16] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy161 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:19:00] <icinga-miraheze>	 RECOVERY - cp41 Disk Space on cp41 is OK: DISK OK - free space: / 26334MiB (28% inode=98%);
[04:20:21] <icinga-miraheze>	 RECOVERY - cp41 SSH on cp41 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u2 (protocol 2.0)
[04:20:45] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:21:20] <botifico>	 [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03NUMBEROFWIKIS-fix [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/commit/5e58619e42aa
[04:21:23] <botifico>	 [02miraheze/WikiDiscover] 07Universal-Omega 035e58619 - Dont use LocalDatabases for NUMBEROFWIKIS
[04:21:25] <botifico>	 [02WikiDiscover] 07Universal-Omega created branch 03NUMBEROFWIKIS-fix - 13https://github.com/miraheze/WikiDiscover
[04:21:26] <botifico>	 [02WikiDiscover] 07Universal-Omega opened pull request 03#110: Dont use LocalDatabases for NUMBEROFWIKIS - 13https://github.com/miraheze/WikiDiscover/pull/110
[04:23:13] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8113
[04:23:15] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for puppet181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:24:40] <icinga-miraheze>	 PROBLEM - cp41 SSH on cp41 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[04:25:27] <miraheze-github>	 miraheze/WikiDiscover - Universal-Omega the build passed.
[04:25:44] <botifico>	 [02WikiDiscover] 07Universal-Omega closed pull request 03#110: Dont use LocalDatabases for NUMBEROFWIKIS - 13https://github.com/miraheze/WikiDiscover/pull/110
[04:25:47] <botifico>	 [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/267e763a0d74...acefe8616d15
[04:25:48] <botifico>	 [02miraheze/WikiDiscover] 07Universal-Omega 03acefe86 - Dont use LocalDatabases for NUMBEROFWIKIS (#110)
[04:25:51] <botifico>	 [02miraheze/WikiDiscover] 07Universal-Omega deleted branch 03NUMBEROFWIKIS-fix
[04:25:53] <botifico>	 [02WikiDiscover] 07Universal-Omega deleted branch 03NUMBEROFWIKIS-fix - 13https://github.com/miraheze/WikiDiscover
[04:26:08] <MirahezeLSBot>	 !log [universalomega@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'WikiDiscover'} to all
[04:26:17] <MirahezeLSBot>	 !log [universalomega@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'WikiDiscover'} to all - SUCCESS in 9s
[04:26:35] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[04:26:43] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[04:29:11] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[04:29:42] <miraheze-github>	 miraheze/WikiDiscover - Universal-Omega the build passed.
[04:29:47] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw151 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[04:31:31] <icinga-miraheze>	 RECOVERY - cp41 ferm_active on cp41 is OK: OK ferm input default policy is set
[04:31:38] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for test151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8181
[04:34:10] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for reports171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8205
[04:34:21] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for matomo151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8203
[04:34:28] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw171 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[04:35:43] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw152 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8114
[04:36:19] <icinga-miraheze>	 PROBLEM - cp41 Disk Space on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[04:37:50] <icinga-miraheze>	 PROBLEM - cp41 ferm_active on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[04:38:19] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for test151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:40:11] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for reports171 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[04:41:01] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for matomo151 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[04:41:06] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw152 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[04:42:10] <icinga-miraheze>	 RECOVERY - cp41 Disk Space on cp41 is OK: DISK OK - free space: / 26332MiB (28% inode=98%);
[04:44:59] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8113
[04:47:23] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw172 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8118
[04:47:32] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8206
[04:47:46] <icinga-miraheze>	 RECOVERY - cp41 SSH on cp41 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u2 (protocol 2.0)
[04:49:02] <icinga-miraheze>	 PROBLEM - cp41 Disk Space on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:49:24] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for phorge171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8202
[04:51:29] <icinga-miraheze>	 RECOVERY - cp41 ferm_active on cp41 is OK: OK ferm input default policy is set
[04:51:30] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mon181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8201
[04:51:35] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:52:07] <icinga-miraheze>	 PROBLEM - cp41 SSH on cp41 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[04:54:12] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw172 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:54:20] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy161 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[04:55:40] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for phorge171 on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[04:57:07] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw172 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8118
[04:57:25] <icinga-miraheze>	 PROBLEM - cp41 ferm_active on cp41 is CRITICAL: CHECK_NRPE: Error - Could not connect to 2400:d320:2161:9775::1: Connection reset by peer
[04:57:52] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mon181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:03:22] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mwtask181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8160
[05:03:56] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw172 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:09:23] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mwtask181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:12:28] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8115
[05:13:00] <icinga-miraheze>	 RECOVERY - cp41 Current Load on cp41 is OK: LOAD OK - total load average: 0.06, 0.06, 0.07
[05:13:09] <icinga-miraheze>	 RECOVERY - cp41 Disk Space on cp41 is OK: DISK OK - free space: / 26329MiB (28% inode=98%);
[05:14:31] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for phorge171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8202
[05:14:33] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8113
[05:19:48] <icinga-miraheze>	 PROBLEM - cp41 Current Load on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:20:02] <icinga-miraheze>	 PROBLEM - cp41 Disk Space on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:21:19] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for phorge171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:21:23] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw161 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:21:28] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:22:59] <icinga-miraheze>	 PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[05:24:12] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for puppet181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8204
[05:24:13] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[05:27:49] <icinga-miraheze>	 PROBLEM - Host cp41 is DOWN: PING CRITICAL - Packet loss = 100%
[05:34:46] <icinga-miraheze>	 RECOVERY - Host cp41 is UP: PING OK - Packet loss = 44%, RTA = 1125.99 ms
[05:35:07] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for reports171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8205
[05:35:09] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8115
[05:36:53] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for puppet181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:37:03] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:37:08] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8206
[05:37:16] <icinga-miraheze>	 PROBLEM - cp41 NTP time on cp41 is WARNING: NTP WARNING: Offset -0.1886747479 secs
[05:40:15] <icinga-miraheze>	 PROBLEM - cp41 NTP time on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:43:56] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy161 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:44:01] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw161 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:45:02] <icinga-miraheze>	 PROBLEM - Host cp41 is DOWN: PING CRITICAL - Packet loss = 100%
[05:45:20] <icinga-miraheze>	 PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[06:16:42] <icinga-miraheze>	 RECOVERY - Host cp41 is UP: PING WARNING - Packet loss = 96%, RTA = 122.99 ms
[06:18:23] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for reports171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[06:20:43] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw162 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8116
[06:20:44] <icinga-miraheze>	 RECOVERY - cp41 SSH on cp41 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u2 (protocol 2.0)
[06:20:44] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8119
[06:20:44] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8206
[06:20:44] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mon181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8201
[06:20:45] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for reports171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8205
[06:21:00] <icinga-miraheze>	 RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK
[06:21:01] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for matomo151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8203
[06:21:01] <icinga-miraheze>	 RECOVERY - cp41 PowerDNS Recursor on cp41 is OK: DNS OK: 0.313 seconds response time. miraheze.org returns 2602:294:0:b13::110,2602:294:0:b23::112,38.46.223.205,38.46.223.206
[06:25:03] <icinga-miraheze>	 PROBLEM - cp41 SSH on cp41 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[06:27:31] <icinga-miraheze>	 PROBLEM - Host cp41 is DOWN: PING CRITICAL - Packet loss = 100%
[06:43:28] <icinga-miraheze>	 RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000.
[06:44:58] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/update.php --wiki=wanderingstarswiki --quick (END - exit=256)
[06:45:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[06:45:10] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/update.php --wiki=wanderingstarswiki --quick --force (END - exit=0)
[06:45:17] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[07:26:01] <icinga-miraheze>	 RECOVERY - Host cp41 is UP: PING WARNING - Packet loss = 90%, RTA = 123.04 ms
[07:27:24] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw162 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[07:27:48] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mon181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[07:28:24] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for swiftproxy161 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[07:28:28] <icinga-miraheze>	 RECOVERY - cp41 ferm_active on cp41 is OK: OK ferm input default policy is set
[07:28:29] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for reports171 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[07:28:48] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for matomo151 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[07:28:54] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw181 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[07:28:54] <icinga-miraheze>	 PROBLEM - cp41 PowerDNS Recursor on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[07:29:40] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw182 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8120
[07:30:17] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw152 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8114
[07:35:06] <icinga-miraheze>	 PROBLEM - Host cp41 is DOWN: PING CRITICAL - Packet loss = 100%
[07:39:59] <icinga-miraheze>	 RECOVERY - Host cp41 is UP: PING WARNING - Packet loss = 90%, RTA = 122.92 ms
[07:42:28] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw182 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[07:42:29] <icinga-miraheze>	 PROBLEM - cp41 ferm_active on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[07:42:29] <icinga-miraheze>	 PROBLEM - cp41 Nginx Backend for mw152 on cp41 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[07:45:23] <icinga-miraheze>	 PROBLEM - Host cp41 is DOWN: PING CRITICAL - Packet loss = 100%
[08:02:00] <icinga-miraheze>	 RECOVERY - Host cp41 is UP: PING OK - Packet loss = 0%, RTA = 122.36 ms
[08:02:01] <icinga-miraheze>	 RECOVERY - cp41 Current Load on cp41 is OK: LOAD OK - total load average: 0.19, 0.07, 0.02
[08:02:08] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw182 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8120
[08:02:10] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8113
[08:02:12] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw162 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8116
[08:02:12] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8206
[08:02:27] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw152 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8114
[08:02:28] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw172 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8118
[08:02:33] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for reports171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8205
[08:02:36] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for test151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8181
[08:02:39] <icinga-miraheze>	 RECOVERY - cp41 ferm_active on cp41 is OK: OK ferm input default policy is set
[08:02:41] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mon181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8201
[08:02:41] <icinga-miraheze>	 RECOVERY - cp41 conntrack_table_size on cp41 is OK: OK: nf_conntrack is 0 % full
[08:02:44] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for phorge171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8202
[08:02:49] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw161 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8115
[08:02:51] <icinga-miraheze>	 RECOVERY - cp41 Puppet on cp41 is OK: OK: Puppet is currently enabled, last run 56 seconds ago with 0 failures
[08:02:54] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8117
[08:03:04] <icinga-miraheze>	 RECOVERY - cp41 Varnish Backends on cp41 is OK: All 18 backends are healthy
[08:03:09] <icinga-miraheze>	 RECOVERY - cp41 HTTP 4xx/5xx ERROR Rate on cp41 is OK: OK - NGINX Error Rate is 34%
[08:03:09] <icinga-miraheze>	 RECOVERY - cp41 NTP time on cp41 is OK: NTP OK: Offset -0.001658052206 secs
[08:03:14] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for puppet181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8204
[08:03:14] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for swiftproxy171 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8207
[08:03:19] <icinga-miraheze>	 RECOVERY - cp41 HTTPS on cp41 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 3607 bytes in 0.816 second response time
[08:03:19] <icinga-miraheze>	 RECOVERY - cp41 PowerDNS Recursor on cp41 is OK: DNS OK: 0.026 seconds response time. miraheze.org returns 2602:294:0:b13::110,2602:294:0:b23::112,38.46.223.205,38.46.223.206
[08:03:19] <icinga-miraheze>	 RECOVERY - cp41 APT on cp41 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[08:03:24] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mw181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8119
[08:03:39] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for mwtask181 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8160
[08:03:44] <icinga-miraheze>	 RECOVERY - cp41 Nginx Backend for matomo151 on cp41 is OK: TCP OK - 0.000 second response time on localhost port 8203
[08:03:49] <icinga-miraheze>	 RECOVERY - cp41 Disk Space on cp41 is OK: DISK OK - free space: / 26345MiB (28% inode=98%);
[08:03:49] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 122.52 ms
[08:03:54] <icinga-miraheze>	 RECOVERY - cp41 SSH on cp41 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u2 (protocol 2.0)
[08:12:40] <icinga-miraheze>	 PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[09:10:48] <icinga-miraheze>	 RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000.
[10:39:58] <icinga-miraheze>	 PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[10:56:38] <MirahezeRelay>	 <songngu.xyz> [[phab:T11823]] created.
[10:56:38] <wm-bot>	 https://meta.miraheze.org/wiki/phab:T11823
[10:56:39] <MirahezeRelay>	 <Wiki-Bot#2998> <https://phabricator.miraheze.org/T11823>
[11:09:03] <icinga-miraheze>	 RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000.
[11:51:56] <icinga-miraheze>	 PROBLEM - elephants.ggreig.com - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query ggreig.com. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[12:09:44] <icinga-miraheze>	 PROBLEM - cheeseepedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'cheeseepedia.org' expires in 15 day(s) (Sun 25 Feb 2024 12:03:37 PM GMT +0000).
[12:09:56] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/56e317a8cd9e...970ed28ec557
[12:09:58] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot 03970ed28 - Bot: Update SSL cert for cheeseepedia.org
[12:20:30] <icinga-miraheze>	 PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mahdiruiz.line.pm All nameservers failed to answer the query.
[12:21:04] <icinga-miraheze>	 RECOVERY - elephants.ggreig.com - reverse DNS on sslhost is OK: SSL OK - elephants.ggreig.com reverse DNS resolves to cp37.wikitide.net - CNAME OK
[13:09:25] <icinga-miraheze>	 RECOVERY - cheeseepedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'cheeseepedia.org' will expire on Thu 09 May 2024 11:09:50 AM GMT +0000.
[13:36:20] <icinga-miraheze>	 PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[13:37:04] <MirahezeLSBot>	 !log [paladox@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'AuthorProtect'} to all
[13:37:05] <MirahezeLSBot>	 !log [paladox@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'AuthorProtect'} to all - SUCCESS in 1s
[13:37:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:37:09] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:37:20] <MirahezeLSBot>	 !log [paladox@mwtask181] starting deploy of {'world': True, 'versions': '1.41', 'upgrade_extensions': 'AuthorProtect'} to all
[13:37:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:37:48] <MirahezeLSBot>	 !log [paladox@test151] starting deploy of {'versions': ['1.41', '1.42'], 'upgrade_extensions': 'AuthorProtect'} to test151
[13:37:50] <MirahezeLSBot>	 !log [paladox@test151] finished deploy of {'versions': ['1.41', '1.42'], 'upgrade_extensions': 'AuthorProtect'} to test151 - SUCCESS in 1s
[13:37:50] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:37:53] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:38:16] <MirahezeLSBot>	 !log [paladox@test151] starting deploy of {'world': True, 'versions': ['1.41', '1.42']} to test151
[13:38:18] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:38:19] <MirahezeLSBot>	 !log [paladox@mwtask181] finished deploy of {'world': True, 'versions': '1.41', 'upgrade_extensions': 'AuthorProtect'} to all - SUCCESS in 58s
[13:38:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:38:50] <MirahezeLSBot>	 !log [paladox@test151] finished deploy of {'world': True, 'versions': ['1.41', '1.42']} to test151 - SUCCESS in 33s
[13:38:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:38:55] <botifico>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/47af9205cedd
[13:38:56] <botifico>	 [02miraheze/mw-config] 07paladox 0347af920 - Re-enable AuthorProtect
[13:38:58] <botifico>	 [02mw-config] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/mw-config
[13:39:00] <botifico>	 [02mw-config] 07paladox opened pull request 03#5473: Re-enable AuthorProtect - 13https://github.com/miraheze/mw-config/pull/5473
[13:39:04] <botifico>	 [02mw-config] 07paladox closed pull request 03#5473: Re-enable AuthorProtect - 13https://github.com/miraheze/mw-config/pull/5473
[13:39:07] <botifico>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/0736aa7ed989...abcbd2dc6cfc
[13:39:10] <botifico>	 [02miraheze/mw-config] 07paladox 03abcbd2d - Re-enable AuthorProtect (#5473)
[13:39:13] <botifico>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-5
[13:39:14] <botifico>	 [02mw-config] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/mw-config
[13:39:20] <MirahezeLSBot>	 !log [paladox@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all
[13:39:21] <MirahezeLSBot>	 !log [paladox@test151] starting deploy of {'pull': 'config', 'config': True} to test151
[13:39:22] <MirahezeLSBot>	 !log [paladox@test151] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output.
[13:39:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:39:26] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:39:28] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:39:29] <MirahezeLSBot>	 !log [paladox@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 9s
[13:39:32] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:39:56] <MirahezeLSBot>	 !log [paladox@test151] starting deploy of {'pull': 'config', 'config': True} to test151
[13:39:56] <miraheze-github>	 miraheze/mw-config - paladox the build passed.
[13:39:56] <MirahezeLSBot>	 !log [paladox@test151] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output.
[13:39:58] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:40:00] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:40:04] <miraheze-github_>	 miraheze/mw-config - paladox the build passed.
[13:41:30] <MirahezeLSBot>	 !log [paladox@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'RatePage'} to all
[13:41:33] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:41:40] <MirahezeLSBot>	 !log [paladox@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'RatePage'} to all - SUCCESS in 9s
[13:41:42] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:42:29] <MirahezeLSBot>	 !log [paladox@mwtask181] starting deploy of {'world': True, 'versions': '1.41'} to all
[13:42:31] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:42:47] <MirahezeLSBot>	 !log [paladox@test151] starting deploy of {'versions': ['1.41', '1.42'], 'upgrade_extensions': 'RatePage'} to test151
[13:42:49] <MirahezeLSBot>	 !log [paladox@test151] finished deploy of {'versions': ['1.41', '1.42'], 'upgrade_extensions': 'RatePage'} to test151 - SUCCESS in 2s
[13:42:49] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:42:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:43:15] <MirahezeLSBot>	 !log [paladox@mwtask181] finished deploy of {'world': True, 'versions': '1.41'} to all - SUCCESS in 46s
[13:43:18] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:43:37] <botifico>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/03c9748cd681
[13:43:38] <botifico>	 [02miraheze/mw-config] 07paladox 0303c9748 - Re-enable RatePage
[13:43:41] <botifico>	 [02mw-config] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/mw-config
[13:43:43] <botifico>	 [02mw-config] 07paladox opened pull request 03#5474: Re-enable RatePage - 13https://github.com/miraheze/mw-config/pull/5474
[13:43:46] <botifico>	 [02mw-config] 07paladox closed pull request 03#5474: Re-enable RatePage - 13https://github.com/miraheze/mw-config/pull/5474
[13:43:49] <botifico>	 [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/abcbd2dc6cfc...05088768e6c2
[13:43:50] <botifico>	 [02miraheze/mw-config] 07paladox 030508876 - Re-enable RatePage (#5474)
[13:43:52] <botifico>	 [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-5
[13:43:53] <botifico>	 [02mw-config] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/mw-config
[13:43:53] <MirahezeLSBot>	 !log [paladox@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all
[13:43:54] <MirahezeLSBot>	 !log [paladox@test151] starting deploy of {'pull': 'config', 'config': True} to test151
[13:43:55] <MirahezeLSBot>	 !log [paladox@test151] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output.
[13:43:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:43:58] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:44:00] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:44:02] <MirahezeLSBot>	 !log [paladox@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 9s
[13:44:04] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[13:44:39] <miraheze-github>	 miraheze/mw-config - paladox the build passed.
[13:44:42] <miraheze-github_>	 miraheze/mw-config - paladox the build passed.
[13:46:38] <icinga-miraheze>	 PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is CRITICAL: CRITICAL - NGINX Error Rate is 60%
[13:48:34] <icinga-miraheze>	 RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK
[13:52:38] <icinga-miraheze>	 PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 59%
[13:54:38] <icinga-miraheze>	 PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is CRITICAL: CRITICAL - NGINX Error Rate is 60%
[14:05:24] <icinga-miraheze>	 RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000.
[14:36:25] <icinga-miraheze>	 PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[14:40:21] <botifico>	 [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/commit/cab3dd455626
[14:40:22] <botifico>	 [02miraheze/ManageWiki] 07paladox 03cab3dd4 - Fix
[14:40:25] <botifico>	 [02ManageWiki] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/ManageWiki
[14:40:27] <botifico>	 [02ManageWiki] 07paladox opened pull request 03#448: Fix - 13https://github.com/miraheze/ManageWiki/pull/448
[14:41:40] <botifico>	 [02ManageWiki] 07paladox edited pull request 03#448: Add fallback to array if array isn't defined - 13https://github.com/miraheze/ManageWiki/pull/448
[14:41:48] <botifico>	 [02ManageWiki] 07paladox edited pull request 03#448: ManageWikiExtensions: Add fallback to array if array isn't defined - 13https://github.com/miraheze/ManageWiki/pull/448
[14:41:52] <botifico>	 [02ManageWiki] 07paladox closed pull request 03#448: ManageWikiExtensions: Add fallback to array if array isn't defined - 13https://github.com/miraheze/ManageWiki/pull/448
[14:41:55] <botifico>	 [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/8f2d7d3689cf...7008baae063a
[14:41:56] <botifico>	 [02miraheze/ManageWiki] 07paladox 037008baa - Fix (#448)
[14:41:58] <botifico>	 [02miraheze/ManageWiki] 07paladox deleted branch 03paladox-patch-5
[14:42:00] <botifico>	 [02ManageWiki] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/ManageWiki
[14:44:35] <miraheze-github>	 miraheze/ManageWiki - paladox the build passed.
[14:45:17] <icinga-miraheze>	 RECOVERY - storytime.jdstroy.cf - reverse DNS on sslhost is OK: SSL OK - storytime.jdstroy.cf reverse DNS resolves to cp36.wikitide.net - CNAME OK
[14:45:56] <miraheze-github>	 miraheze/ManageWiki - paladox the build passed.
[15:05:29] <icinga-miraheze>	 RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000.
[15:17:16] <icinga-miraheze>	 PROBLEM - storytime.jdstroy.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for storytime.jdstroy.cf could not be found
[15:36:30] <icinga-miraheze>	 PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[15:59:02] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/sql.php /srv/mediawiki/1.41/maintenance/archives/patch-pagelinks-target_id.sql (START)
[15:59:06] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:05:34] <icinga-miraheze>	 RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000.
[16:30:06] <MirahezeLSBot>	 !log [macfan@test151] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/disableOATHAuthForUser.php --wiki=metawikibeta MacFan4000 (END - exit=256)
[16:30:09] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:30:30] <MirahezeLSBot>	 !log [macfan@test151] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/OATHAuth/maintenance/disableOATHAuthForUser.php --wiki=metawikibeta MacFan4000 (END - exit=0)
[16:30:33] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:32:38] <icinga-miraheze>	 PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 59%
[17:14:20] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/sql.php /srv/mediawiki/1.41/maintenance/archives/patch-pagelinks-target_id.sql (END - exit=0)
[17:14:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:15:37] <icinga-miraheze>	 [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1
[17:16:49] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/runJobs.php --procs 24 (START)
[17:16:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:17:21] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/runJobs.php --procs 24 (END - exit=2)
[17:17:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:17:29] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/runJobs.php --wiki=rainworldwiki --procs 24 (START)
[17:17:31] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:20:16] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 32.45, 21.88, 15.40
[17:21:52] <botifico>	 [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/commit/ca7f3edd5b3f
[17:21:54] <botifico>	 [02miraheze/ManageWiki] 07paladox 03ca7f3ed - Fix searching
[17:21:55] <botifico>	 [02ManageWiki] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/ManageWiki
[17:21:57] <botifico>	 [02ManageWiki] 07paladox opened pull request 03#449: Fix searching - 13https://github.com/miraheze/ManageWiki/pull/449
[17:22:16] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.33, 21.82, 16.19
[17:23:49] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/runJobs.php --wiki=rainworldwiki --procs 24 (END - exit=0)
[17:23:51] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:24:01] <MirahezeLSBot>	 !log [paladox@test151] starting deploy of {'world': True, 'l10n': True, 'versions': ['1.41', '1.42']} to test151
[17:24:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:24:16] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 12.68, 18.71, 15.76
[17:24:18] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/runJobs.php --wiki=rainworldwiki --procs 24 (START)
[17:24:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:26:22] <miraheze-github>	 miraheze/ManageWiki - paladox the build passed.
[17:28:16] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 39.86, 30.62, 21.35
[17:29:47] <MirahezeLSBot>	 !log [paladox@test151] finished deploy of {'world': True, 'l10n': True, 'versions': ['1.41', '1.42']} to test151 - SUCCESS in 345s
[17:29:49] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:30:19] <MirahezeLSBot>	 !log [paladox@test151] starting deploy of {'world': True, 'l10n': True, 'versions': ['1.41', '1.42']} to test151
[17:30:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:30:55] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/runJobs.php --wiki=rainworldwiki --procs 24 (END - exit=0)
[17:30:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:32:16] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 12.56, 23.45, 20.78
[17:33:15] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/runJobs.php --wiki=rainworldwiki --procs 24 (START)
[17:33:17] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:34:16] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 29.43, 24.50, 21.37
[17:35:36] <icinga-miraheze>	 [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1
[17:37:06] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/runJobs.php --wiki=rainworldwiki --procs 24 (END - exit=0)
[17:37:08] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:37:43] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/runJobs.php --wiki=rainworldwiki --procs 24 (START)
[17:37:44] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/runJobs.php --wiki=rainworldwiki --procs 24 (END - exit=0)
[17:37:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:37:48] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:38:16] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/runJobs.php --wiki=polcompballanarchywiki --procs 24 (START)
[17:38:17] <MirahezeLSBot>	 !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/runJobs.php --wiki=polcompballanarchywiki --procs 24 (END - exit=0)
[17:38:19] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:38:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:39:36] <MirahezeLSBot>	 !log [paladox@test151] finished deploy of {'world': True, 'l10n': True, 'versions': ['1.41', '1.42']} to test151 - SUCCESS in 557s
[17:39:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:39:41] <MirahezeLSBot>	 !log [paladox@test151] starting deploy of {'world': True, 'l10n': True, 'versions': ['1.41', '1.42']} to test151
[17:39:44] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:40:16] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 10.41, 19.77, 21.00
[17:41:27] <MirahezeLSBot>	 !log [paladox@test151] finished deploy of {'world': True, 'l10n': True, 'versions': ['1.41', '1.42']} to test151 - SUCCESS in 105s
[17:41:29] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:42:16] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 9.39, 16.40, 19.62
[17:43:02] <botifico>	 [02ManageWiki] 07Universal-Omega closed pull request 03#449: Fix searching - 13https://github.com/miraheze/ManageWiki/pull/449
[17:43:04] <botifico>	 [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/7008baae063a...0bca25d5f0eb
[17:43:05] <botifico>	 [02miraheze/ManageWiki] 07paladox 030bca25d - Fix searching (#449)
[17:43:08] <botifico>	 [02ManageWiki] 07Universal-Omega deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/ManageWiki
[17:43:10] <botifico>	 [02miraheze/ManageWiki] 07Universal-Omega deleted branch 03paladox-patch-5
[17:43:36] <MirahezeLSBot>	 !log [paladox@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to all
[17:43:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:43:46] <MirahezeLSBot>	 !log [paladox@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 9s
[17:43:48] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:44:08] <MirahezeLSBot>	 !log [paladox@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to all
[17:44:09] <MirahezeLSBot>	 !log [paladox@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 1s
[17:44:10] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:44:13] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:44:19] <MirahezeLSBot>	 !log [paladox@test151] starting deploy of {'versions': ['1.41', '1.42'], 'upgrade_extensions': 'ManageWiki'} to test151
[17:44:21] <MirahezeLSBot>	 !log [paladox@test151] finished deploy of {'versions': ['1.41', '1.42'], 'upgrade_extensions': 'ManageWiki'} to test151 - SUCCESS in 1s
[17:44:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:44:25] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:45:35] <MirahezeLSBot>	 !log [paladox@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to all
[17:45:36] <MirahezeLSBot>	 !log [paladox@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 1s
[17:45:38] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:45:40] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:46:00] <MirahezeLSBot>	 !log [paladox@mwtask181] starting deploy of {'world': True, 'l10n': True, 'versions': '1.41'} to all
[17:46:02] <MirahezeLSBot>	 !log [paladox@test151] starting deploy of {'world': True, 'l10n': True, 'versions': ['1.41', '1.42']} to test151
[17:46:02] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:46:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:47:27] <MirahezeLSBot>	 !log [paladox@test151] finished deploy of {'world': True, 'l10n': True, 'versions': ['1.41', '1.42']} to test151 - SUCCESS in 85s
[17:47:30] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:47:51] <MirahezeLSBot>	 !log [paladox@mwtask181] finished deploy of {'world': True, 'l10n': True, 'versions': '1.41'} to all - SUCCESS in 110s
[17:47:54] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:50:03] <icinga-miraheze>	 PROBLEM - cp36 Disk Space on cp36 is WARNING: DISK WARNING - free space: / 9707MiB (10% inode=98%);
[18:02:18] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 141.38 ms
[18:02:35] <botifico>	 [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03fix-searching [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/commit/139e13a9b5d1
[18:02:36] <botifico>	 [02miraheze/ManageWiki] 07Universal-Omega 03139e13a - Fix searching
[18:02:38] <botifico>	 [02ManageWiki] 07Universal-Omega created branch 03fix-searching - 13https://github.com/miraheze/ManageWiki
[18:02:39] <botifico>	 [02ManageWiki] 07Universal-Omega opened pull request 03#450: Fix searching - 13https://github.com/miraheze/ManageWiki/pull/450
[18:04:15] <botifico>	 [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03fix-searching [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/139e13a9b5d1...75782b716a8f
[18:04:17] <botifico>	 [02miraheze/ManageWiki] 07Universal-Omega 0375782b7 - -
[18:04:18] <botifico>	 [02ManageWiki] 07Universal-Omega synchronize pull request 03#450: Fix searching - 13https://github.com/miraheze/ManageWiki/pull/450
[18:04:19] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 142.05 ms
[18:08:34] <miraheze-github>	 miraheze/ManageWiki - Universal-Omega the build passed.
[18:08:40] <icinga-miraheze>	 PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 9715MiB (10% inode=98%);
[18:14:31] <icinga-miraheze>	 PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 138.96 ms
[18:16:01] <botifico>	 [02ManageWiki] 07Universal-Omega edited pull request 03#450: T11831: fix searching - 13https://github.com/miraheze/ManageWiki/pull/450
[18:16:20] <botifico>	 [02ManageWiki] 07Universal-Omega closed pull request 03#450: T11831: fix searching - 13https://github.com/miraheze/ManageWiki/pull/450
[18:16:24] <botifico>	 [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/ManageWiki/compare/0bca25d5f0eb...0a3417c53248
[18:16:25] <botifico>	 [02miraheze/ManageWiki] 07Universal-Omega 030a3417c - T11831: fix searching (#450)
[18:16:26] <botifico>	 [02miraheze/ManageWiki] 07Universal-Omega deleted branch 03fix-searching
[18:16:27] <botifico>	 [02ManageWiki] 07Universal-Omega deleted branch 03fix-searching - 13https://github.com/miraheze/ManageWiki
[18:16:32] <icinga-miraheze>	 RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 133.66 ms
[18:17:27] <MirahezeLSBot>	 !log [universalomega@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to all
[18:17:30] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:17:37] <MirahezeLSBot>	 !log [universalomega@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 9s
[18:17:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:20:26] <miraheze-github>	 miraheze/ManageWiki - Universal-Omega the build passed.
[18:32:16] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/970ed28ec557...b2b71cb0336f
[18:32:17] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot 03b2b71cb - Bot: Add SSL cert for lophocmatngu.wiki
[18:35:19] <botifico>	 [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/cfe59950ab46...9274192f15c8
[18:35:20] <botifico>	 [02miraheze/dns] 07Universal-Omega 039274192 - Switch sdiy.info to Miraheze cps
[18:43:25] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/b2b71cb0336f...fb3646700d7a
[18:43:26] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot 03fb36467 - Bot: Add SSL cert for sdiy.info
[18:59:07] <icinga-miraheze>	 RECOVERY - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is OK: OK - NGINX Error Rate is 39%
[19:01:56] <icinga-miraheze>	 PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[19:27:25] <MirahezeLSBot>	 !log [alex@test151] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/createAndPromote.php --wiki=metawikibeta BlueMoon SupahCoolTempPassword1 --use-runner (END - exit=256)
[19:27:27] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:28:24] <MirahezeLSBot>	 !log [alex@test151] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/createAndPromote.php --wiki=metawikibeta BlueMoon SupahCoolTempPassword1 (END - exit=0)
[19:28:26] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:28:44] <Orange_Star>	 docs need updating, --use-runner is no longer needed
[19:29:50] <icinga-miraheze>	 PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is WARNING: WARNING - NGINX Error Rate is 40%
[19:30:28] <botifico>	 [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/9274192f15c8...35f13efc4de6
[19:30:30] <botifico>	 [02miraheze/dns] 07Universal-Omega 0335f13ef - Switch wikitide.com to Miraheze cps
[19:31:09] <MirahezeLSBot>	 !log [alex@test151] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/createAndPromote.php --wiki=metawikibeta BlueMoon --bureaucrat --sysop --force (END - exit=0)
[19:31:12] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:31:45] <icinga-miraheze>	 RECOVERY - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is OK: OK - NGINX Error Rate is 39%
[19:32:33] <botifico>	 [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/35f13efc4de6...f965a30f3a48
[19:32:35] <botifico>	 [02miraheze/dns] 07Universal-Omega 03f965a30 - Add acme challenges for wikitide.com
[19:35:12] <botifico>	 [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/f965a30f3a48...a959ff2a457f
[19:35:13] <botifico>	 [02miraheze/dns] 07Universal-Omega 03a959ff2 - Update acme
[19:41:25] <botifico>	 [02mw-config] 07redbluegreenhat opened pull request 03#5475: Enable RequestSSL on mirabeta - 13https://github.com/miraheze/mw-config/pull/5475
[19:41:36] <Orange_Star>	 CosmicAlpha: ^ pls
[19:42:14] <miraheze-github>	 miraheze/mw-config - redbluegreenhat the build passed.
[19:46:06] <botifico>	 [02mw-config] 07Universal-Omega closed pull request 03#5475: Enable RequestSSL on mirabeta - 13https://github.com/miraheze/mw-config/pull/5475
[19:46:09] <botifico>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/05088768e6c2...b446d765000d
[19:46:10] <botifico>	 [02miraheze/mw-config] 07redbluegreenhat 03b446d76 - Enable RequestSSL on mirabeta (#5475)
[19:46:43] <Orange_Star>	 ty
[19:47:10] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[19:48:01] <MirahezeLSBot>	 !log [alex@test151] starting deploy of {'config': True} to test151
[19:48:02] <MirahezeLSBot>	 !log [alex@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s
[19:48:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:48:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:48:20] <MirahezeLSBot>	 !log [alex@test151] starting deploy of {'force': True, 'versions': '1.41', 'upgrade_extensions': 'RequestSSL'} to test151
[19:48:21] <MirahezeLSBot>	 !log [alex@test151] finished deploy of {'force': True, 'versions': '1.41', 'upgrade_extensions': 'RequestSSL'} to test151 - SUCCESS in 1s
[19:48:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:48:25] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:53:44] <botifico>	 [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/fb3646700d7a...b233e12fbde1
[19:53:47] <botifico>	 [02miraheze/ssl] 07Universal-Omega 03b233e12 - Add some wikitide.org redirects
[19:55:32] <botifico>	 [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/a959ff2a457f...9fbbbfc49937
[19:55:35] <botifico>	 [02miraheze/dns] 07Universal-Omega 039fbbbfc - Point some of wikitide.org to Miraheze cps
[19:57:54] <MirahezeLSBot>	 !log [@mwtask181] starting deploy of {'config': True} to all
[19:57:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:58:02] <MirahezeLSBot>	 !log [@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 8s
[19:58:04] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:59:54] <icinga-miraheze>	 RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000.
[20:00:41] <MirahezeLSBot>	 !log [alex@test151] starting deploy of {'config': True, 'force': True} to test151
[20:00:42] <MirahezeLSBot>	 !log [alex@test151] finished deploy of {'config': True, 'force': True} to test151 - SUCCESS in 0s
[20:00:44] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:00:47] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:01:23] <Orange_Star>	 gotta be patient then
[20:09:06] <icinga-miraheze>	 RECOVERY - wikitide.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wikitide.org' will expire on Wed 08 May 2024 10:33:50 PM GMT +0000.
[20:20:40] <icinga-miraheze>	 PROBLEM - mon181 Check correctness of the icinga configuration on mon181 is CRITICAL: Icinga configuration contains errors
[20:24:39] <paladox>	 CosmicAlpha: ^
[20:25:01] <paladox>	 > Feb 09 20:23:59 mon181 icinga2[2977571]: [2024-02-09 20:23:59 +0000] critical/config: Error: An object with type 'Service' and name 'sslhost!wikitide.org - LetsEncrypt' already exists (in /etc/icinga2/conf.d/ssl.conf: 58:1-58:42), new declarati>
[20:25:09] <botifico>	 [02TSPortal] 07pixDeVl synchronize pull request 03#17: Updated text to reflect new owner and juristiction; replace register no. with EIN - 13https://github.com/miraheze/TSPortal/pull/17
[20:26:13] <botifico>	 [02ssl] 07paladox commented on commit 03b233e12fbde1802a8e91f5847db9256f531622b1 - 13https://github.com/miraheze/ssl/commit/b233e12fbde1802a8e91f5847db9256f531622b1#commitcomment-138481004
[20:27:09] <botifico>	 [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/b233e12fbde1...f0db0898a4a5
[20:27:11] <botifico>	 [02miraheze/ssl] 07paladox 03f0db089 - Remove duplicate wikitide.net
[20:28:24] <botifico>	 [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/f0db0898a4a5...48b5b2f86502
[20:28:25] <botifico>	 [02miraheze/ssl] 07paladox 0348b5b2f - Allow *.wikitide.org
[20:28:34] <CosmicAlpha>	 paladox: oh, thanks
[20:28:44] <botifico>	 [02ssl] 07paladox commented on commit 03f0db0898a4a5f8c73446107a6b2b46046af62975 - 13https://github.com/miraheze/ssl/commit/f0db0898a4a5f8c73446107a6b2b46046af62975#commitcomment-138481069
[20:32:25] <icinga-miraheze>	 RECOVERY - mon181 Check correctness of the icinga configuration on mon181 is OK: Icinga configuration is correct
[20:32:32] <icinga-miraheze>	 PROBLEM - *.wikitide.org - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[20:33:34] <paladox>	 CosmicAlpha: ^
[20:33:45] <botifico>	 [02TSPortal] 07pixDeVl synchronize pull request 03#17: Updated text to reflect new owner and juristiction; replace register no. with EIN - 13https://github.com/miraheze/TSPortal/pull/17
[20:34:33] <CosmicAlpha>	 paladox: I assumed that would be fixed when *.wikitide.org is changed to MH cps but if not monitoring scripts may need changed to support it
[20:34:38] <icinga-miraheze>	 PROBLEM - www.samafia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.samafia.org' expires in 15 day(s) (Sun 25 Feb 2024 08:07:20 PM GMT +0000).
[20:34:48] <paladox>	 I ran puppet on cp*
[20:34:50] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/48b5b2f86502...8c41f2c48df9
[20:34:51] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot 038c41f2c - Bot: Update SSL cert for www.samafia.org
[20:36:37] <CosmicAlpha>	 paladox: yeah but *.wikitide.org uses WT cps still, only a few subdomains and root domain use MH cps
[20:36:50] <paladox>	 oh
[20:38:02] <botifico>	 [02TSPortal] 07Universal-Omega closed pull request 03#17: Updated text to reflect new owner and juristiction; replace register no. with EIN - 13https://github.com/miraheze/TSPortal/pull/17
[20:38:05] <botifico>	 [02miraheze/TSPortal] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/TSPortal/compare/5afb00fd039b...100387909243
[20:38:06] <botifico>	 [02miraheze/TSPortal] 07pixDeVl 031003879 - Updated text to reflect new owner and juristiction; replace register no. with EIN (#17)
[20:39:54] <botifico>	 [02miraheze/TSPortal] 07Universal-Omega tagged 031003879 as 03v16 13https://github.com/miraheze/TSPortal/commit/1003879092430b1e53224c76d7299aa5e053b4ae
[20:39:56] <botifico>	 [02TSPortal] 07Universal-Omega created tag 03v16 - 13https://github.com/miraheze/TSPortal
[20:42:00] <botifico>	 [02miraheze/ManageWiki] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/0a3417c53248...886cc6b94587
[20:42:03] <botifico>	 [02miraheze/ManageWiki] 07redbluegreenhat 03886cc6b - Merge pull request from GHSA-4jr2-jhfm-2r84
[20:42:19] <botifico>	 [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03reports-v16 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/c2f749a4b45d
[20:42:20] <botifico>	 [02miraheze/puppet] 07Universal-Omega 03c2f749a - reports: upgrade to v16
[20:42:22] <botifico>	 [02puppet] 07Universal-Omega created branch 03reports-v16 - 13https://github.com/miraheze/puppet
[20:42:23] <botifico>	 [02puppet] 07Universal-Omega opened pull request 03#3750: reports: upgrade to v16 - 13https://github.com/miraheze/puppet/pull/3750
[20:42:48] <MirahezeLSBot>	 !log [universalomega@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to all
[20:42:51] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:42:58] <MirahezeLSBot>	 !log [universalomega@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 9s
[20:43:01] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:43:49] <MirahezeLSBot>	 !log [paladox@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'DiscussionTools'} to all
[20:43:51] <MirahezeLSBot>	 !log [alex@test151] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to test151
[20:43:51] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:43:52] <MirahezeLSBot>	 !log [alex@test151] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to test151 - SUCCESS in 1s
[20:43:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:43:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:43:59] <MirahezeLSBot>	 !log [paladox@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'DiscussionTools'} to all - SUCCESS in 9s
[20:44:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:44:23] <MirahezeLSBot>	 !log [paladox@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'NukeDPL'} to all
[20:44:25] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:44:32] <MirahezeLSBot>	 !log [paladox@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'NukeDPL'} to all - SUCCESS in 9s
[20:44:35] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:44:48] <MirahezeLSBot>	 !log [paladox@test151] starting deploy of {'versions': ['1.41', '1.42'], 'upgrade_extensions': 'DiscussionTools'} to test151
[20:44:49] <MirahezeLSBot>	 !log [paladox@test151] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output.
[20:44:50] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:44:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:44:58] <MirahezeLSBot>	 !log [paladox@test151] starting deploy of {'versions': ['1.41', '1.42'], 'upgrade_extensions': 'NukeDPL'} to test151
[20:45:00] <MirahezeLSBot>	 !log [paladox@test151] finished deploy of {'versions': ['1.41', '1.42'], 'upgrade_extensions': 'NukeDPL'} to test151 - SUCCESS in 2s
[20:45:00] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:45:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:45:38] <MirahezeLSBot>	 !log [alex@test151] starting deploy of {'force': True, 'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to test151
[20:45:39] <MirahezeLSBot>	 !log [alex@test151] finished deploy of {'force': True, 'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to test151 - SUCCESS in 1s
[20:45:41] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:45:43] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:46:04] <miraheze-github>	 miraheze/ManageWiki - redbluegreenhat the build passed.
[21:02:54] <icinga-miraheze>	 PROBLEM - apocrypha.wiki - LetsEncrypt on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[21:03:49] <icinga-miraheze>	 RECOVERY - www.samafia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.samafia.org' will expire on Thu 09 May 2024 07:34:44 PM GMT +0000.
[21:04:39] <botifico>	 [02miraheze/ManageWiki] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/886cc6b94587...2ef0f50880d7
[21:04:40] <botifico>	 [02miraheze/ManageWiki] 07redbluegreenhat 032ef0f50 - Escape some more interface messages
[21:04:45] <MirahezeLSBot>	 !log [alex@test151] starting deploy of {'force': True, 'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to test151
[21:04:46] <MirahezeLSBot>	 !log [alex@test151] finished deploy of {'force': True, 'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to test151 - SUCCESS in 1s
[21:04:47] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:04:50] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:05:17] <MirahezeLSBot>	 !log [universalomega@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to all
[21:05:20] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:05:23] <MirahezeLSBot>	 !log [alex@test151] starting deploy of {'force': True, 'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to test151
[21:05:24] <MirahezeLSBot>	 !log [alex@test151] finished deploy of {'force': True, 'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to test151 - SUCCESS in 1s
[21:05:26] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:05:27] <MirahezeLSBot>	 !log [universalomega@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 9s
[21:05:28] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:05:31] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:09:03] <miraheze-github>	 miraheze/ManageWiki - redbluegreenhat the build passed.
[21:11:51] <botifico>	 [02miraheze/ManageWiki] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/2ef0f50880d7...6942e8b2c01d
[21:11:52] <botifico>	 [02miraheze/ManageWiki] 07redbluegreenhat 036942e8b - Escape output
[21:12:01] <MirahezeLSBot>	 !log [alex@test151] starting deploy of {'force': True, 'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to test151
[21:12:02] <MirahezeLSBot>	 !log [alex@test151] finished deploy of {'force': True, 'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to test151 - SUCCESS in 1s
[21:12:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:12:06] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:13:15] <MirahezeLSBot>	 !log [universalomega@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to all
[21:13:17] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:13:24] <MirahezeLSBot>	 !log [universalomega@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 9s
[21:13:26] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:15:46] <miraheze-github>	 miraheze/ManageWiki - redbluegreenhat the build passed.
[21:23:29] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03addserver [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/commit/127bb8a086c8
[21:23:32] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03127bb8a - Use addServer
[21:23:33] <botifico>	 [02MirahezeMagic] 07Universal-Omega created branch 03addserver - 13https://github.com/miraheze/MirahezeMagic
[21:23:35] <botifico>	 [02MirahezeMagic] 07Universal-Omega opened pull request 03#463: Use addServer - 13https://github.com/miraheze/MirahezeMagic/pull/463
[21:30:27] <miraheze-github>	 miraheze/MirahezeMagic - Universal-Omega the build passed.
[21:32:46] <icinga-miraheze>	 RECOVERY - apocrypha.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'apocrypha.wiki' will expire on Fri 01 Mar 2024 12:06:59 PM GMT +0000.
[21:37:20] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#463: Use addServer - 13https://github.com/miraheze/MirahezeMagic/pull/463
[21:37:22] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03addserver [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/127bb8a086c8...7fe5d71643f3
[21:37:25] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 037fe5d71 - Fix
[21:37:31] <icinga-miraheze>	 PROBLEM - cp41 HTTPS on cp41 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 503
[21:37:35] <Orange_Star>	 CosmicAlpha: Special:EmailUser on meta is super slow
[21:37:39] <icinga-miraheze>	 PROBLEM - cp51 HTTPS on cp51 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502
[21:37:46] <Orange_Star>	 feels like it shouldn't since all it should do is queue a job
[21:37:50] <icinga-miraheze>	 PROBLEM - mw172 HTTPS on mw172 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10004 milliseconds with 0 bytes received
[21:37:51] <icinga-miraheze>	 PROBLEM - mw151 HTTPS on mw151 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 502
[21:37:52] <icinga-miraheze>	 PROBLEM - mw151 MediaWiki Rendering on mw151 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[21:38:15] <icinga-miraheze>	 PROBLEM - cp41 Varnish Backends on cp41 is CRITICAL: 4 backends are down. mw151 mw152 mw172 mw182
[21:38:27] <icinga-miraheze>	 PROBLEM - cp27 Varnish Backends on cp27 is CRITICAL: 4 backends are down. mw151 mw152 mw172 mw182
[21:38:28] <icinga-miraheze>	 PROBLEM - cp37 Varnish Backends on cp37 is CRITICAL: 4 backends are down. mw151 mw152 mw172 mw182
[21:38:34] <Orange_Star>	 oh, I guess it wasn't related to Special:EmailUser after all
[21:38:44] <icinga-miraheze>	 PROBLEM - cp51 Varnish Backends on cp51 is CRITICAL: 2 backends are down. mw152 mw182
[21:38:54] <icinga-miraheze>	 PROBLEM - cp36 Varnish Backends on cp36 is CRITICAL: 2 backends are down. mw152 mw182
[21:39:30] <icinga-miraheze>	 RECOVERY - cp41 HTTPS on cp41 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 3609 bytes in 0.892 second response time
[21:39:38] <icinga-miraheze>	 RECOVERY - cp51 HTTPS on cp51 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 3609 bytes in 1.057 second response time
[21:39:49] <icinga-miraheze>	 RECOVERY - mw172 HTTPS on mw172 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 285 bytes in 0.063 second response time
[21:39:49] <icinga-miraheze>	 RECOVERY - mw151 MediaWiki Rendering on mw151 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 1.334 second response time
[21:39:51] <icinga-miraheze>	 RECOVERY - mw151 HTTPS on mw151 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 285 bytes in 0.063 second response time
[21:40:15] <icinga-miraheze>	 RECOVERY - cp41 Varnish Backends on cp41 is OK: All 18 backends are healthy
[21:40:22] <icinga-miraheze>	 RECOVERY - cp37 Varnish Backends on cp37 is OK: All 18 backends are healthy
[21:40:26] <icinga-miraheze>	 RECOVERY - cp27 Varnish Backends on cp27 is OK: All 18 backends are healthy
[21:40:44] <icinga-miraheze>	 RECOVERY - cp51 Varnish Backends on cp51 is OK: All 18 backends are healthy
[21:40:54] <icinga-miraheze>	 RECOVERY - cp36 Varnish Backends on cp36 is OK: All 18 backends are healthy
[21:44:01] <miraheze-github>	 miraheze/MirahezeMagic - Universal-Omega the build passed.
[21:44:44] <icinga-miraheze>	 PROBLEM - cp51 Varnish Backends on cp51 is CRITICAL: 1 backends are down. mw172
[21:44:54] <icinga-miraheze>	 PROBLEM - cp36 Varnish Backends on cp36 is CRITICAL: 1 backends are down. mw172
[21:45:05] <icinga-miraheze>	 PROBLEM - cp26 Varnish Backends on cp26 is CRITICAL: 1 backends are down. mw172
[21:47:04] <icinga-miraheze>	 PROBLEM - cp37 Varnish Backends on cp37 is CRITICAL: 3 backends are down. mw151 mw161 mw171
[21:47:08] <icinga-miraheze>	 PROBLEM - mw172 MediaWiki Rendering on mw172 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[21:47:19] <icinga-miraheze>	 PROBLEM - cp27 Varnish Backends on cp27 is CRITICAL: 4 backends are down. mw151 mw161 mw171 mw172
[21:48:44] <icinga-miraheze>	 RECOVERY - cp51 Varnish Backends on cp51 is OK: All 18 backends are healthy
[21:48:54] <icinga-miraheze>	 RECOVERY - cp36 Varnish Backends on cp36 is OK: All 18 backends are healthy
[21:48:59] <icinga-miraheze>	 RECOVERY - cp37 Varnish Backends on cp37 is OK: All 18 backends are healthy
[21:49:03] <icinga-miraheze>	 RECOVERY - cp26 Varnish Backends on cp26 is OK: All 18 backends are healthy
[21:49:03] <icinga-miraheze>	 RECOVERY - mw172 MediaWiki Rendering on mw172 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.317 second response time
[21:49:19] <icinga-miraheze>	 RECOVERY - cp27 Varnish Backends on cp27 is OK: All 18 backends are healthy
[21:53:40] <botifico>	 [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#463: Use addServer - 13https://github.com/miraheze/MirahezeMagic/pull/463
[21:53:42] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03addserver [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/7fe5d71643f3...832cadc025ff
[21:53:44] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 03832cadc - Fix
[21:54:06] <botifico>	 [02MirahezeMagic] 07Universal-Omega closed pull request 03#463: Use addServer - 13https://github.com/miraheze/MirahezeMagic/pull/463
[21:54:08] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/6f6339b572de...71c4f1b4ea84
[21:54:10] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 0371c4f1b - Use addServer (#463)
[21:54:13] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03addserver
[21:54:15] <botifico>	 [02MirahezeMagic] 07Universal-Omega deleted branch 03addserver - 13https://github.com/miraheze/MirahezeMagic
[21:59:53] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=simpleelectronicswiki --no-updates /home/universalomega/ImportDump/simpleelectronicswiki-20240209201551.xml (START)
[21:59:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:00:09] <miraheze-github>	 miraheze/MirahezeMagic - Universal-Omega the build passed.
[22:00:16] <CosmicAlpha>	 !log deleted and recreated simpleelectronicswiki
[22:00:18] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:00:28] <miraheze-github>	 miraheze/MirahezeMagic - Universal-Omega the build passed.
[22:01:07] <CosmicAlpha>	 Orange_Star: that may have been my fault
[22:02:09] <MirahezeLSBot>	 !log [@mwtask181] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all
[22:02:12] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:02:17] <MirahezeLSBot>	 !log [@mwtask181] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all - SUCCESS in 8s
[22:02:20] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:05:06] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=simpleelectronicswiki --no-updates /home/universalomega/ImportDump/simpleelectronicswiki-20240209201551.xml (END - exit=0)
[22:05:08] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=simpleelectronicswiki (START)
[22:05:09] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:05:11] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:05:55] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=simpleelectronicswiki (END - exit=0)
[22:05:56] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=simpleelectronicswiki --active --update (END - exit=0)
[22:05:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:05:59] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:17:42] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=simpleelectronicswiki --search-recursively --skip-dupes /home/universalomega/simpleelectronicswiki/images (START)
[22:17:44] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=simpleelectronicswiki --search-recursively --skip-dupes /home/universalomega/simpleelectronicswiki/images (END - exit=0)
[22:17:45] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:17:47] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:18:29] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=simpleelectronicswiki --search-recursively --skip-dupes /home/universalomega/simpleelectronicswiki/images (START)
[22:18:30] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=simpleelectronicswiki --search-recursively --skip-dupes /home/universalomega/simpleelectronicswiki/images (END - exit=0)
[22:18:32] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:18:34] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:23:42] <MirahezeLSBot>	 !log [@test151] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to test151
[22:23:43] <MirahezeLSBot>	 !log [@test151] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s
[22:23:45] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:23:47] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:23:51] <MirahezeLSBot>	 !log [@test151] starting deploy of {'folders': '1.42/extensions/MirahezeMagic'} to test151
[22:23:52] <MirahezeLSBot>	 !log [@test151] finished deploy of {'folders': '1.42/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s
[22:23:54] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:23:56] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:27:15] <botifico>	 [02miraheze/python-functions] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/python-functions/compare/21f694c2b432...955174bf06ad
[22:27:16] <botifico>	 [02miraheze/python-functions] 07Universal-Omega 03955174b - fix_container_permissions: use 1.41
[22:28:20] <miraheze-github>	 miraheze/python-functions - Universal-Omega the build has errored.
[22:28:46] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=simpleelectronicswiki --search-recursively --skip-dupes /home/universalomega/simpleelectronicswiki/images --comment-ext=desc (START)
[22:28:49] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:28:56] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=simpleelectronicswiki --search-recursively --skip-dupes /home/universalomega/simpleelectronicswiki/images --comment-ext=desc (END - exit=0)
[22:28:58] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:30:11] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=simpleelectronicswiki --search-recursively /home/universalomega/simpleelectronicswiki/images --comment-ext=desc (START)
[22:30:12] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=simpleelectronicswiki --search-recursively /home/universalomega/simpleelectronicswiki/images --comment-ext=desc (END - exit=0)
[22:30:14] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:30:16] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:31:34] <botifico>	 [02miraheze/python-functions] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/python-functions/compare/955174bf06ad...603d01c4cfac
[22:31:37] <botifico>	 [02miraheze/python-functions] 07paladox 03603d01c - Fix indentation in fix_container_permissions.py
[22:32:44] <miraheze-github>	 miraheze/python-functions - paladox the build has errored.
[22:33:18] <botifico>	 [02miraheze/python-functions] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/python-functions/compare/603d01c4cfac...f05bd47612f7
[22:33:21] <botifico>	 [02miraheze/python-functions] 07paladox 03f05bd47 - Update setup.py
[22:33:47] <RhinosF1>	 paladox: I am working on them fixes
[22:33:52] <paladox>	 ok
[22:34:09] <RhinosF1>	 paladox: id suggest ignoring anything until a first version is publish
[22:34:12] <RhinosF1>	 Published
[22:34:16] <paladox>	 ok
[22:34:17] <RhinosF1>	 It's acknowledged it's broken
[22:34:21] <RhinosF1>	 Same to CosmicAlpha
[22:34:27] <miraheze-github>	 miraheze/python-functions - paladox the build has errored.
[22:36:36] <RhinosF1>	 CosmicAlpha: for reference, anything that's paths or version specific will be pulled out into separate files
[22:50:28] <icinga-miraheze>	 PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[22:53:35] <CosmicAlpha>	 Thats fine RhinosF1 thanks
[22:53:45] <CosmicAlpha>	 !log deleted and recreated scruffywiki
[22:53:47] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:54:05] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[22:54:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:54:27] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[22:54:28] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[22:54:30] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:54:32] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:55:10] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[22:55:12] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:55:31] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[22:55:32] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[22:55:34] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:55:36] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:55:40] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=0)
[22:55:41] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[22:55:42] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:55:44] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:56:32] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=0)
[22:56:33] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[22:56:34] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:56:36] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:56:42] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[22:56:44] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:56:59] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[22:57:00] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[22:57:02] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:57:04] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:57:43] <CosmicAlpha>	 hmm
[22:57:58] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=0)
[22:57:59] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[22:58:00] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:58:02] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:58:33] <CosmicAlpha>	 https://www.irccloud.com/pastebin/uXtFissS
[22:58:43] <CosmicAlpha>	 paladox: any ideas ^?
[22:59:27] <paladox>	 nope :/
[23:00:04] <CosmicAlpha>	 hmmm
[23:01:21] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:01:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:01:38] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[23:01:39] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:01:40] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:01:42] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:01:47] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:01:50] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:01:50] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:01:52] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[23:01:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:01:53] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:01:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:01:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:02:12] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[23:02:13] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:02:14] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:02:17] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:02:39] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=0)
[23:02:40] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:02:41] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:02:43] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:02:53] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=0)
[23:02:54] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:02:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:02:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:03:08] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:03:10] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:03:11] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=0)
[23:03:12] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:03:14] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:03:16] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:03:26] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[23:03:27] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:03:29] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:03:31] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:04:17] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:04:19] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:04:27] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=0)
[23:04:28] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:04:29] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:04:31] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:04:34] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[23:04:35] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:04:37] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:04:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:05:34] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=0)
[23:05:35] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:05:36] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:05:38] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:05:49] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:05:51] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:06:05] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[23:06:06] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:06:08] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:06:10] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:07:04] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=0)
[23:07:05] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:07:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:07:09] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:07:40] <CosmicAlpha>	 Every time I run it it imports a little bit more so I guess I will keep running it
[23:07:48] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:07:50] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:08:05] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[23:08:06] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:08:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:08:09] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:09:03] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=0)
[23:09:04] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:09:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:09:08] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:09:59] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:10:02] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:10:17] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[23:10:18] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:10:19] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:10:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:11:15] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=0)
[23:11:16] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:11:17] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:11:20] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:11:22] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:11:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:11:38] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[23:11:39] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:11:41] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:11:43] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:12:37] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=0)
[23:12:38] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:12:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:12:41] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:14:58] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:15:00] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:18:51] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[23:18:52] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:18:53] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:18:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:19:17] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=2)
[23:19:18] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:19:19] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:19:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:20:21] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:20:22] <icinga-miraheze>	 RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK
[23:20:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:20:35] <icinga-miraheze>	 [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1
[23:20:37] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[23:20:38] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:20:40] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:20:42] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:21:36] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=0)
[23:21:37] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:21:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:21:41] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:25:17] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:25:19] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:25:34] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[23:25:35] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:25:36] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:25:38] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:25:52] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=2)
[23:25:53] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:25:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:25:58] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:27:37] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:27:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:27:55] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[23:27:56] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:27:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:27:59] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:28:20] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=2)
[23:28:21] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:28:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:28:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:30:34] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:30:36] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:32:19] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=0)
[23:32:20] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:32:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:32:22] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=256)
[23:32:23] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:32:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:32:26] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:32:29] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:45:53] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/MirahezeMagic/maintenance/restoreManageWikiBackup.php --wiki=scruffywiki --filename mw.json (END - exit=0)
[23:45:55] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:51:11] <icinga-miraheze>	 RECOVERY - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is OK: OK - NGINX Error Rate is 36%
[23:54:40] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/71c4f1b4ea84...16eee6be8a24
[23:54:43] <botifico>	 [02miraheze/MirahezeMagic] 07Universal-Omega 0316eee6b - restoreManageWikiBackup: use ManageWikiExtensions for extensions
[23:56:00] <MirahezeLSBot>	 !log [universalomega@mwtask181] starting deploy of {'versions': '1.41', 'upgrade_extensions': 'MirahezeMagic'} to all
[23:56:01] <MirahezeLSBot>	 !log [universalomega@mwtask181] finished deploy of {'versions': '1.41', 'upgrade_extensions': 'MirahezeMagic'} to all - SUCCESS in 1s
[23:56:02] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:56:04] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:56:15] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/MirahezeMagic/maintenance/restoreManageWikiBackup.php --wiki=scruffywiki --filename mw.json (END - exit=0)
[23:56:18] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:57:26] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (START)
[23:57:29] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:57:49] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=scruffywiki --no-updates /home/universalomega/ImportDump/scruffywiki-20240209225206.xml (END - exit=256)
[23:57:50] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (START)
[23:57:51] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=scruffywiki (END - exit=256)
[23:57:51] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:57:52] <MirahezeLSBot>	 !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/initSiteStats.php --wiki=scruffywiki --active --update (END - exit=0)
[23:57:54] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:57:56] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:57:58] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log