[00:01:09] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN [00:03:09] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is WARNING: WARNING - NGINX Error Rate is 50% [00:04:39] RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 21223MiB (23% inode=98%); [00:05:08] RECOVERY - cp41 Disk Space on cp41 is OK: DISK OK - free space: / 19316MiB (20% inode=98%); [00:05:09] PROBLEM - cp27 HTTP 4xx/5xx ERROR Rate on cp27 is CRITICAL: CRITICAL - NGINX Error Rate is 67% [00:05:29] RECOVERY - cp36 Disk Space on cp36 is OK: DISK OK - free space: / 21195MiB (23% inode=98%); [01:15:38] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/e537655031c2...2907da681d78 [01:15:39] [02miraheze/mw-config] 07AgentIsai 032907da6 - Re-add "Hosted by" badge [01:16:36] miraheze/mw-config - AgentIsai the build passed. [01:23:39] !log [@test151] starting deploy of {'config': True} to test151 [01:23:40] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [01:23:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:23:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:32:15] !log [@mwtask181] starting deploy of {'config': True} to all [01:32:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:32:25] !log [@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 9s [01:32:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:36:56] !log [@mwtask171] starting deploy of {'config': True} to all [01:37:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:37:04] !log [@mwtask171] finished deploy of {'config': True} to all - SUCCESS in 8s [01:37:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:39:55] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03cp-jobrunner [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/a788ef7ee314 [01:39:56] [02miraheze/puppet] 07Universal-Omega 03a788ef7 - changeprop151: make local jobrunner [01:39:59] [02puppet] 07Universal-Omega created branch 03cp-jobrunner - 13https://github.com/miraheze/puppet [01:40:01] [02puppet] 07Universal-Omega opened pull request 03#3820: changeprop151: make local jobrunner - 13https://github.com/miraheze/puppet/pull/3820 [01:42:21] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03cp-jobrunner [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/a788ef7ee314...f5440e483f67 [01:42:24] [02miraheze/puppet] 07Universal-Omega 03f5440e4 - Update [01:42:46] [02puppet] 07Universal-Omega synchronize pull request 03#3820: changeprop151: make local jobrunner - 13https://github.com/miraheze/puppet/pull/3820 [01:44:48] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03cp-jobrunner [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/f5440e483f67...73817d27f9b5 [01:44:50] [02miraheze/puppet] 07Universal-Omega 0373817d2 - Add [01:44:52] [02puppet] 07Universal-Omega synchronize pull request 03#3820: changeprop151: make local jobrunner - 13https://github.com/miraheze/puppet/pull/3820 [01:46:05] miraheze/puppet - Universal-Omega the build passed. [02:27:38] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [02:44:39] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mahdiruiz.line.pm All nameservers failed to answer the query. [02:57:06] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [03:13:50] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [03:26:35] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [03:30:52] PROBLEM - db181 Current Load on db181 is CRITICAL: LOAD CRITICAL - total load average: 13.83, 20.19, 9.35 [03:34:40] RECOVERY - db181 Current Load on db181 is OK: LOAD OK - total load average: 0.52, 9.63, 7.38 [04:40:08] [02landing] 07colleirose opened pull request 03#144: Remove April Fools changes because April 1st is over for most people right now - 13https://github.com/miraheze/landing/pull/144 [04:40:59] miraheze/landing - colleirose the build passed. [04:55:00] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp37.wikitide.net - CNAME OK [05:34:46] PROBLEM - wiki.k2cho.me - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.k2cho.me' expires in 7 day(s) (Wed 10 Apr 2024 05:33:52 AM GMT +0000). [07:01:06] PROBLEM - eventgate181 NTP time on eventgate181 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H [-4|-6] [-w ] [-c ] [-v verbose] [-o ] [07:03:03] PROBLEM - eventgate181 NTP time on eventgate181 is CRITICAL: NTP CRITICAL: Offset 91.78926179 secs [08:18:52] [02puppet] 07RhinosF1 synchronize pull request 03#3817: rename-wiki: various - 13https://github.com/miraheze/puppet/pull/3817 [08:20:09] [02puppet] 07RhinosF1 commented on pull request 03#3814: update rename wiki script with "good version" - 13https://github.com/miraheze/puppet/pull/3814#issuecomment-2031368372 [08:20:46] miraheze/puppet - RhinosF1 the build passed. [08:23:16] RECOVERY - wikigenius.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wikigenius.org' will expire on Mon 01 Jul 2024 07:17:23 AM GMT +0000. [09:36:29] PROBLEM - db181 Backups SQL on db181 is CRITICAL: FILE_AGE CRITICAL: /var/log/sql-backup.log is 1209654 seconds old and 115136 bytes [09:57:20] PROBLEM - graphite151 NTP time on graphite151 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H [-4|-6] [-w ] [-c ] [-v verbose] [-o ] [09:59:21] PROBLEM - graphite151 NTP time on graphite151 is CRITICAL: NTP CRITICAL: Offset 94.40894225 secs [10:10:11] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:08:27] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [12:10:58] PROBLEM - db161 Backups SQL on db161 is CRITICAL: FILE_AGE CRITICAL: /var/log/sql-backup.log is 1209617 seconds old and 115453 bytes [12:11:17] PROBLEM - ping6 on cp26 is CRITICAL: PING CRITICAL - Packet loss = 60%, RTA = 252.03 ms [12:13:17] RECOVERY - ping6 on cp26 is OK: PING OK - Packet loss = 0%, RTA = 179.29 ms [12:40:07] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 220.59 ms [12:40:40] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 212.19 ms [12:42:15] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 212.72 ms [12:48:23] RECOVERY - ping6 on cp27 is OK: PING OK - Packet loss = 0%, RTA = 192.58 ms [12:52:32] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 202.69 ms [12:52:49] RECOVERY - ping6 on cp26 is OK: PING OK - Packet loss = 0%, RTA = 166.28 ms [12:54:35] RECOVERY - ping6 on cp27 is OK: PING OK - Packet loss = 0%, RTA = 184.14 ms [12:58:38] RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 183.94 ms [13:04:52] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 219.63 ms [13:04:53] PROBLEM - ping6 on ns2 is WARNING: PING WARNING - Packet loss = 0%, RTA = 221.19 ms [13:08:03] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 211.12 ms [13:10:05] RECOVERY - ping6 on cp26 is OK: PING OK - Packet loss = 0%, RTA = 198.61 ms [13:11:00] RECOVERY - ping6 on cp27 is OK: PING OK - Packet loss = 0%, RTA = 198.74 ms [13:15:09] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 211.04 ms [13:17:12] RECOVERY - ping6 on cp27 is OK: PING OK - Packet loss = 0%, RTA = 197.09 ms [13:21:20] PROBLEM - ping6 on cp27 is WARNING: PING WARNING - Packet loss = 0%, RTA = 209.58 ms [13:23:17] PROBLEM - ping6 on cp26 is WARNING: PING WARNING - Packet loss = 0%, RTA = 218.88 ms [13:25:26] RECOVERY - ping6 on cp27 is OK: PING OK - Packet loss = 0%, RTA = 180.83 ms [13:25:28] RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 198.52 ms [13:27:20] RECOVERY - ping6 on cp26 is OK: PING OK - Packet loss = 0%, RTA = 139.47 ms [13:38:45] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.mahdiruiz.line.pm. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:19:58] !log [alex@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=themanaworldwiki The%2BMana%2BWorld-20240401200416.xml --username-prefix=themanaworld --no-updates --report 1 (START) [14:20:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:21:03] !log [alex@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=themanaworldwiki The%2BMana%2BWorld-20240401200416.xml --username-prefix=themanaworld --no-updates --report 1 (END - exit=0) [14:21:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:21:28] !log [alex@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=themanaworldwiki (START) [14:21:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:28:34] !log [alex@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=themanaworldwiki (END - exit=0) [14:28:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:06:39] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [15:21:08] [02miraheze/landing] 07redbluegreenhat pushed 031 commit to 03revert-april-fools [+0/-0/±1] 13https://github.com/miraheze/landing/commit/f70268e98a2a [15:21:11] [02miraheze/landing] 07redbluegreenhat 03f70268e - Restore pre-April Fool's version [15:21:12] [02landing] 07redbluegreenhat created branch 03revert-april-fools - 13https://github.com/miraheze/landing [15:21:20] [02landing] 07redbluegreenhat opened pull request 03#145: Restore pre-April Fool's version - 13https://github.com/miraheze/landing/pull/145 [15:21:47] [02landing] 07redbluegreenhat closed pull request 03#144: Remove April Fools changes because April 1st is over for most people right now - 13https://github.com/miraheze/landing/pull/144 [15:21:50] [02miraheze/landing] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/51184825127f...89d2647e6b19 [15:21:51] [02miraheze/landing] 07colleirose 0389d2647 - Remove April Fools changes because April 1st is over for most people right now (#144) [15:21:53] [02landing] 07redbluegreenhat closed pull request 03#145: Restore pre-April Fool's version - 13https://github.com/miraheze/landing/pull/145 [15:21:56] [02landing] 07redbluegreenhat deleted branch 03revert-april-fools - 13https://github.com/miraheze/landing [15:21:58] [02miraheze/landing] 07redbluegreenhat deleted branch 03revert-april-fools [15:22:00] [02miraheze/landing] 07redbluegreenhat pushed 031 commit to 03revert-april-fools [+0/-0/±1] 13https://github.com/miraheze/landing/commit/f70268e98a2a [15:22:02] [02miraheze/landing] 07redbluegreenhat 03f70268e - Restore pre-April Fool's version [15:22:04] [02landing] 07redbluegreenhat created branch 03revert-april-fools - 13https://github.com/miraheze/landing [15:22:05] [02miraheze/landing] 07redbluegreenhat deleted branch 03revert-april-fools [15:22:06] [02landing] 07redbluegreenhat deleted branch 03revert-april-fools - 13https://github.com/miraheze/landing [15:22:21] miraheze/landing - redbluegreenhat the build passed. [15:23:07] miraheze/landing - redbluegreenhat the build passed. [15:26:49] RECOVERY - wiki.manos.pt - reverse DNS on sslhost is OK: SSL OK - wiki.manos.pt reverse DNS resolves to cp36.wikitide.net - CNAME OK [15:29:21] RECOVERY - wiki.manos.pt - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.manos.pt' will expire on Fri 10 May 2024 10:20:07 PM GMT +0000. [15:33:08] PROBLEM - cp41 Disk Space on cp41 is WARNING: DISK WARNING - free space: / 10214MiB (10% inode=98%); [15:38:40] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mahdiruiz.line.pm All nameservers failed to answer the query. [15:40:08] PROBLEM - wiki.mahdiruiz.line.pm - LetsEncrypt on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [15:54:16] PROBLEM - ping6 on cp51 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 168.44 ms [15:56:15] RECOVERY - ping6 on cp51 is OK: PING OK - Packet loss = 0%, RTA = 168.94 ms [16:07:51] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [16:09:15] RECOVERY - wiki.mahdiruiz.line.pm - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mahdiruiz.line.pm' will expire on Fri 14 Jun 2024 04:28:50 PM GMT +0000. [17:25:19] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=barneybunchwiki --logwiki=metawiki --ignorestatus Freggsu Neocon (END - exit=0) [17:25:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:29:07] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=tvcensorshipwiki --logwiki=metawiki --ignorestatus ZaldyMacalalad Volman00 (END - exit=0) [17:29:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:29:49] !log [macfan@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=uglylogoswiki --logwiki=metawiki --ignorestatus ZaldyMacalalad Volman00 (END - exit=0) [17:29:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:29:59] PROBLEM - encyclopediarobotica.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'encyclopediarobotica.org' expires in 15 day(s) (Thu 18 Apr 2024 05:05:13 PM GMT +0000). [17:30:14] [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/f9318683b281...4bc37035b1da [17:30:16] [02miraheze/ssl] 07WikiTideSSLBot 034bc3703 - Bot: Update SSL cert for encyclopediarobotica.org [17:50:01] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/5ccc54e16698...340a46297842 [17:50:02] [02miraheze/puppet] 07Universal-Omega 03340a462 - changeprop: tune [17:57:35] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/340a46297842...ceecf3a5e288 [17:57:37] [02miraheze/puppet] 07Universal-Omega 03ceecf3a - changeprop: add smw.update queue [17:59:28] RECOVERY - encyclopediarobotica.org - LetsEncrypt on sslhost is OK: OK - Certificate 'encyclopediarobotica.org' will expire on Mon 01 Jul 2024 04:30:05 PM GMT +0000. [19:05:01] PROBLEM - starveil.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'starveil.wiki' expires in 15 day(s) (Thu 18 Apr 2024 06:52:16 PM GMT +0000). [19:05:14] [02miraheze/ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/4bc37035b1da...e3eeac62d4a5 [19:05:16] [02miraheze/ssl] 07WikiTideSSLBot 03e3eeac6 - Bot: Update SSL cert for starveil.wiki [19:10:21] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [19:32:26] PROBLEM - changeprop151 Puppet on changeprop151 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 12 minutes ago with 0 failures [19:33:32] RECOVERY - starveil.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'starveil.wiki' will expire on Mon 01 Jul 2024 06:05:08 PM GMT +0000. [19:39:28] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mahdiruiz.line.pm All nameservers failed to answer the query. [19:55:20] !log [alex@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/refreshLinks.php --wiki=allthetropeswiki (START) [19:55:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:56:37] !log [alex@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/refreshLinks.php --wiki=allthetropeswiki (END - exit=2) [19:56:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:58:59] !log [alex@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/refreshLinks.php --wiki=allthetropeswiki (START) [19:59:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:24] PROBLEM - wiki.mahdiruiz.line.pm - LetsEncrypt on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [20:31:26] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03EventStreamConfig [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/befbe1029f40 [20:31:29] [02miraheze/mw-config] 07Universal-Omega 03befbe10 - Add more EventStreamConfig [20:31:32] [02mw-config] 07Universal-Omega created branch 03EventStreamConfig - 13https://github.com/miraheze/mw-config [20:31:34] [02mw-config] 07Universal-Omega opened pull request 03#5524: Add more EventStreamConfig - 13https://github.com/miraheze/mw-config/pull/5524 [20:32:29] miraheze/mw-config - Universal-Omega the build passed. [20:37:44] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [20:39:30] RECOVERY - wiki.mahdiruiz.line.pm - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mahdiruiz.line.pm' will expire on Fri 14 Jun 2024 04:28:50 PM GMT +0000. [20:40:01] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03EventStreamConfig [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/befbe1029f40...e449f0d0a024 [20:40:03] [02miraheze/mw-config] 07Universal-Omega 03e449f0d - Update logging [20:40:07] [02mw-config] 07Universal-Omega synchronize pull request 03#5524: Add more EventStreamConfig - 13https://github.com/miraheze/mw-config/pull/5524 [20:41:04] miraheze/mw-config - Universal-Omega the build passed. [20:43:05] [02mw-config] 07Universal-Omega closed pull request 03#5524: Add more EventStreamConfig - 13https://github.com/miraheze/mw-config/pull/5524 [20:43:10] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/2907da681d78...46907f31c54b [20:43:12] [02miraheze/mw-config] 07Universal-Omega 0346907f3 - Add more EventStreamConfig (#5524) [20:43:14] [02miraheze/mw-config] 07Universal-Omega deleted branch 03EventStreamConfig [20:43:17] [02mw-config] 07Universal-Omega deleted branch 03EventStreamConfig - 13https://github.com/miraheze/mw-config [20:43:38] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [20:43:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:43:48] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 9s [20:43:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:44:02] miraheze/mw-config - Universal-Omega the build passed. [20:53:44] !log [@test151] starting deploy of {'config': True} to test151 [20:53:45] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [20:53:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:54:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:06:51] !log [@mwtask171] starting deploy of {'config': True} to all [21:06:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:06:59] !log [@mwtask171] finished deploy of {'config': True} to all - SUCCESS in 8s [21:07:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:36:36] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [21:37:07] PROBLEM - changeprop151 changeprop on changeprop151 is CRITICAL: connect to address 10.0.15.148 and port 7200: Connection refused [21:39:06] RECOVERY - changeprop151 changeprop on changeprop151 is OK: TCP OK - 0.000 second response time on 10.0.15.148 port 7200 [21:43:02] PROBLEM - changeprop151 changeprop on changeprop151 is CRITICAL: connect to address 10.0.15.148 and port 7200: Connection refused [21:47:29] PROBLEM - cp36 Disk Space on cp36 is WARNING: DISK WARNING - free space: / 9696MiB (10% inode=98%); [21:48:58] RECOVERY - changeprop151 changeprop on changeprop151 is OK: TCP OK - 0.000 second response time on 10.0.15.148 port 7200 [21:54:39] PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 9698MiB (10% inode=98%); [22:06:44] RECOVERY - changeprop151 Puppet on changeprop151 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures