[00:12:56] PROBLEM - wiki.wubbygame.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.wubbygame.com' expires in 15 day(s) (Tue 23 Jul 2024 11:51:08 PM GMT +0000). [00:13:06] [02ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/f484ac657684...af3abbe723d5 [00:13:09] [02ssl] 07WikiTideSSLBot 03af3abbe - Bot: Update SSL cert for wiki.wubbygame.com [00:13:11] PROBLEM - irad.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'irad.wiki' expires in 15 day(s) (Tue 23 Jul 2024 11:50:41 PM GMT +0000). [00:13:23] [02ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/af3abbe723d5...0520ef02ef27 [00:13:24] [02ssl] 07WikiTideSSLBot 030520ef0 - Bot: Update SSL cert for irad.wiki [00:49:31] [02mw-config] 07BlankEclair closed pull request 03#5596: T12271: Add $wgUseLegacyMediaStyles - 13https://github.com/miraheze/mw-config/pull/5596 [00:51:20] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 23.83, 19.89, 17.93 [00:53:20] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 17.67, 19.34, 18.01 [01:07:15] [02ssl] 07BlankEclair opened pull request 03#787: T12287: Add redirect from minigamemadness.miraheze.org to wiki.minigamemadness.net - 13https://github.com/miraheze/ssl/pull/787 [01:07:21] [02ssl] 07coderabbitai[bot] commented on pull request 03#787: T12287: Add redirect from minigamemadness.miraheze.org to wiki.minigamemadness.net - 13https://github.com/miraheze/ssl/pull/787#issuecomment-2212724145 [01:09:13] [02ssl] 07coderabbitai[bot] edited a comment on pull request 03#787: T12287: Add redirect from minigamemadness.miraheze.org to wiki.minigamemadness.net - 13https://github.com/miraheze/ssl/pull/787#issuecomment-2212724145 [01:10:51] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 25.72, 21.42, 19.62 [01:10:56] RECOVERY - wiki.wubbygame.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.wubbygame.com' will expire on Sat 05 Oct 2024 11:13:01 PM GMT +0000. [01:13:02] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 20.53, 20.25, 19.37 [01:13:02] RECOVERY - irad.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'irad.wiki' will expire on Sat 05 Oct 2024 11:13:18 PM GMT +0000. [01:14:43] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 19.40, 19.63, 19.23 [01:43:20] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 23.50, 20.61, 19.69 [01:45:20] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 16.95, 19.26, 19.32 [01:51:20] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.17, 21.36, 20.13 [01:54:05] [02ssl] 07The-Voidwalker closed pull request 03#787: T12287: Add redirect from minigamemadness.miraheze.org to wiki.minigamemadness.net - 13https://github.com/miraheze/ssl/pull/787 [01:54:07] [02ssl] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/0520ef02ef27...8be16423d716 [01:54:10] [02ssl] 07BlankEclair 038be1642 - T12287: Add redirect from minigamemadness.miraheze.org to wiki.minigamemadness.net (#787) [02:01:20] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 18.68, 20.07, 20.27 [02:05:20] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 25.47, 22.76, 21.31 [02:07:20] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.39, 22.28, 21.29 [02:13:20] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 18.63, 19.17, 20.29 [02:27:54] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 20.48, 21.57, 20.48 [02:35:51] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 24.15, 23.41, 21.69 [02:37:51] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 21.24, 22.01, 21.35 [02:39:51] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 26.29, 23.90, 22.14 [02:41:51] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.13, 23.22, 22.12 [02:43:51] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 25.89, 23.79, 22.44 [02:51:51] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 18.02, 22.45, 22.69 [03:01:51] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 13.07, 17.18, 19.83 [03:19:51] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 25.95, 21.69, 19.86 [03:25:51] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 20.38, 23.83, 21.70 [03:31:51] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 13.03, 17.64, 19.74 [03:38:34] PROBLEM - wiki.grab-tools.live - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.grab-tools.live could not be found [04:43:07] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 19.03, 20.42, 19.48 [04:45:03] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 15.47, 18.73, 18.97 [05:54:03] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.01, 20.55, 18.92 [05:57:56] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 16.56, 19.09, 18.81 [06:03:51] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.21, 20.51, 19.33 [06:05:51] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 18.19, 19.65, 19.16 [06:08:07] RECOVERY - wiki.grab-tools.live - reverse DNS on sslhost is OK: SSL OK - wiki.grab-tools.live reverse DNS resolves to cp36.wikitide.net - CNAME OK [06:13:51] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 21.81, 22.00, 20.47 [06:21:51] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 19.66, 20.16, 20.24 [06:27:51] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 20.85, 20.73, 20.45 [06:29:51] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 24.02, 21.30, 20.64 [06:30:30] [02mw-config] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/0efa51f2e8b5...376f4bfcbaba [06:30:33] [02mw-config] 07The-Voidwalker 03376f4bf - add cps 26 & 27 to wgMultiPurgeVarnishServers [06:31:28] miraheze/mw-config - The-Voidwalker the build passed. [06:31:51] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 16.47, 19.80, 20.22 [06:32:13] !log [@mwtask181] starting deploy of {'config': True} to all [06:32:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:32:32] !log [@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 12s [06:32:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:37:12] !log [@mwtask171] starting deploy of {'config': True} to all [06:37:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:37:21] !log [@mwtask171] finished deploy of {'config': True} to all - SUCCESS in 9s [06:37:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:53:19] !log [@test151] starting deploy of {'config': True} to test151 [06:53:20] !log [@test151] finished deploy of {'config': True} to test151 - SUCCESS in 0s [06:53:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:53:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:57:51] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 19.48, 21.24, 20.57 [07:09:35] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [07:12:08] PROBLEM - wiki.themanaworld.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.themanaworld.org All nameservers failed to answer the query. [07:13:51] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 15.11, 17.78, 19.78 [07:14:05] PROBLEM - wiki.joust.ro - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.joust.ro All nameservers failed to answer the query. [07:14:46] PROBLEM - wiki.astralprojections.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.astralprojections.org All nameservers failed to answer the query. [07:19:16] PROBLEM - wiki.consid.vn - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.consid.vn All nameservers failed to answer the query. [07:21:50] PROBLEM - ie.unigon.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - ie.unigon.net All nameservers failed to answer the query. [07:23:43] PROBLEM - threedomwiki.pcast.site - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - threedomwiki.pcast.site All nameservers failed to answer the query. [07:23:44] PROBLEM - crustypedia.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - crustypedia.org All nameservers failed to answer the query. [07:25:11] PROBLEM - history.sdtef.org - LetsEncrypt on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [07:27:46] PROBLEM - wiki.albrusmusic.ru - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.albrusmusic.ru All nameservers failed to answer the query. [07:29:22] PROBLEM - wiki.maribelhearn.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.maribelhearn.com All nameservers failed to answer the query. [07:32:29] PROBLEM - wiki.luemir.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.luemir.xyz All nameservers failed to answer the query. [07:32:49] PROBLEM - wiki.grottocenter.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.grottocenter.org All nameservers failed to answer the query. [07:34:01] PROBLEM - history.sdtef.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - history.sdtef.org All nameservers failed to answer the query. [07:36:49] PROBLEM - cyberlaw.ccdcoe.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - cyberlaw.ccdcoe.org All nameservers failed to answer the query. [07:37:47] PROBLEM - nl.xliving.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - nl.xliving.org All nameservers failed to answer the query. [07:39:00] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [07:41:37] PROBLEM - wiki.themanaworld.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.themanaworld.org could not be found [07:43:34] RECOVERY - wiki.joust.ro - reverse DNS on sslhost is OK: SSL OK - wiki.joust.ro reverse DNS resolves to cp36.wikitide.net - CNAME OK [07:43:43] RECOVERY - wiki.astralprojections.org - reverse DNS on sslhost is OK: SSL OK - wiki.astralprojections.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [07:48:34] RECOVERY - wiki.consid.vn - reverse DNS on sslhost is OK: SSL OK - wiki.consid.vn reverse DNS resolves to cp36.wikitide.net - CNAME OK [07:50:40] RECOVERY - ie.unigon.net - reverse DNS on sslhost is OK: SSL OK - ie.unigon.net reverse DNS resolves to cp36.wikitide.net - CNAME OK [07:52:56] RECOVERY - threedomwiki.pcast.site - reverse DNS on sslhost is OK: SSL OK - threedomwiki.pcast.site reverse DNS resolves to cp36.wikitide.net - CNAME OK [07:52:58] RECOVERY - crustypedia.org - reverse DNS on sslhost is OK: SSL OK - crustypedia.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [07:54:23] RECOVERY - history.sdtef.org - LetsEncrypt on sslhost is OK: OK - Certificate 'history.sdtef.org' will expire on Sat 27 Jul 2024 04:31:19 PM GMT +0000. [07:56:47] RECOVERY - wiki.albrusmusic.ru - reverse DNS on sslhost is OK: SSL OK - wiki.albrusmusic.ru reverse DNS resolves to cp36.wikitide.net - CNAME OK [07:58:16] RECOVERY - wiki.maribelhearn.com - reverse DNS on sslhost is OK: SSL OK - wiki.maribelhearn.com reverse DNS resolves to cp36.wikitide.net - CNAME OK [08:01:41] RECOVERY - wiki.luemir.xyz - reverse DNS on sslhost is OK: SSL OK - wiki.luemir.xyz reverse DNS resolves to cp36.wikitide.net - CNAME OK [08:02:09] RECOVERY - wiki.grottocenter.org - reverse DNS on sslhost is OK: SSL OK - wiki.grottocenter.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [08:03:45] RECOVERY - history.sdtef.org - reverse DNS on sslhost is OK: SSL OK - history.sdtef.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [08:05:46] RECOVERY - cyberlaw.ccdcoe.org - reverse DNS on sslhost is OK: SSL OK - cyberlaw.ccdcoe.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [08:07:04] RECOVERY - nl.xliving.org - reverse DNS on sslhost is OK: SSL OK - nl.xliving.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [08:52:14] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.76, 19.02, 17.40 [08:54:10] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 19.62, 18.67, 17.44 [09:01:23] PROBLEM - wiki.penguinmod.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.penguinmod.com All nameservers failed to answer the query. [09:05:23] PROBLEM - wiki.kingmingshrimp.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.kingmingshrimp.com All nameservers failed to answer the query. [09:13:28] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [09:20:23] PROBLEM - you.r-fit.cc - LetsEncrypt on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [09:30:50] RECOVERY - wiki.penguinmod.com - reverse DNS on sslhost is OK: SSL OK - wiki.penguinmod.com reverse DNS resolves to cp36.wikitide.net - CNAME OK [09:34:16] RECOVERY - wiki.kingmingshrimp.com - reverse DNS on sslhost is OK: SSL OK - wiki.kingmingshrimp.com reverse DNS resolves to cp36.wikitide.net - CNAME OK [09:49:34] RECOVERY - you.r-fit.cc - LetsEncrypt on sslhost is OK: OK - Certificate 'you.r-fit.cc' will expire on Sun 28 Jul 2024 03:44:54 AM GMT +0000. [09:50:32] PROBLEM - education.gced.in - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - education.gced.in All nameservers failed to answer the query. [09:53:44] PROBLEM - revi.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - revi.wiki All nameservers failed to answer the query. [10:19:42] RECOVERY - education.gced.in - reverse DNS on sslhost is OK: SSL OK - education.gced.in reverse DNS resolves to cp36.wikitide.net - CNAME OK [10:22:08] PROBLEM - aman.awiki.org - LetsEncrypt on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [10:22:19] PROBLEM - elsterclopedie.marithaime.nl - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - elsterclopedie.marithaime.nl All nameservers failed to answer the query. [10:22:58] RECOVERY - revi.wiki - reverse DNS on sslhost is OK: SSL OK - revi.wiki reverse DNS resolves to cp36.wikitide.net - CNAME FLAT [10:36:28] PROBLEM - ns2 NTP time on ns2 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:36:36] PROBLEM - wiki.mcjones.gay - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mcjones.gay All nameservers failed to answer the query. [10:36:57] PROBLEM - wiki.altilunium.my.id - LetsEncrypt on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [10:37:01] PROBLEM - wiki.simplifiedcoding.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.simplifiedcoding.org All nameservers failed to answer the query. [10:38:23] RECOVERY - ns2 NTP time on ns2 is OK: NTP OK: Offset -0.0004134774208 secs [10:51:15] RECOVERY - aman.awiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'aman.awiki.org' will expire on Sat 27 Jul 2024 08:30:19 PM GMT +0000. [10:51:39] RECOVERY - elsterclopedie.marithaime.nl - reverse DNS on sslhost is OK: SSL OK - elsterclopedie.marithaime.nl reverse DNS resolves to cp36.wikitide.net - CNAME OK [11:02:53] PROBLEM - www.istpcomputing.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - www.istpcomputing.com All nameservers failed to answer the query. [11:05:12] RECOVERY - wiki.mcjones.gay - reverse DNS on sslhost is OK: SSL OK - wiki.mcjones.gay reverse DNS resolves to cp36.wikitide.net - CNAME OK [11:05:52] RECOVERY - wiki.altilunium.my.id - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.altilunium.my.id' will expire on Fri 02 Aug 2024 03:04:17 AM GMT +0000. [11:06:21] RECOVERY - wiki.simplifiedcoding.org - reverse DNS on sslhost is OK: SSL OK - wiki.simplifiedcoding.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [11:17:53] PROBLEM - wiki.insideearth.info - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.insideearth.info All nameservers failed to answer the query. [11:21:17] PROBLEM - wiki.potabi.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.potabi.com All nameservers failed to answer the query. [11:23:24] PROBLEM - wikislamica.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wikislamica.org All nameservers failed to answer the query. [11:32:37] RECOVERY - www.istpcomputing.com - reverse DNS on sslhost is OK: SSL OK - www.istpcomputing.com reverse DNS resolves to cp36.wikitide.net - CNAME OK [11:35:20] PROBLEM - wiki.limaru.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.limaru.net All nameservers failed to answer the query. [11:36:01] RECOVERY - cp37 Nginx Backend for mw151 on cp37 is OK: TCP OK - 0.000 second response time on localhost port 8113 [11:38:32] PROBLEM - itora.bunnies1230.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - itora.bunnies1230.com All nameservers failed to answer the query. [11:39:04] PROBLEM - www.lab612.at - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - www.lab612.at All nameservers failed to answer the query. [11:40:01] PROBLEM - cp37 Nginx Backend for mw151 on cp37 is CRITICAL: connect to address localhost and port 8113: Connection refused [11:40:20] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.57, 19.58, 18.04 [11:41:23] PROBLEM - wiki.valkyrienskies.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.valkyrienskies.org All nameservers failed to answer the query. [11:42:12] PROBLEM - lpfteam.nl - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - lpfteam.nl All nameservers failed to answer the query. [11:42:17] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 20.18, 19.74, 18.29 [11:47:08] RECOVERY - wiki.insideearth.info - reverse DNS on sslhost is OK: SSL OK - wiki.insideearth.info reverse DNS resolves to cp36.wikitide.net - CNAME OK [11:51:04] RECOVERY - wiki.potabi.com - reverse DNS on sslhost is OK: SSL OK - wiki.potabi.com reverse DNS resolves to cp36.wikitide.net - CNAME OK [11:52:18] RECOVERY - wikislamica.org - reverse DNS on sslhost is OK: SSL OK - wikislamica.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [11:55:54] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 23.12, 20.46, 18.86 [11:57:51] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 25.00, 21.61, 19.44 [11:59:51] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 18.47, 20.21, 19.19 [12:04:11] RECOVERY - wiki.limaru.net - reverse DNS on sslhost is OK: SSL OK - wiki.limaru.net reverse DNS resolves to cp36.wikitide.net - CNAME OK [12:06:40] PROBLEM - wiki.blockate.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.blockate.com All nameservers failed to answer the query. [12:07:51] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.18, 20.77, 19.54 [12:08:15] RECOVERY - www.lab612.at - reverse DNS on sslhost is OK: SSL OK - www.lab612.at reverse DNS resolves to cp36.wikitide.net - CNAME OK [12:08:32] RECOVERY - itora.bunnies1230.com - reverse DNS on sslhost is OK: SSL OK - itora.bunnies1230.com reverse DNS resolves to cp36.wikitide.net - CNAME OK [12:08:51] PROBLEM - wiki.elgeis.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.elgeis.com All nameservers failed to answer the query. [12:09:03] PROBLEM - wiki.msnld.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.msnld.com All nameservers failed to answer the query. [12:10:15] RECOVERY - wiki.valkyrienskies.org - reverse DNS on sslhost is OK: SSL OK - wiki.valkyrienskies.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [12:11:39] [02MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/MirahezeMagic/compare/42a080ced2ed...a6ceed97bcab [12:11:42] [02MirahezeMagic] 07translatewiki 03a6ceed9 - Localisation updates from https://translatewiki.net. [12:11:49] RECOVERY - lpfteam.nl - reverse DNS on sslhost is OK: SSL OK - lpfteam.nl reverse DNS resolves to cp36.wikitide.net - CNAME FLAT [12:11:51] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 17.38, 19.79, 19.50 [12:16:09] miraheze/MirahezeMagic - translatewiki the build has errored. [12:23:26] !log [@test151] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to test151 [12:23:27] !log [@test151] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s [12:23:39] !log [@test151] starting deploy of {'folders': '1.42/extensions/MirahezeMagic'} to test151 [12:23:40] !log [@test151] finished deploy of {'folders': '1.42/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s [12:23:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:23:51] !log [@test151] starting deploy of {'folders': '1.43/extensions/MirahezeMagic'} to test151 [12:23:52] !log [@test151] finished deploy of {'folders': '1.43/extensions/MirahezeMagic'} to test151 - SUCCESS in 0s [12:23:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:25:34] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 25.29, 21.52, 20.12 [12:27:31] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.21, 21.64, 20.33 [12:29:27] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 24.10, 21.98, 20.57 [12:31:24] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.38, 21.70, 20.62 [12:32:19] !log [@mwtask181] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all [12:32:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:32:31] !log [@mwtask181] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all - SUCCESS in 12s [12:32:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:32:43] !log [@mwtask181] starting deploy of {'folders': '1.42/extensions/MirahezeMagic'} to all [12:32:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:32:53] !log [@mwtask181] finished deploy of {'folders': '1.42/extensions/MirahezeMagic'} to all - SUCCESS in 9s [12:32:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:35:20] RECOVERY - wiki.blockate.com - reverse DNS on sslhost is OK: SSL OK - wiki.blockate.com reverse DNS resolves to cp36.wikitide.net - CNAME OK [12:36:28] PROBLEM - moddedminecraft.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - moddedminecraft.wiki All nameservers failed to answer the query. [12:37:20] PROBLEM - wiki.nevillepedia.eu - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nevillepedia.eu All nameservers failed to answer the query. [12:38:07] !log [@mwtask171] starting deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all [12:38:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:38:16] RECOVERY - wiki.msnld.com - reverse DNS on sslhost is OK: SSL OK - wiki.msnld.com reverse DNS resolves to cp36.wikitide.net - CNAME OK [12:38:16] !log [@mwtask171] finished deploy of {'folders': '1.41/extensions/MirahezeMagic'} to all - SUCCESS in 9s [12:38:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:38:28] !log [@mwtask171] starting deploy of {'folders': '1.42/extensions/MirahezeMagic'} to all [12:38:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:38:37] !log [@mwtask171] finished deploy of {'folders': '1.42/extensions/MirahezeMagic'} to all - SUCCESS in 9s [12:38:38] RECOVERY - wiki.elgeis.com - reverse DNS on sslhost is OK: SSL OK - wiki.elgeis.com reverse DNS resolves to cp36.wikitide.net - CNAME OK [12:38:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:39:09] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 18.39, 19.70, 20.15 [13:05:56] RECOVERY - moddedminecraft.wiki - reverse DNS on sslhost is OK: SSL OK - moddedminecraft.wiki reverse DNS resolves to cp36.wikitide.net - CNAME FLAT [13:06:40] RECOVERY - wiki.nevillepedia.eu - reverse DNS on sslhost is OK: SSL OK - wiki.nevillepedia.eu reverse DNS resolves to cp36.wikitide.net - CNAME OK [13:08:54] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [13:54:05] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 23.91, 20.69, 18.65 [13:56:01] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 24.36, 21.29, 19.07 [13:57:58] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 21.88, 21.64, 19.48 [13:59:55] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 16.91, 19.60, 18.98 [14:15:40] PROBLEM - ns2 Puppet on ns2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [14:41:36] [02mw-config] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/justinrainbow/json-schema-5.3.0 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/c049f47fd8f6 [14:41:37] [02mw-config] 07dependabot[bot] 03c049f47 - Update justinrainbow/json-schema requirement from 5.2.13 to 5.3.0 [14:41:40] [02mw-config] 07dependabot[bot] created branch 03dependabot/composer/justinrainbow/json-schema-5.3.0 - 13https://github.com/miraheze/mw-config [14:41:43] [02mw-config] 07dependabot[bot] labeled pull request 03#5601: Update justinrainbow/json-schema requirement from 5.2.13 to 5.3.0 - 13https://github.com/miraheze/mw-config/pull/5601 [14:41:45] [02mw-config] 07dependabot[bot] labeled pull request 03#5601: Update justinrainbow/json-schema requirement from 5.2.13 to 5.3.0 - 13https://github.com/miraheze/mw-config/pull/5601 [14:41:46] [02mw-config] 07dependabot[bot] opened pull request 03#5601: Update justinrainbow/json-schema requirement from 5.2.13 to 5.3.0 - 13https://github.com/miraheze/mw-config/pull/5601 [14:42:37] miraheze/mw-config - dependabot[bot] the build passed. [14:44:14] RECOVERY - ns2 Puppet on ns2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [14:46:25] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.90, 20.78, 18.93 [14:56:07] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 25.31, 22.58, 20.53 [14:58:04] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 17.82, 20.91, 20.17 [15:00:00] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 17.53, 20.06, 19.96 [15:27:51] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 26.43, 22.54, 19.35 [15:31:51] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 19.36, 22.27, 20.12 [15:33:51] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 15.64, 19.93, 19.52 [15:42:25] [Grafana] !tech FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [15:59:51] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.94, 18.34, 16.87 [16:01:51] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 24.71, 20.16, 17.70 [16:03:51] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 21.40, 20.13, 17.99 [16:05:51] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 15.65, 18.67, 17.74 [16:31:51] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 24.93, 20.38, 18.06 [16:33:51] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 19.42, 20.20, 18.30 [16:33:53] [02ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/8be16423d716...66a3fdc7a155 [16:33:55] [02ssl] 07WikiTideSSLBot 0366a3fdc - Bot: Add SSL cert for arceniawiki.doughhearts.com [16:35:33] [02ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/66a3fdc7a155...e40491b0ef96 [16:35:36] [02ssl] 07WikiTideSSLBot 03e40491b - Bot: Add SSL cert for iewiki.purnamcommunity.in [16:36:12] [02ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/e40491b0ef96...4c28ac6debc9 [16:36:13] [02ssl] 07WikiTideSSLBot 034c28ac6 - Bot: Add SSL cert for wiki.yahia.xyz [16:40:46] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 24.05, 21.75, 19.57 [16:46:35] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 15.45, 21.53, 20.52 [16:47:36] [02dns] 07MacFan4000 opened pull request 03#533: add gimkit.wiki and junxions.wiki zones - 13https://github.com/miraheze/dns/pull/533 [16:47:58] could somebody please merge https://github.com/miraheze/dns/pull/533? [16:48:31] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 11.59, 18.22, 19.43 [16:56:21] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 27.12, 21.58, 19.99 [16:58:19] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.81, 22.29, 20.48 [17:00:17] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 13.52, 18.81, 19.41 [17:02:25] PROBLEM - db181 Current Load on db181 is CRITICAL: LOAD CRITICAL - total load average: 37.16, 15.21, 5.83 [17:05:06] PROBLEM - db181 Puppet on db181 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:06:15] PROBLEM - db181 PowerDNS Recursor on db181 is CRITICAL: CRITICAL - Plugin timed out while executing system call [17:10:20] RECOVERY - db181 PowerDNS Recursor on db181 is OK: DNS OK: 0.291 seconds response time. wikitide.net returns 2602:294:0:b13::110,38.46.223.205 [17:10:22] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 39 minutes ago with 0 failures [17:28:25] PROBLEM - db181 Current Load on db181 is WARNING: LOAD WARNING - total load average: 0.22, 2.33, 10.93 [17:30:25] RECOVERY - db181 Current Load on db181 is OK: LOAD OK - total load average: 0.49, 1.70, 9.65 [17:45:53] PROBLEM - ns2 Puppet on ns2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [18:14:04] PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 28.30, 22.52, 18.34 [18:14:23] RECOVERY - ns2 Puppet on ns2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:26:04] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 19.50, 23.02, 21.55 [18:30:04] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 17.18, 19.12, 20.24 [19:07:25] [Grafana] !tech RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [19:27:13] RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:30:24] RECOVERY - mwtask171 Puppet on mwtask171 is OK: OK: Puppet is currently enabled, last run 34 seconds ago with 0 failures [19:37:59] PROBLEM - ns2 NTP time on ns2 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H [-4|-6] [-w ] [-c ] [-v verbose] [-o