[00:03:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 6.38, 3.56, 1.96 [00:34:06] PROBLEM - db131 Current Load on db131 is CRITICAL: CRITICAL - load average: 10.45, 7.51, 5.12 [00:36:05] RECOVERY - db131 Current Load on db131 is OK: OK - load average: 3.05, 5.66, 4.73 [03:01:32] RECOVERY - db121 Backups SQL on db121 is OK: FILE_AGE OK: /var/log/sql-backup.log is 91 seconds old and 0 bytes [03:03:31] PROBLEM - mon141 Backups Grafana on mon141 is WARNING: FILE_AGE WARNING: /var/log/grafana-backup.log is 864190 seconds old and 92 bytes [04:26:07] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.zulaclub.net. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [04:27:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 2.96, 3.50, 3.96 [04:29:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.59, 3.91, 4.05 [04:31:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 2.94, 3.54, 3.90 [04:35:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 5.56, 4.22, 4.05 [04:39:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.05, 3.68, 3.87 [04:41:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 5.23, 4.21, 4.04 [04:54:43] RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp24.miraheze.org - CNAME OK [05:35:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.65, 2.76, 3.94 [05:39:47] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 1.09, 1.62, 3.18 [05:54:00] PROBLEM - elephants.ggreig.com - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.405891180038452 seconds [06:23:16] RECOVERY - elephants.ggreig.com - reverse DNS on sslhost is OK: SSL OK - elephants.ggreig.com reverse DNS resolves to cp24.miraheze.org - CNAME OK [06:55:53] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 10.49, 12.07, 6.49 [07:01:48] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.11, 7.39, 6.16 [07:03:46] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 20.48, 11.47, 7.70 [07:10:53] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7551 MB (5% inode=99%); [07:19:32] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 6.13, 6.40, 7.76 [07:23:28] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 3.30, 4.72, 6.75 [07:25:01] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.003975570202 secs [07:27:23] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 9.52, 9.32, 8.30 [07:29:21] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.40, 7.09, 7.60 [07:33:18] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 3.57, 5.34, 6.76 [07:36:53] RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 15663 MB (11% inode=99%); [07:42:53] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 13629 MB (10% inode=99%); [07:44:05] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 23.37, 11.51, 8.19 [07:57:01] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1068638265 secs [07:58:53] RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 16809 MB (12% inode=99%); [08:03:47] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 1.56, 5.02, 7.35 [08:05:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 7.48, 4.44, 2.33 [08:07:43] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 2.19, 3.74, 6.30 [08:31:14] PROBLEM - wiki.bloxotel.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.bloxotel.tk could not be found [09:24:00] PROBLEM - db142 Backups SQL on db142 is CRITICAL: FILE_AGE CRITICAL: /var/log/sql-backup.log is 1209712 seconds old and 86595 bytes [09:59:01] PROBLEM - ns1 NTP time on ns1 is CRITICAL: NTP CRITICAL: Offset 0.5000661314 secs [11:15:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 1.12, 2.44, 3.89 [11:15:55] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/08dd154d8330...60c15dfdc3c1 [11:15:56] [02miraheze/MirahezeMagic] 07translatewiki 0360c15df - Localisation updates from https://translatewiki.net. [11:15:58] [02miraheze/ImportDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/9ee94cd71b92...3a7c44f944e7 [11:15:59] [02miraheze/ImportDump] 07translatewiki 033a7c44f - Localisation updates from https://translatewiki.net. [11:16:02] [02miraheze/PDFEmbed] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/compare/4753eba5ff5a...65b9638cfbc8 [11:16:03] [02miraheze/PDFEmbed] 07translatewiki 0365b9638 - Localisation updates from https://translatewiki.net. [11:16:04] [02miraheze/YouTube] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/YouTube/compare/0c76812986e7...042700f17292 [11:16:06] [02miraheze/YouTube] 07translatewiki 03042700f - Localisation updates from https://translatewiki.net. [11:16:08] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/89ade4da395e...f36676cf45f7 [11:16:11] [02miraheze/CreateWiki] 07translatewiki 03f36676c - Localisation updates from https://translatewiki.net. [11:21:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.55, 3.51, 3.86 [11:22:58] miraheze/YouTube - translatewiki the build passed. [11:23:43] miraheze/PDFEmbed - translatewiki the build passed. [11:28:03] miraheze/CreateWiki - translatewiki the build passed. [11:28:06] miraheze/MirahezeMagic - translatewiki the build passed. [11:29:56] miraheze/ImportDump - translatewiki the build passed. [12:25:21] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 10.78, 8.31, 7.23 [12:27:21] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 8.97, 8.14, 7.28 [12:41:17] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [12:45:17] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [12:53:34] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 10.35, 9.64, 6.64 [12:54:48] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 10.52, 8.57, 7.41 [12:55:29] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 4.14, 7.74, 6.30 [12:58:42] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 9.21, 9.06, 7.87 [13:03:21] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 10.67, 9.49, 7.72 [13:05:21] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 14.81, 10.59, 8.28 [13:07:21] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 9.26, 10.70, 8.67 [13:09:21] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 5.92, 8.97, 8.28 [13:33:51] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 12.79, 9.41, 7.98 [13:34:03] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 13.90, 10.42, 8.32 [13:35:48] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 8.83, 9.21, 8.09 [13:36:03] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 10.10, 10.12, 8.47 [13:37:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 0.86, 1.65, 3.67 [13:39:38] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 10.77, 9.96, 8.63 [13:39:47] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 1.06, 1.52, 3.38 [13:41:35] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 8.48, 9.62, 8.67 [14:02:03] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 13.75, 10.60, 9.04 [14:02:08] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 15.79, 12.11, 10.01 [14:04:09] PROBLEM - db131 Current Load on db131 is CRITICAL: CRITICAL - load average: 11.76, 7.50, 4.36 [14:06:03] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 8.26, 10.69, 9.55 [14:06:08] RECOVERY - db131 Current Load on db131 is OK: OK - load average: 4.62, 6.35, 4.33 [14:07:58] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 8.87, 10.88, 10.32 [14:08:03] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 9.31, 10.16, 9.49 [14:15:45] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 8.27, 9.69, 10.04 [14:34:03] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 12.98, 10.29, 9.01 [14:34:05] PROBLEM - db131 Current Load on db131 is CRITICAL: CRITICAL - load average: 10.41, 7.05, 4.71 [14:38:03] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 9.99, 10.60, 9.48 [14:40:03] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 6.78, 9.34, 9.16 [14:42:05] PROBLEM - db131 Current Load on db131 is WARNING: WARNING - load average: 2.42, 7.84, 6.95 [14:44:05] RECOVERY - db131 Current Load on db131 is OK: OK - load average: 2.09, 5.86, 6.32 [15:32:50] RECOVERY - telepedia-wiki.org - reverse DNS on sslhost is OK: SSL OK - telepedia-wiki.org reverse DNS resolves to cp24.miraheze.org - NS RECORDS OK [16:05:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 8.27, 4.70, 2.64 [16:40:40] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.25, 6.68, 5.58 [16:42:40] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.59, 6.53, 5.66 [16:57:01] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.002661585808 secs [17:20:43] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.63, 7.63, 6.17 [17:22:43] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.85, 6.45, 5.92 [17:40:43] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 13.86, 9.84, 7.22 [17:41:19] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 14.15, 10.58, 7.35 [17:44:43] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.65, 7.70, 7.00 [17:47:14] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.42, 7.82, 7.19 [17:48:43] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.63, 8.23, 7.31 [17:50:43] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.71, 7.83, 7.29 [17:53:09] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.37, 5.92, 6.62 [17:54:43] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.85, 6.14, 6.70 [19:31:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.39, 2.77, 3.94 [19:35:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 7.85, 4.72, 4.41 [20:19:01] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1021329463 secs [21:43:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 1.19, 2.11, 3.99 [21:47:47] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 1.40, 1.58, 3.32 [22:17:38] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [22:47:39] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [23:02:58] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 12.93, 6.09, 2.79 [23:06:58] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 2.45, 5.99, 3.67