[09:22:05] PROBLEM - MirahezeBots sopel on bots1 is UNKNOWN: Remote Icinga instance '100.node4.net.fosshost.org' is not connected to '112.node1.net.fosshost.org' [09:22:23] PROBLEM - streambot service on bots1 is UNKNOWN: Remote Icinga instance '100.node4.net.fosshost.org' is not connected to '112.node1.net.fosshost.org' [09:22:27] PROBLEM - swap on bots1 is UNKNOWN: Remote Icinga instance '100.node4.net.fosshost.org' is not connected to '112.node1.net.fosshost.org' [09:22:29] PROBLEM - discordirc-fhl service on bots1 is UNKNOWN: Remote Icinga instance '100.node4.net.fosshost.org' is not connected to '112.node1.net.fosshost.org' [09:22:33] PROBLEM - sopel beta service on bots1 is UNKNOWN: Remote Icinga instance '100.node4.net.fosshost.org' is not connected to '112.node1.net.fosshost.org' [09:22:35] em [09:22:35] PROBLEM - MirahezeBots SSL on bots1 is UNKNOWN: Remote Icinga instance '100.node4.net.fosshost.org' is not connected to '112.node1.net.fosshost.org' [09:22:39] PROBLEM - ping6 #page on bots1 is UNKNOWN: Remote Icinga instance '100.node4.net.fosshost.org' is not connected to '112.node1.net.fosshost.org' [09:22:43] PROBLEM - ping4 #page on bots1 is UNKNOWN: Remote Icinga instance '100.node4.net.fosshost.org' is not connected to '112.node1.net.fosshost.org' [09:22:47] PROBLEM - procs on bots1 is UNKNOWN: Remote Icinga instance '100.node4.net.fosshost.org' is not connected to '112.node1.net.fosshost.org' [09:22:49] PROBLEM - Flask-site on bots1 is UNKNOWN: Remote Icinga instance '100.node4.net.fosshost.org' is not connected to '112.node1.net.fosshost.org' [09:22:51] PROBLEM - users on bots1 is UNKNOWN: Remote Icinga instance '100.node4.net.fosshost.org' is not connected to '112.node1.net.fosshost.org' [09:22:55] PROBLEM - http on bots1 is UNKNOWN: Remote Icinga instance '100.node4.net.fosshost.org' is not connected to '112.node1.net.fosshost.org' [09:22:57] PROBLEM - disk / on bots1 is UNKNOWN: Remote Icinga instance '100.node4.net.fosshost.org' is not connected to '112.node1.net.fosshost.org' [09:22:59] PROBLEM - Apache on bots1 is UNKNOWN: Remote Icinga instance '100.node4.net.fosshost.org' is not connected to '112.node1.net.fosshost.org' [09:23:23] PROBLEM - Host bots1 is DOWN: PING CRITICAL - Packet loss = 100% [09:23:59] urgh [09:27:02] $log failover traffic to tools1 [09:37:35] ugochimobi: the whole node is down [09:37:59] ah [09:38:07] oh, i see join [09:38:17] AH, yeah [09:38:31] I was wondering [09:38:38] RECOVERY - Host bots1 is UP: PING OK - Packet loss = 0%, RTA = 139.36 ms [09:39:46] ugochimobi: host, crashed. hopefully alive now. [09:40:04] okay [09:40:52] RECOVERY - Puppet on bots1 is OK: OK: Puppet is currently enabled, last run 22 seconds ago with 0 failures [09:41:02] here comes a wild StreamBotMH [09:41:20] RECOVERY - StreamBot on bots1 is OK: PROCS OK: 1 process with command name 'python3' [09:42:32] yep [09:50:00] $log sudo rm -f /lib/systemd/system/discordircfh.service [09:50:08] $log restart all relays [09:50:32] $log sudo systemctl daemon-reload [09:50:47] no void-bot [09:54:04] ugochimobi: everything looks happy now [09:55:09] RhinosF1: ah, great then. [09:57:37] [2021-12-22 09:21:27,899] sopel.irc.backends ERROR - Server timeout detected after 125.59032s; closing. [09:57:54] socket.gaierror: [Errno -3] Temporary failure in name resolution [09:57:59] ugochimobi: looks like DNS [09:58:40] DNS? how? [09:59:33] no idea [10:00:11] ah [10:09:35] I see I just missed all the excitement [10:10:45] Sario: first outage of the freeze [10:10:58] task is UBN and I approved my own response [10:12:43] Sario: 70 emails from monitoring [10:13:16] Oh, that'll be fun to sort through this morning [19:05:33] [02MirahezeBots] 07dependabot[bot] pushed 031 commit to 03dependabot/pip/mypy-0.930 [+0/-0/±1] 13https://git.io/JyfN8 [19:05:34] [02MirahezeBots] 07dependabot[bot] 0303e765e - Bump mypy from 0.920 to 0.930 Bumps [mypy](https://github.com/python/mypy) from 0.920 to 0.930. - [Release notes](https://github.com/python/mypy/releases) - [Commits](https://github.com/python/mypy/compare/v0.920...v0.930) --- updated-dependencies: - dependency-name: mypy dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off- [19:05:34] by: dependabot[bot] [19:05:35] [url] GitHub - python/mypy: Optional static typing for Python | github.com [19:05:35] [url] Releases · python/mypy · GitHub | github.com [19:05:35] [url] Comparing v0.920...v0.930 · python/mypy · GitHub | github.com [19:05:36] [02MirahezeBots] 07dependabot[bot] opened pull request 03#625: Bump mypy from 0.920 to 0.930 - 13https://git.io/JyfN4 [19:05:37] [02MirahezeBots] 07dependabot[bot] created branch 03dependabot/pip/mypy-0.930 - 13https://git.io/JJ3ea [19:05:39] [02MirahezeBots] 07dependabot[bot] labeled pull request 03#625: Bump mypy from 0.920 to 0.930 - 13https://git.io/JyfN4 [19:05:40] [02MirahezeBots] 07dependabot[bot] labeled pull request 03#625: Bump mypy from 0.920 to 0.930 - 13https://git.io/JyfN4 [19:05:42] [02MirahezeBots] 07dependabot[bot] pushed 031 commit to 03dependabot/pip/setuptools-60.0.4 [+0/-0/±1] 13https://git.io/JyfNR [19:05:43] [02MirahezeBots] 07dependabot[bot] 037ce1b3f - Bump setuptools from 59.6.0 to 60.0.4 Bumps [setuptools](https://github.com/pypa/setuptools) from 59.6.0 to 60.0.4. - [Release notes](https://github.com/pypa/setuptools/releases) - [Changelog](https://github.com/pypa/setuptools/blob/main/CHANGES.rst) - [Commits](https://github.com/pypa/setuptools/compare/v59.6.0...v60.0.4) --- updated-dependencies: - dependency- [19:05:43] name: setuptools dependency-type: direct:development update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] [19:05:44] [url] GitHub - pypa/setuptools: Official project repository for the Setuptools build system | github.com [19:05:45] [url] Releases · pypa/setuptools · GitHub | github.com [19:05:45] [02MirahezeBots] 07dependabot[bot] created branch 03dependabot/pip/setuptools-60.0.4 - 13https://git.io/JJ3ea [19:05:46] [url] setuptools/CHANGES.rst at main · pypa/setuptools · GitHub | github.com [19:05:46] [02MirahezeBots] 07dependabot[bot] opened pull request 03#626: Bump setuptools from 59.6.0 to 60.0.4 - 13https://git.io/JyfN0 [19:05:47] [url] Comparing v59.6.0...v60.0.4 · pypa/setuptools · GitHub | github.com [19:05:48] [02MirahezeBots] 07dependabot[bot] labeled pull request 03#626: Bump setuptools from 59.6.0 to 60.0.4 - 13https://git.io/JyfN0 [19:05:49] [02MirahezeBots] 07dependabot[bot] labeled pull request 03#626: Bump setuptools from 59.6.0 to 60.0.4 - 13https://git.io/JyfN0 [19:05:51] [02MirahezeBots] 07dependabot[bot] commented on pull request 03#624: Bump setuptools from 59.6.0 to 60.0.3 - 13https://git.io/JyfNE [19:05:52] [02MirahezeBots] 07dependabot[bot] closed pull request 03#624: Bump setuptools from 59.6.0 to 60.0.3 - 13https://git.io/JDj0s [19:05:54] [02MirahezeBots] 07dependabot[bot] deleted branch 03dependabot/pip/setuptools-60.0.3 [19:05:55] [02MirahezeBots] 07dependabot[bot] deleted branch 03dependabot/pip/setuptools-60.0.3 - 13https://git.io/JJ3ea