[00:00:00] RECOVERY - kafka181 APT on kafka181 is OK: APT OK: 120 packages available for upgrade (0 critical updates). [00:00:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:00:06] RECOVERY - eventgate181 APT on eventgate181 is OK: APT OK: 122 packages available for upgrade (0 critical updates). [00:00:06] !log [void@puppet181] Upgraded packages on mattermost1: libcups2 and libjson-xs-perl [00:00:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:00:23] !log [void@puppet181] Upgraded packages on bast161: libcups2 [00:00:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:00:35] !log [void@puppet181] Upgraded packages on mem151: libcups2 [00:00:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:00:43] RECOVERY - bast161 APT on bast161 is OK: APT OK: 112 packages available for upgrade (0 critical updates). [00:00:48] !log [void@puppet181] Upgraded packages on mem161: libcups2 [00:00:50] RECOVERY - bast181 APT on bast181 is OK: APT OK: 112 packages available for upgrade (0 critical updates). [00:00:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:01:01] !log [void@puppet181] Upgraded packages on mem201: libcups2 [00:01:02] RECOVERY - db181 APT on db181 is OK: APT OK: 122 packages available for upgrade (0 critical updates). [00:01:03] RECOVERY - mem201 APT on mem201 is OK: APT OK: 120 packages available for upgrade (0 critical updates). [00:01:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:01:10] RECOVERY - ldap171 APT on ldap171 is OK: APT OK: 112 packages available for upgrade (0 critical updates). [00:01:14] !log [void@puppet181] Upgraded packages on mem191: libcups2 [00:01:15] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/40bdb085cb173006ef0f6237794e3d895be34baa [00:01:15] 02statichelp/03main 07WikiTideBot 0340bdb08 Bot: Auto-update Tech namespace pages 2025-09-12 00:01:13 [00:01:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:01:27] !log [void@puppet181] Upgraded packages on mon181: libcups2 [00:01:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:01:35] RECOVERY - mem161 APT on mem161 is OK: APT OK: 120 packages available for upgrade (0 critical updates). [00:01:41] !log [void@puppet181] Upgraded packages on mw152: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:01:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:01:54] !log [void@puppet181] Upgraded packages on mw162: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:01:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:02:09] !log [void@puppet181] Upgraded packages on mw173: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:02:12] RECOVERY - mem191 APT on mem191 is OK: APT OK: 112 packages available for upgrade (0 critical updates). [00:02:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:02:23] !log [void@puppet181] Upgraded packages on mw161: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:02:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:02:33] RECOVERY - mem151 APT on mem151 is OK: APT OK: 120 packages available for upgrade (0 critical updates). [00:02:37] !log [void@puppet181] Upgraded packages on mw153: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:02:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:02:51] !log [void@puppet181] Upgraded packages on mw163: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:02:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:02:59] RECOVERY - mon181 APT on mon181 is OK: APT OK: 82 packages available for upgrade (0 critical updates). [00:03:05] !log [void@puppet181] Upgraded packages on mw151: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:03:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:03:19] !log [void@puppet181] Upgraded packages on mw172: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:03:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:03:32] !log [void@puppet181] Upgraded packages on mw191: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:03:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:03:46] !log [void@puppet181] Upgraded packages on mw171: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:03:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:04:01] !log [void@puppet181] Upgraded packages on mw181: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:04:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:04:14] !log [void@puppet181] Upgraded packages on mw202: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:04:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:04:28] !log [void@puppet181] Upgraded packages on mw192: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:04:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:04:33] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.25, 21.56, 21.19 [00:04:41] !log [void@puppet181] Upgraded packages on mw193: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:04:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:04:55] !log [void@puppet181] Upgraded packages on mw203: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:04:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:05:09] !log [void@puppet181] Upgraded packages on mw201: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:05:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:05:24] !log [void@puppet181] Upgraded packages on mw183: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:05:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:05:38] !log [void@puppet181] Upgraded packages on mw182: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:05:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:05:51] !log [void@puppet181] Upgraded packages on mwtask151: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:05:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:06:06] !log [void@puppet181] Upgraded packages on mwtask161: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:06:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:06:20] !log [void@puppet181] Upgraded packages on mwtask171: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:06:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:06:33] !log [void@puppet181] Upgraded packages on os151: libcups2 [00:06:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:06:48] !log [void@puppet181] Upgraded packages on ns1: libcups2 [00:06:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:07:01] !log [void@puppet181] Upgraded packages on os161: libcups2 [00:07:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:07:07] RECOVERY - ns1 APT on ns1 is OK: APT OK: 118 packages available for upgrade (0 critical updates). [00:07:13] !log [void@puppet181] Upgraded packages on prometheus151: libcups2 [00:07:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:07:26] !log [void@puppet181] Upgraded packages on rdb151: libcups2 [00:07:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:07:37] RECOVERY - os161 APT on os161 is OK: APT OK: 112 packages available for upgrade (0 critical updates). [00:07:39] !log [void@puppet181] Upgraded packages on reports171: libcups2 [00:07:41] RECOVERY - os151 APT on os151 is OK: APT OK: 114 packages available for upgrade (0 critical updates). [00:07:41] RECOVERY - prometheus151 APT on prometheus151 is OK: APT OK: 120 packages available for upgrade (0 critical updates). [00:07:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:07:51] !log [void@puppet181] Upgraded packages on phorge171: libcups2 [00:07:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:08:01] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 56586MiB (12% inode=99%); [00:08:06] !log [void@puppet181] Upgraded packages on os191: libcups2 [00:08:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:08:19] RECOVERY - rdb151 APT on rdb151 is OK: APT OK: 120 packages available for upgrade (0 critical updates). [00:08:21] !log [void@puppet181] Upgraded packages on mwtask181: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:08:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:08:29] RECOVERY - phorge171 APT on phorge171 is OK: APT OK: 77 packages available for upgrade (0 critical updates). [00:08:33] !log [void@puppet181] Upgraded packages on puppet181: libcups2 and libjson-xs-perl [00:08:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:08:44] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 56217MiB (12% inode=99%); [00:08:46] !log [void@puppet181] Upgraded packages on os162: libcups2 [00:08:52] RECOVERY - reports171 APT on reports171 is OK: APT OK: 116 packages available for upgrade (0 critical updates). [00:08:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:09:07] !log [void@puppet181] Upgraded packages on os202: libcups2 [00:09:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:09:16] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 56902MiB (12% inode=99%); [00:09:19] !log [void@puppet181] Upgraded packages on os201: libcups2 [00:09:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:09:36] !log [void@puppet181] Upgraded packages on swiftproxy161: libcups2 [00:09:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:09:51] RECOVERY - os202 APT on os202 is OK: APT OK: 75 packages available for upgrade (0 critical updates). [00:09:51] RECOVERY - os162 APT on os162 is OK: APT OK: 114 packages available for upgrade (0 critical updates). [00:09:52] !log [void@puppet181] Upgraded packages on ns2: libcups2 [00:09:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:09:59] RECOVERY - os191 APT on os191 is OK: APT OK: 112 packages available for upgrade (0 critical updates). [00:10:07] !log [void@puppet181] Upgraded packages on swiftobject191: libcups2 [00:10:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:10:21] RECOVERY - os201 APT on os201 is OK: APT OK: 84 packages available for upgrade (0 critical updates). [00:10:21] !log [void@puppet181] Upgraded packages on swiftobject161: libcups2 [00:10:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:10:28] RECOVERY - ns2 APT on ns2 is OK: APT OK: 117 packages available for upgrade (0 critical updates). [00:10:33] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.08, 23.27, 22.20 [00:10:37] !log [void@puppet181] Upgraded packages on swiftobject151: libcups2 [00:10:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:10:51] !log [void@puppet181] Upgraded packages on swiftobject171: libcups2 [00:11:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:11:07] !log [void@puppet181] Upgraded packages on swiftac171: libcups2 [00:11:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:11:20] !log [void@puppet181] Upgraded packages on test151: libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, imagemagick-6.q16, imagemagick, libcups2, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra [00:11:22] RECOVERY - swiftobject191 APT on swiftobject191 is OK: APT OK: 76 packages available for upgrade (0 critical updates). [00:11:22] RECOVERY - swiftproxy161 APT on swiftproxy161 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [00:11:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:11:37] !log [void@puppet181] Upgraded packages on swiftobject181: libcups2 [00:11:39] RECOVERY - swiftobject161 APT on swiftobject161 is OK: APT OK: 76 packages available for upgrade (0 critical updates). [00:11:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:11:51] !log [void@puppet181] Upgraded packages on swiftobject201: libcups2 [00:11:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:11:59] RECOVERY - swiftobject181 APT on swiftobject181 is OK: APT OK: 76 packages available for upgrade (0 critical updates). [00:12:07] !log [void@puppet181] Upgraded packages on swiftproxy171: libcups2 [00:12:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:12:18] RECOVERY - swiftobject151 APT on swiftobject151 is OK: APT OK: 76 packages available for upgrade (0 critical updates). [00:12:29] RECOVERY - swiftac171 APT on swiftac171 is OK: APT OK: 127 packages available for upgrade (0 critical updates). [00:12:34] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.60, 23.68, 22.47 [00:12:40] RECOVERY - swiftobject171 APT on swiftobject171 is OK: APT OK: 76 packages available for upgrade (0 critical updates). [00:13:07] RECOVERY - swiftproxy171 APT on swiftproxy171 is OK: APT OK: 129 packages available for upgrade (0 critical updates). [00:13:23] RECOVERY - swiftobject201 APT on swiftobject201 is OK: APT OK: 76 packages available for upgrade (0 critical updates). [00:16:33] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.50, 23.84, 22.84 [00:18:33] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.63, 24.56, 23.23 [00:20:34] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.51, 23.34, 22.97 [00:26:33] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 15.06, 17.25, 20.26 [00:45:36] !log [salt-user@mattermost1] Upgraded packages libcups2 libjson-xs-perl libperl5.36 perl perl-base perl-modules-5.36 [00:45:37] !log [salt-user@cloud15] Upgraded packages libcups2 libjson-xs-perl libperl5.36 perl perl-base perl-modules-5.36 [00:45:38] !log [salt-user@puppet181] Upgraded packages libcups2 libjson-xs-perl libperl5.36 perl perl-base perl-modules-5.36 [00:45:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:45:40] !log [salt-user@cloud17] Upgraded packages libcups2 libjson-xs-perl libperl5.36 perl perl-base perl-modules-5.36 [00:45:42] !log [salt-user@cloud18] Upgraded packages libcups2 libjson-xs-perl libperl5.36 perl perl-base perl-modules-5.36 [00:45:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:45:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:45:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:45:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:46:08] RECOVERY - cloud17 APT on cloud17 is OK: APT OK: 185 packages available for upgrade (0 critical updates). [00:46:40] RECOVERY - puppet181 APT on puppet181 is OK: APT OK: 83 packages available for upgrade (0 critical updates). [00:46:42] RECOVERY - mattermost1 APT on mattermost1 is OK: APT OK: 115 packages available for upgrade (0 critical updates). [00:47:00] RECOVERY - cloud15 APT on cloud15 is OK: APT OK: 186 packages available for upgrade (0 critical updates). [00:47:34] RECOVERY - cloud18 APT on cloud18 is OK: APT OK: 185 packages available for upgrade (0 critical updates). [00:48:51] !log [salt-user@cloud20] Upgraded packages libcups2 libjson-xs-perl libperl5.36 perl perl-base perl-modules-5.36 [00:48:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:50:29] RECOVERY - cloud20 APT on cloud20 is OK: APT OK: 187 packages available for upgrade (0 critical updates). [00:51:28] RECOVERY - cloud19 APT on cloud19 is OK: APT OK: 187 packages available for upgrade (0 critical updates). [00:51:53] !log [salt-user@test151] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:51:54] !log [salt-user@mw153] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:51:55] !log [salt-user@mw191] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:51:56] !log [salt-user@mw173] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:51:57] !log [salt-user@mwtask151] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:51:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:51:58] !log [salt-user@mw162] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:51:59] !log [salt-user@mw172] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:00] !log [salt-user@mw161] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:01] !log [salt-user@mw163] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:02] !log [salt-user@mw151] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:03] !log [salt-user@mw193] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:04] !log [salt-user@mw202] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:05] !log [salt-user@mw192] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:05] RECOVERY - mw192 APT on mw192 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:52:06] !log [salt-user@mwtask171] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:07] !log [salt-user@mw152] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:08] !log [salt-user@mw171] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:09] !log [salt-user@mwtask161] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:10] !log [salt-user@mw203] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:11] !log [salt-user@mw183] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:12] RECOVERY - cloud16 APT on cloud16 is OK: APT OK: 185 packages available for upgrade (0 critical updates). [00:52:12] !log [salt-user@mw182] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:13] !log [salt-user@mw201] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:14] !log [salt-user@mw181] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:15] !log [salt-user@mwtask181] Upgraded packages imagemagick imagemagick-6-common imagemagick-6.q16 libcups2 libimage-magick-perl libimage-magick-q16-perl libmagick++-6.q16-8 libmagickcore-6.q16-6 libmagickcore-6.q16-6-extra libmagickwand-6.q16-6 libperl5.36 perl perl-base perl-modules-5.36 [00:52:17] RECOVERY - test151 APT on test151 is OK: APT OK: 122 packages available for upgrade (0 critical updates). [00:52:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:23] RECOVERY - mw151 APT on mw151 is OK: APT OK: 135 packages available for upgrade (0 critical updates). [00:52:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:35] RECOVERY - mw181 APT on mw181 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:52:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:42] RECOVERY - mw182 APT on mw182 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:52:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:48] RECOVERY - mw203 APT on mw203 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:52:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:50] RECOVERY - mw153 APT on mw153 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:52:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:58] RECOVERY - mw193 APT on mw193 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:53:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:53:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:53:05] RECOVERY - mw152 APT on mw152 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:53:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:53:12] RECOVERY - mwtask171 APT on mwtask171 is OK: APT OK: 137 packages available for upgrade (0 critical updates). [00:53:13] RECOVERY - mw201 APT on mw201 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:53:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:53:16] RECOVERY - mw183 APT on mw183 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:53:16] RECOVERY - mw163 APT on mw163 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:53:17] RECOVERY - mw162 APT on mw162 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:53:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:53:20] RECOVERY - mwtask161 APT on mwtask161 is OK: APT OK: 137 packages available for upgrade (0 critical updates). [00:53:20] RECOVERY - mw172 APT on mw172 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:53:24] RECOVERY - mwtask151 APT on mwtask151 is OK: APT OK: 137 packages available for upgrade (0 critical updates). [00:53:29] RECOVERY - mwtask181 APT on mwtask181 is OK: APT OK: 137 packages available for upgrade (0 critical updates). [00:53:31] RECOVERY - mw161 APT on mw161 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:53:33] RECOVERY - mw202 APT on mw202 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:53:33] RECOVERY - mw191 APT on mw191 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:53:53] RECOVERY - mw171 APT on mw171 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [00:53:54] RECOVERY - mw173 APT on mw173 is OK: APT OK: 133 packages available for upgrade (0 critical updates). [01:22:33] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.39, 19.98, 18.34 [01:24:33] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 16.37, 18.48, 17.98 [01:48:33] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.18, 19.19, 17.30 [02:12:33] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.07, 22.80, 21.20 [02:14:33] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.38, 22.17, 21.19 [02:22:33] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.24, 22.05, 21.18 [02:26:33] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.15, 22.11, 21.48 [02:30:33] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.40, 23.13, 22.00 [02:49:13] PROBLEM - matomo151 Check unit status of matomo-archiver-3 on matomo151 is CRITICAL: CRITICAL: Status of the systemd unit matomo-archiver-3 [03:17:20] [Grafana] FIRING: The mediawiki job queue has more than 100000 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?from=1757579810000&orgId=1&to=1757647040155 [03:56:33] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.77, 22.66, 23.90 [04:02:33] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.63, 22.55, 23.22 [04:04:33] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.32, 22.43, 23.10 [04:14:33] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 14.39, 16.65, 19.87 [04:41:20] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.64, 20.03, 18.45 [04:43:17] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.78, 20.44, 18.79 [04:48:05] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [04:51:06] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 15.93, 19.54, 19.27 [04:56:04] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [05:30:04] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [05:36:04] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [05:48:33] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.74, 19.81, 17.49 [05:52:33] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 20.32, 20.35, 18.27 [05:56:33] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.89, 21.52, 19.23 [06:02:20] [Grafana] RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?from=1757579810000&orgId=1&to=1757656910000 [06:02:33] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.03, 23.55, 20.86 [06:04:33] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.61, 23.10, 21.04 [06:06:34] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.24, 23.49, 21.43 [06:18:04] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [06:26:04] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [06:50:04] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [06:50:44] PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 49832MiB (10% inode=99%); [06:56:04] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [07:04:05] PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 10.30, 7.41, 3.45 [07:06:03] RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 1.77, 5.10, 3.08 [07:08:33] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 10.91, 20.64, 23.96 [07:12:33] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 7.60, 13.30, 20.15 [07:18:05] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [07:20:01] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 49854MiB (10% inode=99%); [07:26:04] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [07:33:16] PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 49924MiB (10% inode=99%); [08:03:13] RECOVERY - matomo151 Check unit status of matomo-archiver-3 on matomo151 is OK: OK: Status of the systemd unit matomo-archiver-3 [08:10:04] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [08:16:04] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [08:38:04] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [08:46:05] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [08:56:51] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/a3a21367c7e3a79a5ed6c214977772b86ef4da0c [08:56:51] 02ssl/03main 07WikiTideBot 03a3a2136 Bot: Auto-update domain lists [09:28:04] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [09:36:04] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [11:35:55] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/39cc8d3a9308edd409fe700d30ea364b2dffe766 [11:35:56] 02ssl/03main 07WikiTideBot 0339cc8d3 Bot: Auto-update domain lists [13:05:39] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/ea15614c6fc472224005506a3ebc6971322d432f [13:05:39] 02ssl/03main 07WikiTideBot 03ea15614 Bot: Auto-update domain lists [13:15:52] PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 11.24, 9.52, 5.12 [13:17:52] RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 2.58, 6.70, 4.61 [14:06:34] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.89, 15.51, 10.16 [14:08:05] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [14:08:33] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 19.89, 17.04, 11.39 [14:16:04] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [14:20:17] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.58, 19.71, 15.85 [14:21:03] [02ssl] 07pskyechology pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/e062ab5092750567019d96779fc567385666b795 [14:21:03] 02ssl/03main 07Skye 03e062ab5 Redirect skibiditoilet.miraheze.org to skibidi-toilet.wiki [14:22:14] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 19.57, 20.05, 16.45 [14:26:06] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.79, 20.98, 17.61 [14:30:01] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.60, 22.47, 18.91 [14:33:56] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.31, 22.41, 19.74 [14:46:13] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.37, 23.39, 21.80 [14:48:12] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.55, 22.74, 21.73 [14:52:11] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.91, 23.61, 22.29 [14:56:09] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.78, 23.64, 22.65 [14:58:08] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.42, 24.05, 22.93 [15:00:08] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.93, 23.49, 22.86 [15:12:05] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.08, 23.46, 23.05 [15:18:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.79, 23.89, 23.42 [15:26:05] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 26.96, 24.73, 23.88 [15:28:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 14.20, 21.63, 22.91 [15:32:05] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 7.53, 13.46, 19.20 [15:47:53] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [15:55:53] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [16:14:40] [02mw-config] 07pskyechology opened pull request #6103: T13517: Add SearchDigest extension (07miraheze:03main...07pskyechology:03searchdigest) 13https://github.com/miraheze/mw-config/pull/6103 [16:15:41] miraheze/mw-config - pskyechology the build passed. [16:22:31] [02mw-config] 07pskyechology left a file comment in pull request #6103 03a9a943e: @Universal-Omega Did we get that patch for supporting indexes like this yet? […] 13https://github.com/miraheze/mw-config/pull/6103#discussion_r2344784525 [16:33:23] [02mw-config] 07pskyechology opened pull request #6104: Add researcher protection level for weltseelewiki (07miraheze:03main...07pskyechology:03T14267) 13https://github.com/miraheze/mw-config/pull/6104 [16:34:11] miraheze/mw-config - pskyechology the build passed. [16:34:44] [02mw-config] 07pskyechology merged pull request #6104: Add researcher protection level for weltseelewiki (07miraheze:03main...07pskyechology:03T14267) 13https://github.com/miraheze/mw-config/pull/6104 [16:34:46] [02mw-config] 07pskyechology pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/fe74942c6bd364e112b1610d74939cffa9c5fe3a [16:34:48] 02mw-config/03main 07Skye 03fe74942 Add researcher protection level for weltseelewiki (#6104)… [16:35:06] !log [skye@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [16:35:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:35:31] !log [skye@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s [16:35:33] miraheze/mw-config - pskyechology the build passed. [16:35:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:36:44] [02puppet] 07Universal-Omega created 03mediamoderation-concurrency (+1 new commit) 13https://github.com/miraheze/puppet/commit/474c697c9f35 [16:36:44] 02puppet/03mediamoderation-concurrency 07CosmicAlpha 03474c697 changeprop201: increase mediaModerationScanFileJob concurrency to 25 [16:36:49] [02puppet] 07Universal-Omega opened pull request #4519: changeprop201: increase mediaModerationScanFileJob concurrency to 25 (03main...03mediamoderation-concurrency) 13https://github.com/miraheze/puppet/pull/4519 [16:36:56] [02puppet] 07coderabbitai[bot] commented on pull request #4519:
[…] 13https://github.com/miraheze/puppet/pull/4519#issuecomment-3286009436 [16:43:08] [02puppet] 07Universal-Omega un-readied pull request #4519: changeprop201: increase mediaModerationScanFileJob concurrency to 25 (03main...03mediamoderation-concurrency) 13https://github.com/miraheze/puppet/pull/4519 [16:56:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.40, 19.29, 12.61 [17:00:06] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.26, 21.52, 15.02 [17:04:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.98, 23.12, 17.20 [17:06:44] [02puppet] 07pskyechology opened pull request #4520: CSP: Add clips.twitch.tv to frame-src (07miraheze:03main...07pskyechology:03T13677) 13https://github.com/miraheze/puppet/pull/4520 [17:06:50] [02puppet] 07coderabbitai[bot] commented on pull request #4520:
[…] 13https://github.com/miraheze/puppet/pull/4520#issuecomment-3286131912 [17:08:06] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.09, 23.41, 18.65 [17:09:53] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [17:10:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.37, 23.07, 19.09 [17:11:32] PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 23.88, 20.02, 14.69 [17:12:05] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.60, 23.43, 19.69 [17:13:32] RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 19.91, 19.50, 15.13 [17:14:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.02, 23.23, 20.07 [17:15:53] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [17:16:05] PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.07, 23.63, 20.61 [17:18:05] PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.53, 22.93, 20.73 [17:28:05] RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 11.03, 17.14, 19.23 [17:30:31] PROBLEM - bast161 Current Load on bast161 is WARNING: LOAD WARNING - total load average: 0.99, 1.71, 0.85 [17:32:30] RECOVERY - bast161 Current Load on bast161 is OK: LOAD OK - total load average: 0.14, 1.15, 0.74 [17:38:36] !log [skye@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php MirahezeMagic:RenameDatabase --wiki=loginwiki --rename --old=twanpcwiki --new=beesproductionswiki --user=Skye (END - exit=0) [17:38:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:42:51] !log [skye@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php CreateWiki:SetContainersAccess --wiki=beesproductionswiki (END - exit=0) [17:42:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:48:07] !log [skye@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php MirahezeMagic:RenameDatabase --wiki=loginwiki --rename --old=furthestcontinentwiki --new=simdreamwebwiki --user=Skye (END - exit=0) [17:48:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:49:09] !log [skye@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php CreateWiki:SetContainersAccess --wiki=simdreamwebwiki (END - exit=0) [17:49:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:57:00] !log [skye@mwtask181] Starting import for utaitewiki (XML: ./utaite.xml; Images: None) (START) [17:57:01] !log [skye@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php importDump --wiki=utaitewiki --no-updates --username-prefix=fandom:utaite -- ./utaite.xml (START) [17:57:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:57:07] !log [skye@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php importDump --wiki=utaitewiki --no-updates --username-prefix=fandom:utaite -- ./utaite.xml (END - exit=1) [17:57:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:57:08] !log [skye@mwtask181] Finished import for utaitewiki (XML: ./utaite.xml; Images: None) (END - exit=1) [17:57:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:57:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:57:54] extra content at the end of line aint that fun [18:07:53] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [18:26:10] PROBLEM - matomo151 Disk Space on matomo151 is WARNING: DISK WARNING - free space: / 1959MiB (10% inode=89%); [19:05:53] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [19:09:53] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [19:15:53] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [19:38:50] !log [skye@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php MirahezeMagic:RenameDatabase --wiki=loginwiki --rename --old=aeropediawiki --new=aircyclopediawiki --user=Skye (END - exit=0) [19:38:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:39:39] !log [skye@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php CreateWiki:SetContainersAccess --wiki=aircyclopediawiki (END - exit=0) [19:39:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:27:53] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [20:35:53] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [20:47:53] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [21:02:10] RECOVERY - matomo151 Disk Space on matomo151 is OK: DISK OK - free space: / 6174MiB (34% inode=89%); [21:05:53] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [21:17:53] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [21:23:46] !log [somerandomdeveloper@test151] starting deploy of {'versions': '1.44', 'upgrade_extensions': 'RightFunctions'} to test151 [21:23:47] !log [somerandomdeveloper@test151] finished deploy of {'versions': '1.44', 'upgrade_extensions': 'RightFunctions'} to test151 - SUCCESS in 1s [21:23:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:23:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:24:10] !log [somerandomdeveloper@mwtask181] starting deploy of {'versions': '1.44', 'upgrade_extensions': 'RightFunctions'} to all [21:24:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:24:34] !log [somerandomdeveloper@mwtask181] finished deploy of {'versions': '1.44', 'upgrade_extensions': 'RightFunctions'} to all - SUCCESS in 24s [21:24:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:25:53] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [21:26:59] !log [somerandomdeveloper@test151] starting deploy of {'versions': '1.45', 'upgrade_extensions': 'RightFunctions'} to test151 [21:27:00] !log [somerandomdeveloper@test151] finished deploy of {'versions': '1.45', 'upgrade_extensions': 'RightFunctions'} to test151 - SUCCESS in 0s [21:27:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:27:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:47:53] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [22:05:53] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [22:58:39] [02mw-config] 07Universal-Omega merged pull request #6095: Temporarily duplicate dynamicpagelist3 to dynamicpagelist4 (03main...03dpl4) 13https://github.com/miraheze/mw-config/pull/6095 [22:58:41] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/a2e77607a9c4bd81774c0036db7c5c2321d76a94 [22:58:43] 02mw-config/03main 07CosmicAlpha 03a2e7760 Temporarily duplicate dynamicpagelist3 to dynamicpagelist4… [22:58:45] [02mw-config] 07Universal-Omega 04deleted 03dpl4 at 0389800df 13https://api.github.com/repos/miraheze/mw-config/commit/89800df [22:59:33] miraheze/mw-config - Universal-Omega the build passed. [23:02:32] !log [universalomega@test151] sudo -u www-data /usr/local/bin/foreachwikiindblist /tmp/dynamicpagelist3.php /srv/mediawiki/1.44/maintenance/run.php ManageWiki:ToggleExtension --name=dynamicpagelist4 (START) [23:02:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:02:36] !log [universalomega@test151] sudo -u www-data /usr/local/bin/foreachwikiindblist /tmp/dynamicpagelist3.php /srv/mediawiki/1.44/maintenance/run.php ManageWiki:ToggleExtension --name=dynamicpagelist4 (END - exit=0) [23:02:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:04:33] !log [universalomega@test151] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php ManageWiki:ToggleExtension --wiki=metawikibeta --name=dynamicpagelist3 --disable --all-wikis --execute (END - exit=0) [23:04:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:06:21] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [23:06:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:06:45] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 24s [23:06:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:07:11] !log [universalomega@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /tmp/dynamicpagelist3.php /srv/mediawiki/1.44/maintenance/run.php ManageWiki:ToggleExtension --name=dynamicpagelist4 (START) [23:07:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:10:01] [02mw-config] 07Universal-Omega created 03remove-dynamicpagelist3 (+1 new commit) 13https://github.com/miraheze/mw-config/commit/bb406d2f5e73 [23:10:01] 02mw-config/03remove-dynamicpagelist3 07CosmicAlpha 03bb406d2 Remove dynamicpagelist3… [23:10:05] [02mw-config] 07Universal-Omega opened pull request #6105: Remove dynamicpagelist3 (03main...03remove-dynamicpagelist3) 13https://github.com/miraheze/mw-config/pull/6105 [23:11:00] miraheze/mw-config - Universal-Omega the build passed. [23:26:00] !log [universalomega@mwtask181] sudo -u www-data /usr/local/bin/foreachwikiindblist /tmp/dynamicpagelist3.php /srv/mediawiki/1.44/maintenance/run.php ManageWiki:ToggleExtension --name=dynamicpagelist4 (END - exit=0) [23:26:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:27:21] [02mw-config] 07Universal-Omega merged pull request #6105: Remove dynamicpagelist3 (03main...03remove-dynamicpagelist3) 13https://github.com/miraheze/mw-config/pull/6105 [23:27:23] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/4aaea5b6961ba0c664f96bcd0c92f03b2cc9edec [23:27:25] [02mw-config] 07Universal-Omega 04deleted 03remove-dynamicpagelist3 at 03bb406d2 13https://api.github.com/repos/miraheze/mw-config/commit/bb406d2 [23:27:26] 02mw-config/03main 07CosmicAlpha 034aaea5b Remove dynamicpagelist3… [23:27:27] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [23:27:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:27:51] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 23s [23:27:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:28:18] miraheze/mw-config - Universal-Omega the build passed. [23:30:42] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.44/maintenance/run.php ManageWiki:ToggleExtension --wiki=metawiki --name=dynamicpagelist3 --disable --all-wikis --execute (END - exit=0) [23:30:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log