[00:11:22] RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 55099MiB (12% inode=99%); [00:27:20] [Grafana] RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [02:09:36] PROBLEM - wiki.lesunk.com - Cloudflare on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [03:00:50] RECOVERY - mon181 Backups Grafana on mon181 is OK: FILE_AGE OK: /var/log/grafana-backup.log is 30 seconds old and 93 bytes [04:03:22] PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 49825MiB (10% inode=99%); [07:20:26] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=ecopediawiki (END - exit=0) [07:20:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:20:33] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=ecopediawiki (END - exit=0) [07:20:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:20:48] !log [reception@mwtask181] starting deploy of {'files': '../mediawiki/1.42/extensions/SemanticMediaWiki/.smw.json'} to all [07:20:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:21:08] !log [reception@mwtask181] finished deploy of {'files': '../mediawiki/1.42/extensions/SemanticMediaWiki/.smw.json'} to all - SUCCESS in 19s [07:21:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:23:07] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=gejrfleaudacierwiki (END - exit=0) [07:23:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:23:12] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=gejrfleaudacierwiki (END - exit=0) [07:23:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:23:18] !log [reception@mwtask181] starting deploy of {'files': '../mediawiki/1.42/extensions/SemanticMediaWiki/.smw.json'} to all [07:23:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:23:36] !log [reception@mwtask181] finished deploy of {'files': '../mediawiki/1.42/extensions/SemanticMediaWiki/.smw.json'} to all - SUCCESS in 18s [07:23:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:27:37] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=gejrfleaudacierwiki sudo -u www-data php /srv/mediawiki/1.42/extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki qualtiversewikiwiki (END - exit=256) [07:27:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:27:56] !log sudo -u www-data php /srv/mediawiki/1.42/extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki qualtiversewikiwiki [07:27:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:28:40] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=gejrfleaudacierwiki sudo -u www-data php /srv/mediawiki/1.42/extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki qualtiversewikiwiki (END - exit=256) [07:28:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:29:10] !log sudo -u www-data php /srv/mediawiki/1.42/extensions/CirrusSearch/maintenance/ForceSearchIndex.php --wiki qualtiversewikiwiki --skipLinks --indexOnSkip [07:29:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:29:42] !log sudo -u www-data php /srv/mediawiki/1.42/extensions/CirrusSearch/maintenance/ForceSearchIndex.php --wiki qualtiversewikiwiki --skipParse [07:29:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:31:51] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=2b2tocewiki (END - exit=0) [07:31:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:31:55] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=2b2tocewiki (END - exit=0) [07:31:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:31:59] !log [reception@mwtask181] starting deploy of {'files': '../mediawiki/1.42/extensions/SemanticMediaWiki/.smw.json'} to all [07:32:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:32:18] !log [reception@mwtask181] finished deploy of {'files': '../mediawiki/1.42/extensions/SemanticMediaWiki/.smw.json'} to all - SUCCESS in 18s [07:32:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:33:11] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=alphacentauriwiki (END - exit=0) [07:33:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:33:44] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=alphacentauriwiki (END - exit=0) [07:33:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:33:47] !log [reception@mwtask181] starting deploy of {'files': '../mediawiki/1.42/extensions/SemanticMediaWiki/.smw.json'} to all [07:33:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:34:05] !log [reception@mwtask181] finished deploy of {'files': '../mediawiki/1.42/extensions/SemanticMediaWiki/.smw.json'} to all - SUCCESS in 18s [07:34:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:38:00] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=lingowiki (END - exit=0) [07:38:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:38:05] !log [reception@mwtask181] sudo -u www-data php /srv/mediawiki/1.42/maintenance/run.php /srv/mediawiki/1.42/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=lingowiki (END - exit=0) [07:38:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:38:09] !log [reception@mwtask181] starting deploy of {'files': '../mediawiki/1.42/extensions/SemanticMediaWiki/.smw.json'} to all [07:38:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:38:27] !log [reception@mwtask181] finished deploy of {'files': '../mediawiki/1.42/extensions/SemanticMediaWiki/.smw.json'} to all - SUCCESS in 18s [07:38:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:39:21] !log sudo -u www-data php /srv/mediawiki/1.42/extensions/CirrusSearch/maintenance/UpdateSearchIndexConfig.php --wiki utgwiki [07:39:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:39:42] !log sudo -u www-data php /srv/mediawiki/1.42/extensions/CirrusSearch/maintenance/ForceSearchIndex.php --wiki utgwiki --skipLinks --indexOnSkip [07:39:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:39:56] !log sudo -u www-data php /srv/mediawiki/1.42/extensions/CirrusSearch/maintenance/ForceSearchIndex.php --wiki utgwiki --skipParse [07:39:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:39:33] PROBLEM - db151 Backups SQL on db151 is WARNING: FILE_AGE WARNING: /var/log/db-backups/db-backups/db-backups.log is 1382634 seconds old and 1662408 bytes [18:31:38] PROBLEM - sptwiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'sptwiki.org' expires in 14 day(s) (Sun 26 Jan 2025 06:17:34 PM GMT +0000). [18:31:49] [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/718315e71ce4bcae5b53a2879ba5a9116299a298 [18:31:50] 02ssl/03master 07WikiTideSSLBot 03718315e Bot: Update SSL cert for sptwiki.org [18:39:42] PROBLEM - ourlifewiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'ourlifewiki.org' expires in 14 day(s) (Sun 26 Jan 2025 06:18:01 PM GMT +0000). [18:39:51] [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/e81407796cfabe3f1c7ce5125320449627353cef [18:39:51] 02ssl/03master 07WikiTideSSLBot 03e814077 Bot: Update SSL cert for ourlifewiki.org [18:45:22] PROBLEM - cp37 Disk Space on cp37 is CRITICAL: DISK CRITICAL - free space: / 27162MiB (5% inode=99%); [19:01:33] RECOVERY - sptwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'sptwiki.org' will expire on Fri 11 Apr 2025 05:33:12 PM GMT +0000. [19:37:42] RECOVERY - ourlifewiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'ourlifewiki.org' will expire on Fri 11 Apr 2025 05:41:16 PM GMT +0000.