[00:10:14] !log admin restarting nova-api on cloudcontrol1003 to try and recover whatever it's doing with designate_floating_ip_ptr_records_updater [00:10:17] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [05:42:40] Hi, wm-bb appears to be broken again. [05:43:49] * Catastros pokes bd808 [07:56:21] IIRC there is a policy for production wikis not to depend on tool labs. Anyone knows where to find that policy (because T166138)? [07:56:21] T166138: Please add Petit Formal Script to the UniversalLanguageSelector - https://phabricator.wikimedia.org/T166138 [07:58:02] something on https://wikitech.wikimedia.org/wiki/Cross-Realm_traffic_guidelines#Case_3:_generic_network_access_prod_--%3E_cloud, probably? (found via T285098) [07:58:03] T285098: Production A/B test deployment - Improved Property Suggester/Recommender - https://phabricator.wikimedia.org/T285098 [07:58:55] i would ask production sres, what production does is more their territory [07:59:00] Thanks [07:59:14] anyways, s/tool labs/toolforge/ (or cloud services, if more appropriate) [07:59:30] Tight, that too. Thanks! [08:03:40] andre: in this case, see also https://phabricator.wikimedia.org/T209998 [08:04:30] Thanks! that might be enough info for me to add a comment [08:36:00] !log toolsbeta resolve merge conflicts on labs/private [08:36:03] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [13:25:57] !log tools apply buster systemd security updates [13:26:01] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [15:17:39] !log tools.bridgebot Restarting becuase the bot is not working on all channels. Logs are inconclusive as to why. [15:17:42] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.bridgebot/SAL [15:45:04] !log admin failback from labstore1006 to labstore1007 (dumps NFS) https://gerrit.wikimedia.org/r/c/operations/puppet/+/705417 [15:45:07] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [17:07:31] !log admin reloading haproxy on dbproxy1018 for T286598 [17:07:34] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [17:07:35] T286598: Fail over clouddb1019, clouddb1020 for switch changes - https://phabricator.wikimedia.org/T286598 [17:34:40] !log added toolforge-jobs-framework-cli v3 to aptly buster-tools and buster-toolsbeta [17:34:41] arturo: Unknown project "added" [17:37:20] !log tools added toolforge-jobs-framework-cli v3 to aptly buster-tools and buster-toolsbeta [17:37:23] right [17:37:23] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [17:45:50] !log tools pushed new toolforge-jobs-framework-api docker image into the registry (3a6ae38d51202c5c765c8d800cb8380e2a20b998) (T286126 [17:45:54] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [17:45:54] T286126: toolforge-jobs: allow setting limits and requests - https://phabricator.wikimedia.org/T286126 [18:42:35] !log tools deploying systemd security tools on toolforge public stretch machines T287004 [18:42:40] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [18:42:41] T287004: CVE CVE-2021-33910 (systemd crash) on Cloud VPS - https://phabricator.wikimedia.org/T287004 [19:07:15] !log tools.quickcategories deployed b1f23a7801 (minor updates) [19:07:18] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quickcategories/SAL [19:09:21] !log toolsbeta upgraded version of maintain-kubeusers to the latest in master branch T285011 [19:09:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [19:09:24] T285011: Add process to stop and disable k8s jobs for disabled tools - https://phabricator.wikimedia.org/T285011 [19:22:21] !log tools.quickcategories deployed 1d17bc8e87 (update config loading code) [19:22:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.quickcategories/SAL [19:33:35] !log tools.pagepile-visual-filter deployed 93add9ed8b (update config loading code) [19:33:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.pagepile-visual-filter/SAL [19:36:43] !log tools.pagepile-visual-filter (and now also upgraded the venv accordingly, Flask v2 etc.) [19:36:45] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.pagepile-visual-filter/SAL [19:46:34] !log tools.ranker deployed f309990d5b (update config loading code; also upgraded venv, e.g. Flask v2) [19:46:37] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.ranker/SAL [21:04:01] hi all, I am seeing a weird behavior with VPS and external volumes [21:05:54] I have a VPS instance with two volumes that are attached to that same instance on /dev/sdb and /dev/sdb, but if I try to mount the volume on /dev/sdb I get an error and if I mount the volume on /dev/sdc I get the content (and size in terms of free space) of the fist volume [21:05:59] it is very confusing [21:06:26] what instance? [21:06:29] and what errors? [21:08:42] Reedy: the instance is called "backend" within the project "wikicommunityhealth" [21:10:03] Reedy: the error is the classical [21:10:08] `mount: /home/cristiancantoro/test: wrong fs type, bad option, bad superblock on /dev/sdb, missing codepage or helper program, or other error.` [21:18:36] !log toolsbeta applied `login_server: true` to toolsbeta-sgecron-01 T287037 [21:18:40] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [21:18:40] T287037: toolsbeta remote crontab is broken - https://phabricator.wikimedia.org/T287037 [22:44:19] CristianCantoro: the second might be that the volume you think is on sdb is actually on sdc [22:44:29] the first one is more weird, though