[08:47:05] 10Release-Engineering-Team (Radar), 10serviceops: Puppet failure on deploy-1002.devtools.eqiad1.wikimedia.cloud due to missing profile::kubernetes::deployment_server::user_defaults - https://phabricator.wikimedia.org/T294174 (10hashar) Thanks for the missing Kafka / Zookeeper settings, I could not figure them... [09:39:47] 10Release-Engineering-Team (Doing): Change notification email from jenkins-bot@wikimedia.org to releng internal list - https://phabricator.wikimedia.org/T151642 (10hashar) [10:01:28] 10Release-Engineering-Team (Doing): Change notification email from jenkins-bot@wikimedia.org to releng internal list - https://phabricator.wikimedia.org/T151642 (10hashar) Thank you @Gehel. I have send an email to each mailing lists owners with the detailed instructions. [10:01:41] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Doing): Change notification email from jenkins-bot@wikimedia.org to releng internal list - https://phabricator.wikimedia.org/T151642 (10hashar) [10:04:24] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban): zuul git-daemon sometime reject connections: Too many children, dropping connection - https://phabricator.wikimedia.org/T222661 (10hashar) After raising to 96 max connections, I have checked on contint2001 and contint1001 with:... [10:55:53] (03PS1) 10Kosta Harlan: [WIP] PhpWebserver: Start second backend for ResourceLoader requests [integration/quibble] - 10https://gerrit.wikimedia.org/r/738359 [10:58:50] 10Continuous-Integration-Infrastructure, 10Jenkins: Remove Performance plugin from CI Jenkins - https://phabricator.wikimedia.org/T295577 (10hashar) [11:01:27] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Doing): Change notification email from jenkins-bot@wikimedia.org to releng internal list - https://phabricator.wikimedia.org/T151642 (10Lucas_Werkmeister_WMDE) I received the email, but it doesn’t look like there’s anything left to be done fo... [11:02:05] (03PS1) 10Hashar: jjb: stop using Performance publisher [integration/config] - 10https://gerrit.wikimedia.org/r/738361 (https://phabricator.wikimedia.org/T295577) [11:03:20] (03PS1) 10Kosta Harlan: [DNM] Test run with ResourceLoader backend [integration/quibble] - 10https://gerrit.wikimedia.org/r/738362 [11:03:42] (03PS1) 10Hashar: jjb: remove selenium defaults [integration/config] - 10https://gerrit.wikimedia.org/r/738363 [11:05:03] (03CR) 10Hashar: [C: 03+2] jjb: stop using Performance publisher [integration/config] - 10https://gerrit.wikimedia.org/r/738361 (https://phabricator.wikimedia.org/T295577) (owner: 10Hashar) [11:05:05] (03CR) 10jerkins-bot: [V: 04-1] [WIP] PhpWebserver: Start second backend for ResourceLoader requests [integration/quibble] - 10https://gerrit.wikimedia.org/r/738359 (owner: 10Kosta Harlan) [11:06:18] !log Restarting CI Jenkins to remove the Performance plugin T295577 [11:06:21] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:06:21] T295577: Remove Performance plugin from CI Jenkins - https://phabricator.wikimedia.org/T295577 [11:06:50] (03Merged) 10jenkins-bot: jjb: stop using Performance publisher [integration/config] - 10https://gerrit.wikimedia.org/r/738361 (https://phabricator.wikimedia.org/T295577) (owner: 10Hashar) [11:12:08] (03CR) 10Hashar: [C: 03+2] "Noop in JJB" [integration/config] - 10https://gerrit.wikimedia.org/r/738363 (owner: 10Hashar) [11:12:18] 10Continuous-Integration-Infrastructure, 10Jenkins: Remove Performance plugin from CI Jenkins - https://phabricator.wikimedia.org/T295577 (10hashar) 05Open→03Resolved a:03hashar [11:13:55] (03Merged) 10jenkins-bot: jjb: remove selenium defaults [integration/config] - 10https://gerrit.wikimedia.org/r/738363 (owner: 10Hashar) [11:15:11] (03CR) 10jerkins-bot: [V: 04-1] [DNM] Test run with ResourceLoader backend [integration/quibble] - 10https://gerrit.wikimedia.org/r/738362 (owner: 10Kosta Harlan) [11:29:02] 10Release-Engineering-Team (Radar), 10GitLab, 10Security-Team, 10serviceops: Setup GitLab Runner in trusted environment - https://phabricator.wikimedia.org/T295481 (10Jelto) >>! In T295481#7496769, @Dzahn wrote: > > That sound good to me. Jelto, would you already have "hardware" requirements for the VMs?... [11:34:47] (03PS2) 10Kosta Harlan: [WIP] PhpWebserver: Start second backend for ResourceLoader requests [integration/quibble] - 10https://gerrit.wikimedia.org/r/738359 [11:34:53] (03PS2) 10Kosta Harlan: [DNM] Test run with ResourceLoader backend [integration/quibble] - 10https://gerrit.wikimedia.org/r/738362 [11:42:25] (03CR) 10jerkins-bot: [V: 04-1] [WIP] PhpWebserver: Start second backend for ResourceLoader requests [integration/quibble] - 10https://gerrit.wikimedia.org/r/738359 (owner: 10Kosta Harlan) [11:42:45] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Seen), 10Zuul, 10ci-test-error (WMF-deployed Build Failure): fatal: remote error: access denied or repository not exported: /mediawiki/extensions/ReadingLists - https://phabricator.wikimedia.org/T187897 (10hashar) And on the Zuul-merge, i... [11:47:47] (03PS3) 10Kosta Harlan: [WIP] PhpWebserver: Start second backend for ResourceLoader requests [integration/quibble] - 10https://gerrit.wikimedia.org/r/738359 [11:47:53] (03PS3) 10Kosta Harlan: [DNM] Test run with ResourceLoader backend [integration/quibble] - 10https://gerrit.wikimedia.org/r/738362 [11:50:21] (03PS4) 10Kosta Harlan: [DNM] Test run with ResourceLoader backend [integration/quibble] - 10https://gerrit.wikimedia.org/r/738362 [11:51:22] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Radar): docker-reporter-releng-images => docker registry: status=3/NOTIMPLEMENTED - https://phabricator.wikimedia.org/T292485 (10hashar) 05Open→03Resolved Looks fixed now. [12:12:57] (03CR) 10jerkins-bot: [V: 04-1] [DNM] Test run with ResourceLoader backend [integration/quibble] - 10https://gerrit.wikimedia.org/r/738362 (owner: 10Kosta Harlan) [12:14:16] PROBLEM - SSH on contint1001.mgmt is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [12:24:47] (03PS5) 10Kosta Harlan: [DNM] Test run with ResourceLoader backend (more deps) [integration/quibble] - 10https://gerrit.wikimedia.org/r/738362 [12:24:53] (03PS1) 10Kosta Harlan: [DNM] Test with ResourceLoader backend (normal) [integration/quibble] - 10https://gerrit.wikimedia.org/r/738373 [12:36:22] (03PS3) 10Pwirth: Add Forms [integration/config] - 10https://gerrit.wikimedia.org/r/738237 [12:47:01] (03PS3) 10Pwirth: Add Workflows [integration/config] - 10https://gerrit.wikimedia.org/r/738238 [12:47:14] (03CR) 10jerkins-bot: [V: 04-1] [DNM] Test run with ResourceLoader backend (more deps) [integration/quibble] - 10https://gerrit.wikimedia.org/r/738362 (owner: 10Kosta Harlan) [12:49:52] (03CR) 10Hashar: [C: 03+2] Add Forms [integration/config] - 10https://gerrit.wikimedia.org/r/738237 (owner: 10Pwirth) [12:50:05] (03CR) 10Hashar: [C: 03+2] Add Workflows [integration/config] - 10https://gerrit.wikimedia.org/r/738238 (owner: 10Pwirth) [12:51:41] (03Merged) 10jenkins-bot: Add Forms [integration/config] - 10https://gerrit.wikimedia.org/r/738237 (owner: 10Pwirth) [12:51:50] (03Merged) 10jenkins-bot: Add Workflows [integration/config] - 10https://gerrit.wikimedia.org/r/738238 (owner: 10Pwirth) [12:52:40] (03CR) 10Hashar: "Deployed!" [integration/config] - 10https://gerrit.wikimedia.org/r/738238 (owner: 10Pwirth) [13:31:19] (03CR) 10Hashar: [C: 03+2] Add StandardDialogs [integration/config] - 10https://gerrit.wikimedia.org/r/738239 (owner: 10Pwirth) [13:31:25] (03CR) 10Hashar: [C: 03+2] Add UnifiedTaskOverview [integration/config] - 10https://gerrit.wikimedia.org/r/738240 (owner: 10Pwirth) [13:31:29] (03CR) 10Hashar: [C: 03+2] Add PageCheckout [integration/config] - 10https://gerrit.wikimedia.org/r/738242 (owner: 10Pwirth) [13:33:15] (03Merged) 10jenkins-bot: Add StandardDialogs [integration/config] - 10https://gerrit.wikimedia.org/r/738239 (owner: 10Pwirth) [13:33:17] (03Merged) 10jenkins-bot: Add UnifiedTaskOverview [integration/config] - 10https://gerrit.wikimedia.org/r/738240 (owner: 10Pwirth) [13:33:24] (03Merged) 10jenkins-bot: Add PageCheckout [integration/config] - 10https://gerrit.wikimedia.org/r/738242 (owner: 10Pwirth) [13:45:24] (03CR) 10Hashar: Adjust cache settings for more performant browser tests (034 comments) [integration/quibble] - 10https://gerrit.wikimedia.org/r/738252 (owner: 10Kosta Harlan) [13:46:32] (03CR) 10Hashar: "Deployed!" [integration/config] - 10https://gerrit.wikimedia.org/r/738242 (owner: 10Pwirth) [14:09:14] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Doing), 10Zuul, 10observability, 10Patch-For-Review: Migrate Zuul alerting to Grafana / AlertManager - https://phabricator.wikimedia.org/T292284 (10hashar) I have checked the panel https://grafana-rw.wikimedia.org/d/000000322/zuul-gearm... [14:21:08] 10Gerrit, 10Release-Engineering-Team (Radar), 10SRE, 10observability, 10Patch-For-Review: Add prometheus exporter to Gerrit - https://phabricator.wikimedia.org/T184086 (10hashar) a:05hashar→03None [14:28:51] 10Continuous-Integration-Infrastructure, 10Quibble, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), and 2 others: Terminating MySQL takes several minutes in (Wikibase?) CI jobs - https://phabricator.wikimedia.org/T265615 (10hashar) Quibbl... [14:33:21] 10Gerrit, 10Wikidata, 10Wikidata Query UI: wikidata-query-gui-build doesn’t work when latest commit is by dependabot (commit-msg hook adds Change-Id in wrong place) - https://phabricator.wikimedia.org/T295601 (10Lucas_Werkmeister_WMDE) [14:35:12] 10Gerrit, 10Wikidata, 10Wikidata Query UI: wikidata-query-gui-build doesn’t work when latest commit is by dependabot (commit-msg hook adds Change-Id in wrong place) - https://phabricator.wikimedia.org/T295601 (10Lucas_Werkmeister_WMDE) The above is with the commit-msg hook from Gerrit 3.3.6 (according to the... [14:35:27] 10Continuous-Integration-Infrastructure, 10Quibble, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), and 2 others: Terminating MySQL takes several minutes in (Wikibase?) CI jobs - https://phabricator.wikimedia.org/T265615 (10hashar) Pfff I... [14:40:23] 10Continuous-Integration-Infrastructure, 10Quibble, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), and 2 others: Terminating MySQL takes several minutes in (Wikibase?) CI jobs - https://phabricator.wikimedia.org/T265615 (10Lucas_Werkmeist... [14:43:28] 10Gerrit, 10Wikidata, 10Wikidata Query UI: wikidata-query-gui-build doesn’t work when latest commit is by dependabot (commit-msg hook adds Change-Id in wrong place) - https://phabricator.wikimedia.org/T295601 (10Lucas_Werkmeister_WMDE) The recommended **workaround** is to **create and merge another commit wi... [14:56:57] Lucas_WMDE: sorry about the confusion about that task regarding MySQL being slow to terminate [14:57:07] I went reinvestigating the code again and trying stuff [14:57:12] np, it is confusing :/ [14:57:20] until I reread the task and came back to "the disk is too slow" :D [14:57:21] I tried to make it a bit better [14:57:28] yeah I have noticed. thanks! [14:57:56] maybe there is some magic settng that would let us make the disk IO faster [15:19:07] 10Gerrit, 10Wikidata, 10Wikidata Query UI, 10wdwb-tech: wikidata-query-gui-build doesn’t work when latest commit is by dependabot (commit-msg hook adds Change-Id in wrong place) - https://phabricator.wikimedia.org/T295601 (10Lucas_Werkmeister_WMDE) [15:40:53] (03CR) 10Kosta Harlan: "Well, this was interesting to explore, but it does not give us any specific benefits over using HTTP/php-fpm (T276428), and it offers the " [integration/quibble] - 10https://gerrit.wikimedia.org/r/738359 (owner: 10Kosta Harlan) [15:40:56] (03Abandoned) 10Kosta Harlan: [WIP] PhpWebserver: Start second backend for ResourceLoader requests [integration/quibble] - 10https://gerrit.wikimedia.org/r/738359 (owner: 10Kosta Harlan) [15:41:00] (03Abandoned) 10Kosta Harlan: [DNM] Test with ResourceLoader backend (normal) [integration/quibble] - 10https://gerrit.wikimedia.org/r/738373 (owner: 10Kosta Harlan) [15:41:05] (03Abandoned) 10Kosta Harlan: [DNM] Test run with ResourceLoader backend (more deps) [integration/quibble] - 10https://gerrit.wikimedia.org/r/738362 (owner: 10Kosta Harlan) [15:52:44] (03CR) 10Ahmon Dancy: [C: 04-1] "Superseded by https://gerrit.wikimedia.org/r/c/mediawiki/tools/scap/+/738024" [tools/scap] - 10https://gerrit.wikimedia.org/r/657832 (https://phabricator.wikimedia.org/T272760) (owner: 10Reedy) [15:53:53] (03Abandoned) 10Reedy: [WIP] Better handling of scap_lint errors [tools/scap] - 10https://gerrit.wikimedia.org/r/657832 (https://phabricator.wikimedia.org/T272760) (owner: 10Reedy) [15:54:14] 10Continuous-Integration-Infrastructure, 10Quibble, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-10-01 to 2020-12-31 (Q2)), and 2 others: Terminating MySQL takes several minutes in (Wikibase?) CI jobs - https://phabricator.wikimedia.org/T265615 (10hashar) I have... [16:17:59] RECOVERY - SSH on contint1001.mgmt is OK: SSH OK - OpenSSH_6.6 (protocol 2.0) https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [16:21:39] hi thcipriani o/ yt? [16:21:55] trying to do a scap initialization for a new repo and deployment [16:21:59] i'm very very close [16:22:03] but am getting [16:22:05] Tyler is off today. Perhaps I can help. [16:22:21] oh ok, hi dancy [16:22:23] thank you [16:22:24] am getting [16:22:25] b"Cloning into '/srv/deployment/airflow-dags/analytics-cache/cache'...\nfatal: repository 'http://deploy1002.eqiad.wmnet/airflow-dags/analytics/.git/' not found\n" [16:22:37] on deploy1002 [16:22:45] exists and is cloned [16:22:46] /srv/deployment/airflow-dags/analytics [16:23:20] i thought maybe i did something wrong with scap configs, but it looks correct when comparing to eventlog1003's deployment of /srv/deployment/eventlogging/analytics [16:23:25] * dancy looks around [16:23:37] the scap target is an-test-client1001.eqiad.wmnet [16:23:52] the scap command that puppet is trying to run is [16:23:53] sudo -u analytics /usr/bin/scap deploy-local --repo airflow-dags/analytics -D log_json:False [16:29:49] dancy: i did have an initial incorrect configuration, i had git_repo (populated from scap.cfg?) set to the name of the repo in the upstream (gitlab), which does not match the 'name' of the repo on the deploy server [16:29:56] the real git repo name on gitlab is data-engineering/airflow-dags [16:30:13] on deploy1002 it is checked out in /srv/deployment as airflow-dags/analyltics [16:30:20] airflow-dags/analytics [16:30:38] i fixed in scap.cfg and pulled on deploy1002, but /srv/deployment/airflow-dags/analytics-cache/.config was not autommatically fixed [16:30:46] so i manually edited it to fix git_repo [16:30:53] it looks correct now to me [16:32:12] I'm trying to find a working case of cloning something from http://deploy1002 [16:34:52] hmm, maybe my ssh user is wrong.... [16:35:43] dancy: git clone --jobs 1 http://deploy1002.eqiad.wmnet/eventlogging/analytics/.git ./eventlogging-analytics workfs for me on an-test-client1001 [16:36:05] thx [16:36:11] git clone --jobs 1 http://deploy1002.eqiad.wmnet/airflow-dags/analytics/.git ./airflow-dags [16:36:13] does now [16:36:14] not [16:36:19] which...does not matter for ssh user i think [16:36:46] i'm going to see what happens if i scap deploy this... [16:38:28] I was able to `git clone http://deploy1002.eqiad.wmnet/airflow-dags/analytics/.git` just now... seems like something changed. [16:39:25] i did just try a scap deploy but it failed... [16:39:37] hmmm i also was able to clone [16:39:57] the scap deploy looks like it failed ssh, so i dont think it would have affecrted an-test-client [16:39:58] hmmm [16:40:04] running puppet on client [16:41:56] dancy: puppet worked...so scap deploy-local succeeded this time??? [16:41:57] weird. [16:42:15] i think i see what's wrong with the ssh part...but that has nothing to do with the puppet launched scap deploy-local bits. [16:42:30] so ummmm, thanks for your help(?), i will keep poking at this but perhaps this step is working now... [16:42:32] :) [16:42:57] Alright. Sorry I couldn't add clarity. [16:48:11] (03PS1) 10Ahmon Dancy: Improve _check_fatals error reporting [tools/scap] - 10https://gerrit.wikimedia.org/r/738435 [16:51:17] 10Release-Engineering-Team (Doing), 10GitLab (Support), 10User-brennen: Couldn't fork a gitlab repository - https://phabricator.wikimedia.org/T295468 (10brennen) p:05Triage→03High a:03brennen [17:04:04] so James_F, I wanted to ask you about https://phabricator.wikimedia.org/T295477. Given the request it sounds like you'd prefer a new project for this, but the discussion on the ticket made me wonder if you had reconsidered and would rather have more quota in deployment-prep [17:04:55] 10Release-Engineering-Team (Doing), 10GitLab (Support), 10User-brennen: Couldn't fork a gitlab repository - https://phabricator.wikimedia.org/T295468 (10brennen) Saw one more instance of this this morning from https://gitlab.wikimedia.org/thcipriani/train-stats → https://gitlab.wikimedia.org/krinkle/train-st... [17:06:42] dancy: still there? [17:06:43] i'm so close. [17:06:49] i'm trying to do scap deploy [17:06:54] 17:06:50 [@deploy1002:/srv/deployment/airflow-dags/analytics] (main)[093f067] ± scap deploy -e hadoop-test -v --no-log-message [17:07:01] i'm mgetting [17:07:05] Received disconnect from 2620:0:861:104:10:64:5:6 port 22:2: Too many authentication failures [17:07:07] still here [17:07:07] in the verbose output [17:07:16] i can see it offering a bunch of keys [17:07:29] but it looks like the airflow_deploy one didn't make it before there were too many offered [17:07:46] https://www.irccloud.com/pastebin/AcF0BM8m/ [17:07:50] full paste of output ^ [17:08:02] i verified that ssh does work to the host with that key [17:08:40] `17:05:51 Unable to find keyholder key for analytics` might be the most relevant piece of info, but I'm not certain. [17:09:45] ah [17:09:49] https://doc.wikimedia.org/mw-tools-scap/_modules/scap/cli.html#Application.get_keyholder_key [17:09:51] ? [17:09:56] perhaps I need to set the key name in scap.cfg? [17:10:45] trying that [17:12:25] dancy: ok...now getting [17:12:32] sign_and_send_pubkey: signing failed: agent refused operation [17:12:43] https://www.irccloud.com/pastebin/vTHVJsSB/ [17:13:27] pretty sure i added the key and armed keyholder properly [17:13:29] checking... [17:15:02] i'm going to restart and arm keyholder, just in case [17:16:06] dancy: THAT WORKED [17:16:10] i guess a keyholder restart is needed? [17:16:21] you are such a great rubber ducky! [17:16:22] :) [17:16:29] Excellent! glad to help. haha [17:45:40] 10Beta-Cluster-Infrastructure, 10Abstract Wikipedia team, 10function-evaluator, 10function-orchestrator: Work out how we're going to have "production-like" versions of the wikifunctions evaluator and orchestrator services in Beta Cluster - https://phabricator.wikimedia.org/T289315 (10Jdforrester-WMF) [17:45:52] 10Beta-Cluster-Infrastructure, 10Abstract Wikipedia team, 10Cloud-VPS (Project-requests): Request creation of deployment-prep-k8s VPS project - https://phabricator.wikimedia.org/T295477 (10Jdforrester-WMF) 05Open→03Invalid Yeah, let's just do this within the existing project, if that's OK with the WMCS a... [17:55:09] 10Phabricator, 10Developer Productivity: Show previews for Phabricator links in Slack (and other messaging apps) - https://phabricator.wikimedia.org/T288117 (10Tgr) There's an upstream task https://secure.phabricator.com/T13018 and some related discussion at https://meta.discourse.org/t/onebox-doesnt-render-bo... [18:07:39] (03PS1) 10Accraze: inference-services: add articlequality-transformer [integration/config] - 10https://gerrit.wikimedia.org/r/738447 (https://phabricator.wikimedia.org/T294419) [18:10:07] (03CR) 10jerkins-bot: [V: 04-1] inference-services: add articlequality-transformer [integration/config] - 10https://gerrit.wikimedia.org/r/738447 (https://phabricator.wikimedia.org/T294419) (owner: 10Accraze) [18:12:03] (03PS2) 10Accraze: inference-services: add articlequality-transformer [integration/config] - 10https://gerrit.wikimedia.org/r/738447 (https://phabricator.wikimedia.org/T294419) [18:19:35] (03PS1) 10Ahmon Dancy: Clarify some scap messages [tools/scap] - 10https://gerrit.wikimedia.org/r/738448 [18:25:47] (03CR) 10Ahmon Dancy: [C: 03+2] Clarify some scap messages [tools/scap] - 10https://gerrit.wikimedia.org/r/738448 (owner: 10Ahmon Dancy) [18:26:22] (03Merged) 10jenkins-bot: Clarify some scap messages [tools/scap] - 10https://gerrit.wikimedia.org/r/738448 (owner: 10Ahmon Dancy) [18:39:00] (03PS1) 10Ahmon Dancy: Avoid copying L10N files from/to /tmp [tools/scap] - 10https://gerrit.wikimedia.org/r/738453 (https://phabricator.wikimedia.org/T295304) [18:41:34] (03CR) 10jerkins-bot: [V: 04-1] Avoid copying L10N files from/to /tmp [tools/scap] - 10https://gerrit.wikimedia.org/r/738453 (https://phabricator.wikimedia.org/T295304) (owner: 10Ahmon Dancy) [18:45:39] (03PS2) 10Ahmon Dancy: Avoid copying L10N files from/to /tmp [tools/scap] - 10https://gerrit.wikimedia.org/r/738453 (https://phabricator.wikimedia.org/T295304) [19:45:39] is there gitlab IRC integration yet/planned? [19:45:54] i see I can set up the irker integration, but I'd have to run an irker server [19:46:01] does releng/gitlab.wm.org have one? [19:48:20] There is some planed [20:11:56] ottomata: https://phabricator.wikimedia.org/T288381 is somewhat stalled right now [20:14:02] dancy: I re-read that task just now, and one part I don't get is, how do last weeks cdb files end up in this/next weeks php-ver directory. Does that happen in prep? [20:14:56] In other words, how the initial state you describe comes into being. Perhaps this used to copy it from last weeks version during this step. [20:32:45] 10Gerrit: Security issue - https://phabricator.wikimedia.org/T295622 (10Masoud_shokohi) [20:34:13] 10Gerrit: Security issue - https://phabricator.wikimedia.org/T295622 (10Masoud_shokohi) 05Open→03Resolved [20:36:03] ^ trash, disabled the account [20:36:11] legoktm: ok thanks [20:38:28] legoktm: they seem to be a very old vandal [20:38:36] I can't really see any useful edits [20:38:43] indeed [20:38:55] But then their commons edit I reverted was 5 months old :( [20:39:12] 10Release-Engineering-Team (Next), 10Wikibugs, 10GitLab (Integrations), 10Patch-For-Review: Connect WikiBugs IRC bot to Wikimedia GitLab - https://phabricator.wikimedia.org/T288381 (10Legoktm) I'm not sure how to move this forward, I think some guidance from RelEng would be helpful on whether 1) we can get... [20:39:16] urbanecm: is it lock worthy for the SUL ^ [20:40:15] 10Release-Engineering-Team (Next), 10Wikibugs, 10GitLab (Integrations), 10Patch-For-Review: Connect WikiBugs IRC bot to Wikimedia GitLab - https://phabricator.wikimedia.org/T288381 (10Legoktm) And also whether GitLab will even be able to go through the firewall and send webhooks to Toolforge/Cloud VPS (nei... [21:23:19] PROBLEM - SSH on contint1001.mgmt is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/Dc-operations/Hardware_Troubleshooting_Runbook [21:28:18] (03PS1) 10Hashar: utils/jjb-diff: support job filtering [integration/config] - 10https://gerrit.wikimedia.org/r/738478 [21:31:03] (03PS1) 10Hashar: jjb: use job template for mw phan jobs [integration/config] - 10https://gerrit.wikimedia.org/r/738479 [21:37:35] (03PS1) 10Hashar: jjb: parameterize the docker-setup-mwext-for-phan macro [integration/config] - 10https://gerrit.wikimedia.org/r/738481 [21:38:37] (03PS2) 10Hashar: jjb: parameterize the docker-setup-mwext-for-phan macro [integration/config] - 10https://gerrit.wikimedia.org/r/738481 [21:38:47] some good old friday refactoring [22:11:57] (03CR) 10Jeena Huneidi: [C: 03+2] "LGTM" [integration/config] - 10https://gerrit.wikimedia.org/r/738447 (https://phabricator.wikimedia.org/T294419) (owner: 10Accraze) [22:13:51] (03Merged) 10jenkins-bot: inference-services: add articlequality-transformer [integration/config] - 10https://gerrit.wikimedia.org/r/738447 (https://phabricator.wikimedia.org/T294419) (owner: 10Accraze) [22:17:10] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/738447 [22:17:12] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL