[00:30:10] 10Data-Engineering, 10Airflow, 10Platform Engineering: Replace Airflow's HDFS client (snakebite) with pyarrow - https://phabricator.wikimedia.org/T284566 (10Ottomata) We've been looking into pyarrow + airflow a little bit in general, and I need a place to park some findings, so here it is! pyarrow is not th... [03:43:16] (EventgateLoggingExternalLatency) firing: Elevated latency for POST events on eventgate-logging-external in eqiad. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?viewPanel=79&orgId=1&var-service=eventgate-logging-external - https://alerts.wikimedia.org [03:58:16] (EventgateLoggingExternalLatency) resolved: Elevated latency for POST events on eventgate-logging-external in eqiad. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?viewPanel=79&orgId=1&var-service=eventgate-logging-external - https://alerts.wikimedia.org [06:39:17] 10Data-Engineering, 10Data-Engineering-Kanban: Some varnishkafka instances dropped traffic for a long time due to the wrong version of the package installed - https://phabricator.wikimedia.org/T300164 (10Mayakp.wiki) Thanks @Isaac for noting that, I have edited the above comment with my analysis. My formula wa... [14:33:00] Hea ottomata - you atround? [14:35:07] joal: heya yup! [14:35:19] mforns: i''m considering getting rid of the conf/ directories, whatcha think? [14:35:25] just have artifact_config.yaml top level [14:35:29] I have a question on gobblin dpeloyment - would you batcave for a minute? [14:35:34] and then instance artifact.yamls in instance dirs [14:35:40] joal: yup coming! [14:43:36] ottomata: I'm fine with that [14:43:43] I was just writing on the CR about this [14:43:59] the only thing is then we force users to write all artifacts in 1 file [14:44:44] while it would be interesting once we have lots of dependencies, to have i.e. one file for maven artifacts and one for hql artifacts [14:45:12] but on the other hand, having just 1 file looks simpler/cleaner [14:46:21] also, ottomata, what do you think of changind the ArtifactRegistry constructor to find the artifact config files automatically? Like: [14:46:22] artifact = ArtifactRegistry('analytics') [14:56:55] (03PS1) 10Sharvaniharan: Add a required variable to app analytics fragment [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/761354 [14:57:10] 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review, 10Product-Analytics (Kanban): Test log file and error notification - https://phabricator.wikimedia.org/T295733 (10BTullis) It worked! ` btullis@stat1007:~$ tail -n 3 /srv/product_analytics/logs/product-analytics-movement-metrics/monthly_mov... [14:57:29] (03CR) 10jerkins-bot: [V: 04-1] Add a required variable to app analytics fragment [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/761354 (owner: 10Sharvaniharan) [15:14:51] mforns: re automatic: yes i would like something like that if we can figure it out [15:19:50] cool, I can do! [15:28:33] 10Data-Engineering, 10SRE, 10SRE-Access-Requests: Give bmansurov access necessary to support Research Airflow jobs - https://phabricator.wikimedia.org/T301215 (10Arnoldokoth) Hey @Ottomata Could you kindly confirm the appropriate group for this and also approve the same so we could go ahead with it? [15:28:46] 10Data-Engineering, 10SRE, 10SRE-Access-Requests: Give bmansurov access necessary to support Research Airflow jobs - https://phabricator.wikimedia.org/T301215 (10Arnoldokoth) 05Open→03In progress [15:30:29] 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review, 10Product-Analytics (Kanban): Test log file and error notification - https://phabricator.wikimedia.org/T295733 (10mpopov) >>! In T295733#7697347, @BTullis wrote: > It worked! > ` > btullis@stat1007:~$ tail -n 3 /srv/product_analytics/logs/p... [15:31:14] 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review, 10Product-Analytics (Kanban): Test log file and error notification - https://phabricator.wikimedia.org/T295733 (10BTullis) I've now merged that previous change, so the next movement metrics script will run on the 7th of next month. [15:34:46] 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review, 10Product-Analytics (Kanban): Test log file and error notification - https://phabricator.wikimedia.org/T295733 (10BTullis) > Or perhaps the default value should be the resource $description rather than undef? I was thinking that the defaul... [15:42:23] 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review, 10Product-Analytics (Kanban): Test log file and error notification - https://phabricator.wikimedia.org/T295733 (10mpopov) > I was thinking that the default value should be the `$title` of the resource, because that will match the selector i... [15:46:03] 10Data-Engineering, 10SRE, 10SRE-Access-Requests: Give bmansurov access necessary to support Research Airflow jobs - https://phabricator.wikimedia.org/T301215 (10Ottomata) Hello! Yes, the group is analytics-research-admins, and approved! [15:57:51] mforns: i need to rename analytics-test to analytics_test for this pythonpath thing to work [15:57:57] am doing the puppet stuff to do that [15:58:03] going to just push that rename to master [15:58:04] main [15:58:04] ok [16:14:53] mforns: did you figure out why rebasing artifact-registry on main is causing conflicts still? [16:15:00] i just tried locally and got the same conflicts you got yesterday [16:15:08] hm.. no [16:15:18] did you push your rebase to the branch? [16:15:30] yesterday's yes, today's not yet [16:16:19] hm [16:16:59] 10Data-Engineering, 10Data-Engineering-Kanban, 10Patch-For-Review, 10Product-Analytics (Kanban): Test log file and error notification - https://phabricator.wikimedia.org/T295733 (10Mayakp.wiki) a:05BTullis→03Mayakp.wiki Thank you so much @BTullis ! I was able to see the error in the log file and we can... [16:19:16] mforns: i guess i'm going to try to resolve and push to branch [16:19:38] ok [16:23:47] (03PS19) 10Phuedx: [WIP] Metrics Platform event schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/676392 (https://phabricator.wikimedia.org/T276379) (owner: 10Jason Linehan) [16:24:14] (03CR) 10Phuedx: [WIP] Metrics Platform event schema (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/676392 (https://phabricator.wikimedia.org/T276379) (owner: 10Jason Linehan) [16:25:20] (03CR) 10jerkins-bot: [V: 04-1] [WIP] Metrics Platform event schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/676392 (https://phabricator.wikimedia.org/T276379) (owner: 10Jason Linehan) [16:26:23] (03CR) 10Phuedx: [WIP] Metrics Platform event schema (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/676392 (https://phabricator.wikimedia.org/T276379) (owner: 10Jason Linehan) [16:28:13] ok mforns pushed the rebase, hopefully that doesn't happen again [16:28:39] (03PS20) 10Phuedx: [WIP] Metrics Platform event schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/676392 (https://phabricator.wikimedia.org/T276379) (owner: 10Jason Linehan) [16:28:40] btw, i think it might work better in the future if you rebase from main rather than pull/merge changes into your branch from it (not sure if that is what you are doing) [16:28:42] i usually do [16:28:44] git fetch [16:28:48] git rebase origin/main [16:29:18] ok, yes, I think it happened to me when I tried to rebase the branch on main, and then push to the branch, it asked me to git pull first.. [16:29:31] yeah do a fetch instead of a pull [16:29:34] and then rebase with origin/main [16:29:36] rather than just main [16:30:02] ah ok [16:36:45] ok team - forgot to deploy yesterday, doing it now [16:38:22] (03PS1) 10Joal: Update changelog.md to v0.1.25 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/761394 [16:38:35] a-team - if anyone has a minute --^ [16:39:01] (03CR) 10Ottomata: [V: 03+2 C: 03+2] Update changelog.md to v0.1.25 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/761394 (owner: 10Joal) [16:39:07] merged joal [16:39:08] thanks ottomata [16:39:30] !log Release refinery-source v0.1.25 to archiva [16:39:32] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:40:15] Starting build #102 for job analytics-refinery-maven-release-docker [16:42:33] ottomata: quick note on gobblin-wmf - I'm about to decorellate our version number from the gobblin main one - any objection? [16:42:44] not at all, that makes sense [16:42:49] its an extension now, right? [16:42:53] ack - we're going to v 1,0 [16:43:34] 10Data-Engineering, 10Data-Engineering-Kanban: Some varnishkafka instances dropped traffic for a long time due to the wrong version of the package installed - https://phabricator.wikimedia.org/T300164 (10Isaac) Yep! That's all making more sense to me now. Thanks again for running the numbers and contextualizin... [16:46:35] 10Data-Engineering, 10Data-Engineering-Kanban: Some varnishkafka instances dropped traffic for a long time due to the wrong version of the package installed - https://phabricator.wikimedia.org/T300164 (10JAllemandou) Thank you @Isaac for the quick review :) [16:52:48] Project analytics-refinery-maven-release-docker build #102: 09SUCCESS in 12 min: https://integration.wikimedia.org/ci/job/analytics-refinery-maven-release-docker/102/ [16:54:46] 10Data-Engineering-Kanban: Add alert for varnishkafka low/zero messages per second to alertmanager - https://phabricator.wikimedia.org/T300246 (10BTullis) [16:55:10] 10Data-Engineering, 10SRE, 10SRE-Access-Requests: Give bmansurov access necessary to support Research Airflow jobs - https://phabricator.wikimedia.org/T301215 (10Arnoldokoth) Okay, great. Thank you! @Ottomata [17:00:51] Starting build #61 for job analytics-refinery-update-jars-docker [17:01:19] (03PS1) 10Maven-release-user: Add refinery-source jars for v0.1.25 to artifacts [analytics/refinery] - 10https://gerrit.wikimedia.org/r/761399 [17:01:19] Project analytics-refinery-update-jars-docker build #61: 09SUCCESS in 28 sec: https://integration.wikimedia.org/ci/job/analytics-refinery-update-jars-docker/61/ [17:02:49] (03CR) 10Joal: [V: 03+2 C: 03+2] "Merging for deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/761399 (owner: 10Maven-release-user) [17:05:12] !log Deploying refinery with scap [17:05:14] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [17:12:08] 10Data-Engineering, 10Patch-For-Review, 10Product-Analytics (Kanban): Test log file and error notification - https://phabricator.wikimedia.org/T295733 (10BTullis) [17:15:25] (03PS1) 10Joal: Update Gobblin version to 0.16 [analytics/gobblin-wmf] - 10https://gerrit.wikimedia.org/r/761400 [17:15:53] (03CR) 10Joal: "Needs testing" [analytics/gobblin-wmf] - 10https://gerrit.wikimedia.org/r/761400 (owner: 10Joal) [17:20:14] 10Data-Engineering, 10Data-Engineering-Kanban, 10Airflow, 10Patch-For-Review: [Airflow] Set up scap deployment - https://phabricator.wikimedia.org/T295380 (10fkaelin) Thanks @Ottomata! cc @bmansurov [17:31:04] ottomata: do we do sre-sync today? I see the meeting room full of people, if you folks are grosking we can skip [17:33:04] We're still doing post-standups about Airflow. I'm not sure, sorry. [17:34:19] nono all good, I'll finish some work :) [17:36:21] elukey: just doing a sync,feel free to skip :) [17:41:14] !log Deploy refinery onto HDFS [17:41:16] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [17:46:48] mforns: i started moving config around and got a little eager with a few changes in artifact-registry [17:46:55] i didn't want to push over what you have already [17:46:57] so i made a new branch [17:46:58] https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/commit/a5318f0aa97722f74addceded63a4bf7450aa6f7 [17:46:59] to ask you first [17:47:09] mostly change to automate the artifact config loading [17:47:21] like [17:47:22] artifact = ArtifactRegistry.for_wmf_airflow_instance(airflow_instance_name).artifact_url [17:48:00] if you are ok with that i can push it to your artifact-registry branch [17:49:21] 10Data-Engineering-Kanban, 10Data-Catalog: Set up opensearch cluster for datahub - https://phabricator.wikimedia.org/T301382 (10razzi) [17:53:31] 10Data-Engineering-Kanban, 10Data-Catalog: Set up opensearch cluster for datahub - https://phabricator.wikimedia.org/T301382 (10razzi) [17:55:27] ottomata: I'm doing that too! [17:56:01] not the same way though [18:01:39] 10Data-Engineering, 10Data-Engineering-Kanban: Deploy DataHub in MVP phase - https://phabricator.wikimedia.org/T301385 (10BTullis) [18:02:13] 10Data-Engineering, 10Data-Engineering-Kanban: Deploy DataHub in MVP phase - https://phabricator.wikimedia.org/T301385 (10BTullis) [18:02:15] 10Data-Engineering-Kanban, 10Data-Catalog: Set up opensearch cluster for datahub - https://phabricator.wikimedia.org/T301382 (10BTullis) [18:02:20] 10Data-Engineering, 10Data-Engineering-Kanban: Proof-of-concept Karapace as Confluent schema registry replacement - https://phabricator.wikimedia.org/T301386 (10razzi) [18:02:28] 10Data-Engineering, 10Data-Engineering-Kanban: Proof-of-concept Karapace as Confluent schema registry replacement - https://phabricator.wikimedia.org/T301386 (10razzi) [18:02:30] 10Data-Engineering, 10Data-Engineering-Kanban: Deploy DataHub in MVP phase - https://phabricator.wikimedia.org/T301385 (10razzi) [18:02:38] 10Data-Engineering, 10SRE, 10SRE-Access-Requests: Give bmansurov access necessary to support Research Airflow jobs - https://phabricator.wikimedia.org/T301215 (10Arnoldokoth) Hey @leila Could you kindly approve this? [18:03:12] 10Data-Engineering, 10Data-Engineering-Kanban: Proof-of-concept Karapace as Confluent schema registry replacement - https://phabricator.wikimedia.org/T301386 (10razzi) (note for later: 4GB ram and 20GB disk should be sufficient for the vm for this) [18:03:46] 10Data-Engineering, 10Data-Engineering-Kanban: Deploy DataHub in MVP phase - https://phabricator.wikimedia.org/T301385 (10BTullis) [18:04:34] 10Data-Engineering, 10Data-Engineering-Kanban: Deploy DataHub in MVP phase - https://phabricator.wikimedia.org/T301385 (10razzi) [18:04:51] 10Data-Engineering, 10Data-Engineering-Kanban: Deploy DataHub in MVP phase - https://phabricator.wikimedia.org/T301385 (10razzi) [18:05:36] 10Data-Engineering, 10SRE, 10SRE-Access-Requests: Give bmansurov access necessary to support Research Airflow jobs - https://phabricator.wikimedia.org/T301215 (10leila) Approved. (and thank you for your support.) [18:12:17] Hi, is it possible to migrate archiva off of git-fat (and possibly to git lfs instead)? context https://phabricator.wikimedia.org/T279509 [18:17:13] mforns: responded to your comments [18:17:29] still reviewing :] [18:23:30] mforns: i'm going to make a MR onto your branch so that we can see multiple commits at once [18:23:47] ok [18:24:25] https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/14 [18:24:38] oh cool! the comments on the commit got moved over too! [18:24:39] that is very cool. [18:31:18] (03CR) 10Ottomata: [C: 03+1] Update Gobblin version to 0.16 [analytics/gobblin-wmf] - 10https://gerrit.wikimedia.org/r/761400 (owner: 10Joal) [18:32:17] mforns: i'd love to land this stuff before i create the research instance. want to bc to discuss? [18:35:22] 10Data-Engineering, 10Infrastructure-Foundations, 10Product-Analytics, 10Research, and 2 others: Maybe restrict domains accessible by webproxy - https://phabricator.wikimedia.org/T300977 (10fkaelin) This would affect the research team, especially if the stat machines are also included in this restriction.... [18:45:51] ottomata: finished the review, left some comments [18:45:57] ok looking [18:47:26] mforns: responded and pushed [18:47:47] mforns: re the relative paths [18:47:53] yeah, you are right [18:48:10] not sure how to do it better atm, so i just put it in a very specific place with some docs about it [18:48:36] yea, agree [18:49:21] I was trying to do it slightly different: as artifacts.yaml lives now in the config folder together with dag_confg I was calling ArtifactRegistry and passing 'artifacts.yaml' directly [18:49:31] but.. [18:49:42] that wouldn;t have worked of course [18:49:59] yea, I like your way [18:51:14] ottomata: merged [18:52:36] okay cool now i'm looking back at your branch :) [18:53:27] I'm pulling your changes and seeing if I have anything else [18:53:48] i like the idea of jinja templating those files.... that would make some things even more automatic [18:54:05] alternatively, we could have some special artifact_config.yaml for dev instnaces? [18:57:31] ottomata: the thing with templating, is that you'd need to pass the (dev) base cache path to ArtifactRegistry, and that happens within the dag_config.py file. Ideally, the developer would set the dev base cache path within the DAG file [18:57:42] yeahhhh [18:57:53] lets return to this problem later, we have it for other things in dag_config.py too i guess [18:59:19] ottomata: the other day I thought that dag_config.py could always check for the existence of a (gitignored) .user_config.yaml file somewhere, and use it to override the default_args and maybe base cache path too... [18:59:29] oh hooo [18:59:33] or rather dev_config.py [18:59:34] intersting [18:59:39] sorry dev_config.yaml [18:59:51] i think...since yamlreader is used to read [18:59:57] i believe it will merge configs that conflict [19:00:11] so if dev_artifact_config.yaml is in the list [19:00:15] (and at the end?) [19:00:20] i think it will replace anything in artifact_config.yaml [19:00:34] like artifact_cachces.hdfs [19:00:56] but then it will be just about artifact config? It would be cool that it keeps default_args too. [19:04:42] that would just be artifact_config [19:04:51] but we could use mergedeep to do that for default_args too [19:05:12] maybe we can gitignore all files named dev_config.py within config directories, and let developers build their own dev_config.py files, which should import regular dag_config and override it with whatever params [19:07:04] ya [19:07:14] or even in their homedirs? [19:07:23] mforns: lets do that in another MR tho ya? [19:07:31] if we can merge this one i can get research's thign going [19:07:34] yes def [19:07:44] one sec about to update the README [19:07:49] it's not tested! [19:07:52] OH hahahah [19:07:55] well yes lets do that first [19:07:56] duh [19:08:00] actually, my last version was failing [19:13:00] testing [19:13:40] mforns: just pushed a couple more commits there [19:13:43] importantly [19:13:44] https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/13/diffs?commit_id=f1ca211590066c120fbd80d8d23032c9e227691e [19:13:49] and https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/13/diffs?commit_id=1d62f7df9254271facf84f0dd772ffe575fca072 [19:13:54] unlinking the wmf_airflow_common symlinks [19:16:16] ok [19:26:08] ottomata: I'm getting some errors in artifact.py, I'll be in the bc for 20 mins, then I have a meeting :] [19:26:26] okay [19:26:29] i'm trying to test too [19:26:30] coming [19:44:40] (03PS1) 10Sharvaniharan: Add a required variable to app analytics fragment [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/761452 [19:45:18] (03CR) 10jerkins-bot: [V: 04-1] Add a required variable to app analytics fragment [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/761452 (owner: 10Sharvaniharan) [19:50:19] (03PS2) 10Sharvaniharan: Add a required variable to app analytics fragment [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/761452 [19:51:20] (03CR) 10jerkins-bot: [V: 04-1] Add a required variable to app analytics fragment [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/761452 (owner: 10Sharvaniharan) [19:51:35] ottomata: pushed [19:51:40] (03CR) 10Ottomata: Add a required variable to app analytics fragment (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/761452 (owner: 10Sharvaniharan) [19:51:43] mforns: ty [19:57:18] (03CR) 10Sharvaniharan: "This change is ready for review." (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/761452 (owner: 10Sharvaniharan) [20:02:41] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering, 10Product-Analytics: Wikistats pageview data missing counts for Mobile App pageviews on Commons, going back to 2020-11 - https://phabricator.wikimedia.org/T299439 (10JAllemandou) After looking at our code that annotates webrequests as being pageviews,... [20:26:04] 10Data-Engineering, 10Product-Analytics: wikidata unique devices per-project-family overcount offset - https://phabricator.wikimedia.org/T301403 (10JAllemandou) [20:26:28] 10Analytics, 10Analytics-Wikistats, 10Data-Engineering, 10Product-Analytics: Wikistats reports no mobile unique devices for Wikidata and MediaWiki.org - https://phabricator.wikimedia.org/T299559 (10JAllemandou) Good catch @nshahquinn-wmf ! We indeed don't load sites in `m.` without something before. I'm go... [20:58:08] heya ottomata can I help? [20:59:34] mforns: hey i have a meeting too but i have somethign cool for user config....i'm crazy! [20:59:38] will push one min [21:03:53] 10Data-Engineering, 10Product-Analytics: wikidata unique devices per-project-family overcount offset - https://phabricator.wikimedia.org/T301403 (10nshahquinn-wmf) @JAllemandou thank you for finding this! What do you have in mind for Product Analytics to investigate? I don't think we have much understanding of... [21:05:13] mforns: [21:05:14] https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/15/diffs [21:05:17] i'm crazy! [21:05:18] haha [21:05:24] looking :D [21:05:27] see README for hastily typed explanation [21:05:56] oh... hm no one in this meeting [21:05:58] i can go to bc [21:08:09] ottomata: that's not crazy! it's cool!! [21:08:12] bc? [21:08:15] ya [21:21:02] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog, 10Epic, 10User-razzi: Evaluate Amundsen as a Data Catalog - https://phabricator.wikimedia.org/T300756 (10Milimetric) [21:21:13] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog: Evaluate DataHub as a Data Catalog - https://phabricator.wikimedia.org/T299703 (10Milimetric) [21:21:59] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog, 10Epic: Evaluate OpenMetadata as a Data Catalog - https://phabricator.wikimedia.org/T300540 (10Milimetric) [21:28:26] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog, 10Epic: Evaluate Atlas as a Data Catalog - https://phabricator.wikimedia.org/T299166 (10Milimetric) [21:29:20] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog, 10Epic, 10User-razzi: Evaluate Amundsen as a Data Catalog - https://phabricator.wikimedia.org/T300756 (10Milimetric) 05Open→03Resolved [21:29:22] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog, 10Epic: Data Catalog Technical Evaluation - https://phabricator.wikimedia.org/T293643 (10Milimetric) [21:29:30] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog: Evaluate DataHub as a Data Catalog - https://phabricator.wikimedia.org/T299703 (10Milimetric) 05Open→03Resolved [21:29:32] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog, 10Epic: Data Catalog Technical Evaluation - https://phabricator.wikimedia.org/T293643 (10Milimetric) [21:29:40] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog, 10Epic: Evaluate OpenMetadata as a Data Catalog - https://phabricator.wikimedia.org/T300540 (10Milimetric) 05Open→03Resolved [21:29:42] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog, 10Epic: Data Catalog Technical Evaluation - https://phabricator.wikimedia.org/T293643 (10Milimetric) [21:30:15] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog, 10Epic: Evaluate Atlas - https://phabricator.wikimedia.org/T299165 (10Milimetric) [21:30:17] 10Data-Engineering, 10Data-Engineering-Kanban, 10Data-Catalog, 10Epic: Evaluate Atlas as a Data Catalog - https://phabricator.wikimedia.org/T299166 (10Milimetric) [22:04:26] 10Data-Engineering, 10SRE, 10SRE-Access-Requests, 10Patch-For-Review: Give bmansurov access necessary to support Research Airflow jobs - https://phabricator.wikimedia.org/T301215 (10Arnoldokoth) @bmansurov This is sorted now. [22:05:35] 10Data-Engineering, 10SRE, 10SRE-Access-Requests, 10Patch-For-Review: Give bmansurov access necessary to support Research Airflow jobs - https://phabricator.wikimedia.org/T301215 (10Arnoldokoth) 05In progress→03Resolved a:03Arnoldokoth [22:19:16] fab: FYI, just trying to get a patch merged with marcel that does a little config restructing before we set up research deployment of airflow [22:19:18] hopefully tomorrow [23:33:27] 10Analytics-Radar, 10SRE, 10Traffic-Icebox, 10Patch-For-Review: The WMF-Last-Access Set-Cookie header should follow RFC 2965 syntax rather than the pre-RFC Netscape format - https://phabricator.wikimedia.org/T147967 (10Ladsgroup) 05Open→03Declined It seems RFC 6265 actually brought back Expires (https:... [23:45:57] 10Analytics-Radar, 10Wikimedia-production-error: eventgate_validation_error: '.web_session_id' should NOT be shorter than 20 characters - https://phabricator.wikimedia.org/T297521 (10Jdlrobson)