[07:31:51] <wikibugs>	 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization, 07Epic: [Epic] Replace Archiva with Gitlab artifact repositories - https://phabricator.wikimedia.org/T367315#10094847 (10hashar) I had a link to the documentation at https://wiki...
[09:36:38] <wikibugs>	 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Rollback haproxy feed automated ingestion - https://phabricator.wikimedia.org/T372456#10095103 (10gmodena)
[09:42:59] <wikibugs>	 (03CR) 10Santiago Faci: "https://phabricator.wikimedia.org/T368326 is about creating the experiment fragment (enrolled, asigned, names) that we should add to the b" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1066889 (https://phabricator.wikimedia.org/T366802) (owner: 10Clare Ming)
[09:43:05] <wikibugs>	 (03CR) 10Santiago Faci: "https://phabricator.wikimedia.org/T368326 is about creating the experiment fragment (enrolled, asigned, names) that we should add to the b" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1066883 (https://phabricator.wikimedia.org/T366802) (owner: 10Clare Ming)
[09:44:21] <wikibugs>	 (03CR) 10Santiago Faci: "Looks good but https://phabricator.wikimedia.org/T368326 is about creating the experiment fragment (enrolled, asigned, names) that we shou" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1066880 (https://phabricator.wikimedia.org/T366802) (owner: 10Clare Ming)
[09:48:07] <wikibugs>	 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Event-Platform, 13Patch-For-Review: Rollback haproxy feed automated ingestion - https://phabricator.wikimedia.org/T372456#10095122 (10gmodena) f/up from a convo with @fgiunchedi in IRC.  We should be able to delete webrequest_frontend_rc0 metrics from...
[09:51:38] <wikibugs>	 10Data-Engineering (Q1 2024 July 1st - September 30th), 10Event-Platform: [NEEDS GROOMING] We should improve the code health of gobblin-wmf - https://phabricator.wikimedia.org/T370368#10095126 (10gmodena)
[10:05:40] <wikibugs>	 (03PS1) 10Santiago Faci: Adding a new 'experiments' fragment to collect data about which experiments is a subject enrolled in [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1067306 (https://phabricator.wikimedia.org/T368326)
[10:06:07] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Adding a new 'experiments' fragment to collect data about which experiments is a subject enrolled in [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1067306 (https://phabricator.wikimedia.org/T368326) (owner: 10Santiago Faci)
[10:08:59] <wikibugs>	 (03PS2) 10Santiago Faci: Adding a new 'experiments' fragment to collect data about which experiments is a subject enrolled in [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1067306 (https://phabricator.wikimedia.org/T368326)
[10:15:37] <wikibugs>	 06Data-Engineering, 06Data-Platform-SRE, 10Data-Services, 06DBA: Prepare and check storage layer for cswikivoyage - https://phabricator.wikimedia.org/T370912#10095249 (10Ladsgroup) How can I escalate this? It's been a month now and community is waiting.
[10:56:37] <wikibugs>	 06Data-Engineering, 10Data-Services, 06DBA, 10Data-Platform-SRE (2024.08.17 - 2024.09.06): Prepare and check storage layer for cswikivoyage - https://phabricator.wikimedia.org/T370912#10095405 (10BTullis) a:03BTullis
[10:58:10] <wikibugs>	 06Data-Engineering, 10CheckUser, 06Data Products, 06DBA, and 2 others: Remove cuc_actiontext, cuc_only_for_read_old, and cuc_private from cu_changes on WMF wikis - https://phabricator.wikimedia.org/T370903#10095409 (10Ladsgroup)
[11:18:22] <wikibugs>	 (03PS2) 10Peter Fischer: page_weighted_tags_change: add rev_based flag [schemas/event/primary] - 10https://gerrit.wikimedia.org/r/1065287 (https://phabricator.wikimedia.org/T372914)
[11:23:40] <wikibugs>	 06Data-Engineering, 10Data-Services, 06DBA, 10Data-Platform-SRE (2024.08.17 - 2024.09.06): Prepare and check storage layer for cswikivoyage - https://phabricator.wikimedia.org/T370912#10095469 (10BTullis) >>! In T370912#10095249, @Ladsgroup wrote: > How can I escalate this? It's been a month now and commun...
[11:36:19] <wikibugs>	 06Data-Engineering, 10Data-Services, 06DBA, 10Data-Platform-SRE (2024.08.17 - 2024.09.06): Prepare and check storage layer for cswikivoyage - https://phabricator.wikimedia.org/T370912#10095502 (10BTullis) 05Open→03Resolved p:05Triage→03High This is done now. The `sre.wikireplicas.add-wiki` cook...
[12:24:37] <wikibugs>	 (03CR) 10Aqu: [C:03+1] gobblin: remove webrequest_frontend_rc0.pull [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1062677 (https://phabricator.wikimedia.org/T372456) (owner: 10Gmodena)
[12:41:35] <wikibugs>	 (03PS43) 10Aqu: Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762)
[12:56:30] <wikibugs>	 (03CR) 10Santiago Faci: "This is the change where I have added that fragment: https://gerrit.wikimedia.org/r/c/schemas/event/secondary/+/1067306" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1066880 (https://phabricator.wikimedia.org/T366802) (owner: 10Clare Ming)
[12:56:46] <wikibugs>	 (03CR) 10Santiago Faci: "This is the change where I have added that fragment: https://gerrit.wikimedia.org/r/c/schemas/event/secondary/+/1067306" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1066883 (https://phabricator.wikimedia.org/T366802) (owner: 10Clare Ming)
[12:56:57] <wikibugs>	 (03CR) 10Santiago Faci: "This is the change where I have added that fragment: https://gerrit.wikimedia.org/r/c/schemas/event/secondary/+/1067306" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1066889 (https://phabricator.wikimedia.org/T366802) (owner: 10Clare Ming)
[12:59:32] <wikibugs>	 (03CR) 10Aqu: "Ty for your layer of refactoring Otto." [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu)
[13:57:24] <wikibugs>	 (03CR) 10Ottomata: Refactor Refine to be triggered by Airflow (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu)
[14:07:47] <wikibugs>	 (03PS44) 10Ottomata: Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu)
[14:11:49] <wikibugs>	 (03CR) 10CI reject: [V:04-1] Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu)
[14:15:18] <wikibugs>	 06Data-Engineering, 06Discovery-Search, 10Data-Platform-SRE (2024.08.17 - 2024.09.06), 07IPv6: Some Search clusters have inconsistent AAAA DNS records for the primary IPv6 of the hosts - https://phabricator.wikimedia.org/T312555#10096209 (10brouberol) I //think// I fixed this in https://phabricator.wikimed...
[14:20:21] <wikibugs>	 06Data-Engineering, 06Discovery-Search, 10Data-Platform-SRE (2024.08.17 - 2024.09.06), 07IPv6: Some Search clusters have inconsistent AAAA DNS records for the primary IPv6 of the hosts - https://phabricator.wikimedia.org/T312555#10096234 (10brouberol) It appears that wdqs10[11-13] and wdqs200[7-8] still la...
[14:20:23] <wikibugs>	 06Data-Engineering, 06Discovery-Search, 10Data-Platform-SRE (2024.08.17 - 2024.09.06), 07IPv6: Some Search clusters have inconsistent AAAA DNS records for the primary IPv6 of the hosts - https://phabricator.wikimedia.org/T312555#10096238 (10brouberol) a:03brouberol
[14:22:49] <wikibugs>	 06Data-Engineering, 06Discovery-Search, 10Data-Platform-SRE (2024.08.17 - 2024.09.06), 07IPv6: Some Search clusters have inconsistent AAAA DNS records for the primary IPv6 of the hosts - https://phabricator.wikimedia.org/T312555#10096260 (10bking) @brouberol yes, feel free to add the records at your conven...
[14:30:31] <wikibugs>	 06Data-Engineering, 06Discovery-Search, 10Data-Platform-SRE (2024.08.17 - 2024.09.06), 07IPv6: Some Search clusters have inconsistent AAAA DNS records for the primary IPv6 of the hosts - https://phabricator.wikimedia.org/T312555#10096298 (10brouberol) All fixed! I ran `sudo cookbook sre.dns.netbox -t T3125...
[14:30:48] <wikibugs>	 06Data-Engineering, 06Discovery-Search, 10Data-Platform-SRE (2024.08.17 - 2024.09.06), 07IPv6: Some Search clusters have inconsistent AAAA DNS records for the primary IPv6 of the hosts - https://phabricator.wikimedia.org/T312555#10096301 (10brouberol) 05Open→03Resolved
[14:50:35] <wikibugs>	 10Data-Engineering (Q1 2024 July 1st - September 30th), 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization, and 2 others: Validate CI integration so that Ci can release Maven artifacts on user's demand - https://phabricator.wikimedia.org/T367403#10096430 (10Gehel) 05Open→03Stalled Pu...
[15:07:27] <wikibugs>	 (03CR) 10Aqu: Refactor Refine to be triggered by Airflow (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762) (owner: 10Aqu)
[15:31:58] <wikibugs>	 06Data-Engineering, 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization: List python projects that are published to Archiva and how they are deployed - https://phabricator.wikimedia.org/T373450 (10Gehel) 03NEW
[16:04:52] <wikibugs>	 06Data-Engineering, 06Data-Platform-SRE, 07Kubernetes: Migrate dse cluster off of Pod Security Policies - https://phabricator.wikimedia.org/T369492#10096723 (10BTullis)
[17:12:13] <wikibugs>	 (03PS45) 10Aqu: Refactor Refine to be triggered by Airflow [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1016808 (https://phabricator.wikimedia.org/T356762)
[17:16:43] <wikibugs>	 (03PS3) 10Aqu: Make TransformFunction Deduplication Deterministic [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1051061 (https://phabricator.wikimedia.org/T356762)
[19:42:40] <wikibugs>	 (03CR) 10Clare Ming: "good point - agree - let's hold on this and include the experiments fragment in the next version bumps of the app + web base schemas" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1066880 (https://phabricator.wikimedia.org/T366802) (owner: 10Clare Ming)
[19:44:21] <wikibugs>	 (03CR) 10Clare Ming: [C:03+1] "this lgtm - will let Sam merge" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1067306 (https://phabricator.wikimedia.org/T368326) (owner: 10Santiago Faci)
[21:12:28] <wikibugs>	 06Data-Engineering, 06Data-Platform: DegradedArray email alerts for aqs1013 and aqs1014 are firing since April 18 - https://phabricator.wikimedia.org/T373490 (10andrea.denisse) 03NEW
[23:03:50] <wikibugs>	 06Data-Engineering, 10Event-Platform, 07Wikimedia-production-error: PHP Warning: Stats: Cannot associate label keys with label values: Not all initialized labels have an assigned value. - https://phabricator.wikimedia.org/T373086#10098374 (10colewhite)
[23:04:27] <wikibugs>	 06Data-Engineering, 10Event-Platform, 07Wikimedia-production-error: PHP Warning: Stats: Cannot associate label keys with label values: Not all initialized labels have an assigned value. - https://phabricator.wikimedia.org/T373086#10098377 (10colewhite) Introduced in https://gerrit.wikimedia.org/r/c/mediawiki...