[03:15:06] <wikibugs>	 10Traffic, 10DNS, 10SRE, 10Chinese-Sites: Let all requests from mainland China will be processed to codfw/esams/drmrs - https://phabricator.wikimedia.org/T330024 (10Shizhao)
[07:27:21] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10ops-codfw: asw-a-codfw management interface unreachable - https://phabricator.wikimedia.org/T330048 (10ayounsi) p:05Triage→03High
[09:20:06] <wikibugs>	 10Traffic, 10netops, 10DBA, 10Data-Persistence, and 9 others: codfw row B switches upgrade - https://phabricator.wikimedia.org/T327991 (10Jelto)
[09:23:59] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE: Standardize VRRP group IDs - https://phabricator.wikimedia.org/T260363 (10ayounsi) 05Open→03Declined We're slowly moving away from VRRP. The benefits of renumbering them all is not worth the time, especially as we removed the custom field in favor or {T311218}.
[10:42:27] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Move management routers ssh port - https://phabricator.wikimedia.org/T277438 (10ayounsi) Before we merge/deploy any of those changes, Rancid and [[ https://github.com/wikimedia/operations-software-homer/blob/de281c32054862799dbf8102ed627d7d...
[11:54:05] <wikibugs>	 10Traffic, 10netops, 10DBA, 10Data-Persistence, and 9 others: codfw row B switches upgrade - https://phabricator.wikimedia.org/T327991 (10Clement_Goubert)
[14:25:44] <wikibugs>	 10Traffic, 10Infrastructure-Foundations, 10SRE, 10netbox, 10Patch-For-Review: Issues converting services from active/passive to active/active - https://phabricator.wikimedia.org/T330084 (10jbond) p:05Triage→03High
[14:27:48] <jbond>	 hi traffic i tried to convert netbox from active passive to active/active and recived some errors from the dns server.  ill need help from traffic to correct the initial issues however as a higher priority it would be good if someone from traffic can check the health of the DNS serveres to make sure thetre is nothing stuill broken https://phabricator.wikimedia.org/T330084 ( cc kwakuofori ) thanks
[14:32:24] <vgutierrez>	 it's a day off in the US, I'm off as well.. dunno if sukhe is working today
[14:34:12] * vgutierrez taking a look
[14:34:34] <jbond>	 vgutierrez: ack thanks for the heads up i have done a health chjeck on the dns serveres my self and it lgtm
[14:40:43] <vgutierrez>	 yup.. .everything seems healthy
[14:40:59] <vgutierrez>	 jbond: it looks like this would require 2 different commits at the DNS level
[14:41:18] <vgutierrez>	 getting rid of the old netbox metafo entry and adding the new geoip one
[14:41:27] <vgutierrez>	 that will trigger some downtime in netbox
[14:41:53] <vgutierrez>	 but b.black is your guy :)
[14:42:47] <jbond>	 vgutierrez: ack thanks i did wonder if that may be the case. fixing netbox is a lower priority so can definetly wait untill people are back thanks for looking <3
[14:46:23] <wikibugs>	 10Traffic, 10Infrastructure-Foundations, 10SRE, 10netbox, 10Patch-For-Review: Issues converting services from active/passive to active/active - https://phabricator.wikimedia.org/T330084 (10jbond) p:05High→03Medium lowering priority @Vgutierrez confirmed there are no immediate issues with dns.  They a...
[15:41:17] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10observability: Investigate Juniper structured logs - https://phabricator.wikimedia.org/T250703 (10ayounsi) 05Open→03Declined The need never was very strong, and that would be a pain to integrate with ECS.  > The good news is that at least 1 person in the...
[22:31:24] <wikibugs>	 10Traffic, 10Performance-Team (Radar), 10affects-Kiwix-and-openZIM: Image requests sending neither "Last-Modified" nor "ETag" HTTP headers. - https://phabricator.wikimedia.org/T295556 (10Krinkle) >>! In T256217#8069417, @mark wrote: >>>! In T256217#7960730, @Krinkle wrote: >> I'm not sure since when, but bas...