[07:13:49] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10observability: Grafana posting to http://wpt-graphite.wmftest.org:8080/ - https://phabricator.wikimedia.org/T307445 (10ayounsi) @jbond i think this can be closed?
[07:32:58] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE: DHCPd: update config to log more info - https://phabricator.wikimedia.org/T309524 (10ayounsi)
[07:43:05] <wikibugs>	 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, and 2 others: decommission atlas-esams - https://phabricator.wikimedia.org/T307026 (10ayounsi)
[07:44:19] <wikibugs>	 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, and 2 others: decommission atlas-esams - https://phabricator.wikimedia.org/T307026 (10ayounsi) a:05ayounsi→03RobH Thanks Faidon. I ended up emailing them as the dashboard seems limited. @robh: we can proceed with the decom of that box, following...
[08:02:36] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10netbox: Netbox Juniper report - https://phabricator.wikimedia.org/T306238 (10ayounsi) @jbond, I was wondering if the upgrade went as expected. And if there was a timeline for OIDC. No urgency at all, even if it's 1, 6 or more months, just doing some planning :)
[08:02:57] <jinxer-wm>	 (HAProxyEdgeTrafficDrop) firing: 69% request drop in text@ulsfo during the past 30 minutes - https://wikitech.wikimedia.org/wiki/Monitoring/EdgeTrafficDrop - https://grafana.wikimedia.org/d/000000479/frontend-traffic?viewPanel=12&orgId=1&from=now-24h&to=now&var-site=ulsfo&var-cache_type=text - https://alerts.wikimedia.org/?q=alertname%3DHAProxyEdgeTrafficDrop
[08:07:56] <jinxer-wm>	 (HAProxyEdgeTrafficDrop) resolved: 69% request drop in text@ulsfo during the past 30 minutes - https://wikitech.wikimedia.org/wiki/Monitoring/EdgeTrafficDrop - https://grafana.wikimedia.org/d/000000479/frontend-traffic?viewPanel=12&orgId=1&from=now-24h&to=now&var-site=ulsfo&var-cache_type=text - https://alerts.wikimedia.org/?q=alertname%3DHAProxyEdgeTrafficDrop
[08:10:02] <wikibugs>	 10Traffic, 10netops, 10Infrastructure-Foundations, 10SRE: drmrs: primary software task - https://phabricator.wikimedia.org/T282788 (10ayounsi)
[08:11:05] <wikibugs>	 10Traffic, 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: drmrs: initial geodns configuration - https://phabricator.wikimedia.org/T304089 (10ayounsi) 05Open→03Resolved a:03ayounsi I think everything here is done, and follow up is in {T311472} Feel free to re-open if needed.
[08:18:09] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE: Validate new (anycast) IPv6 /48 announcement being accepted by transits - https://phabricator.wikimedia.org/T301900 (10ayounsi) @cmooney I had a quick look at NTT/Telia/Lumen looking glass and the prefix seems to be accepted properly.  Longer term, this could ma...
[08:18:45] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10netbox: Improve Netbox import script to avoid port-number collisions in JunOS - https://phabricator.wikimedia.org/T301392 (10ayounsi)
[08:24:35] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10netbox: Represent sub-interface and bridge device assocations in Netbox - https://phabricator.wikimedia.org/T296832 (10ayounsi)
[08:31:38] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE-tools, 10serviceops: Support services VIPs with not marked as VIP in Netbox - https://phabricator.wikimedia.org/T295793 (10ayounsi) Pinging @jelto for gitlab (not sure if the issue is still present or relevant) and @akosiaris for lists1001 (I can confirm the mi...
[08:48:07] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE: Packet Drops on Eqiad ASW -> CR uplinks - https://phabricator.wikimedia.org/T291627 (10ayounsi) With {T304712} will give us the possibility to move to 40G uplinks (instead of 4x10G) for some rows: C as of now, and D once {T308331} is done. This could be a good t...
[11:08:34] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE, 10netbox: Netbox Juniper report - https://phabricator.wikimedia.org/T306238 (10MoritzMuehlenhoff) >>! In T306238#8047863, @ayounsi wrote: > @jbond, I was wondering if the upgrade went as expected. And if there was a timeline for OIDC. > No urgency at all, even...
[15:09:23] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE-tools, 10serviceops: Support services VIPs with not marked as VIP in Netbox - https://phabricator.wikimedia.org/T295793 (10akosiaris) >>! In T295793#8047985, @ayounsi wrote: > Pinging @jelto for gitlab (not sure if the issue is still present or relevant) and @a...
[20:50:21] <wikibugs>	 10netops, 10Infrastructure-Foundations, 10SRE-tools, 10Wikimedia-Mailing-lists, 10serviceops: Support services VIPs with not marked as VIP in Netbox - https://phabricator.wikimedia.org/T295793 (10Legoktm) Any IP (mis)configuration most likely predates Amir's and my involvement with mailman, we never touc...