[08:20:03] <wikibugs>	 10netops, 06Infrastructure-Foundations, 10Prod-Kubernetes, 06ServiceOps: changeprop-jobqueue in codfw rows E & F has no IPv6 connectivity to kafka-main - https://phabricator.wikimedia.org/T433881#12181867 (10cmooney) Apologies for this one folks, it seems this was due to a misconfiguration on our end that'...
[08:35:39] <wikibugs>	 10netops, 06Infrastructure-Foundations, 06SRE: Consider removing BFD on datacentre IBGP peerings - https://phabricator.wikimedia.org/T433675#12181927 (10ayounsi) Sounds good to me!
[09:19:22] <wikibugs>	 10netops, 06Infrastructure-Foundations, 10Prod-Kubernetes, 06ServiceOps, 13Patch-For-Review: changeprop-jobqueue in codfw rows E & F has no IPv6 connectivity to kafka-main - https://phabricator.wikimedia.org/T433881#12182149 (10jijiki) 05Open→03Resolved p:05Triage→03High a:03jijiki I revert...
[09:35:40] <wikibugs>	 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-eqiad, 06SRE: eqiad row A/B switch refresh prep - https://phabricator.wikimedia.org/T418012#12182272 (10cmooney)
[13:39:15] <hashar>	 jhathaway: good morning.   I got PCC compile missing a node due to `WARNING: no nodes found for class: Class/Role::Jenkins`
[13:39:15] <hashar>	 a node with that role was added some weeks/months ago (contint1003.wikimedia.org).  Thus I guess the facts do not refresh automatically or need a manual update?
[13:39:26] <hashar>	 https://wikitech.wikimedia.org/wiki/Help:Puppet-compiler#Updating_nodes states that is done via a systemd timer
[13:39:35] <hashar>	 (happy to file a task if you want :)
[13:47:25] <jhathaway>	 hashar: thanks, they should update automatically, if you could throw up a task with the above, that would be great
[13:52:02] <hashar>	 jhathaway: done with https://phabricator.wikimedia.org/T433980  , I should have started that
[13:52:17] <hashar>	 I am not blocked on it, so no rush :]
[13:54:22] <jhathaway>	 thanks hashar 
[14:33:32] <wikibugs>	 10netops, 06Infrastructure-Foundations, 10Prod-Kubernetes, 06ServiceOps: changeprop-jobqueue in codfw rows E & F has no IPv6 connectivity to kafka-main - https://phabricator.wikimedia.org/T433881#12183670 (10RLazarus) Thanks both!
[15:26:46] <wikibugs>	 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, 06SRE: codfw: pod AB switches upgrade (2026) - https://phabricator.wikimedia.org/T426197#12183919 (10cmooney)
[16:37:17] <wikibugs>	 10Mail, 06Infrastructure-Foundations, 06MediaWiki-Core-Platform-Team, 10MediaWiki-Email, and 10 others: Could not send confirmation email: Unknown error in PHP's mail() function. - https://phabricator.wikimedia.org/T383047#12184299 (10Tgr) Thanks for the thorough investigation!  The code 74 errors are now...