[06:29:06] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10RKemper) [07:45:12] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10elukey) [07:48:42] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10MoritzMuehlenhoff) [07:49:29] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10MoritzMuehlenhoff) [07:58:30] legoktm: yep, medium is fine, I'm off today but will take care of it tomorrow [09:40:51] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10cmooney) [09:41:50] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10cmooney) [09:50:28] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10elukey) [09:54:15] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10cmooney) [10:21:13] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10cmooney) [10:22:16] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10cmooney) [10:58:02] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10ArielGlenn) [11:17:42] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10MoritzMuehlenhoff) [11:18:40] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10MoritzMuehlenhoff) [12:21:09] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10cmooney) [13:10:23] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): Cookbooks repository: avoid stale code in master branch - https://phabricator.wikimedia.org/T287465 (10Volans) p:05Triage→03Medium [14:18:40] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): Cookbooks repository: avoid stale code in master branch - https://phabricator.wikimedia.org/T287465 (10dcaro) Some notes: > The stale copies of those cookbooks are deployed to the cumin hosts, with the risk of potentially running sta... [14:22:27] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): Cookbooks repository: avoid stale code in master branch - https://phabricator.wikimedia.org/T287465 (10Volans) >>! In T287465#7239650, @dcaro wrote: > Removing the tasks will make the rebasing even harder, and the merge later too. Wh... [14:37:20] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): Cookbooks repository: avoid stale code in master branch - https://phabricator.wikimedia.org/T287465 (10Volans) >>! In T287465#7239650, @dcaro wrote: > Some notes: > >> The stale copies of those cookbooks are deployed to the cumin hos... [14:37:26] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10Vgutierrez) [14:43:54] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10cmooney) [14:46:46] jbond, moritzm: would one of you be able to disable puppet before I proceed with the eqiad row B change at the top of the hour? [14:47:08] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10ops-monitoring-bot) Icinga downtime set by mmandere@cumin1001 for 1:00:00 4 host(s) and their services with reason: Eqiad row B maintenance ` c... [14:47:24] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): Cookbooks repository: avoid stale code in master branch - https://phabricator.wikimedia.org/T287465 (10dcaro) > What do you mean? I don't understand the english, sorry. Rephrasing: Removing the tasks from the master branch will make... [14:47:38] topranks: ack, I can do this [14:47:55] cheers [14:50:21] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): Cookbooks repository: avoid stale code in master branch - https://phabricator.wikimedia.org/T287465 (10Volans) >>! In T287465#7239783, @dcaro wrote: >> What do you mean? I don't understand the english, sorry. > > Rephrasing: Removing... [14:51:30] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10ops-monitoring-bot) Icinga downtime set by mmandere@cumin1001 for 1:00:00 1 host(s) and their services with reason: Eqiad row B maintenance ` a... [14:52:27] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10Vgutierrez) [14:53:17] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): Cookbooks repository: avoid stale code in master branch - https://phabricator.wikimedia.org/T287465 (10dcaro) > How removing the entire wmcs/ subtree can make any rebase harder given that there is guarantee of no conflicts at all as t... [14:55:26] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10ops-monitoring-bot) Icinga downtime set by mmandere@cumin1001 for 1:00:00 1 host(s) and their services with reason: Eqiad row B maintenance ` l... [14:55:55] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10Vgutierrez) [14:56:30] topranks: puppet disabled [14:56:44] Great thanks. [14:57:29] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10Marostegui) [15:10:07] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, and 2 others: Switch buffer re-partition - Eqiad Row A - https://phabricator.wikimedia.org/T286032 (10MoritzMuehlenhoff) [15:12:30] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10Marostegui) >>! In T286061#7231980, @Marostegui wrote: > m1-master.eqiad.wmnet switched over to dbproxy1012 which is on row A. Once this row is... [15:16:04] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, and 2 others: Switch buffer re-partition - Eqiad Row A - https://phabricator.wikimedia.org/T286032 (10Marostegui) [15:18:16] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, and 2 others: Switch buffer re-partition - Eqiad Row A - https://phabricator.wikimedia.org/T286032 (10Marostegui) [15:18:33] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10Bstorm) [15:19:10] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10Bstorm) [15:19:20] 10netops, 10Infrastructure-Foundations, 10SRE: Adjust egress buffer allocations on ToR switches - https://phabricator.wikimedia.org/T284592 (10cmooney) [15:20:08] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): Cookbooks repository: avoid stale code in master branch - https://phabricator.wikimedia.org/T287465 (10jbond) > Because the branch was made when the subtree existed, so there's already quite a bit of git history that would be lost. Ha... [15:20:50] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10cmooney) [17:09:23] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Switch buffer re-partition - Eqiad Row B - https://phabricator.wikimedia.org/T286061 (10cmooney) 05Open→03Resolved [17:09:33] 10netops, 10Infrastructure-Foundations, 10SRE: Adjust egress buffer allocations on ToR switches - https://phabricator.wikimedia.org/T284592 (10cmooney) [17:33:07] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): Cookbooks repository: avoid stale code in master branch - https://phabricator.wikimedia.org/T287465 (10dcaro) You'll have to keep applying the changes/refactors to both branches, that will not go away until they are merged (if Icinga... [18:13:55] 10SRE-tools, 10Infrastructure-Foundations, 10cloud-services-team (Kanban): Cookbooks repository: avoid stale code in master branch - https://phabricator.wikimedia.org/T287465 (10jbond) >>! In T287465#7240495, @dcaro wrote: > You'll have to keep applying the changes/refactors to both branches, that will not g...