[07:40:24] 10Traffic: Remove image check on Varnish Dockerized Test Environment - https://phabricator.wikimedia.org/T303794 (10MMandere) [07:40:45] 10Traffic: Remove image check on Varnish Dockerized Test Environment - https://phabricator.wikimedia.org/T303794 (10MMandere) p:05Triage→03Low [10:42:49] 10netops, 10Data-Engineering, 10Infrastructure-Foundations, 10Product-Analytics, and 2 others: Maybe restrict domains accessible by webproxy - https://phabricator.wikimedia.org/T300977 (10ayounsi) [10:43:02] 10netops, 10Data-Engineering, 10Infrastructure-Foundations, 10Product-Analytics, and 2 others: Maybe restrict domains accessible by webproxy - https://phabricator.wikimedia.org/T300977 (10ayounsi) [15:07:54] 10Traffic: Upgrade pybal-test200[23] from Stretch to Buster - https://phabricator.wikimedia.org/T297187 (10MMandere) [15:08:18] 10Traffic: Upgrade pybal-test200[23] from Stretch to Buster - https://phabricator.wikimedia.org/T297187 (10KOfori) p:05Triage→03Low a:03Marc [15:08:45] 10Traffic: Upgrade pybal-test200[23] from Stretch to Buster - https://phabricator.wikimedia.org/T297187 (10MMandere) a:05Marc→03MMandere [16:46:52] 10netops, 10Data-Engineering, 10Infrastructure-Foundations, 10Product-Analytics, and 2 others: Maybe restrict domains accessible by webproxy - https://phabricator.wikimedia.org/T300977 (10ayounsi) Thanks for this task! Now that we have a clear path forward in T298087, it makes sens to focus on this one as... [17:28:53] 10Traffic, 10DC-Ops, 10SRE, 10ops-ulsfo: ganeti4002 dimm error - https://phabricator.wikimedia.org/T303318 (10RobH) You have successfully submitted request SR1087324652. [18:13:34] 10Traffic, 10SRE, 10Patch-For-Review: Configure dns and puppet repositories for new drmrs datacenter - https://phabricator.wikimedia.org/T282787 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by sukhe@cumin2002 for host cp6009.drmrs.wmnet with OS buster [18:25:15] (VarnishPrometheusExporterDown) firing: Varnish Exporter on instance cp6009:9331 is unreachable - https://alerts.wikimedia.org [18:50:01] ^ expected, reimaging [19:12:23] 10Traffic, 10SRE, 10Patch-For-Review: Configure dns and puppet repositories for new drmrs datacenter - https://phabricator.wikimedia.org/T282787 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by sukhe@cumin2002 for host cp6009.drmrs.wmnet with OS buster completed: - cp6009 (**WARN**) -... [20:27:24] 10Traffic, 10SRE, 10Patch-For-Review: Configure dns and puppet repositories for new drmrs datacenter - https://phabricator.wikimedia.org/T282787 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by sukhe@cumin2002 for host cp6010.drmrs.wmnet with OS buster [20:40:15] (VarnishPrometheusExporterDown) firing: Varnish Exporter on instance cp6010:9331 is unreachable - https://alerts.wikimedia.org [20:41:49] ^ expected [20:45:15] (VarnishPrometheusExporterDown) resolved: Varnish Exporter on instance cp6010:9331 is unreachable - https://alerts.wikimedia.org [20:47:56] (EdgeTrafficDrop) firing: 45% request drop in text@drmrs during the past 30 minutes - https://wikitech.wikimedia.org/wiki/Monitoring/EdgeTrafficDrop - https://grafana.wikimedia.org/d/000000479/frontend-traffic?viewPanel=12&orgId=1&from=now-24h&to=now&var-site=drmrs&var-cache_type=text - https://alerts.wikimedia.org [20:52:56] (EdgeTrafficDrop) resolved: 69% request drop in text@drmrs during the past 30 minutes - https://wikitech.wikimedia.org/wiki/Monitoring/EdgeTrafficDrop - https://grafana.wikimedia.org/d/000000479/frontend-traffic?viewPanel=12&orgId=1&from=now-24h&to=now&var-site=drmrs&var-cache_type=text - https://alerts.wikimedia.org [21:36:08] 10Traffic, 10SRE, 10Patch-For-Review: Configure dns and puppet repositories for new drmrs datacenter - https://phabricator.wikimedia.org/T282787 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by sukhe@cumin2002 for host cp6010.drmrs.wmnet with OS buster completed: - cp6010 (**WARN**) -...