[08:52:53] <wikibugs>	 10serviceops, 10DBA, 10Phabricator, 10serviceops-collab, and 2 others: sort out mysql privileges for phab1004/phab2002 - https://phabricator.wikimedia.org/T315713 (10Marostegui) Daniel, while working on the grants, we've noticed something strange with db1117 (m3-slave), so we are going to rebuild it (it sh...
[09:10:58] <wikibugs>	 10serviceops, 10DBA, 10Phabricator, 10serviceops-collab, and 2 others: sort out mysql privileges for phab1004/phab2002 - https://phabricator.wikimedia.org/T315713 (10Marostegui) @Dzahn also, to confirm, phab1004 needs to have exactly the same grants as phab1001, right? I see it does on mysql but not on the...
[10:49:16] <wikibugs>	 10serviceops, 10Discovery-Search, 10SRE, 10serviceops-collab, and 2 others: Sunset search.wikimedia.org service - https://phabricator.wikimedia.org/T316296 (10Jelto) >>! In T316296#8206081, @Jelto wrote: > [...] > Out of curiosity I looked at the httpd logs for the Pods on Kubernetes and found only one "va...
[13:26:10] <wikibugs>	 10serviceops, 10SRE, 10TimedMediaHandler: Upgrade Wikimedia production's ffmpeg to 4.4 or later so we can use the fpsmax flag - https://phabricator.wikimedia.org/T318419 (10Jdforrester-WMF) p:05Triage→03Low
[13:36:46] <jnuche>	 hi, we have a huge spike of PHP errors coming from some timed dump process running on host snapshot1008 The errors started an hour and a half ago and I don't see any recent changes around the relevant code. Could this be an ops issue somewhere? https://logstash.wikimedia.org/goto/8b63707e9db235abb2f4ce70800dc186
[13:42:08] <apergos>	 we moved all dumps jobs to php7.4 at the beginning of the week, that could be the cause
[16:39:17] <wikibugs>	 10serviceops, 10DBA, 10Phabricator, 10serviceops-collab, and 2 others: sort out mysql privileges for phab1004/phab2002 - https://phabricator.wikimedia.org/T315713 (10Aklapper) Assuming it's related, if not please ignore this comment: After ssh'ing onto phab1001, I cannot connect to MariaDB anymore:  ` $:ac...
[21:21:03] <wikibugs>	 10serviceops, 10DBA, 10Phabricator, 10serviceops-collab, and 2 others: sort out mysql privileges for phab1004/phab2002 - https://phabricator.wikimedia.org/T315713 (10Marostegui) It is related yeah, we are rebuilding it