[00:43:43] <wikibugs>	 10GitLab (Project Migration), 06Release-Engineering-Team, 07Essential-Work: Create new GitLab project group: wmgmc - https://phabricator.wikimedia.org/T387060#10784814 (10thcipriani)
[07:47:43] <wikibugs>	 10GitLab (Infrastructure), 10ChangeProp, 06cloud-services-team, 06collaboration-services, and 10 others: Figure out a plan to move forward with regarding Redis License changes - https://phabricator.wikimedia.org/T360596#10785130 (10hashar) Redis is now available under the AGPLv3. That was announced by thei...
[08:05:42] <wikibugs>	 10GitLab (Infrastructure), 10ChangeProp, 06cloud-services-team, 06collaboration-services, and 10 others: Figure out a plan to move forward with regarding Redis License changes - https://phabricator.wikimedia.org/T360596#10785204 (10akosiaris) >>! In T360596#10785130, @hashar wrote: > Redis is now available...
[15:26:37] <wikibugs>	 10GitLab, 06collaboration-services: 422 error logging into gitlab during the hackathon - https://phabricator.wikimedia.org/T393191 (10Reedy) 03NEW
[15:46:38] <wikibugs>	 10GitLab, 06collaboration-services: 422 error logging into gitlab during the hackathon - https://phabricator.wikimedia.org/T393191#10786538 (10Aklapper) Cannot reproduce. I'm on the `Wikimedia` wifi at the Hackathon and I just logged into our GitLab without a problem, and 2FA also worked without a problem.
[15:52:17] <wikibugs>	 10GitLab, 06collaboration-services: 422 error logging into gitlab during the hackathon - https://phabricator.wikimedia.org/T393191#10786557 (10thcipriani) FWIW, I'm not seeing much of a spike in 4xx responses per grafana: https://grafana.wikimedia.org/d/R_1IvBZnz/gitlab-omnibus-overview?orgId=1&refresh=1m&view...
[17:41:44] <wikibugs>	 10GitLab, 06collaboration-services: 422 error logging into gitlab during the hackathon - https://phabricator.wikimedia.org/T393191#10786955 (10Dzahn) First thoughts by some might be related to throttling (fyi, for those with access, this has the details where we exempted the Hackathon network T382309).  But th...
[17:45:59] <wikibugs>	 10GitLab, 06collaboration-services: 422 error logging into gitlab during the hackathon - https://phabricator.wikimedia.org/T393191#10786962 (10Reedy) I had an issue earlier, so did another person…  I’m not sure if either was after the wifi reset
[17:50:24] <wikibugs>	 10GitLab, 06collaboration-services: 422 error logging into gitlab during the hackathon - https://phabricator.wikimedia.org/T393191#10786965 (10Dzahn) I can confirm though there are multiple hits in the gitlab access_log that match a 422 and an IP from the Hackathon network.
[17:54:59] <wikibugs>	 10GitLab, 06collaboration-services: 422 error logging into gitlab during the hackathon - https://phabricator.wikimedia.org/T393191#10786967 (10Dzahn) Here are the timestamps. There is block between 09:31 and 09:43, another 10:04 to 10:24, 2 lone events at 15:34 and then it stopped. Would this correlate with lo...
[18:02:16] <wikibugs>	 10GitLab, 06collaboration-services: 422 error logging into gitlab during the hackathon - https://phabricator.wikimedia.org/T393191#10786981 (10Dzahn) The url.path is almost always `/users/auth/openid_connect/callback?...`  with the exception of the last 2 which were for `import/github.json`.  The referer is mo...
[18:12:48] <wikibugs>	 10GitLab, 06collaboration-services: 422 error logging into gitlab during the hackathon - https://phabricator.wikimedia.org/T393191#10787024 (10Dzahn) It has also been confirmed that our CAS (idp) has mostly been idling.  https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&refresh=5m&var-server=idp1...