[00:00:26] FIRING: Evaluator: Gateway Timeout (504): Evaluator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DEvaluator%3A+Gateway+Timeout+%28504%29 [00:10:26] RESOLVED: Evaluator: Gateway Timeout (504): Evaluator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DEvaluator%3A+Gateway+Timeout+%28504%29 [00:15:26] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [00:25:26] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [00:40:22] FIRING: Wikifunctions Pod Crash: One of the Wikifunctions k8s pods has crashed - https://alerts.wikimedia.org/?q=alertname%3DWikifunctions+Pod+Crash [00:50:22] RESOLVED: Wikifunctions Pod Crash: One of the Wikifunctions k8s pods has crashed - https://alerts.wikimedia.org/?q=alertname%3DWikifunctions+Pod+Crash [02:55:26] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [03:00:26] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [03:00:41] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [03:05:41] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [03:35:26] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [03:45:26] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [06:55:26] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [07:05:26] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [08:40:26] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [08:50:27] FIRING: Evaluator: Gateway Timeout (504): Evaluator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DEvaluator%3A+Gateway+Timeout+%28504%29 [08:55:26] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [08:55:27] RESOLVED: Evaluator: Gateway Timeout (504): Evaluator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DEvaluator%3A+Gateway+Timeout+%28504%29 [10:55:26] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [10:55:26] FIRING: Evaluator: Gateway Timeout (504): Evaluator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DEvaluator%3A+Gateway+Timeout+%28504%29 [11:05:41] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [11:10:26] RESOLVED: Evaluator: Gateway Timeout (504): Evaluator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DEvaluator%3A+Gateway+Timeout+%28504%29 [11:30:26] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [11:40:41] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [14:25:26] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [14:35:26] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [14:35:41] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [14:40:41] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [17:20:22] FIRING: Wikifunctions Pod Crash: One of the Wikifunctions k8s pods has crashed - https://alerts.wikimedia.org/?q=alertname%3DWikifunctions+Pod+Crash [17:30:22] RESOLVED: Wikifunctions Pod Crash: One of the Wikifunctions k8s pods has crashed - https://alerts.wikimedia.org/?q=alertname%3DWikifunctions+Pod+Crash [17:30:37] FIRING: Wikifunctions Pod Crash: One of the Wikifunctions k8s pods has crashed - https://alerts.wikimedia.org/?q=alertname%3DWikifunctions+Pod+Crash [17:35:37] RESOLVED: Wikifunctions Pod Crash: One of the Wikifunctions k8s pods has crashed - https://alerts.wikimedia.org/?q=alertname%3DWikifunctions+Pod+Crash [18:25:26] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [18:45:26] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [19:15:26] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [19:15:26] FIRING: Evaluator: Gateway Timeout (504): Evaluator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DEvaluator%3A+Gateway+Timeout+%28504%29 [19:20:26] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [19:25:26] RESOLVED: Evaluator: Gateway Timeout (504): Evaluator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DEvaluator%3A+Gateway+Timeout+%28504%29 [19:40:26] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [19:50:26] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [22:20:26] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [22:25:26] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [23:25:26] FIRING: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [23:35:27] FIRING: Evaluator: Gateway Timeout (504): Evaluator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DEvaluator%3A+Gateway+Timeout+%28504%29 [23:45:26] RESOLVED: Orchestrator: Gateway Timeout (504): Orchestrator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DOrchestrator%3A+Gateway+Timeout+%28504%29 [23:45:27] RESOLVED: Evaluator: Gateway Timeout (504): Evaluator Service Outage - https://alerts.wikimedia.org/?q=alertname%3DEvaluator%3A+Gateway+Timeout+%28504%29