[00:29:12] (03CR) 10David Martin: "Thanks, James! I probably should have provided some background explanation. None of the unnecessary properties that you flagged will act" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1019138 (https://phabricator.wikimedia.org/T356228) (owner: 10David Martin) [07:25:45] (03PS1) 10Joal: Update clickstream job - better joins [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1037370 (https://phabricator.wikimedia.org/T366042) [07:48:57] (03CR) 10Joal: [C:03+2] "Verified on cluster - self merging for deploy" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1037370 (https://phabricator.wikimedia.org/T366042) (owner: 10Joal) [08:07:14] (03Merged) 10jenkins-bot: Update clickstream job - better joins [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1037370 (https://phabricator.wikimedia.org/T366042) (owner: 10Joal) [08:33:58] Hey folks - I'm about to release refinery-source. Holler if you wish me to add something not yet in there [08:45:57] (03PS1) 10Joal: Update changelog.md for v0.2.42 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1037434 [08:46:44] gmodena: may I ask for a +1 or +2 on this please? --^ [08:50:54] joal checking [08:51:00] thank you [08:51:30] (03CR) 10Gmodena: [C:03+1] Update changelog.md for v0.2.42 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1037434 (owner: 10Joal) [08:52:40] (03CR) 10Joal: [V:03+2 C:03+2] "Self merging for deploy" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1037434 (owner: 10Joal) [08:53:58] Starting build #7 for job analytics-refinery-maven-release [09:18:29] Project analytics-refinery-maven-release build #7: 09SUCCESS in 24 min: https://integration.wikimedia.org/ci/job/analytics-refinery-maven-release/7/ [09:30:37] Starting build #7 for job analytics-refinery-update-jars [09:31:06] !log release refinery-source v0.2.41 on archiva [09:31:08] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:33:02] (03PS1) 10Maven-release-user: Add refinery-source jars for v0.2.41 to artifacts [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1036603 [09:33:02] Project analytics-refinery-update-jars build #7: 09SUCCESS in 2 min 23 sec: https://integration.wikimedia.org/ci/job/analytics-refinery-update-jars/7/ [09:34:10] (03CR) 10Joal: [V:03+2 C:03+2] "Merging for deploy" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1036603 (owner: 10Maven-release-user) [10:38:21] My stat1009 job should be finished in 1-2h. [11:36:56] oh it could take 10h, there is an asymptotic tail :-/ [12:05:24] Heya folks, I'm about to deploy refinery - let me know if there's anything you'd like me to add before going for it [12:29:32] !log Deploy refinery using scap [12:29:34] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [12:59:41] (03CR) 10Jforrester: [C:03+2] "Acknowledged" [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1019138 (https://phabricator.wikimedia.org/T356228) (owner: 10David Martin) [13:00:16] (03Merged) 10jenkins-bot: Create schema for tracking WikiLambda run-function API endpoints [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/1019138 (https://phabricator.wikimedia.org/T356228) (owner: 10David Martin) [13:42:00] !log deploy refinery onto HDFS [13:42:02] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [13:54:53] gmodena: I have created a new airflow CR if you don't mind: https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/715 [13:54:57] It's relatively small :) [13:56:31] joal done. Does analytics/dags/webrequest/refine_webrequest_frontend_hourly_dag_factory.py require a version bump too? [13:57:03] hm, could be! it's a very minor change, but to match the exisitng webrequest it would be good! [13:57:07] gmodena: --^ [13:57:24] joal ok. Let me open a MR then [13:57:35] +1 gmodena - I'll review and then deploy [13:58:01] gmodena: I'm also sending a small change to the clicksteam MR (bump of artifact version) - I'll take your approval is still ok :) [14:04:29] joal https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/716 [14:05:31] done gmodena [14:06:35] test failed gmodena :( [14:07:19] gmodena: I think you need to merge the latest version of main to get the artifact declared [14:09:45] joal updated - re-running tests [14:12:22] still failure gmodena - fixtures this time [14:19:02] joal it's fixed now [14:20:07] 06Data-Engineering, 10MediaWiki-extensions-Linter, 10Parsoid-Read-Views, 10Event-Platform, 07Wikimedia-production-error: Commons page fatals when accessed in parsoid read views mode - https://phabricator.wikimedia.org/T364229#9846799 (10ihurbain) [14:20:22] 10Data-Engineering (Q4 2024 April 1st - June 30th), 10Event-Platform, 10GitLab (Pipeline Services MigrationšŸ¤): Migrate Data Engineering Pipelinelib repos to GitLab - https://phabricator.wikimedia.org/T344730#9846801 (10Snwachukwu) Thanks for the reminder @tchin . Is there some restriction on the gitlab trust... [14:51:40] 10Data-Engineering (Q4 2024 April 1st - June 30th), 10Event-Platform, 10GitLab (Pipeline Services MigrationšŸ¤): Migrate Data Engineering Pipelinelib repos to GitLab - https://phabricator.wikimedia.org/T344730#9846947 (10dancy) >>! In T344730#9846800, @Snwachukwu wrote: > Thanks for the reminder @tchin . Is th... [14:57:20] 10Data-Engineering (Q4 2024 April 1st - June 30th), 10Event-Platform, 10GitLab (Pipeline Services MigrationšŸ¤): Migrate Data Engineering Pipelinelib repos to GitLab - https://phabricator.wikimedia.org/T344730#9846958 (10Snwachukwu) @dancy Thank you! I have just done that. See merge request [[ https://gitlab.w... [15:29:34] Ok, all fixed on the airflow side, deploying [15:37:03] !log deploying airflow dags [15:37:04] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:03:02] !log Delete old "reportupdater_browser_all_sites_weekly" DAG from airflow (lefover from reportupdater migration, renamed to browser_metrics_weekly/grid [16:03:04] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:20:44] !log Pause webrequest airflow dag to rollback a change [16:20:48] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:38:42] gehel: We have another NPE with maxmind reader :( [16:42:30] gehel: I'll reopen the ticket [16:43:03] Damn! [16:43:26] Can you paste the stack trace to the ticket?