[16:07:26] !log admin Adding new OSDs ['cloudcephosd1018.eqiad.wmnet'] to the cluster - cookbook ran by andrew@buster [16:07:28] !log admin Adding OSD cloudcephosd1018.eqiad.wmnet... (1/1) - cookbook ran by andrew@buster [16:07:29] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [16:07:33] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [16:07:57] !log admin Rebooting node cloudcephosd1018.eqiad.wmnet - cookbook ran by andrew@buster [16:08:01] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [16:10:41] !log admin Finished rebooting node cloudcephosd1018.eqiad.wmnet - cookbook ran by andrew@buster [16:10:44] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [16:13:52] !log admin Adding new OSDs ['cloudcephosd1018.eqiad.wmnet'] to the cluster - cookbook ran by andrew@buster [16:13:55] !log admin Adding OSD cloudcephosd1018.eqiad.wmnet... (1/1) - cookbook ran by andrew@buster [16:13:56] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [16:13:59] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [16:16:08] !log admin Added OSD cloudcephosd1018.eqiad.wmnet... (1/1) - cookbook ran by andrew@buster [16:16:11] !log admin Added 1 new OSDs ['cloudcephosd1018.eqiad.wmnet'] - cookbook ran by andrew@buster [16:16:11] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [16:16:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [16:46:21] hello os thos the place to ask about paws ? [16:47:15] I mean, "is this the best place to ask about paws?" [16:47:43] I tried to run the code from https://public.paws.wmcloud.org/756525/My%20first%20notebook.ipynb [16:48:14] but I get an error creating the connection: [16:48:41] it says "OperationalError: (1045, "Access denied for user 's52771'@'10.64.37.27' (using password: YES)") [16:49:02] any idea what I am doing wrong !? [16:51:27] orenbo: you seem to have found an outdated tutorial which does not work with the recent wiki replica rearchitecture, try https://public.paws.wmcloud.org/User:JHernandez_(WMF)/Accessing%20Wikireplicas%20from%20PAWS.ipynb instead [16:52:52] ps - I got the link from https://wikitech.wikimedia.org/wiki/PAWS/PAWS_examples_and_recipes#Connecting_to_Wiki_replicas [16:53:35] trying your link [16:54:08] Changes to db connections also documented at . It looks like that [[PAWS/PAWS examples and recipes]] page needs updating. [16:54:44] note: I actuallt tried to use the new replica host name too which i got here https://wikitech.wikimedia.org/wiki/News/Wiki_Replicas_2020_Redesign#How_should_I_connect_to_databases_in_PAWS%3F [17:04:03] majavah: thanks for the link it seems to help. [17:04:40] btw, what is the difference between analytics and web replicas? [17:11:04] orenbo: the web cluster should be used for queries by interactive web tools, analytics for everything else, analytics allows longer queries than web but might be slower [17:13:37] ok I opened a phabricator item for this [17:13:51] at https://phabricator.wikimedia.org/T290024 [17:15:16] is there a query to get the html for a enwik page from the replica ? [17:17:39] I used the web api for this but not sql [17:55:58] orenbo I posted https://public.paws.wmcloud.org/User:JHernandez_(WMF)/Accessing%20the%20new%20replicas%2C%20changes%20from%20the%20previous%20cluster.ipynb in the task as well, shows the differences, may be helpful [18:03:49] orenbo: the text is not in the DB https://wikitech.wikimedia.org/wiki/Help:Toolforge/Database#Unused_tables depending on what you are doing accessing the dumps or the API could be an option [18:13:43] !log tools.lexeme-forms deployed dfc0838301 (l10n updates) [18:13:47] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL [20:32:29] joakino: accessing the dumps provides wikisource - which is increasingly more challanging to parse (templates + lua modules + transclusions) so I guess the an example for an api query on paws would be nice [20:36:59] orenbo: a fairly easy way to get the HTML could be with the rest API, https://en.wikipedia.org/api/rest_v1/#/Page%20content/get_page_html__title_ particularly the /page/html/{title} I’m on my phone right now, can’t cook an example [20:37:22] You can try it from there and do a request with python [20:37:54] The action API can provide the same and much more , but I can’t do it from my phone ☹️ [20:44:00] perhaps later [20:44:53] I got a very annoying bug trying to run this wikidata query https://quarry.wmflabs.org/query/37904 on the replicas [20:46:03] I put it in a triple single quoated f-string and replaced the double quotes with single quotes [20:46:42] but I the % creates a bug and doubling or quadroupling the % does not help. [20:47:02] as recommended here https://stackoverflow.com/questions/16531116/python-valueerror-unsupported-format-character-y-0x59 [20:47:23] which is strange as % shouldn't even matter in an fstring [21:53:52] !log clouddb-services disable puppet and osm updater script on clouddb1003 T285668 [21:53:56] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Clouddb-services/SAL [21:53:56] T285668: tiles.wmflabs.org OSM is outdated - https://phabricator.wikimedia.org/T285668 [22:07:58] !log clouddb-services restarting osmdb on clouddb1003 to try to capture enough connections T285668 [22:08:00] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Clouddb-services/SAL [22:08:01] T285668: tiles.wmflabs.org OSM is outdated - https://phabricator.wikimedia.org/T285668 [23:23:15] !log toolsbeta deleting toolsbeta-workflow-test T289709 [23:23:18] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [23:23:19] T289709: Switching to a default of nfs_mount: false caused some stale fstab entries to clean up. - https://phabricator.wikimedia.org/T289709