[09:08:05] !log tools restrict logging in to tools-sgebastion-10 (aka login-buster) T397459 [09:08:09] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/SAL [09:08:09] T397459: Lock down tools-sgebastion-10 (login-buster.toolforge.org) to only members of tools with known dependencies on it - https://phabricator.wikimedia.org/T397459 [10:49:20] !log quarry deploy deny-all robots.txt file T397502 [10:49:24] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Quarry/SAL [10:49:24] T397502: quarry: Add a robots.txt - https://phabricator.wikimedia.org/T397502 [15:48:54] bd808: any chance you know when the user was added to the project for https://phabricator.wikimedia.org/T379550#10930166? I'm trying to find where it failed in the logs. [17:16:35] andrewbogott: unfortunately I don’t think I !logged it, but it would have almost certainly been within an hour of creating the account. https://ldap.toolforge.org/user/zuuldevopsbot [17:22:06] thanks. I found at least one candidate although I have my doubts https://gerrit.wikimedia.org/r/c/operations/puppet/+/1162979 [19:49:58] Authentication faied on WinSCP? putty works fine [19:50:28] reduce a test case or produce more logs [20:01:41] It says "Server refused our key." (re @jeremy_b: reduce a test case or produce more logs) [20:02:09] which server are you trying to connect to? login.toolforge.org? [20:02:17] yes [20:02:27] ok [20:05:55] well more logs than that. (re @Yetkin: It says "Server refused our key.") [20:20:20] I am good to go. The client was outdated... 😊 (re @lucaswerkmeister: which server are you trying to connect to? login.toolforge.org?) [20:36:34] Mediawiki API does not return watch count for some pages. Any ideas as to why? [20:43:40] because not enough watchers (re @Yetkin: Mediawiki API does not return watch count for some pages. Any ideas as to why?) [20:45:11] https://mediawiki.org/wiki/Manual:$wgUnwatchedPageThreshold/en [20:45:39] Is this the default behavior? Any recent changes? Worked fine in May. See this page: https://tr.wikipedia.org/w/index.php?title=Vikipedi:Denemelerin_etkisi&oldid=35409953 (4th column on the left) [20:47:45] can dig through configuration repo and/or phabricator to find changes. but it's not just about configuration. the number of watchers will change over time. (re @Yetkin: Is this the default behavior? Any recent changes? Worked fine in May. See this page: https://tr.wikipedia.org/w/index.php?title=...) [20:49:07] I can give you some samples that have more than 40 watchers and do not return any info from API... 😊 [20:53:34] this is serious. Can I contact any core developer about it? [20:56:41] No response from mediawiki IRC channel... [20:56:47] I could say again "reduce a test case". which basically implies give some examples. show the code (bot repo?) or an APIsandbox URL that used to work and now doesn't. [20:56:48] but also make sure nothing changed on your side. are you really sure you're logged in? does the bot have the right bits? are you using botpassworde (re @Yetkin: I can give you some samples that have more than 40 watchers and do not return any info from API... 😊) [20:58:05] and if it's such an emergency then you should explain why on phabricator. how do you use this data? how does it effect your work? [20:58:25] Already checked. I am using bot passwords. [20:58:25] The code returns just fine for some pages and nothing for some other pages. (re @jeremy_b: I could say again "reduce a test case". which basically implies give some examples. show the code (bot repo?) or an APIsandbox U...) [20:59:15] ok, what I said again then (re @Yetkin: Already checked. I am using bot passwords. [20:59:15] The code returns just fine for some pages and nothing for some other pages.) [20:59:51] No changes on my side, if you mean that 😊 This is surely a bug... (re @jeremy_b: ok, what I said again then) [21:00:29] and the rest of what I said [21:01:25] try to get the watch count for the page [21:01:25] https://tr.wikipedia.org/wiki/Vikipedi:%22Sans%C3%BCr%22_diye_ba%C4%9F%C4%B1rma [21:01:27] via API and you will see what I mean [21:02:16] The API response does not return the "watchers" field at all even though the page is being watched by muştple users. See? [21:04:27] per https://tr.wikipedia.org/w/index.php?title=Vikipedi:%22Sans%C3%BCr%22_diye_ba%C4%9F%C4%B1rma&action=info that page has too few people watching it for the exact number to be shown [21:07:11] taavi: How did it use to work last month, then? 😊 Did you see the page I referenced above? [21:07:57] the most obvious answer is that people who were watching that page last month are no longing watching it [21:08:04] second paragraph. check if you have the right. unwatchedpages (re @jeremy_b: I could say again "reduce a test case". which basically implies give some examples. show the code (bot repo?) or an APIsandbox U...) [21:08:29] yes or number changed [21:12:11] trying with a sysop account 😊 (re @jeremy_b: second paragraph. check if you have the right. unwatchedpages) [21:14:26] Did you see what I wrote above? Did you test it yourself? Did you see the API result? (re @jeremy_b: second paragraph. check if you have the right. unwatchedpages) [21:19:44] did you actually test if you're logged in successfully? (re @Yetkin: trying with a sysop account 😊) [21:20:05] ask the API your username or assert or ask for your rights [21:22:23] Did you get what I said above? The same method works for some pages and does not work for toher pages. This is not about whether you are logged in or not (re @jeremy_b: did you actually test if you're logged in successfully?) [21:27:37] ok then [21:27:39] 1) yes I still want you to try what I asked [21:27:40] 2) yes I still want a further reduced test case. (I said link to code repo or apisandbox link) if you think it works for some pages and not other pages then name a couple from each set. (re @Yetkin: Did you get what I said above? The same method works for some pages and does not work for toher pages. This is not about whether...) [21:28:26] and here. where have you filed on phab? (re @jeremy_b: and if it's such an emergency then you should explain why on phabricator. how do you use this data? how does it effect your work...) [21:32:08] I will see you on Phab. Thanks for your time! (re @jeremy_b: ok then [21:32:09] 1) yes I still want you to try what I asked [21:32:11] 2) yes I still want a further reduced test case. (I said link to code repo o...) [21:33:08] Where can I see the configuration variables set for trwiki? [21:34:05] https://noc.wikimedia.org/wiki.php?wiki=trwiki (`$wgUnwatchedPageThreshold` is 30) [21:36:46] https://codesearch.wmcloud.org/search/?q=unwatchedpages&files=&excludeFiles=&repos=operations%2Fmediawiki-config [21:40:51] We did not have a request to change this limit. Also, the API request returned watch count values last month. How would you explain this behavior? Is there a way to alter the threshold value? (re @lucaswerkmeister: https://noc.wikimedia.org/wiki.php?wiki=trwiki ($wgUnwatchedPageThreshold is 30)) [21:41:24] feel free to answer my questions [21:41:25] This does not list the values used on trwiki (re @jeremy_b: https://codesearch.wmcloud.org/search/?q=unwatchedpages&files=&excludeFiles=&repos=operations%2Fmediawiki-config) [21:42:08] I will do it on phab (re @jeremy_b: feel free to answer my questions) [21:43:12] did you recently start using a bot password by any chance? [21:43:32] (also, yes, please answer jeremy’s questions, because until you do that it seems this discussion will just keep going in circles) [21:43:50] this doesn't say if bot password was new or not. (re @Yetkin: Already checked. I am using bot passwords. [21:43:51] The code returns just fine for some pages and nothing for some other pages.) [21:46:37] The behavior is the same with an admin and a bot account. Neither query returns the watchers field... This answers your question. If you merely test the API, you will see what I mean (re @lucaswerkmeister: did you recently start using a bot password by any chance?) [21:46:55] it does not answer my question. I asked a very specific question and you did not answer it [21:47:11] apisandbox. again. (re @Yetkin: The behavior is the same with an admin and a bot account. Neither query returns the watchers field... This answers your question...) [21:48:36] Man, tested two cases. [21:48:37] 1. Sysop account [21:48:39] 2. Bot account (via bot password) [21:48:40] Neither query returns the watchers field from action=info method [21:48:42] Clear now? (re @lucaswerkmeister: it does not answer my question. I asked a very specific question and you did not answer it) [21:48:48] looks like I already attempted to explain "steps to reproduce" to yetkin a while ago. https://t.me/wmcloudirc/81781 [21:49:28] let me try again. you say the behavior was different one month ago than it is now. were you also using a bot password one month ago? was it the same bot password as you are using now? [21:50:40] and again how did you confirm that your were really logged in instead of just changing configuration and thinking that's enough? (re @Yetkin: Man, tested two cases. [21:50:40] 1. Sysop account [21:50:42] 2. Bot account (via bot password) [21:50:43] Neither query returns the watchers field from action...) [21:50:47] Why does it matter? I say I tested this with a sysop account, right? The code is using the sysop account to get the watch count, with does not work now at all... (re @lucaswerkmeister: let me try again. you say the behavior was different one month ago than it is now. were you also using a bot password one month ...) [21:51:32] You think the API returns watch counts even when you are not logged in for some pages? (re @jeremy_b: and again how did you confirm that you were really logged in instead of just changing configuration and thinking that's enough?) [21:52:00] you claim this is important to you. "serious" even. doesn't sound like you want to help us help you though. (re @Yetkin: Why does it matter? I say I tested this with a sysop account, right? The code is using the sysop account to get the watch count,...) [21:52:16] I bet it does (re @Yetkin: You think the API returns watch counts even when you are not logged in for some pages?) [21:52:21] prove me wrong [21:52:50] already proved you wrong 😊 Read my earlier messages [21:53:32] See this, for example and do a quick API test (re @Yetkin: Man, tested two cases. [21:53:33] 1. Sysop account [21:53:34] 2. Bot account (via bot password) [21:53:36] Neither query returns the watchers field from action...) [21:53:54] please just answer the question instead of trying to guess why I’m asking it. I promise you there’s a logic behind it (re @Yetkin: Why does it matter? I say I tested this with a sysop account, right? The code is using the sysop account to get the watch count,...) [21:55:37] https://tr.wikipedia.org/w/index.php?title=Galata_Kulesi&action=info&uselang=en [21:55:37] says 44 watchers. logged out, incognito window. why would API be different? [21:55:50] Lucas, I respect you. I have already stated that my code has been using the same sysop account for a few months but as far as I can tell, after the end of May, I can no longer get the watch count for "some" pages, which is really weird [21:56:48] you're not meeting us halfway [21:56:58] you're withholding details only you have [21:57:26] https://tr.wikipedia.org/w/api.php?action=query&titles=Galata%20Kulesi&prop=info&inprop=watchers returns 44 watchers for this page (even logged out), so there is no difference [21:59:18] Try this [21:59:18] https://tr.wikipedia.org/wiki/Vikipedi:B%C3%BCrokrat_tart%C4%B1%C5%9Fmas%C4%B1 [22:03:24] you still haven’t answered my question. “using the same sysop account” does not tell me whether your bot is logging into that sysop account via a bot password or something else [22:04:04] and if it was already using bot password before breaking (re @lucaswerkmeister: you still haven’t answered my question. “using the same sysop account” does not tell me whether your bot is logging into that sy...) [22:06:10] see also sandbox version https://tr.wikipedia.org/wiki/special:apisandbox?uselang=en#action=query&titles=Galata%20Kulesi&prop=info&inprop=watchers (re @lucaswerkmeister: https://tr.wikipedia.org/w/api.php?action=query&titles=Galata%20Kulesi&prop=info&inprop=watchers returns 44 watchers for this pa...) [22:21:42] Lucas, I see it now. It says I have to reset the bot password for my sysop account. When I changed that, it worked. Thanks for your patience 😊 (re @lucaswerkmeister: you still haven’t answered my question. “using the same sysop account” does not tell me whether your bot is logging into that sy...) [22:24:16] Are there still non-redirect responses from tools served on tools.wmflabs.org? I ask because I'm updating WikimediaDebug, and I wonder if it still needs that. [22:25:37] \o/ (re @Yetkin: Lucas, I see it now. It says I have to reset the bot password for my sysop account. When I changed that, it worked. Thanks for y...) [22:25:53] Krinkle: someone else in here might know better but not AFAIK at least [22:26:19] (I didn’t even know WikimediaDebug had any toolforge features to begin with…) [22:28:50] The main thing I'm aware of is that it disables the proxy error page serving in favour of your own error page coming through and maybe some header mangling being skipped to see more of your tool's web service directly. [22:28:57] I don't know how much that is still the case today [22:31:52] ref T243734 [22:31:53] T243734: X-Wikimedia-Debug header does nothing on Toolforge web services - https://phabricator.wikimedia.org/T243734 [22:31:57] refT103662 [22:31:58] ref T103662 [22:31:58] T103662: Urlproxy (Toolforge front proxy) should not overwrite error page - https://phabricator.wikimedia.org/T103662 [22:32:03] ref T227626 [22:32:04] T227626: X-Wikimedia-Debug header can make strange results for errors from Toolforge tools - https://phabricator.wikimedia.org/T227626 [22:32:16] 2020 commit says the feature was removed. https://gerrit.wikimedia.org/r/c/operations/puppet/+/622436 [22:32:22] https://codesearch.wmcloud.org/search/?q=%5BWw%5Dikimedia-%3F%5BdD%5Debug&files=cloud%7Ctool%7Cdynamic%7Cproxy%7Cwebservice%7Cwmcs&excludeFiles=&repos= [22:32:33] can't find anything relevant in codesearch elsewhere either [22:35:30] same, only thing I could find in codesearch is beta handling