[00:07:54] agreed. i was just offering my perspective for your guide based on what i've seen. [00:08:15] heck, if they even knew to check modules and/or sub-pages, that would solve half the problems. [00:12:07] Glad you made it here. You can DM either Agent or NotAracham with your concern. (or any other steward, for that matter) [00:12:54] If it can avoid me fighting my internet connection i'll gladly do that [00:13:43] Plus determining which of the options from this link is exactly for what I want is rather difficult for my feeble mind [00:22:56] Since you said Discord works well for your internet, I'd recommend starting with DMing a Steward. They can advise if you need to use SR and what "category" is best for your concern. [00:23:40] I have DMd agent as of minutes prior [00:38:29] [1/2] Oh man 😄 [00:38:29] [2/2] What did I do 😄 [00:40:30] [1/5] Someone asked me for help. [00:40:30] [2/5] I'd say sure,let's see, [00:40:31] [3/5] Oh hang on, your files are all heavily modified and not suitable to interact with templates and modules from Wikipedia. [00:40:31] [4/5] Half of the files were missing and the rest needed simply replacing. [00:40:31] [5/5] Day three, and I am still replacing templates and modules or adding the missing ones 😄 [00:40:45] I'm too good hearted 😄 [00:42:03] He also has a nag of seeing templates, and think, I need those because of red links. Clicks in the green document field on the [edit] copies and pastes.... [00:43:56] [1/2] Voila! Document page in a template page. [00:43:56] [2/2] I've replaced probably 20 templates in Loop already. The long [template:tlg] f.ex. 😮 It's soo long, and in loop. You just keep scrolling 😄 [00:47:36] This is how I ended up 3k templates deep into wikipedia template spaghetti, just trying to kill every error. A lesson well learned. [00:47:59] Indeed [00:48:58] That got me to write that "Calculate the work you need to do"-page [00:55:45] [1/3] oh, man! been there, done that. [00:55:45] [2/3] "can you help with our wiki? I'd just like such-and-such template" [00:55:45] [3/3] 30 dependencies later... [00:57:32] favicons started loading [00:57:34] and then [00:57:36] unloaded [00:57:39] 😭 [00:58:48] images of all kinds may be here and there until the migration is complete in a couple weeks. [01:09:08] in general I'd start people who want wikipedia templates off with that massively slimmed down version that isn't dependency hell which works for virtually all use cases except the rare few who legitimately want all the bells and whistles for clear reasons [01:09:56] see very earliest pin in the channel (which btw could use a cleanup) [01:53:12] Ooh, never looked in those... [01:53:20] Some good links there [01:53:30] I stopped grabbing templates from wikipedia cuz they are just an absoloute nightmare 90% of the time [01:54:35] indeed [01:55:03] Also because everyone wants a say in how it should work [01:55:29] They are merging and splitting like rabbits 😄 [01:58:26] the worst part I think is that you can't just undo it, if you start you've kinda stuck with it [02:06:09] Indeed [02:06:43] [1/2] So far I have this: [02:06:43] [2/2] https://jwmeeting.miraheze.org/wiki/Help:Installing_Infoboxes_from_Wikipedia [02:07:00] WHOOW - Only one image??? [02:07:07] Not 3? [02:11:16] The title is wrong though [02:11:24] Need to find something better [02:12:04] [1/2] i am an oddball. i have not had many issues importing templates from Big Wiki and, while I appreciate they may be overkill, they work well on the wiki I spend most of my time on. I'm kind of their wiki guru, but that's also taught me to look for the dependencies. While PI might be more efficient, it's been pretty easy to just pull in Big Wiki's solution. That's probably overkill for sim [02:12:05] [2/2] ple infoboxes, but it has advantages in converting measurements (sq km to sq mi, etc.) and such. some pros and some definite cons. [02:14:32] Problem is, Often these are small wiki's. [02:14:54] Than such heavy machinery is indeed overkill [02:15:29] It's easier for us who know the stuff. I already helped two guys on Miraheze out that way. [02:16:03] But for small wiki's that likely never grow, it's better to start easy [02:16:20] One can always "Upgrade" [02:17:25] [1/2] this is an awesome start. not sure i'd change the title since that's what most people are looking for. [02:17:26] [2/2] only thing I'd add is ensure they have a MediaWiki:common.css page since today I learned the absence of that will prevent xxx/styles.css from working [02:17:47] It's in there 😉 [02:18:08] Without it the Infoboxes won't float right [02:18:16] cool, i musta skimmed over that. [02:18:28] 🙂 [02:18:33] It happens [02:19:09] totally agree. i've already realized i'm kinda the exception to the rule. [02:20:22] that was brought home to me when a wiki asked me to help with an infobox or two and some 30 dependencies later I had them where they wanted to be. I am scarred by that, despite my willingness to snag Big Wiki templates. [02:23:01] Yeah, that gives satisfaction [02:36:06] I'm off to bed... 3:35 am already [02:55:48] It’s 9:55PM for me [03:00:27] I may create a wiki [03:00:39] After WikiTide merged for the better [03:23:55] Server died? [03:24:28] I wouldn't be surprised [03:26:42] Every time I try to press request wiki [03:26:47] It just says “login back” [03:26:49] And I did [03:26:59] But it still won’t go through [03:29:55] What is the PageImages extension exactly useful for? [03:30:30] The description on its extension page is too vague for me [03:48:15] It is used to extract images to feed into the SEO extension [03:48:26] Automatically [04:09:30] category: "Pages that use a deprecated format of the math tags" [04:09:34] how to fix this [04:09:45] just saw it today on one of my pages idk how long its been there [04:28:46] [1/2] Making redirects from searching to the target page is incredible [04:28:46] [2/2] I can finally make it so people can search a page and go to the right one [04:59:02] [1/2] How do I enable the syntax highlighting? [04:59:02] [2/2] I have all the settings set but it just shows me the plain text in the editor [05:01:20] Visual editor also seems to not work on my wiki [05:02:41] [1/2] Visual Editor I heard a lot of people had issues with (not using it myself though) [05:02:42] [2/2] for syntax highlight, did you enable the codeMirror extension? and if yes, did you just do it now? if the latter, it might just be a cache thing maybe [05:17:21] there's a marker button in editor, it's turned off by default for all new aeditors [05:24:21] Why [05:24:47] Well promblemo solved [05:41:22] error 502 ://:conan~34: [05:55:40] tradition [06:11:02] did the site just crash for anyone else [06:11:52] [1/2] Mmm yes [06:11:53] [2/2] Server transferring sure is fun [06:12:29] rip i was cooking just now tbh [06:12:53] Thankfully I was done with some quick stuff [06:13:09] I was just gonna double check some stuff [06:13:23] same was importing some small templates but was going crazy [06:14:22] Are you seeing any errors? [06:14:37] [1/2] Yep [06:14:37] [2/2] Wiki is temp down rn for SephiaSplash [06:14:48] Also Ink Idols wiki [06:15:07] Is it connection refuses [06:15:16] Tye database isn't connecting, so I'm assuming it's doing a merge rn [06:15:17] <.myirlname> all of miraheze is down again [06:15:22] Oh dang [06:15:35] oh [06:15:41] specific database? [06:15:49] db131 [06:16:02] <.myirlname> same thing happened yesterday [06:16:05] db131 is down? [06:16:09] Yes [06:16:15] hmm [06:16:18] I'll restart it [06:16:29] Can you try now? [06:16:41] Still down [06:17:10] It says it can't access the db because it refused to connect [06:17:14] What's your wiki? [06:17:14] https://media.discordapp.net/attachments/1189418422749106336/1200685305292914758/image.png?ex=65c71454&is=65b49f54&hm=4d8a5c215b3487a4a96bf5b89c25e7dca1d8b3ce819b44af74b46b9dddbff1aa&=&format=webp&quality=lossless&width=1259&height=191 [06:17:16] Laaame. [06:17:18] 😖 [06:17:24] SephiaSplash is mine [06:17:27] https://cdn.discordapp.com/attachments/407537962553966603/1200685985755828234/image.png?ex=65c714f6&is=65b49ff6&hm=4f2f2f2d255ee5f766ac830a7f3461f8a47fab3cacf524ade9fe585c45161762& [06:17:38] Yummy mySQL [06:17:50] Let me restart the server [06:19:11] It's literally my Web apps class all over again [06:19:49] Can you all try again? [06:20:02] IT WON'T GIVE ME BACK MY CHILDREN [06:20:13] Still down [06:20:15] https://cdn.discordapp.com/attachments/407537962553966603/1200686692579950603/image.png?ex=65c7159f&is=65b4a09f&hm=4f50b143a8a3afec7fa3e69554016ecbf8ba8622a66117c6c815d2d4b593e1c0& [06:20:17] Im having this issue [06:20:37] [1/2] We did it guys [06:20:38] [2/2] We killed the miraheze servers [06:20:43] Okay now that's weird [06:20:47] MySQL is running [06:21:13] Yeah SephiaSplash is still not connecting to db131 [06:21:43] [1/2] same here [06:21:44] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200687061775159306/image.png?ex=65c715f7&is=65b4a0f7&hm=13e02b754caa9ed6cfa416ab5ef22d09dcce74f6634788ef68a17b0e3dc3e7cd& [06:21:55] that's great [06:22:02] db131 is up but not sure why it's being stubborn [06:22:05] <.myirlname> even meta gives the same error [06:22:05] [1/2] Mines says the wiki is temporarily unavailable [06:22:06] [2/2] Not the site [06:22:27] Great timing because we just finished backing up that server [06:22:30] its a db131 for me [06:22:34] wonderful [06:22:55] So my children might have been snapped out if existence [06:25:03] What caused her(db131) to be in a bad mood? [06:25:25] I guess she didn't like to hear that we were on the verge of replacing her [06:25:31] What's interesting is that it's up [06:25:34] db131 choose violence today [06:27:17] Is there a way to make miraheze to temporarily view the back up but not edit it [06:27:49] no database, no wiki [06:28:06] Dang [06:28:18] yeah mine is down too [06:28:34] We're looking into it [06:28:40] The wiki kidnapped my kids [06:29:09] [1/2] Make sure to check for moths in the db [06:29:09] [2/2] Don't want any bugs in it [06:29:44] I love how the feeds chats show exactly when the database went down [06:30:04] anyone else have wiki problems? [06:30:13] goodbye article on the duchy of parma that you were typing up @cloutius [06:30:14] 😭 [06:30:22] bro... [06:30:31] 😭 [06:30:46] [1/3] My kids [06:30:46] [2/3] I have everything saved to my laptop [06:30:46] [3/3] But they be gone [06:31:22] Good thing I wasn't typing up a long lore heavy page rn like what I was going to do before drawing [06:32:49] Y'all want to drop what your wiki are about in #offtopic [06:34:33] To everyone who doesn't know why their wiki isn't loading, see #announcements [06:34:43] Really hoping my edit went through before the crash... probably not but I'll hope anyways [06:38:36] For those on IRC we are performing emergency maintenance and migrating all the DBs to the new infrastructure right now. [06:39:15] Apologies for the inconvenience everyone [06:39:31] Hopefully everything goes fine and nothing gets lost [06:40:14] Data is 100% fine, it's the software which decided to call it quits today [06:40:18] Nothing is lost, we can see all the data on even db131 but mysql will not accept connections. Rest assured all data is safe. [06:40:36] starting the migration with db131 and db142 first [06:41:10] [1/2] So db131 basically is like [06:41:10] [2/2] All the wikis [06:41:27] there's 4 wiki databases [06:41:35] db131 actually has the least amount of wikis [06:41:44] db121 is the biggest, followed by db101 [06:42:02] Hello guys. [06:42:06] [1/2] So my wiki is stored with the fewest [06:42:07] [2/2] Interesting [06:42:08] db131 is every wiki apparently [06:42:08] I'm new here. [06:42:26] Because the global databases are hosted on it [06:42:45] which is why I'm advocating for a db162 \:P [06:42:56] mariadb on db142 does not want to stop [06:42:58] :thonk: [06:43:05] I thought testwiki was working but only the main page works there. [06:43:22] Go read-only MW side if you have to [06:43:47] the import was still running on it lol [06:43:50] stopped now [06:43:55] Oh lol [06:44:03] Miraheze last.miutes of.pife support on the old servers [06:44:23] <.emjay> :ironic: [06:44:32] I knew they would go out with a bang, and it seems so. [06:44:41] I'll be so glad to be done with them. [06:45:04] Honestly a whole server shutdown is one hell of a way to go down [06:45:41] I didn't expect that, thats for sure. [06:46:13] all the databases are taking their time to shutdown [06:46:26] https://tenor.com/view/oh-my-god-its-happening-ok-stay-calm-the-office-gif-6091046 [06:46:33] any ETA? [06:46:36] haha yeah, I feel that way! [06:46:42] hopefully a few hours [06:46:53] exciting times [06:47:10] [1/3] The transferring [06:47:11] [2/3] It's happening [06:47:11] [3/3] https://cdn.discordapp.com/attachments/407537962553966603/1200693467639205960/ECOfVQkVUAAG2I5.jpg?ex=65c71bee&is=65b4a6ee&hm=a932941bdca537fb24e80a76b26ea005eb4a65bbb764a1a14a9d7dae836bd4c7& [06:52:57] [1/2] is there no way to get the announcement ping role? [06:52:58] [2/2] there's no option in browse channels to get it anymore and its not called "channels & roles" anymore [07:15:47] man [07:16:26] so that's what's going on. okay [07:17:06] We're in the midst of a revamp, added it to you in the meantime while we sort out the other server-sized elephant that decided today was the day to act up. 🙂 [07:17:29] if miraheze moved to a better servers, my pages will be kept or not [07:17:59] nothing is lost [07:18:19] alright ty [07:18:50] since the wiki is not working does anyone know the function to set a car so a player owns it [07:19:13] Unfortunately we host thousands of wikis, so I'm not quite sure which game you're referring to. [07:19:18] This down time is allowing me to make my "wiki mascots" [07:19:19] This is for the entire wiki network, not the specific wiki that you were looking at [07:19:21] Ahh [07:19:41] How long you reckon? [07:19:49] There might be a game-specific discord out there that's likely better equipped to assist, hopefully we'll have y'all back in action within a few hours. [07:20:03] Ok good good [07:20:06] that's honestly faster than I was expecting [07:20:27] rooting for y'all 🙏 [07:20:34] thanks [07:20:45] Memcache will be still an issue? [07:20:59] no because when wikis return, they'll be on our new servers [07:21:06] Cool [07:21:25] then swift migration will continue? [07:21:29] Do you know the model of servers you are using? [07:21:59] Yes, that wont be immediately finished but everything else will be 100% on new infra when wikis return. [07:22:02] It's a mix of parts. I think the rack is a Dell R650? [07:22:03] The other day I mounted an Asus ESC400-12 [07:22:04] Funny enough, there's a tech page on meta for exactly that, but it's not currently available. 😅 [07:22:24] Oh nice! [07:22:55] I was just noticing the issue where the discord code of conduct and so forth are on meta.miraheze.org [07:22:55] I've never had the privilege of racking a server [07:24:53] I've had the privilege of handing the qualified IT technician the parts. 😄 [07:25:16] What you runnin the sites on, EPYC? [07:25:19] https://cdn.discordapp.com/attachments/407537962553966603/1200703066048036886/IMG_20240124_104446395.jpg?ex=65c724de&is=65b4afde&hm=b754c1ae1d7b141adc6f34611be7d80153bcd1d55a0ee7ecec4cebff90ac3a92& [07:25:46] there's no way to create a temp placeholder page about rn? [07:26:01] I only pay for VPS never had to deal with large scale infastructure before [07:26:03] instead of server errors [07:26:23] @agentisai although this is another, I just put one of the cpus [07:27:03] also have you posted on twitter? [07:27:50] gorgeous server for sure! [07:28:06] oh nice, is that an RTX in there? [07:28:17] box of magic and mystery [07:28:35] I see a zero in there, so it's definitely got one of those at the end. 😄 [07:29:01] [1/2] Reject Modernity. Embrace Tradition [07:29:01] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200703996629880942/Reactionary_Meme.png?ex=65c725bc&is=65b4b0bc&hm=0f101018ad36d8cb687d78da5b45107bb1daa7f8229e63cfb3ff3c65be69d1d5& [07:29:27] haha [07:29:34] Tradition just keeled over under duress, I think perhaps not. 😄 [07:29:48] sadly, we must accept modernity or else we have extended farm downtime [07:29:59] as evidenced by db131 just deciding to die [07:30:00] Four 3090 [07:30:27] no way, 4 3090s? [07:30:29] Dang, what on earth is that doing, being sent off to the crypto mines?! [07:30:36] haha yeah, I was about to say [07:30:47] Training speech models [07:30:49] But the Modernity has a thing that I hate. [07:30:51] MY CHILDREN! [07:31:12] [1/2] But yeah [07:31:12] [2/2] Rip miraheze [07:31:15] Nice! Love a good model. [07:31:33] I just do the fancy front-end work of saying hey hardware, do the fancy thing. [07:31:35] I have to locate for you a photo of a server we mounted with eight 4090 XD [07:32:24] The first time we tested we had the fear everything started to go in flames lol [07:32:52] Yeah... heat management would be brutal with 8 of those buddies... wow! [07:32:56] 👀 [07:33:28] Agent needs to go to sleep, let me see if I can rouse folks with appropriate credential access. [07:38:09] https://cdn.discordapp.com/attachments/407537962553966603/1200706297495048272/IMG-20230619-WA00912.jpg?ex=65c727e1&is=65b4b2e1&hm=8a38dd06d9da74dde203fcf77b44b294d084c1ea89dcf407a21cd835b39dcb5f& [07:39:08] I will head out, but ping me if I am needed all, I will probably be checking in every hour or two throughout the night [07:40:01] If anyone has any questions please ping me. I wish the servers could not go out with a bang like this but they sure did. [07:46:19] any other sre looking after process rn? [07:47:36] Currently building files for migration, EMEA folks will be coming online for handoff shortly and NA folks (SRE, not me) will be checking in periodically [07:50:13] 2 TB RAM [08:07:05] a:pepe: [08:28:03] site's got technical difficulties [08:28:14] still getting them an hour later [08:28:42] #announcements [08:29:11] how long's this going to last? [08:29:25] several hours, this is an emergency maintenance [08:31:03] <.labster> This is not a drill [08:31:04] [1/2] The old servers were, like always, acting up, so we decided to do an emergency maintenance to transfer all the data to the new servers as we couldn't get the global DB to turn back on. [08:31:04] [2/2] Note data integrity is assured and there is no data loss. [08:48:43] rip in pieces db131 😔 [08:50:27] good thing i'm not at home today :insane: [09:00:43] even most hardcore hyeprfixation havers need a break, here it is [09:01:19] <.labster, replying to han.0000> If you would like to ensure that db131 ends up in pieces, talk to @owenrb about purchasing our old hardware. Baseball bat not included. [09:03:54] I will happily go down to the DC and end them [09:04:18] If you think that's a good idea once they are down, send me £64 for the train ticket [09:06:34] How would you like the £64 to be sent? [09:08:48] just wanted to come in here and say thank yall for the forced break from maintaining my webkinz doc. i was never gonna get it otherwise [09:12:03] Omg webkinz i used to love them as a kif [09:12:24] I remember i used to watch webkinz prank call videos lol [09:13:29] LOL 100+ messages since I logged off. Must be a server down... Oh.. yes. My site is down too 😄 [09:13:49] Good morning everyone [09:14:01] (or evening, afternoon Night) [09:15:11] Hey Ro [09:15:44] Hey @erilies [09:16:13] [1/2] What's your favourite ideology? [09:16:14] [2/2] For me is Monarchism [09:17:06] Please read the pinned message on top [09:18:54] [1/3] Hmmm... It's not there anymore 😮 [09:18:54] [2/3] But anyway, [09:18:54] [3/3] It is not allowed to talk ideologies etc, like politics in this chat. [09:19:24] You need to go to #offtopic [09:19:40] also this channel is dedicated to Miraheze discussions and support/help [09:19:54] OK, thank you guys. [09:31:47] When Miraheze gets up and running again, can anyone recommend some F1 alternative universe wikis or sports alternative wikis? [09:32:57] [1/2] I only know Wikipedia's [09:32:57] [2/2] They are extensive on all the data, history, etc. [09:35:59] personally never stumbled on such [09:36:55] alt universe/worldbuilding would probably not be hard to stumble on through wikidiscover [09:37:30] [[w:Formula1]] [09:37:30] https://en.wikipedia.org/wiki/Formula1 [09:37:43] but sport related? [09:37:55] yeah sports would be tricky [09:37:57] Yeah :') the picture guide I use for Webkinz uses miraheze, and I loved webkinz YouTube as a kid too. Spent so many hours watching random camcorder videos of stories that had my dream plushies. [09:38:02] I don't think we even had sport category [09:38:15] I know I've seen them but they don't fly off the shelves for sure [09:38:30] not miraheze but https://formularejects.com/wiki/Main_Page [09:38:31] Yeah F2, F3, F4, Formula Regional, Super Formula, Wec, Le Mans, etc [09:38:43] speaking of categories, still cranky about overhaul not going through lol [09:38:49] actually my own wiki has alternate racing universes [09:39:10] including f1 [09:39:24] All the people from different little groups gathering here because their info site is down is one of the cutest things I've seen on discord. [09:39:53] it's peak discord really [09:42:05] the 2024 version of cavemen gathering because their watering hole is dry [09:42:12] happens every time tbh [09:42:13] Whahahaha [09:42:40] quite lucky i ended up choosing today to go and socialise :insane: [09:43:52] All have abstinences 🤪 [09:43:59] woke up and choose socialising [09:45:01] this was planned two weeks ago so this is just a really nice coincidence :EpicFaceMH: [09:46:31] [1/2] Which servers are down now? [09:46:31] [2/2] I saw db131 and mine is db121 [09:46:43] Or are they all down? [09:47:10] db131, but all wikis need db131 to run because it is the global DB, that is why we decided to migrate now because everything was down. [09:47:25] okay [09:48:54] @agentisai had an idea to split global DBs off onto seperate DB server and I am starting to think it's a good idea. That way if one goes down not everything goes down... [09:49:04] <.labster> @cosmicalpha is now a good time to review my pull request? 😖 :EpicFaceMH: 🤣 [09:49:05] yeah my wiki is down [09:49:38] Lol, I probably won't sleep much tonight so I guess I could. [09:50:11] <.labster> Honestly while data is transferring some of you folks should get some sleep so you'll be fresh when you have something to do. [09:50:25] wise idea [09:50:46] the dreaming is timing out so hopefully one person at a given time is able to respond if something poops [09:50:55] no, procrastination time [09:51:04] I just woke up mate 😄 hahaha [09:51:12] every time is procrast time [09:51:34] Does anyone know what the largest wiki is in terms of number of pages hosted on Miraheze? [09:51:41] I was up til 5 am, it's 10:50 here hehehe [09:51:46] Probably a good idea but I have to much on my mind to sleep right now lol, it is 3AM and I don't even feel remotely tired right now... [09:51:46] blue pages [09:51:48] I'm sorry if this is a dumb question but what does it mean when a link or photo works for like two seconds and then doesn't? Like what's happening behind the scenes for that? The pictures on mine are flickering like lights on a Christmas tree. [09:52:00] <.labster> I meant some SREs should sleep but yeah, everyone else can too. [09:52:39] swift going silly when sre is busy w/ db's, I guess [09:52:43] its only like 9pm here 😔 bit before i head to bed rip [09:52:54] not much sense to be found in odd image bugs right now [09:52:59] Image servers are also rebalancing onto new servers so they disappear and reapper during rebalancing for that migration. [09:53:46] Those have been migrating for a few days though. [09:53:48] So when certain lines of code are in the same server it works, but then as the move continues so do those lines and then it doesn't work anymore [09:54:34] Essentially I guess, it doesn't quite work like that in the backend, but that is kinda the idea I guess. [09:54:37] It's the same when the pc is Defragmentating. [09:54:52] it's like the deconstruction chamber in inside out [09:55:10] I think more of it is just cache when it's moment to moment [09:55:12] it's blocks by blocks [09:55:20] oha [09:55:58] Neat, okay, thank y'all [09:58:01] Nonciclopedia is off? [09:59:11] All Wiki's are off [09:59:14] <.labster> Every database is turned off [09:59:22] See #announcements for more context. [09:59:41] Emergency maintenance, hopefully only a few hours [10:01:32] wtf is happening [10:01:38] turn on the mysql [10:02:02] See #announcements [10:02:11] <.labster> The mysql must flow... across an ocean [10:02:32] 💀 [10:02:49] We can't do that. Current DB wasn't working so we had to migrate early to the new infra. Sorry for the inconvenience. [10:03:39] Once we are back online I will probably try and post an on wiki notice with more context and detail for what happened and why we decided to do this emergency maintenance. [10:04:18] <.labster> Will Special:IncidentReports be making a comeback? [10:04:24] well, linux inst for anyone [10:04:40] I was literally just about to mention that. I plan to file an IncidentReport, yes. [10:05:02] now, i think the owner of the vps is creating the .sql file backup, and setuping another mysql server [10:05:03] Is the Twitter account announcement a good idea [10:05:14] Was one not posted? [10:05:17] already done [10:05:22] Ah okay [10:05:30] I thought we posted an announcement. [10:05:49] <.labster> Twitter is terrible now, I can't see it on Nitter either. [10:05:56] <.labster> https://status.miraheze.wiki/ is all green though! [10:06:03] miraheze mastadon [10:06:10] the next gen twitting spot [10:06:21] https://twitter.com/MirahezeStatus [10:06:21] Oh I should update Miraheze Status [10:06:31] cohost [10:06:31] Nope 😄 [10:06:42] nah, nobody will knows.. [10:06:45] I should post to this as well [10:06:57] That's why I asked [10:07:22] i forgor it exists lol [10:07:27] 😄 [10:08:48] I think I am the only one with access to that, I need to correct that so MirahezeStatus account can be used more... [10:09:14] Also there should be at least 2 people who can access any one account [10:09:32] It's refferred to in the erro messages indeed [10:09:49] getting an error when trying to access miraheze [10:09:49] it's saying "cannot access the database: connection refused (db121) [10:09:49] any ideas? [10:10:08] emergency maintenance [10:10:09] See #announcements [10:10:13] <.labster> AFD the servers have all been taken down for emergency maintenence [10:10:20] irc can see announcements? [10:10:24] ah ok, thank you! [10:10:26] <.labster> @rodejong IRC folks can't see announcements channel [10:10:44] oh hahaha. Another thing learned [10:11:04] good idea to make one, maybe [10:11:14] relay from discord announcement [10:11:22] We could make the relay relay #announcements to #miraheze also with an [ANNOUNCEMENT] prefix [10:11:44] irc is a single room? [10:11:46] <.labster> IRC isn't always persistent like discord, they'd have to run ZNC or something [10:12:18] oh right lol, well we could have the relay send notices to users on connection during downtime or something. [10:12:38] Some things are quite important [10:12:46] Like this [10:13:31] AFD: sorry for the inconvenience, we had to do emergency maintenance to migrate to new infrastructure ahead of schedule due to our current servers acting up again. [10:13:53] oh they disconnected right as I sent that message [10:14:04] <.labster> Wait, how can he be in two places at once? [10:14:13] huh? [10:14:23] <.labster> I'm just being silly. [10:14:34] Oh, me? [10:14:51] lol I don't understand [10:16:17] <.labster> We need to stay in good spirits as our data moves over. [10:17:51] I am going to enable a DatabaseMaintenance error page [10:17:58] this was exactly what I was wondering about when I joined [10:22:50] [1/2] What da Elvis goin' on in here? 😮 [10:22:51] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200747740855029761/image.png?ex=65c74e7a&is=65b4d97a&hm=665687bf0e2c2271b26080b66af196ab6ec459665ba5430664b04b2c8b9c9eff& [10:23:03] emergency maintenance [10:23:17] See #announcements [10:23:20] https://discord.com/channels/407504499280707585/407504500136607745/1200690659686895697 [10:23:28] I saw, I saw. 😉 [10:23:32] Read just now!@ [10:25:44] I enabled a new error page [10:25:54] [1/2] um, 2022? [10:25:55] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200748512627929138/image.png?ex=65c74f32&is=65b4da32&hm=5a768a3461c36d05b58888f05e8cdf02af5e7f44a8756250296f7266ad437347& [10:26:19] I fixed that it was leftover from last time we used that error pages when I first created it lol [10:26:50] 141 😱 [10:26:56] Indeed [10:30:51] https://cdn.discordapp.com/attachments/407537962553966603/1200749756541046784/image.png?ex=65c7505a&is=65b4db5a&hm=eadc62691bc6521292dc4b911f87e57572a5780f118a11892ea0c6af82773ce4& [10:31:06] The blue links are kind of hard to read [10:32:06] Indeed, that was made in 3 minutes over a year ago, I will improve it a bit here soon. [10:32:30] During that months long outage of db141 [10:32:56] okay [10:34:36] Well... I am off doing some chores in the mean time, CU guys later 😉 [10:35:39] 🇨🇺 later [10:36:29] hi guys im new here : D [10:36:51] <.labster> Welcome! [10:36:56] ello [10:37:05] this server seems fun [10:37:27] is the miraheze website getting raided or something? [10:37:59] <.labster> See #announcements [10:38:35] How's the style now? [10:38:54] oh i see [10:39:14] Good to know, that database is alive and kicky! [10:39:22] <.labster, replying to cosmicalpha> Everything is good except "scheduled maintenance" which is a blatant lie [10:39:27] I really wish db141 was a history. 😰 [10:39:32] Yep [10:39:49] <.labster> It will be gone soon enough to the server farm in the sky [10:39:58] it definitely is w/ at least backups done better now [10:40:17] wow there are 5,500 Wikis on miraheze? [10:40:31] I feel like over 6k now [10:40:44] How about now? [10:40:46] anyways im gonna go take a look at other channels too [10:40:47] but it includes dormant wikis [10:41:21] are we allowed to send images here because i just foundsomething funny [10:41:24] Does anyone know how long will the maintenance take? [10:41:36] at least a few hours [10:41:58] Oh so it’s not some days, good to know. Thank you! [10:41:59] <.labster, replying to balltuh> if it's on-topic. Otherwise post in #offtopic [10:42:06] I should really create a better page but for now real-time updated stats are in https://meta.miraheze.org/wiki/User:Reception123/temp_stats [10:42:17] (whenever stuff comes back you can have a look) [10:42:20] [1/2] drunk miraheze bot [10:42:20] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200752647381205032/IMG_4471.jpeg?ex=65c7530c&is=65b4de0c&hm=bc22ad7d67c615b8a681db1c1c0aa89a710dfec89eca801f88efd1cbb98ed87d& [10:42:21] but iirc it's 5000 _active_ [10:42:42] I deployed it multiple times for updates lol [10:42:51] lol [10:43:26] wait is labster a moderator for this server only or for all of discord [10:43:43] [10:43:58] All of Discord, of course [10:44:07] <.labster, replying to balltuh> Just this server, sadly. It's to distinguish from wiki administrators. [10:44:15] Did not expect Miraheze to go down today. Unfortunate that this had to be done. [10:44:28] you seem like you could be really trustworthy [10:44:33] We tried our best to avoid it but unfortunately the old servers didn't like that [10:44:35] <.labster> I'm also Chair of the Board for Miraheze. [10:44:44] darn [10:44:44] these servers like to be unpredictable [10:44:52] Well we will soon be on much more reliable hardware to hopefully help things a ton in the future [10:45:22] <.labster, replying to balltuh> speaking words of wisdom, letter B [10:45:28] I know its a bit of inconvenience now, but I do think it'll be worth it when it is all over and done. [10:45:33] : D [10:45:55] Elections here exist? [10:46:50] <.labster> Most things on Miraheze are elected. Discord mods are, stewards are, wiki creators are, and so on. [10:47:02] well anyways [10:47:14] being a contributer of a wiki on miraheze is difficult [10:47:26] last week our wiki got raided [10:47:54] <.labster> Did you report to the counter-vandalism team? [10:48:17] nope i didnt even know a server for miraheze existed [10:48:37] <.labster> You can report on meta.miraheze.org as well (when it's running, of course) [10:48:41] i need to tell this to everyone in my wiki about this server [10:49:53] is there an estimate when the servers will be up again? [10:50:06] a few hours [10:50:12] until its back up [10:50:18] ok thank you [10:51:36] do you guys earn money from hosting the miraheze website? [10:51:39] No [10:51:48] dang [10:52:12] this is one of the most normal servers ive seen [10:52:26] but miraheze itself needs money [10:52:27] other servers are infected with gen z [10:53:03] there's a fundraiser going rn [10:53:04] they should make a suggestion and QNA posting channel [10:53:30] hm [10:53:41] <.labster> #support is for questions and answers [10:54:55] it would help if he was, he knows about a server I observe which should really get taken out for coordinated harassment but ¯\_(ツ)_/¯ [10:55:29] wha [11:01:31] <.labster, replying to raidarr> But how will I make this quarter's OKRs if I disable too many servers? [11:04:00] Hello [11:04:43] <.labster> Welcome! [11:04:56] How do I verify? [11:05:16] <.labster> I don't think you can verify right now, since the wikis are down. [11:05:32] Aww crap [11:06:41] Click on my pfp, thoughts on my ideology? [11:07:07] <.labster> Ideology discussion can go into #offtopic, thanks! [11:07:17] Ahh okay [11:07:54] yeah verification isn't possible cause it links to meta [11:08:30] <.labster> More specifically to db141 which is the most down of the databases right now. [11:08:34] Are you interested to answer? [11:09:02] The fact I am talking to a Discord admin is mindblowing [11:09:29] <.labster> We do exist! [11:09:53] That you talk alot especially in this channel hehe [11:13:14] is there any timeframe for when the servers will come back online [11:13:25] several hours [11:13:30] alright [11:26:23] https://cdn.discordapp.com/attachments/407537962553966603/1200763732628885524/voice-message.ogg?ex=65c75d5e&is=65b4e85e&hm=b02447bd0db9b9c74cf360b2129e996f84dc965e65cae39545fa9b2a7ffa6725& [11:46:55] <508695> why is our wiki down [11:47:26] I've already seen your wiki, I'm a bit confused about it though [11:48:04] #announcements Sudden maintenance for server migration issues. [11:48:22] <508695> o [11:48:29] I also already know. I've been on the GPR discord server for a while [11:48:40] [1/2] We are waiting. [11:48:41] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200769342510469150/image.png?ex=65c76298&is=65b4ed98&hm=4aa43052261ffa13fe86ae48199a64b42cdcc2998dad31ae2ccb1a10da4ac0c1& [11:48:44] Patiently waiting! 🙂 [11:49:27] same [11:50:53] how long will this maintenance take? do you guys have any estimate [11:54:42] it will take hours [11:55:52] We should be able to bring things back up in 1-2 hours I'd estimate. [11:57:00] dam and im out here stuck in the sanctum, is the mining fatigue really permanent or can i remove it? yes i didnt read the wiki much [11:57:16] oh i gound the way down [11:57:22] this is a server for the wiki farm, not a specific wiki [11:57:28] oh ok [11:58:18] We will start slowly bringing things up in read_only in about 5 minutes [11:59:36] yay [12:00:00] Where do u get ping roles? [12:00:51] Ящеры [12:01:06] Почему по английски говорите? [12:02:16] Потому что я делаю (использовал Google Translate) [12:04:28] some wikis should be coming up in read only now [12:04:42] это сервер вики хостинга [12:06:12] are they all coming on one at a time? [12:08:03] No, only wikis on certain databases as the transfers finish for said databases [12:08:36] sorry miss read and thought you said are they all coming on at once [12:08:58] oh ok cool [12:09:39] Currently only the wikis that were on db131 are online now (ironic as that DB was the reason we had to do emergency maintenance) [12:09:40] 👀 [12:09:45] yay mines back but [12:09:59] https://cdn.discordapp.com/attachments/407537962553966603/1200774703430783026/image.png?ex=65c76796&is=65b4f296&hm=2fde2af6abb6004a6306ca6d21700ed5c60e87cc46d0a4ac008e68c5374c829b& [12:10:00] lol [12:10:16] Yeah things will come back, reload a few times and see if it comes back. [12:11:02] yeah it looks good now, still a bit wonky but manageable at least [12:11:24] I would still gove them some time [12:11:31] to warm up, let's say [12:11:33] Cache is completely empty so it will take time to warm up [12:11:42] yeah thats valid [12:14:51] its been a long sleepless night for me... but we'll get it all taken care of... [12:15:19] [1/2] quick question [12:15:19] [2/2] Where do I get the announcement ping role? [12:15:51] I'm not sure how you do anymore, maybe a Moderator has to give manually for now. [12:16:02] oh ok [12:16:03] i was given it manually so yeah [12:16:04] shouldnt have to [12:16:28] it would be in channels & roles but it's disabled [12:23:19] We should be able to bring on another database soon [12:27:40] yay [12:28:28] The other 2 are 3x larger than these ones so may take a little longer [12:31:00] So many people are joining [12:32:11] Next DB is back online [12:32:31] mine is back but without the skin it had before so im being blinded by no dark mode lol [12:32:40] can confirm that it used to be self-assignable and no longer is [12:33:18] Mine’s back? [12:33:34] ok it fixed itself [12:39:23] db151 committed destruction [12:39:49] Hi guys, there's a wiki is down. Can I download all wiki's data? Thanks [12:42:12] It's not possible to download a DataDump until the wiki is back up. There is no data loss [12:42:43] https://tenor.com/view/washing-machine-rock-shake-break-gif-16501605 [12:42:51] The Miraheze databases rn [12:43:09] will bring up another DB soon [12:43:13] What Wiki does Mirahaze use? [12:43:39] What do you mean? Miraheze hosts wikis [12:43:47] If you mean software, MediaWiki [12:44:03] I see [12:45:18] Seems like MediaWiki is not working so we'll. [12:45:54] no? [12:46:04] Mediawiki is very well proven as a software [12:46:07] It's not that, it's the old servers [12:46:20] We're now migratiing to new ones following the merger with WikiTide [12:46:21] OK, one Wiki works, but... [12:46:30] Why there's default favicon? 🤔 [12:46:36] Currently, the wikis are going through some updating as we speak, which is why it is temporarily down. [12:46:58] the file probably didn't load [12:47:10] or the settings hadn't been in the cache yet [12:47:31] Oh! I see. [12:48:14] I will bring up db151 next [12:48:23] https://tenor.com/view/bh187-the-dark-knight-joker-how-do-i-look-well-hello-gif-19287789 [12:48:27] Only have one question! [12:48:33] (eating) [12:48:50] Will there be another break tomorrow or even tonight? [12:48:59] Hmm? [12:49:41] hopefully not miziol7, but until the migration is done, wikis may not be fully functional [12:50:28] Should be fully functional within the hour or so I hope [12:50:41] Let’s hope so [12:51:30] What do you guys think about DocuWiki [12:51:45] pretty cool for simple stuff [12:52:01] but that belongs more in #miraheze-offtopic/#offtopic [12:52:11] That is if I don't fall asleep doing this, if I do Agent will finish when he gets on or Paladox. Its 6AM and I haven't slept at all so very really possibility but I apologize in advance if so. [12:52:40] it's pretty cool but, harder to set [12:53:04] By the way, what infrastructure do we use? On-premise servers or? [12:53:39] We are in the process of moving infra [12:54:04] CosmicAlpha: Remember not to push yourself, there are a lot of people in infrastructure who can pick up where you left off [12:55:12] Not around right now [12:56:42] Moving to cloud based? [12:58:01] they're not, seem to be on our own hardware [12:58:20] since they're listed on Meta to be hosted at FiberState, a colo provider [12:58:48] The new ones are not our own hardware, but rented, dedicated FiberState hardware [13:00:10] Is this relay to Matrix? [13:00:16] no, to IRC [13:00:25] I see [13:00:27] on ircs://irc.libera.chat [13:08:02] portableinfobox is broken in some wiki [13:09:26] it'll warm up eventually [13:09:30] hopefully [13:16:41] [1/2] Looks great!! [13:16:41] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200791488766951465/image.png?ex=65c77738&is=65b50238&hm=79dd0f4dcd392102cd5ff841db4e41bb7b73bfff25554b124b38b532a6fb4492& [13:17:17] Now that looks sick [13:23:19] [1/2] "The wiki is temporarily unavailable" dialog still uses a direct link to Discord instead of miraheze.org/discord [13:23:19] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200793160717180998/image.png?ex=65c778c7&is=65b503c7&hm=8e40e3ea9bf64468cb4a90fe79e7c53c438581521ba9fe7b7871e8596805f044& [13:23:39] as opposed to this dialog [13:23:51] Oh right [13:27:18] Hello? [13:27:25] Hey [13:27:28] Welcome [13:27:31] ello [13:28:16] [1/2] I haven't changed the front page why is the infobox suddenly broken [13:28:16] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200794404932308992/image.png?ex=65c779ef&is=65b504ef&hm=d7c0faf178ae1e57b5cbbfe5b47ab37e819ee2eddd81bebc8c42119fb251f1dc& [13:28:47] It looks like portable Infobox has disabled or not worked [13:28:57] I'd say wait until maintenance is over and then purge [13:29:05] Something is probably grumpy somewhere [13:29:29] Emergency maintenance still underway [13:29:35] ok [13:29:51] The maintenance probably shouldn't cause that [13:29:54] I have question to all you! [13:30:01] But I don't think it's worth debugging [13:30:02] Only 1 DB left to go now [13:30:11] Ask away! [13:30:17] Nice, it has to be db141 [13:30:25] no, db121 [13:30:29] Ah [13:30:39] The largest DB [13:30:44] It's the same with the rss feature. It didn't load any RSS feed [13:30:52] I can see that [13:31:00] @cosmicalpha go to bed if agent is running stuff [13:31:09] Are you guys done already? [13:31:14] And paladox is awake [13:31:17] No [13:31:21] Noooo, STill going on [13:31:26] Paladox is [13:31:32] Go to bed then [13:31:49] Its 630AM [13:31:51] I want to ask you question! [13:31:56] I should sleep an hour [13:32:01] Ask, we can answer [13:32:07] We can do multiple discussions [13:32:11] what's your question, soldier [13:32:17] You can't pull an all nighter [13:32:41] If it's still occurring after a cache purge once the maint is done, please let us know [13:33:16] Yeah I will, Don't worry. I know how to find you 😄 [13:33:30] [1/2] Did everyone has watched that show? [13:33:31] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200795723810226246/Winx_Club.jpg?ex=65c77b2a&is=65b5062a&hm=c52cdcd94918fa0a93975d41f582763c428f440d2bb63cc626ff148647c75fad& [13:33:42] #offtopic [13:33:43] Nope, I didn't [13:33:54] -> #offtopic please [13:35:14] I'll be here for the next like 10 hours now [13:36:01] I'll be here for the next 1 I guess :D5 [13:36:08] I'm off Paladox will handle from here now. [13:36:24] Go paladox woooo [13:37:19] I’ll be here for the next 13.9 hours [13:37:58] is there an estimate for when mirahezze will be back editable ? [13:38:04] Once the last server is back up Paladox will remove read only and maintenance will end also [13:38:24] And we will be completely on new infra, mediawiki-side [13:38:51] i can tell it's already much faster loading [13:39:30] Same [13:39:36] It’s immediately so fast [13:39:42] I can’t know if it’s Miraheze or not [13:40:20] Wow the rest are already done? [13:40:47] yes [13:41:12] 3 of 5 wikis I manage are on 121, so waiting 👍 [13:42:39] How long did it take? [13:42:48] let him sleeep [13:43:11] about 7 hours [13:43:21] Woah [13:43:33] Either way, enjoy your nap [13:43:36] While it lasts [13:43:50] Now I am putting DnD on and sleeping an hour or two. [13:43:53] And those were all the small ones [13:44:00] Only 2? [13:44:00] Oof [13:44:07] Anyways have a nice nap [13:44:14] One was 330GB, the others were 130GB and 190GB [13:44:24] https://tenor.com/view/hiding-under-covers-tired-sleepy-hiding-under-blanket-good-night-gif-15375403 [13:45:06] Meanwhile Paradox will fix db121 [13:45:42] yes, it is still copying though [13:45:49] How do you tell which db a wiki is on [13:46:25] managewiki core shows cluster, in our mw-config repo, Database.php each DB is mapped to a cluster [13:46:28] core settings [13:46:35] stop talking :moonch: lmao [13:46:40] lol yeah [13:47:15] That’s what they all say, and why I hav 3 friends (Jk lol Gn CA) [13:47:58] i can log into my wiki now. is maintenance still going? [13:48:26] Maintenance is for db121, if your wiki is not on db121 you can log in [13:48:26] [1/2] I still have this one [13:48:26] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200799480660906024/image.png?ex=65c77ea9&is=65b509a9&hm=8d8d9aaedebb3172f10ef64459fb6fa6b7a10e6341ee2c3b170e71ce349876ae& [13:48:31] yeah, waiting for other wikis to get back, then read-only mode will be turned off [13:49:04] I must be on db21 I guess [13:49:48] Huh, I don’t see 131 or 121 in the map [13:49:53] (Ping oof) [13:49:56] DUDE [13:50:03] I turned the ping off to not notify [13:50:08] Not anymore, it is new DBs now [13:50:09] Wait he’s still here [13:50:16] wheeze [13:50:26] Aaaa, I meant to reference the message not draw attention [13:50:33] Im sowy 🫠 [13:50:49] Ima go now [13:52:18] It appears when I log in now, db161 is down? [13:52:31] It still says the error when logging in [13:52:55] I'd say give them some more time before [13:53:39] [1/2] miraheze is worked for me now [13:53:39] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200800793473851462/bandicam_2024-01-27_18-56-39-709.jpg?ex=65c77fe2&is=65b50ae2&hm=efe34868210c26b8cb294643f749a35198219282ec7b997223b1d9b58372a2f4& [13:53:43] but are you still working it? [13:54:04] 👆 [13:56:22] https://cdn.discordapp.com/attachments/407537962553966603/1200801476147171428/IMG_5842.png?ex=65c78085&is=65b50b85&hm=d27d1a64678416145e0c298123dafe377915f8dfcb7c28bf4e5270091d885867& [13:56:34] [1/2] Haha. Uh. Fuck. [13:56:34] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200801527779045447/image.png?ex=65c78092&is=65b50b92&hm=50c15c14fb13a811fa91029776ab3425d146f81beb4a95dbc59649763111f9c9& [13:56:35] @legitsi Watch your language. [13:57:04] This only happened when I tried to log in. Double fu-reak. [13:57:27] If you have any account on any affected wiki, login will not work [13:57:37] got it [13:57:56] oh right [13:58:04] it was a problem during 141 [13:58:38] Guess I’m stuck for now [13:59:32] It's an artefact of how central auth "works" [14:00:44] to be honest, CentralAuth is not meant to be used outside of Wikimedia [14:00:54] [1/2] Getting a different message (but means the same thing) on AllTheTropes. [14:00:54] where wikis being deleted is a very rare ocurrence, compared to her [14:00:54] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200802617845108806/IMG_1106.png?ex=65c78195&is=65b50c95&hm=b237bd3125f5b4a4885abcb2b1610814e630941003a2667aca1f25465686d0b3& [14:00:58] https://meta.miraheze.org/wiki/Miraheze [14:01:11] Whow... 4 images [14:01:22] But it loads quickly [14:01:31] What an improvement [14:01:40] oh so not just my wiki is embedding multiple of the same image [14:01:41] is meta stable to edit or is it better to wait a little longer? [14:01:44] [1/2] Getting a different message (but means the same thing) on AllTheTropes. Meta works for me though! [14:01:44] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200802828508221553/IMG_1106.png?ex=65c781c8&is=65b50cc8&hm=79b451bb668195645b415bea2f6e93546ace84c4e9a6038ef11a3b688703093b& [14:01:58] that's on db121 which is currently copying over [14:02:11] when read only is turned off it will be [14:02:34] OK then! I don’t know how long the copying will take. I’m guessing all day? [14:02:43] You have the mobile version. Mine is the desktop version I guess [14:02:57] I feel like it's something w/ discord [14:02:58] May or may not be all-day [14:03:01] it should be done by today [14:03:11] Meta loads pretty fast [14:03:16] It's almost surreal [14:03:18] https://cdn.discordapp.com/attachments/407537962553966603/1200803221615153162/image.png?ex=65c78225&is=65b50d25&hm=ae0344cef7ba3c08edea2a19efeac3efebfce2188e9c6eff35ba6fbfeed067b5& [14:03:24] I think it's read only now anyway, but I would wait [14:03:30] OK then! I don’t know how fast the servers are or how much data there is. [14:03:31] I can feel… THE POWER OF WIKITIDE! [14:03:40] in which timezone? [14:03:43] oh, didn't see that it was read-only—my bad 🤦 [14:03:49] All timezones [14:03:50] https://tenor.com/view/power-aladdin-disney-unlimited-cosmic-power-genie-gif-5266474 [14:03:55] Wait untill everything is over, it will be slower [14:04:07] I sure hope not [14:04:18] give it around 3-4 hours? [14:05:02] UTC [14:05:03] I'd have measured expectations until transition is complete and has a few days to breathe [14:06:14] https://meta.miraheze.org/wiki/Special:RecentChanges?hidebots=1&translations=filter&limit=50&days=7&enhanced=1&urlversion=2 [14:06:41] The (Wiki)Tide is coming in! [14:07:01] That is absolutely the fastest I've ever seen recent changes load at miraheze [14:07:34] The (Wiki)Tide is coming in! [14:07:55] I wonder how it's gonna be for Pizza Tower Wiki lol [14:07:58] I’ve never seen this. How about recent changes cover up to 5 years? [14:08:10] since it's heavy on CSS, images and gifs [14:08:22] As for Pizza Tower Wiki, a little bit slower [14:08:36] well, a bit heavier than average wiki [14:08:51] There will be an initial performance impact until caches populate & settle but it'll probably still be better than the baseline of the old servers [14:09:25] Isn’t CSS a load on the client not the server? [14:09:44] images [14:09:45] Sure, but it won't be as quick as it is now, as nobody can edit and submit either [14:10:12] but yeah, I consider my network to be a bit slower than average [14:10:21] As soon as the traffic is running, it will be a tad slower [14:10:39] An increase in edits shouldn't impact too much [14:10:41] Don't be so pessimist, please \:P [14:10:54] As cache is proactively populated [14:11:06] So an edit will cause parser cache to fill up [14:11:06] Well that was a quick sleep lol [14:11:14] @cosmicalpha get lost [14:11:16] dude [14:11:39] I have to wake up now I actually slept in by 10 minutes, I do sleep for 30 minutes [14:11:58] Not meaning too, the result can only be positive [14:12:18] @cosmicalpha please take a break of checking here. We will survive. [14:12:23] are your wikis working or something [14:12:59] i'm guessing they're all getting ported one-by-one, so some will finish before others [14:13:12] It's going by database server [14:13:19] @cosmicalpha I will DM if anything explodes, mute the server [14:13:20] all servers except db171 are up [14:13:24] also read only for now [14:13:25] oh [14:13:34] which wikis are in db171 [14:13:40] Mine isn't working [14:13:45] Note that if you have an account on any down wiki, you can't login [14:13:50] Am I on db171 now? [14:14:02] If your wiki shows a maintenance screen then yes [14:14:04] *db161 [14:14:12] yeah, whoops [14:14:16] mine are on 121, still on maintenance :ThinkerMH: [14:14:19] what percentage (roughly) of wikis are on db161 [14:14:27] is it a region or age thing [14:14:30] A lot of wikis [14:14:38] db161 is the biggest database server for some reason [14:14:46] It's randomly allocated on creation [14:14:53] sure didn't seem like it [14:15:07] I blame db141 somehow [14:15:14] does CW chooses server for wiki at random? [14:15:28] ah [14:15:31] i see [14:15:32] Yes, database is randomly assigned on creation [14:15:41] Unless you've been moved for some reason [14:15:47] [1/2] times [14:15:47] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200806362775556196/image.png?ex=65c78512&is=65b51012&hm=7066b361922abb35a05723eef372072c414dba1c92255f4bb3b57cb5ffb277b8& [14:15:50] https://phabricator.miraheze.org/T11730 [14:16:02] db161 still is down though on my internet [14:16:09] it's been 8 hours now [14:16:21] "every timezone" [14:16:22] https://cdn.discordapp.com/emojis/1114166620831617054.webp?size=48&name=Clueless&quality=lossless [14:16:44] Honestly better than I thought [14:17:04] isn't it 8 hours and counting though [14:17:15] The original method I was using to migrate everything over would've taken at least a day [14:17:41] Agent, paladox & cosmic need a very well deserved drink once this is done. They are working insanely hard and emergency failovers are a mammoth effort. [14:17:58] more than a drink [14:18:13] How about a McDonalds Ice Cream Machine? [14:18:20] amd sleep [14:18:22] They all need to sleep and then be taken to the nearest pub for a refreshment of their choice [14:18:24] spa even [14:18:36] What is a good way to reward an IT person for their hard work? [14:18:39] They don't need a new maintenance nightmare. 🙂 [14:19:28] Their output is delicious but there's a reason those machines are always broken. [14:19:31] What would be a good reward for someone who does maintenance work on servers? [14:19:48] mrbradlerz: back in my day UO accepted GitHub sponsorships [14:19:51] Apparently the manufacturer makes it hard to service them. [14:20:05] What could that be? [14:20:29] Might need a community award system [14:20:30] What’s the difference with the current one [14:20:44] They are made with lower quality parts for money! [14:20:52] [1/2] Why miraheze toggle only translators can translate? [14:20:52] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200807643288174703/image0.jpg?ex=65c78644&is=65b51144&hm=8f83f702abc73b02e2146800cb59c5c90d08f2a9990671b1fc2e594be4102219& [14:20:59] Like Brad said, so the manufacturer has a monopoly on serving them [14:21:26] Our own version of Varn stars [14:21:34] Using Hexes [14:21:36] did you see @agentisai ? [14:21:36] I meant it retorical 😉 [14:21:44] and still do apparently https://github.com/sponsors/Universal-Omega [14:21:55] GIVE HIM MONEY [14:21:59] The original method was to make a zip file on the server itself and then scp it over. The new method zips the file to stdout, pipes it through ssh, and writes it on the new server through cat which means the slow disks aren't written to and we migrate everything while it zips over [14:22:01] just that their profile is private so it's harder to find the sponsor button [14:22:25] on Meta Wiki only translators can translate now, new user group [14:22:34] very inteligent [14:22:38] Nice! Is that the server with the 8 4090's? [14:22:42] if it's another wiki - something was changed in permission settings? [14:22:43] yes [14:22:59] Those fans must be industrial sized 😆 [14:23:15] Pretending I’m smart enough to understand the latter; can’t we also use MySQL dump and restore or is that too slow [14:23:18] I think my company also did one with 10, 4090. And yes, that is for mining hard [14:23:30] but I don't have photos of that [14:23:51] [1/6] All of the above. To my understanding... [14:23:52] [2/6] * Constant wear and tear from continuous use [14:23:52] [3/6] * Substandard part quality [14:23:52] [4/6] * Inconvenient design for maintenance [14:23:53] [5/6] * Extremely disgusting maintenance [14:23:53] [6/6] * An extremely busy workplace filled with cranky appliances, making it the lowest priority to maintain. [14:23:53] and is not certified, lol [14:23:56] Moving over the database server's files is miles faster than using mysqldump [14:24:02] [1/2] Oh [14:24:02] [2/2] I see some page are locked tho [14:24:35] Got it [14:25:01] (I have no sysadmin experience so I just know what I learn from internet people and what I do on my own VPS) [14:25:07] Makes much sense, especially for mining. Are you all mining something like Bitcoin or one of the more exotic coins? [14:25:08] You need to have some dry ice to cool this beast [14:25:12] To be expected from a high schooler maybe [14:25:25] what if I told you I'm actually 9 [14:25:51] Tech Team [14:26:06] Hey was wanting to ask about some unscheduled maintainence [14:26:10] That would make you like 30+ in human years [14:26:14] Treason detected [14:26:17] very exotic coin, the pow is a real rendering, so it outputs things that are useful [14:26:22] Cause penguins live for max of 30 year [14:26:28] I can't even verify rn since our wiki's server is undergoing unscheduled maintainence [14:26:30] See #announcements [14:26:31] Ask away [14:26:38] Club Penguin lasted for 12 years [14:26:39] Or ask [14:26:59] [1/2] on Meta - ofc, like very important ones [14:26:59] [2/2] also all wikis are on read only right now, untill all wikis will be back online [14:27:13] I was wanting to ask about about an ETA or how to verify on here considering that I am unable to verify due to the maintainence [14:27:31] You can't verify if you're unable to login. [14:27:43] It shouldn't be too much long [14:27:44] Ahh okay, since it just pops the error when I try [14:28:19] as preview works, I will write articles from now, and publish them once the only read mode ends [14:28:42] Nothing is working on our wiki so we are just kinda doomed on it haha [14:28:42] To answer the intended question: TBD, hopefully only a few hours more. We're still waiting on one DB to finish transferring and then there's a bit more to clean up after that [14:28:50] Ah okay that's good! [14:28:56] Hopefully it can be complete by then [14:29:17] The announcements channel is your best bet to track updates. [14:29:43] Yeah I had checked but hadn't seen an ETA is why I was askin since some of our users were wondering [14:30:02] Not a problem, thanks for checking in. [14:30:24] This is unfortunately unplanned maintenance as there was indications that the old servers were imminently going to fail [14:30:33] And one had become dodgy [14:30:35] RIP old servers [14:30:49] Probably due to hard-disk or SSD failure [14:30:54] From extreme overloading [14:31:01] is exactly what I was about to say [14:31:07] Yeah I was confused since it wasn't seemingly in the scheduled once, hence why I was checkin on time [14:31:10] Very much not an ideal circumstance, but I'm glad folks will get to the benefits of the new hardware platform far earlier than planned. [14:31:11] I'd argue there were maybe a couple indications in the past months [14:31:27] The old hardware wasn't great [14:31:37] :rip: old hw and welcome new servers [14:31:40] But it took a significant turn from my understanding [14:31:55] The old hardware should not rest in peace [14:32:05] It needs to be taken onto an explosives range [14:32:17] It need to rest in pieces rather? 😄 [14:32:23] And stuffed with as much explosives as possible and then blown up [14:32:28] https://meta.miraheze.org/wiki/Special:RecentChanges?hidebots=1&translations=filter&limit=50&days=7&enhanced=1&urlversion=2 [14:32:46] Tech:Cp33 etc [14:32:56] You see all these servers [14:33:33] https://meta.miraheze.org/wiki/Category:Servers [14:33:37] when will I be able to delete stuff again? I just noticed I have to like urgently delete something from a wiki [14:33:46] Could be a few hours [14:34:04] who is funding this though? [14:34:05] Rest, in pieces. [14:34:05] Define urgent [14:34:19] If it’s a matter of personal info contact a steward probably [14:34:29] how do I do that [14:34:30] Wikis could theoretically already be on read/write but we'd rather not risk something funny happening if we set them in read/write without the last database server having finished [14:34:31] https://tenor.com/view/overheat-computer-explosion-boom-spark-gif-17323916 [14:34:33] Stewards can't help [14:34:40] fireworks! [14:34:43] not in read-only unfortunately [14:35:03] SRE may be able to help depending on if it's only mediawiki side read only or if the DB is fully locked [14:35:21] Or we could just ban the page in nginx [14:35:30] when a RTX fires it doesn't do that. Also, when a power unit explodes also doesn't do that [14:36:09] @gothiccatgirl can you advise why it's urgent? [14:36:36] https://tenor.com/view/laptop-smoking-smoking-laptop-laptop-on-fire-fire-laptop-computer-smoking-gif-27155816 [14:36:39] That’s more like it [14:36:51] I mean its personal info, but it can most likely wait a few hours or so if that's how long itll be [14:36:58] Anyway, let's not taunt the old servers too much, until things are 100% done there shall be no filling of hardware with explosives [14:37:26] [1/2] https://meta.miraheze.org/wiki/Category:Servers [14:37:27] [2/2] I was wondering where the names of these servers come from. [14:37:27] If it’s high traffic we can probably do smt to hide it for now [14:37:45] yeah, more like it. The thursday I connect a computer that came to our tech support and the 3080 started to burn [14:37:48] The services they run. [14:37:58] If no one buys them, sell what we can, and live stream some filling the cases with high works [14:37:59] nah its not, that's why I'm saying it'll prob be a nothingburger for a few hours [14:38:00] We can't commit changes right now. [14:38:34] Ah okay [14:38:35] Meant Rhinos comment about if it’s very high priority blocking in nginx [14:38:58] Sounds good, please email stewards@miraheze.org if it increases in urgency [14:39:07] alrighty thanks for the help [14:43:04] I think I take a nap, and check in later 😄 [14:43:12] Nothing for me to do! [14:43:22] L8er [14:49:40] Later [14:51:44] when wil the wiki be back up? [14:53:07] Now what is going on to db121 [14:53:12] It’s 9:53AM for me [14:58:23] There's always a last resort option [15:11:47] I'm certain at least one of my wikis is on 121, still no signs of being up [15:12:48] 4 wikis overall still down [15:15:16] You'll know if your wiki is on db121 because it has a maintenance screen up [15:15:23] all other wikis are online but in read-only mode [15:16:06] Oh still in read only I didn’t even notice [15:20:26] Only 4 wikis are still down? [15:22:04] the ones I manage, I meant [15:22:35] Oh [15:22:36] yeah ok, I was right then, just confused that you guys said 161 or 171 are remaining [15:31:22] 1 hour since the transferring [15:50:19] https://cdn.discordapp.com/attachments/407537962553966603/1200830155271184515/Screenshot_20240127-224909.png?ex=65c79b3b&is=65b5263b&hm=61589bb5af6526ea0aff2bb1458b9a3b760adee158c7e9e57d97f3621434bae3& [15:50:47] https://cdn.discordapp.com/attachments/407537962553966603/1200830268928442449/1200830155468324904remix-1706370642498.png?ex=65c79b56&is=65b52656&hm=93ad7dc2ecd30dae49dd238199b10c1a1566870278740fdb4901d4e3ebf3da79& [15:51:07] Do you have a question? [15:51:07] oops [15:51:17] yes [15:51:19] l can't edit [15:51:38] https://cdn.discordapp.com/attachments/407537962553966603/1200830487371972669/remix-eb233dfc-86c5-43ff-bc38-89036e1f27a4.png?ex=65c79b8a&is=65b5268a&hm=06d8cfc4bab651fa12ed9e280b4836986159514d42e3c0ddfed4eafe5f3bdd54& [15:51:49] See #announcements [15:51:52] Emergency maintenance [15:52:02] Because DC Switchover? [15:52:07] Yes [15:52:08] ok [15:52:48] https://cdn.discordapp.com/attachments/407537962553966603/1200830780381864017/Screenshot_20240127-225225.png?ex=65c79bd0&is=65b526d0&hm=f9f31f97a996c430a593ac11a6223be47db12fa148b94e6e0591b57b55467fe6& [15:52:54] noooooo [15:53:52] you missed most of the downtime tho [15:55:49] At least so… [15:56:01] Please stop posting images of things we know [15:56:19] If you have a point to make it, do so [15:57:31] Action was taken by SRE to prevent a significantly longer and significantly more risky outage [16:13:11] Okay I'm assuming right now nobody is able to open the editor because of ongoing issues ? [16:13:43] Read only [16:14:04] You can see your wiki? [16:14:19] If you can’t it’s probably on db121 [16:14:28] oof [16:14:29] The largest server that’s currently migrating [16:14:36] Shouldn’t be too long [16:15:00] alr any estimation, like less than hour, two hour, or more [16:15:42] I can see the wiki fine except for a broken info box but I just assume it's all issues right now which need to be fixed over time [16:16:27] I can see my wiki, just can't login as expected, although the message I get is "Unknown database 'allthetropeswiki' (db161)" which is nothing to do with my wiki. [16:17:21] Truthfully no idea [16:17:32] it's because of CentralAuth [16:17:42] I’d be incredibly shocked if it’s over 24 hours but Almost certainly not [16:17:44] your account is attached to a wiki which is currebtly down [16:18:17] You can open. You can't save. But you can preview and copy to a txt [16:18:33] read only is kept until all wikis will be online [16:18:47] Makes sense.I 'm in the middle of writing an article so I don't need access just yet. These guys have got a lot on atm, so we're all best just leaving them to it. [16:19:37] I wrote 3 articles while in only read mode. I saved them in txts so I can upload later [16:20:18] I wish could write three articles that quickly! [16:20:40] Has been like two hours [16:20:57] It's the research and references that takes time [16:21:36] I had all of that already. Just need formating and translate some things. Any way, kudos to the miraheze team! [16:21:49] Amen to this [16:21:57] Depends really [16:22:15] My wiki has very little content so an article could take 20 minutes [16:22:30] Take [[mh:nyctocosm:Nightmare Serpent]] [16:22:30] https://mh.wikipedia.org/wiki/nyctocosm:Nightmare_Serpent [16:22:31] [16:22:49] Prob one of the better articles we have [16:23:07] Way ahead of me then! I have six books open on my desk and about 20 tabs on the computer. [16:23:32] Average Wikipedia’s [16:23:44] What’s your wiki bye [16:24:01] I think is very different thing. Most probably 6 of my articles is like 1/2 or yours... [16:24:39] Does anyone know how to create a .map in mediawiki? [16:24:40] Is invented or about a game? Maybe wee should continue in #offtopic [16:24:51] I only have a small number of pages, but sometimes my articles can be larger than I was expecting depending on how much I want to say, and how many references I add from various sources. I guess I could write some super short articles in about half an hour if I tried. [16:25:01] It’s for a datapack(a kind of mod) for minecraft [16:26:21] what happened to the wiki [16:26:36] can someone send me geotubepedia link [16:27:25] https://www.planetminecraft.com/data-pack/the-nyctocosm-wip/ [16:28:31] If you are asking me, then the one I have been working on this week is the English Lakes wiki, but most of that has been admin stuff and working on templates. [16:28:33] seems fun. We invent our own creatures. Although now I am writing about creatures made up by Toriyama Sekien (18th century), that made a large bestiary [16:28:50] [1/2] portion of Miraheze is down and the rest are read-only as part of emergency maintanance [16:28:51] [2/2] #announcements [16:29:41] Interesting, so about water masses? [16:32:20] No. Photographing places of interest, lakes, tarns, fells etc., when on my hikes. I then throw in some stuff about history, etymology, and occasional some science stuff, but it all comes from research, which is why it takes me longer to write articles. It's not academic in any way. [16:35:59] like [[c:File:SekienYurei.jpg]] [16:35:59] https://commons.wikimedia.org/wiki/File:SekienYurei.jpg [16:36:00] [16:57:13] I'll check if the import is done [16:57:14] It should be [16:57:24] Once that's done, it's read/write time! [16:57:42] Alright [17:00:30] :pinecone_thumbsup: [17:01:44] Already? [17:01:57] :ThinkerMH: [17:02:38] https://cdn.discordapp.com/attachments/1007098070535786590/1200848309120671875/pat.gif?ex=65c7ac23&is=65b53723&hm=5c4e8ebea4470ab3edd6f5e63b305694036479cb1aa4dcb0e6d6ecdca1dd9cd9& [17:03:00] First we pay the Penguin [17:03:19] Take this to #offtopic [17:03:47] K [17:03:58] ): [17:04:03] Offtopic conversation is allowed in #general to an extent [17:04:18] agent isn't offtopic lol [17:04:25] P.S before move, I made a discord bot to make these gifs sooooo if anyone wants to use it in their own server shameless promo [17:04:26] Lol [17:06:22] @agentisai we have 90k jobs because extended RO [17:06:24] Fun [17:06:43] Hopefully tide clears backlog faster [17:09:26] (code on my gh if anyone wanna take a look at my garbage, repo is Bee-the-I dolent, i also have an instance hosted on a vps that I can give the bot add link for, just lmk) okay not really promo cause i grt nothing over [17:10:25] Jobs still generate in read only? [17:10:27] :thonk: [17:10:41] It looks like the prewarm ones do ye [17:10:49] That's really bad behavior [17:11:02] Ye I might file a bug for that [17:11:21] It should clear fairly quick on our new fancy servers [17:11:50] @agentisai ping me when we are out of RO [17:19:23] it looks like a few other jobs generated [17:19:31] I was reading the vacancies page and it linked to https://meta.miraheze.org/wiki/Talk:Miraheze_Volunteering_Opportunities#Call_for_volunteers_for_SRE_roles from back when MH was on the brink [17:19:42] what happened to the ones that requested to join SRE there? [17:19:50] one of them wanted to be a SWE [17:20:06] looks like for the last 6 hours it's been rising [17:20:23] db121 is still not done copying [17:20:26] a:waaa: [17:20:31] :moonch: [17:20:35] It's quite chunky so I don't blame it [17:20:39] It is at 108GB compressed [17:20:55] Soon I hope [17:21:04] at a rate of 4.5 jobs/sec [17:21:11] I hate parsoid [17:21:14] and jobs [17:21:18] i geniuenly do [17:21:32] 4.5 jobs/sec for 5 hours is insane [17:22:23] like how many reqs do we even get [17:22:38] @agentisai how many req/s do we get? [17:23:02] All my homies hate the job queue [17:23:15] how big is it? [17:23:26] I do when it is generating 4.5 jobs every second [17:23:38] 388GB uncompressed [17:23:43] i mean doesn't parsoid cache even use the DB [17:23:47] we're read only [17:23:58] nothing can be edited so how can the cache invalidate [17:24:37] how much has gone through so far? [17:24:48] 109GB compressed [17:24:58] @cosmicalpha have we copied over the objectcache tables? [17:25:06] objectstash* [17:25:13] Yes [17:25:25] then parsoid is being stupid [17:25:30] parsoid cache is warm [17:25:33] whats new [17:25:37] We are copying over all of /srv/mariadb, so everything [17:26:00] how in read only do we generate 4.5 jobs per second of cache refresh [17:26:29] there is no way 4-5 req/s every second are hitting a page that has an exipred parser cache or isn't cached [17:26:34] that would be insane [17:26:37] Is it a bug? [17:26:44] @cosmicalpha how many requests do we get every second? [17:26:57] I suspect there's something broken here [17:27:09] I am not sure, I can find out later. [17:27:14] could this happen because people still can access editor? [17:27:15] ye please do [17:27:25] no, you can't save an edit [17:27:32] yeah, you can't but [17:27:40] just editor [17:27:48] work [17:28:11] or it's nothing? [17:28:17] If we emergency migrated because of 121 going kaput could the cache being having issues having or smt [17:28:27] 131 [17:28:29] not 121 [17:28:36] I mean it would be really really stupid if it still tried to update a db cache when the db is RO [17:28:42] during edits [17:28:44] [1/2] hi i joined to ask why the rain world wiki is like this [17:28:44] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200854919498965103/image.png?ex=65c7b24b&is=65b53d4b&hm=f2b9fc3e7a48e9d2ff8338619d2d9a4c0cfe4b93a2db7a38ab2549ab330bcc4f& [17:28:50] See #announcements [17:28:51] #announcements [17:28:57] in short: emergency maintance [17:29:01] looks like some css is in a mood [17:29:17] i can't load it at all [17:29:23] rainworldwiki is on db121 so I'm not sure how you're seeing that [17:29:29] so your browser has cached the page but hasn't cached css [17:29:31] hmmmmmmmmmmm [17:29:32] and css will fail [17:29:50] after the "emergency maintenance" will it go back to how it looked normally [17:29:53] yeah [17:29:55] Cache, happened to me on testwiki so I didn't realize everything went down when db131 did. [17:30:00] huh [17:30:08] yes [17:30:09] Are all wikis read-only right now? [17:30:13] yea [17:30:14] yes [17:30:41] every single wiki is going to enter read only mode in 0 cycles [17:30:42] When is it likely to be finished? [17:31:13] when all wikis have been imported into the new infra [17:31:29] We're just waiting on one last database server [17:31:35] which ironically is also the biggest [17:31:55] Alright then [17:32:25] @agentisai is the jobrunner stopped or just stuck cause RO? [17:32:32] probably the latter [17:32:43] db161 is down either way so it can't write to the parser cache [17:32:44] Was it only 131 that died off or all of them? [17:33:08] Just 131, but that DB brings them all down. [17:33:20] It has the most important databases, unfortunately [17:33:26] I'd argue this a better outcome because it means the wikis get on the new servers faster even if they are locked out of editing for a time [17:33:38] Yeah, wikis are really fast rn [17:33:38] (Meaning the CentralAuth database) [17:33:53] I anticipate they might even get faster once Memcached is filled [17:34:02] I noticed things seem to load significantly faster [17:34:06] just wanted to check [17:34:45] oh [17:34:49] just our luck [17:35:20] we might consider a new database just for those wikis [17:35:35] so that even if one db goes down, the entire farm doesn't [17:35:47] It will probably happen just not at this very moment. [17:35:53] of course [17:36:04] redis looks utterly fine so let's not play with parsoid settings to make it less stupid [17:36:21] i swear all job chron would have long OOM'd [17:36:30] the new one doesn't even look like it cares [17:37:54] @pixldev all the failed wiki creations were often caused by redis OOM's on the jobchron [17:38:19] the current jobchron looks like it thinks it's on holiday chilling based on grafana [17:38:19] I wish zip went in alphabetical order so we knew where we were in progress [17:38:25] It's just going all over the place [17:38:50] I wish so also lol [17:39:07] Recode zip [17:39:56] thank you for your guys' hard work with the servers :EpicFaceMH: [17:40:59] This tbh [17:41:01] :thistbh: [17:41:14] Really great to see hard work [17:46:52] @agentisai can you edit https://grafana.miraheze.org/alerting/grafana/-bk-DCynz/view?returnTo=%2Falerting%2Flist to point to wikitide.net not miraheze.org [17:47:04] because it's claiming high workers and we've definately not [17:47:59] hmm [17:48:01] let me see [17:48:37] oh [17:48:39] LOL [17:48:44] @agentisai i meant https://grafana.miraheze.org/alerting/grafana/1tO-Rm47z/view?returnTo=%2Falerting%2Flist [17:48:46] the old servers are running out of workers? [17:48:48] the php one [17:48:49] I shut down all the old mw side servers, only swiftobject servers remain on old infra [17:49:01] it is pointing at mw*.miraheze.org which are shut down [17:49:09] so yes they have 0 workers [17:49:24] [1/3] > phpfpm_active_processes{instance=~"mw[0-9]+\\.miraheze\\.org:9253"} / ( [17:49:25] [2/3] > phpfpm_active_processes{instance=~"mw[0-9]+\\.miraheze\\.org:9253"} + [17:49:25] [3/3] > phpfpm_idle_processes{instance=~"mw[0-9]+\\.miraheze\\.org:9253"} ) [17:49:28] should be [17:49:30] I shut them down because mwtask141 was still trying to run jobs, etc... on old DBs [17:50:13] [1/3] > phpfpm_active_processes{instance=~"mw[0-9]+\\.wikitide\\.net:9253"} / ( [17:50:14] [2/3] > phpfpm_active_processes{instance=~"mw[0-9]+\\.wikitide\\.net:9253"} + [17:50:14] [3/3] > phpfpm_idle_processes{instance=~"mw[0-9]+\\.wikitide\\.net:9253"} ) [17:50:50] probably should have killed task when everything died [17:51:09] Probably would have been a good idea. [17:51:25] But I was focused on db I didn't even think of it [17:51:31] ye [17:51:49] Can't edit. Is this a part of updating? [17:52:15] yes [17:52:26] https://cdn.discordapp.com/attachments/407537962553966603/1200860886244528289/image.png?ex=65c7b7da&is=65b542da&hm=a24abcc58b322418d304bfa62b3644383a3a212f9546c457d4ab35479f21f3a8& [17:52:30] OK then. [17:52:35] So nothing to worry about. [17:52:37] I hope so. [17:52:50] parsoid seems to be doing wonderfk, I am ignoring it for now [17:53:38] db121 has been uploading for 12 hours (how long procees has been running...) [17:54:04] 12 hours and 34 minutes [17:54:22] Guess that means a max of 48 hours given how much it was actually uploaded. [17:54:24] maybe we should've purged some bin logs before migrating [17:54:37] more like maybe 12 hours actually [17:54:44] at the most [17:55:16] Additional? [17:55:33] If has been 12 hours already, I would say another 3-4 hours [17:57:20] Guys i must ask for help in support or i cant ask it here? [17:57:27] Who else has got abstinence symptoms?? [CTRL]+[F5], [CTRL]+[F5], [CTRL]+[F5], [CTRL]+[F5], [CTRL]+[F5] 😄 [17:57:38] Just ask [17:57:54] [1/2] what should i do? [17:57:54] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200862260927672460/image.png?ex=65c7b921&is=65b54421&hm=7fc8e8413412453cea8ccadd827a38708695d9140b05fc4723b2f1246f7a6226& [17:57:54] If it's suppport, we'll tell you [17:58:09] Nothing. See #announcements [17:58:51] So just wait? [17:58:55] Miraheze is moving to new servers, so it may take a while [17:58:58] Yeah [17:59:00] okay [17:59:02] экстренный перевод бд на новые серваки, пока что редактировать ничего нельзя [17:59:15] gjy [18:00:01] Glad there is Google Translate [18:00:16] i also used fandom but fandom is now shit and you cant make private wikis in fandom [18:00:27] ye [18:00:51] I think only Mira allows private wikis among free hostings [18:01:19] how many former fandomers are here? [18:01:24] oh boy [18:01:25] me [18:01:26] a lot [18:01:29] lol [18:01:47] I'm one of tgem ofc [18:02:09] I dont think I'll move all of my wikis to fandom, many of the game wikis i run are publically known and edited [18:02:11] what was your nickname in russian fandom community? [18:02:16] i am Поггль [18:02:23] some people know me [18:03:04] not reveling (yet) cus I'm migrating like 4th? wiki to Mira now lol [18:03:15] okay [18:03:34] + helped Pizza Tower yea [18:03:35] it is sad that miraheze delete non-active wikis [18:03:56] one small edit once in a month resets the timer [18:04:49] archive/finished wikis can request permanent staying [18:04:55] I might unset read only for wikis that are back online in a few minutes [18:05:10] wouldn't it mess up jobs more? [18:05:43] Not for wikis that are online, and not anymore than they already are, probably. [18:05:49] We can just discard jobs for parsoid [18:06:05] mainstash is online so parsoid jobs should work fine [18:06:13] If we unset read only [18:06:40] or just unclicking a box [18:06:46] yup [18:07:02] restart the cache warming from scratch? [18:07:16] is there a ManageWiki API by chance? [18:07:19] Parsoid uses mainstash parser use parsercache... kinda odd IMO but works I guess. [18:10:32] I'd rather see if it clears fine tbh [18:10:48] if jobs are running on 181 and wikis go RW, it would clear [18:10:53] looks like db121 finished uploading now to extract [18:11:56] yay [18:12:25] not as long as expected huh [18:12:46] Mine is still not available 😢 [18:14:22] I just started extracting, but that should be a lot quicker [18:15:01] Welp my 48 hour prediction is destroyed [18:15:17] :ThinkingHardMH: [18:15:51] @cosmicalpha you'll need to manually deploy [18:16:05] testwiki is down so deploy tool will refuse to auto deploy [18:16:11] add --force [18:17:02] I'm aware I will do in a few minutes, busy with db121, and also something IRL right now [18:17:49] ok [18:36:00] hello chat [18:36:08] hi [18:36:34] i was right about to submit a trollpasta to trollpasta.com until i noticed that the site is down lol [18:37:18] our teams are working extremely hard to ensure the migration is complete as quickly as possible [18:37:48] i can tell, keep it up [18:40:17] how do i irc [18:40:31] wait wdym migration [18:41:20] new servers [18:41:32] https://web.libera.chat/?channel=#miraheze [18:41:34] join libera.chat [18:41:42] ohh i panicked a lil [18:41:46] Or with a proper client [18:42:39] you'll have a much faster experience soon [18:43:08] it is what irc is made for [18:43:11] real time [18:43:27] irc is an alternative to discord [18:43:37] that was made before most of our users were born [18:43:53] markiplier [18:44:20] hello guester [18:44:25] can we assist [18:44:33] Internet Relay Chat [18:44:50] nah no big deal [18:45:23] well nvm i got a question [18:45:31] how do i log out? [18:45:37] I wouldn’t call it an alternative tbh [18:45:51] for miraheze users [18:46:01] guester: click the logout button [18:46:11] some people refuse to use discord too [18:46:47] almost didn’t recognize you legroom lol [18:51:23] bruh i lost connection [18:51:30] weird shit ngl [18:52:27] markiplier [18:58:06] I remembered why I don't change discord avies for ages - setting up correct size is a pain [18:59:27] Where is REdmin? [19:01:10] db121 will be back soon [19:01:18] Great [19:08:33] my wikis are not working, why am I having this problem 😭 [19:09:10] Things should be back in around 30 minutes [19:09:58] And out of read only [19:10:33] soon™️ [19:10:45] We're doing some more performance tweaks to give database and memcached moar RAM [19:11:00] I have 64GB RAM [19:11:14] We have a combined total of 1TB of RAM [19:11:19] Hello I am new here [19:11:23] bonjour [19:11:30] Welcome! [19:11:34] Bonjour [19:14:05] Hi @satoshi0587 [19:14:24] Hi [19:14:48] Why are you replying to an hours old message [19:15:03] What's going on in the chat? [19:15:17] Discussing the ongoing maintenance [19:15:34] Is there going to be any change? [19:15:44] Much better performance [19:16:04] I can't wait for them to introduce new characters [19:16:56] I have no idea what new characters you are talking about [19:16:58] What is bro yapping about [19:17:18] I am taking about a show I saw [19:17:23] An anime [19:17:28] -> #offtopic then [19:17:36] It's got nothing to do with Miraheze [19:17:43] Ik [19:18:06] The cite is not working I saw that [19:18:24] Most things are broken [19:18:30] Ye [19:18:40] Did the creator say why? [19:18:58] The creator of Miraheze? [19:19:02] Yes, please read #announcements [19:19:03] https://discord.com/channels/407504499280707585/475350160428498964/1200882575397367838 we should be coming back [19:19:04] I'd love to get in touch with one of them [19:19:33] Congrats @cosmicalpha / @agentisai / @paladox [19:20:06] I’d like to honor you guys… [19:20:13] anyone above or below this message is an awesome person [19:20:18] https://tenor.com/view/washing-machine-rock-shake-break-gif-16501605 [19:20:24] This [19:20:55] Stuff is still loading pretty fast [19:21:08] Friendly ping to let you know that you should be able to take action shortly, all wikis are coming back online now. [19:21:12] lets put these 4ghz processors to max use [19:21:22] It’s faster than me trying to play YouTube videos [19:23:28] Ya'll weren't kidding when you said they'll be faster after migration [19:23:50] Pages load like that 🫰 [19:25:41] The result of faster disks, faster RAM, and faster processors [19:25:47] Our new servers are really beefy [19:26:07] I'm so thrilled [19:26:10] Everything is loading so fast [19:26:14] Christ [19:26:16] even with a cache cache [19:26:19] Aaaaageng [19:26:33] Can I install minecraft on the Miraheze servers? [19:26:42] 👉 👈 [19:26:46] I want to run some cryptominners on them too [19:26:51] :trollgod: [19:26:58] with pleasure [19:27:00] back off i called dibs! [19:27:16] MirahezeMC lets gooooooo [19:27:20] cache isn't completely cold [19:27:29] memcached isn't cold? [19:27:30] But yeah we're doing much better [19:27:34] Memcache is cold [19:27:44] But mainstash shouldn't be [19:27:48] Then microwave it [19:27:49] we've trippled memcache and db ram [19:27:54] Great [19:27:55] memcache has 64g each [19:27:58] db 50g each [19:28:05] whats the difference again? [19:28:10] absolutely beautiful specs [19:28:22] Memcached now has 128GBs of RAM [19:28:23] Different types of cache for different stuff [19:28:28] Does editing a file still take 3 minutes? [19:28:29] versus the previous 30Gb [19:28:35] Check GlobalCache.php for what does what [19:28:37] nope [19:28:41] But the sad part is: every time I still do something, I got logged out and it won’t go [19:28:48] Clear your cookies [19:28:50] we're going to move sessions to redis at some point [19:29:24] 🎉 [19:29:34] Cleared [19:29:34] If you're getting logged out then at this point it's your browser and not us for once :Cool: [19:29:45] I even switched to Opera [19:29:49] It still hates it [19:30:06] What are we currently using? Just a disk dbv [19:30:11] we are so fucking back [19:30:12] Memcached [19:30:22] YESS!!! [19:30:28] memcached [19:30:36] Which server am I on now? [19:31:17] oh thats the software [19:31:25] I thought it was the server name [19:32:09] In ManageWiki core theres a database cluster field. The map of cluster to server is on mw-config [19:32:25] If thats what you mean [19:32:29] https://cdn.discordapp.com/attachments/407537962553966603/1200886065150574603/image.png?ex=65c7cf4d&is=65b55a4d&hm=daf6f6c48b07393de637ebee5f1fa0ed6755a3a6b730e149caabe5be9317a1b2& [19:32:39] f 6 percent [19:33:37] <.labster> Good morning everyone. Why is there so much backlog? [19:33:51] idk [19:33:55] hey @.labster [19:34:23] We migrated servers over 12h [19:34:27] Wiki go zoom [19:35:48] ZOOOOOM [19:36:20] @agentisai fix the php alert in grafana [19:36:23] It's sad still [19:36:30] nyom [19:36:43] That'll be like the first time in about a year that alert has been green [19:36:44] Gotta go fast [19:37:35] ye [19:39:08] quick question re createwiki: how complicated is the extension? [19:39:43] like, if i wanted to try and PR a completely new addition, how complicated would that be [19:39:43] extremely [19:39:49] depends [19:39:52] what do you want to add? [19:40:03] something like a new feature for marking problemati cwikis [19:40:19] isn't that a phab task? [19:40:24] which would create a special page that logs all of those selected wikis (accessible only to stewards/WCs) [19:40:26] you could try to do it, it'd be a good first task for you [19:40:40] Orange_Star: want to even know how possible/easy it is first [19:40:50] it is possible [19:41:02] you need to know how mediawiki's db code and special pages work [19:41:11] as well as HTMLForm [19:41:17] you mean, users won't be able to request wikis which were declined before or shut down by stewards? [19:41:33] it'd involve delving into ManageWikiFormFactory, adding a new box, adding a new flag to RemoteWiki to commit the change to the database, a new database table or column, and creating a new special page which logs that [19:41:56] No, when accepting a request that CVT or wiki creators feel is worth following up on to ensure compliance with the CP, it would be logged [19:42:02] doesn't prevent anything, just a log [19:42:24] sounds hard-ish [19:42:25] ah, so like keeping an eye on it? [19:42:28] basically yeah [19:42:29] oh, I thought you meant the wiki investigations phab task [19:42:37] Oh, no [19:42:42] not super hard [19:42:49] it's probably quite easy [19:42:56] I'd encourage you to try and tackle it [19:43:04] it may help you develop knowledge of PHP [19:43:37] for the special page, I'd recommend stealing SpecialDeletedWikis and SpecialDeletedWikisPager code and reusing it for your proposed changes [19:43:46] Miraheze go BRRRRRRRRRRRR [19:43:47] Hmm yeah hopefully so [19:43:58] How long do you think it would take? [19:43:59] Ultra Sonic fast hyper [19:44:10] which? [19:44:24] So Miraheze is being glitchy right now, I take it? [19:44:27] "PHP-FPM Worker Usage" one seems fixed [19:44:32] wdym? [19:44:33] That one [19:44:33] it shouldn't anymore [19:44:43] ```phpfpm_active_processes{instance=~"mw[0-9]+\\.wikitide\\.net:9253"} / ( phpfpm_active_processes{instance=~"mw[0-9]+\\.wikitide\\.net:9253"} + phpfpm_idle_processes{instance=~"mw[0-9]+\\.wikitide\\.net:9253"} )``` [19:44:47] that's the query [19:44:49] @rhinosf1 ^ [19:44:51] Yes it is now [19:44:59] oh [19:45:02] someone fixed it then [19:45:03] not me [19:45:04] lol [19:45:37] aside from broken images, especially the ones used in CSS, PTW is extremely fast lol [19:45:47] yeah, Swift is still migrating [19:45:49] From the previous convo thread in #offtopic? Interesting [19:46:05] but Swift should migrate faster now that databases are no longer using disk I/O [19:46:06] still gonna be 2-4 weeks? [19:46:09] was me [19:46:12] maybe less now [19:46:13] niiiiice [19:46:16] maybe a week at most? [19:46:20] Maybe? Had convos with other wiki creators that seemed in support as well [19:46:32] I don't need to send the message, I get the answer sooner [19:46:35] We could also make a trusted reviewer user group to allow certain community members to access the list and reciee them [19:46:51] My convo was w/ raidarr [19:47:12] oh hi [19:47:13] welcome [19:47:35] @agentisai what do you think about page name? [19:47:51] Could do Special:RequestWikiFlags but feels like that mischaracterizes it [19:48:04] Special:FlaggedWikis? [19:48:06] Does anyone know how I can access the LocalSettings.php? [19:48:11] yep that works [19:48:14] you don't [19:48:20] most settings are in ManageWiki [19:48:20] yes you do [19:48:23] it's at github [19:48:28] is there a current list of special pages for CreateWiki? [19:48:52] I see [19:48:52] to view: https://github.com/miraheze/mw-config/blob/master/LocalSettings.php [19:49:12] bwm0: look in CreateWiki's extension.json [19:49:12] the most boring of boring [19:49:17] got it [19:49:24] there you can find all the registered special pages [19:49:36] okay so three [19:49:45] ReqWiki, CreateWiki, ReqWikiQueue [19:50:39] you don't, but number of settings available in admin menu, Manage this wiki's additional settings [19:50:43] I thought WikiDiscover and the other list page were there [19:50:52] that's a different extension [19:50:57] called WikiDiscover [19:51:11] [1/2] Do image previews not work for user pages? The previews are fine for every other type of page [19:51:11] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200890771042205726/image.png?ex=65c7d3af&is=65b55eaf&hm=90e5eb6d7c9f6eeb7326c4f41018e56a174b8130cdb40695d9f37bcdd835cedc& [19:51:55] images are still migrating, what we he now is data bases migrated asap [19:52:30] Oh that may be why then, I don't have any other pages that were already cached beforehand to test it I don't think [19:52:36] I'll wait and see [19:53:06] hopefully it won't take as long as we thought initially [19:58:24] Aside from image oddities, how are things post-emergency maintenance for folks? Any other oddities to report? [19:58:59] had to login in each wiki separately? [19:59:10] hmm [19:59:14] otherwise alright [19:59:15] sounds like a session issue [19:59:20] yeah [19:59:27] might be because memcached was reset [19:59:57] there won't be random logouts no more? 🥹 [20:00:05] nope [20:00:06] Nah, that's Mozilla + Google making central auth weird [20:00:21] Logging into each wiki individually is likely to become more and more common [20:00:29] But random logouts shouldn't happen [20:00:59] _blames @zppix_ [20:01:36] Only reason Firefox would to be blame is if its not on the latest [20:02:00] Nah, it's deliberate cookie rules [20:02:14] CentralAuth doesn't play nice with all the third party cookie stuff [20:02:37] And all the generally make cookies as hard as possible [20:04:00] https://samesite-sandbox.glitch.me/ [20:04:08] Thats the issue if I remember right [20:06:11] what’s the cause of Miraheze’s random language glitches [20:06:21] where random things will sometimes be in a random language [20:06:31] even error pages [20:06:36] Which isnt fully an issue with the browser but rather how CentralAuth does cookies if I recall correctly [20:07:01] it was some minor mw code merge [20:07:13] Which again comes back to 'CentralAuth was built for a specific thing that wasn't our use case' [20:07:14] I forgot how it was fixed [20:07:20] Yes it's mainly a central auth problem [20:07:21] was it? [20:07:40] But also partly Mozilla / Google moving too quick for us to keep up [20:07:41] the glitch first came up a few weeks ago iirc [20:07:46] fixed? yeah I haven't encoutered since [20:07:49] and i got german today [20:07:50] That and as far as I know google is the only one doing their cookie restriction thing [20:08:00] For now [20:08:09] ah, that's something different I'm thinking, sorry [20:08:13] I haven’t heard of any plans of them doing so [20:23:52] https://cdn.discordapp.com/attachments/407537962553966603/1200898994856022066/image.png?ex=65c7db57&is=65b56657&hm=415b097c3e65318ee37d68b6ac302243e6510e718f7c2fe7af05832c054cdc49& [20:23:58] @rhinosf1 have a min? [20:24:25] Go ahead [20:24:31] will Dm [20:24:59] fellas, second user reports lang issue [20:25:13] that's an MW 1.40 bug [20:25:21] oof [20:25:27] I remember very explicitly encountering it while testing 1.40 on Betaheze 6 months ago [20:25:36] but for me, I always got changed to Dutch [20:27:25] Great work by all involved in the migration. Thanks as always for tirelessly doing these. ❤️ [20:27:49] Thank you ❤️ [20:28:29] @agentisai have a min? [20:28:32] https://phabricator.miraheze.org/T11734 [20:28:33] it's done! [20:28:46] 💯 [20:30:04] PR? [20:30:52] task [20:31:06] curious if everything I listed is viable or if some things should be taken out [20:36:35] oh, phonos extension is interesting [20:37:08] I might try it on my audio heavy wiki [20:41:19] Do shout if you have any issues [20:41:26] We have contacts for phones [20:48:46] thank you! :D [20:50:12] The wiki community I'm most active with wanted me to thank the tech team for all the work in keeping the site up and especially for diving into this migration to prevent catastrophe. Y'all's efforts are truly appreciated! [20:53:46] [1/2] It's so wonderful to be creative on my own wiki again. [20:53:46] [2/2] Thanks to all involved!! [21:05:42] I'm grateful for the speedy and efficient migration! I'm wondering if anyone else is still having trouble using the Visual Editor? I can use the code editor just fine, but sometimes I prefer the VE, and it isn't working at all for any page I try it with [21:05:57] Wow my wiki runs a lot faster now! Thanks guys! [21:09:18] OOP there it goes! [21:09:54] VE been especially buggy as for recent [21:10:24] I will take a look at VE shortly [21:10:41] remove it [21:10:59] I did a logout/cache clear, etc, and naturally it didn't start to work until after I said it out loud in front of an audience [21:12:01] [1/2] I used to Press "Submit" then "select the content", then press [Ctrl]+[c] to save the text in the memory, for if the page fails. [21:12:01] [2/2] Now I don't get the time to even select the content, so fast it is now 😄 Wowowowowow [21:13:19] oh, happens all the time lol [21:13:30] Yeah lol, I edited 15 pages a little bit ago in the time it used to take me to save one, new servers are 100x better than the old... [21:14:37] Yup!! I am really happy about this. No more frustration about practicing being patient 😄 [21:15:16] and most importantly [21:15:20] no 50X??? [21:16:51] a [21:17:34] [1/2] There should be, at least that are caused by our new servers. Only thing that could cause them is if for some reason the varnish cache proxies go down, but we also replaced those with a bit better servers, and added new ones in Australia and Japan. [21:17:34] [2/2] Overall things should be a lot better going forward though... [21:20:04] Yeah it's working. It's like going from the local bus to an intercity train 😄 [21:20:16] All our servers now run on NVMe exclusively [21:26:28] Goodbye WD Green HDDs [21:26:31] Why an archive of a template, by the way [21:26:51] Would you create an archive for a template? [21:26:54] as a curious question [21:27:15] or never mind [21:28:23] Guys, no idea what happened, but the 'MultimediaViewer' extension is not working. [21:28:41] thought is enabled. [21:28:42] What's it doing? [21:29:03] works on mine wiki [21:29:40] not in mine. It redirects to the file's page. [21:30:04] Link? [21:33:28] check if it's enabled, maybe try to disable and enable again [21:33:58] It and visual editor both take some time to start working, if it was a recent enable. [21:36:05] Commetian archived something again [21:36:35] I enabled and disabled. It went back to normal. [21:37:15] after your comment, NotAracham lol [21:38:17] hey y'all anyone know my module is formatting as plain text instead of the module format [21:38:36] is it on page w/ `Module:` prefix? [21:38:45] yes [21:39:05] Second thing would be to check its content model on Special:ChangeContentModel [21:39:23] Might be set to plain text instead of something more appropriate [21:39:33] Shouldn't do that by default, though. [21:40:17] Should be set to Scribunto [21:40:31] yep i probably messed something up, but the Special: worked. thank you! [21:40:55] Good stuff, do let us know if new modules are also defaulting to plain text, as that shouldn't happen. [21:41:09] will do [21:41:44] Ehhh, I've got other things to tackle today. That's a later problem. 😦 [21:51:29] @k6ka i forgot who i speak to about updating thesimswiki.com cps [21:51:52] ideally it should use mw-lb so that a cp is automatically picked for the users current location [21:52:14] That would be MrC on IRC. [21:52:18] thanks! [21:53:34] i partially handled, it’s frustrating [21:54:36] The talk page archive doesn't need reverting [21:55:06] Thank you to everyone who helped fix the issue from earlier! Was that the whole migration process? Or just one of the steps? [21:55:10] If it's already been done, that's fine too [21:55:35] The emergency maintenance yesterday took care of a large chunk of it, but images are still being migrated. [22:00:00] There should be no more full downtime or read-only periods during remaining migration. You might notice some images missing sometimes but for the most part everything else should be pretty seamless. [22:04:04] no but it was weird that an entirely new template was created for that one archive [22:04:11] especially when it’s nothing unique [22:05:59] good night :pupCoffeeMH: [22:14:35] [1/2] I wanted to show these two being on their little date [22:14:35] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200926858045300846/image-60.png?ex=65c7f54b&is=65b5804b&hm=ffd7356a8b290c083d9300ecc785e7fd94d6763c03ee157d01f11f551d369215& [22:14:39] That's it [22:16:27] Hello [22:17:39] fair [22:25:29] https://jwmeeting.miraheze.org/wiki/The_Watchtower_Announcing_Jehovah%E2%80%99s_Kingdom [22:25:41] The RSS is not working [22:27:11] Any idea why? [22:31:12] @rodejong did it work yesterday? [22:31:57] The rss feed is indeed not loading again [22:32:13] See my previous question [22:33:22] It did on thursday when I added it [22:33:37] Haven't checked since [22:33:46] Untill thismorning [22:34:11] @Site Reliability Engineers: can we take a look? [22:35:17] (I checked... the extension is still enabled) [22:38:44] Hmmm, I'm able to get it a default rss feed to render on my personal workspace, let me test another thing [22:39:28] can edit now [22:41:54] Can repro the RSS issue, but it appears to be site specific. [22:42:07] hmmm [22:42:12] okay [22:42:26] Going to test another non-standard RSS feed and see if I can still repro [22:44:33] Is the RSS url right? visiting that url in the browser yields no results. [22:45:22] <@283848369250500608> [22:45:32] Weird... [22:46:08] oh it does now using chromne [22:46:14] opera does not like that link [22:46:17] https://apps.jw.org/E_RSSSUBSCRIBEMAG [22:47:30] https://cdn.discordapp.com/attachments/407537962553966603/1200935142416461914/image.png?ex=65c7fd02&is=65b58802&hm=d5af6a9f71fa16f4978c37128b82af87143f34247b4141c7406f6b6dccf4ff57& [22:48:17] https://cdn.discordapp.com/attachments/407537962553966603/1200935340811227307/image.png?ex=65c7fd31&is=65b58831&hm=8a6fef5409e1f1e6d2a18d28391548ac1164f8a33dead01054e5e31b403d2d1f& [22:48:42] Same links as on thursday, and it worked.. Don't get it [22:54:50] [1/4] Hi there, not sure if this is the right channel to ask or request this (please direct me to the right one, if not). [22:54:50] [2/4] How do I remove (or request to remote) the CC-BY-SA image at the bottom of the Wiki I am an administrator in? [22:54:51] [3/4] I already changed the license and I don't want viewers/editors to see the icon and be misled. Thanks. [22:54:51] [4/4] https://cdn.discordapp.com/attachments/407537962553966603/1200936986907783259/Screenshot_2024-01-28_at_00.51.55.png?ex=65c7feba&is=65b589ba&hm=97cfb6d197e465f67f10bdf3823428267207f5cb509a7e1f188f0b62090d103e& [22:55:04] what icon? [22:55:08] there is no icon there? [22:55:21] It's hidden beneath preview in discord [22:55:29] oh my bad 😮 [22:55:31] https://cdn.discordapp.com/attachments/407537962553966603/1200937157766951002/image.png?ex=65c7fee2&is=65b589e2&hm=babe6a4c13c35ae75afdb25a74d9627a566c3bb54a31854b60c4f04e98547cf5& [22:55:32]  image, icon whatever [22:55:46] it should have changed when you changed the license [22:55:47] Yes, this one. I attached it. Does Discord hide it? [22:55:59] It displayed a smaller version that clipped it, yes [22:56:03] yes [22:56:03] https://cdn.discordapp.com/attachments/407537962553966603/1200937294425759784/image.png?ex=65c7ff03&is=65b58a03&hm=5a9a598ed6e7b5006223db39cac66ce2a6456bc4270b9b8518edaf952c1e13e3& [22:56:29] What's the "proper" way to change the license? Can you provide a link? [22:56:31] <.labster> Easy way to make it disappear, just pipe site through Discord [22:56:31] If you recently changed the license it may take a second to clear out cache and start showing the updated license [22:56:42] in Special:ManageWiki [22:56:45] MY EYES [22:56:52] if you changed it through MediaWiki:Copyright then it won't change [22:56:58] light theme forever ❤️ [22:57:00] <.labster> [[meta:Help:Changing your wiki license]] [22:57:00] https://meta.wikimedia.org/wiki/Help:Changing_your_wiki_license [22:57:02] [22:57:05] ITS HORRID AAAAAAA [22:57:29] I use darkmode on my phone but i don't like discord dark mode [22:57:37] <.labster> Okay I'm officially terrible at interwiki [22:57:44] <.labster> [[Help:Changing your wiki license]] [22:57:44] https://meta.miraheze.org/wiki/Help:Changing_your_wiki_license [22:57:45] Special:ManageWiki/settings#mw-section-editing [22:57:45] [22:58:14] Oh OK. Many thanks. I was following the instructions and it didn't mention it anywhere. https://meta.miraheze.org/wiki/Help:Changing_your_wiki_license [22:58:29] didn’t wanna cluster with image here so https://discord.com/channels/407504499280707585/615786602454581249/1200937822148902943 [23:01:12] It's specifically in the editing section [23:01:17] [1/2] does anyone know what this text about? book from incendium [23:01:18] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200938611160391851/image.png?ex=65c8003d&is=65b58b3d&hm=6465c0e64bc7d1a1d8b98bf4f9c27448e8fb62e8bfc60a674d99af165117206e& [23:01:30] Wrong chat [23:01:38] oof. sry [23:01:43] No worries [23:01:47] This is the discord server for the global wiki farm Miraheze, I would check with your wiki's team to see if there's a topic-specific discord [23:02:05] Stardust labs has a discord I think [23:02:23] https://discord.com/invite/stardustlabs [23:02:35] i get this discord from the official wiki side. sry ahah [23:02:38] dang they have more then us! [23:02:42] merci <3 [23:02:49] S'popular. 🙂 [23:02:49] I think I found it. Does it take some minutes to change? or does it happen instantly? The image is still there. [23:02:54] go tell them to promote up please lol [23:02:59] instantly but the image might be cached [23:03:01] /joke [23:03:03] Yep. [23:03:58] [1/2] Depending on the skin, the wiki should also have something like this at the bottom of content pages: [23:03:59] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1200939287487721482/image.png?ex=65c800de&is=65b58bde&hm=5fcebf1d9106ad447a16ecc7a7c8d4e036c936c9dd379299fad50fde01c5ddd8& [23:04:12] This should also be a good indicator of whether the change has been implemented. [23:04:16] found the issue [23:04:21] > "wgRSSProxy": "http://bast.miraheze.org:8080", [23:04:29] @cosmicalpha i'm not sure how we clear the cache ^ [23:04:37] Ah... [23:04:47] Which cache? [23:04:54] That text disappears in dark mode and appears in normal mode, by the way. I guess it's a bug (or is it a feature?) 😛 [23:04:55] managewiki cache [23:05:06] Thanks! It worked. [23:05:13] i know we can remove the files but not sure if that's preferable [23:05:44] [1/2] When does it normally get flushed? [23:05:44] [2/2] The cache? [23:05:56] Otherwise I can wait for a bit. [23:06:19] theres a recache button on Special:ManageWikiDefaultPermissions for that wiki [23:06:31] it's happening to more than one wiki [23:06:32] https://github.com/miraheze/MirahezeMagic/blob/master/maintenance/resetWikiCaches.php [23:06:46] oh ok [23:06:53] I guess do foreachwikiindblist with that script for everyone with the rss ext. [23:08:08] mwscript extensions/MirahezeMagic/resetWikiCaches.php --extension=rss --version=1.40 [23:08:21] I would do it if it would let me ssh in [23:09:02] Heh [23:09:10] That should work I think [23:09:43] oh [23:09:48] I still have proxy jump from miraheze bast [23:09:49] fml [23:13:17] i ran it for the wiki but still has a problem huh [23:14:47] Yeah. I also purged the cache here, but still no feed [23:14:50] That makes no sense [23:15:39] @paladox the managewiki cache just didn't change or? [23:15:50] not sure what you mean [23:16:22] @paladox it still has the issue because that wasn't the cause or the managewiki cache didn't update? [23:16:36] well i can see the correct value [23:17:28] oh i see the problem [23:17:28] [1/2] https://jwmeeting.miraheze.org/wiki/JW_Meeting:Error_tests [23:17:29] [2/2] Yeah I tested with MWF feed [23:17:34] [1/2] > [root@bast181:/home/paladox]# telnet apps.jw.org 443 [23:17:34] [2/2] > Trying 18.173.249.28... [23:17:54] ? [23:18:36] [1/4] > telnet apps.jw.org 443 [23:18:37] [2/4] > Trying 13.224.222.63... [23:18:37] [3/4] > Connected to apps.jw.org. [23:18:37] [4/4] > Escape character is '^]'. [23:18:43] from my mac [23:18:47] not sure how to fix it [23:18:50] also different ips [23:19:10] err... [23:19:24] @paladox can you curl from bast the exact url? [23:19:28] i can ping 18.173.249.69 on my mac [23:19:33] [1/5] yea mine differnet awell: [23:19:33] [2/5] telnet apps.jw.org 443 [23:19:34] [3/5] Trying 54.230.10.55... [23:19:34] [4/5] Connected to apps.jw.org. [23:19:34] [5/5] Escape character is '^]'. [23:19:35] why would i try curl [23:19:44] if you can't telenet to it then curl is useless [23:19:59] can bast ping Google? [23:20:03] yeh [23:20:06] both ipv6 and ipv4 [23:20:10] i can ping 18.173.249.69 locally [23:20:18] so it's apps.jw.org alone? [23:20:24] Oh telnet failed [23:20:55] @paladox what's a traceroute show from bast? [23:21:06] Is it dying at their end or before? [23:21:34] siri is so helpful to understand topics you have no idea about lol [23:21:44] [1/32] > traceroute 18.173.249.69 [23:21:44] [2/32] > traceroute to 18.173.249.69 (18.173.249.69), 30 hops max, 60 byte packets [23:21:44] [3/32] > 1 38.46.218.153 (38.46.218.153) 15.770 ms 15.737 ms 15.727 ms [23:21:45] [4/32] > 2 core-100ge0-8-1-5.slc01.fiberstate.com (23.145.120.253) 0.505 ms 0.486 ms 0.468 ms [23:21:45] [5/32] > 3 et-4-0-16-0.bar3.SaltLakeCity1.Level3.net (4.38.253.173) 1.915 ms 1.918 ms 1.886 ms [23:21:45] [6/32] > 4 ae1.3502.edge8.Denver1.level3.net (4.69.219.70) 12.586 ms 12.590 ms 12.569 ms [23:21:46] [7/32] > 5 99.83.69.138 (99.83.69.138) 12.066 ms 99.83.88.206 (99.83.88.206) 31.286 ms 99.83.69.138 (99.83.69.138) 12.034 ms [23:21:46] [8/32] > 6   * [23:21:46] [9/32] > 7   * [23:21:46] [10/32] > 8   * [23:21:47] [11/32] > 9   * [23:21:47] [12/32] > 10   * [23:21:48] [13/32] > 11   * [23:21:48] [14/32] > 12   * [23:21:49] [15/32] > 13   * [23:21:49] [16/32] > 14   * [23:21:50] [17/32] > 15   * [23:21:50] [18/32] > 16   * [23:21:51] [19/32] > 17   * [23:21:51] [20/32] > 18   * [23:21:52] [21/32] > 19   * [23:21:52] [22/32] > 20   * [23:21:53] [23/32] > 21   * [23:21:53] [24/32] > 22   * [23:21:54] [25/32] > 23   * [23:21:54] [26/32] > 24   * [23:21:55] [27/32] > 25   * [23:21:55] [28/32] > 26   * [23:21:56] [29/32] > 27   * [23:21:56] [30/32] > 28   * [23:21:57] [31/32] > 29   * [23:21:57] [32/32] > 30   * [23:22:07] i can't seem to ping 99.83.69.138 [23:22:44] AWS [23:23:14] something for @agentisai to bring up with fiber [23:23:27] It's dying within Amazon's network [23:23:35] Again? lol [23:23:46] Could be a repeat of the issues I had the other day [23:24:22] Where when connected to a vpn using Amazon's London DC, I was getting no response from either of our nameservers [23:24:47] @paladox that leaves fiberstate fine [23:24:53] And gets onto Level 3 [23:25:01] So it's between Level 3 & Amazon [23:25:20] aws-routing-poc@amazon.com amzn-noc-contact@amazon.com abuse@amazonaws.com aws-rpki-routing-poc@amazon.com [23:25:37] @agentisai one of them is best to email ^ [23:31:09] Okay. As I understand it, there is nothing wrong at my end, Nothing wrong with the RSS feed from apps.jw.org, but somewhere in the middle, it's getting lost! Right? [23:31:39] So I can go on with other work and check later again if it works, right? [23:33:27] Yes [23:34:29] Images are breaking for me on my wiki still, is this normal still? [23:36:38] aye [23:36:50] [1/2] Thanks! And thank you all for the hard work to get things fixed. [23:36:51] [2/2] It's well appreciated!! [23:37:32] How long will this be the case? Are the images still being migrated? [23:37:39] I think Paladox has this figured out? [23:37:46] Yes [23:38:04] Images break temporarily while being moved from servers while Swift recalculates their hash [23:38:10] Yes™️ [23:38:11] Oh alright [23:38:13] Once it finishes doing that, they work like normal [23:38:21] Cool, thanks [23:38:23] the most I've seen an image break for is maybe 12 hours [23:43:13] Is there a better bulk upload extension than Upload Wizard? I'd like to be able to specifically specify descriptions and stuff for an aboutfile template and I don't want it to add things I don't want [23:44:05] good luck with the migration btw [23:44:21] <.labster> We're nearly finished, it's just the images remaining [23:44:36] how long is it expected to take? [23:44:41] a few weeks? [23:46:43] <.labster> maybe 2 days? [23:47:49] Oh that's a lot faster than I thought [23:48:03] Also do I have the ability to modify the info Upload Wizard puts on the upload page like the extension page says without being able to access the file [23:50:37] You may be able to my editing Mediawiki: pages [23:55:19] https://cdn.discordapp.com/attachments/407537962553966603/1200952207156191342/image.png?ex=65c80ce6&is=65b597e6&hm=5512557a70b6e31f5fa8c0f54046368b36e42d5c2d9c38f8086338e1ef939c6a& [23:55:29] Vector-2022 has white outer pages [23:55:39] really annoys me and I'd like to have these filled [23:56:59] let's rewrite the existing skin, they said. it will be great, they said [23:57:47] Trying to load any files like MediaWiki:LocalSettings.php just brings me to a white screen that says "File not found."