[00:25:00] MoE doesn't necessarily, the weights are still all loaded into RAM [00:25:19] I know apple are doing some clever stuff where it only loads a section of weights at a time but normal MoE models still load all weights but only activate x% of them [00:27:04] It's not, MoE do let you put some weight on RAM while others on SSD [00:27:56] Standard model requires you to put entire model on RAM/VRAM, otherwise it's deadweight [00:28:15] no they don't afaik [00:28:23] you can technically do it but it's stupid [00:28:33] it means you have to load weights in and out of ram from an ssd [00:28:48] the big models that are MoE do it to save on compute rather than memory because they can throw GPUs at a problem [00:29:22] Well, I'm using 26B MoE model on 4GB VRAM here and get like 20t/s [00:30:12] Same 4GB VRAM I can't even use a 4B dense model [00:30:15] It's probably possible but [00:30:23] 20t/s is not really [00:30:29] anything usable [00:30:55] Guaranteed at least 10t and most of my tasks are pretty small so should be around 20t [00:31:34] yeah but at any decent scale [00:31:36] like mh scale [00:31:45] 20tok/s would probably get overwhelmed [00:31:57] or at least slow down the processing [00:32:25] apple managed to do some weird stuff with MoE to get a 400B param model running in 48GB [00:32:51] and they also have some surprisingly large on device models now [00:32:57] You look at the active parameters when using MoE, that's the minimum you need to load in the RAM/VRAM [00:33:12] yes but it would be incredibly slow to have to constantly load and unload params [00:33:56] nope, that was for for input processing but the input is extremely fast anyway [00:34:13] my point is it's not really optimal [00:34:38] input processing is like 500t/s or something if I'm correct [00:35:03] I mean [00:35:06] it is probably possible [00:35:31] but getting someone else to do your inference is so much easier [00:35:32] and faster [00:36:35] places like groq and cerebras have some pretty interesting stuff [00:36:53] apparently cerebras can do 3KTok/s on gpt-oss-120b [00:39:19] gpt-oss knowledge cutoff is quite far so I guess it's even worse than deepseek [00:40:09] they have specialized solution so they can pull that trick [00:43:03] Also I have no idea why cerebras use f16 while the gpt oss model is native mxfp4 [01:02:42] Sag [01:41:47] > [02:08:42] Hoi! [02:22:10] Hoi there. [06:34:08] hey is this channel allowed for asking quick help? or do I have to make a post specifically in support channel? [06:35:08] General help is for this channel [06:35:36] But if it's a complicated q or you don't get a response, #support is the way to go [06:35:44] oh [06:36:16] The folks who might know are all over the world, so support is great to make sure that it doesn't get buried with other chatter [06:36:25] the first problem I had is that I changed the icon for my wiki, and it deosnt appear for others [06:36:50] I guess that it could be because it may take time? [06:37:14] Is this common? [06:39:02] Yeah, styling and css changes can take a bit to roll through for everyone [06:39:05] https://meta.miraheze.org/wiki/Help:How_to_change_my_logo_or_favicon [06:39:30] As long as what you did roughly matches this, probably just a matter of waiting [06:39:33] Yeah, I have read that, so that is why I was wondering [06:40:08] also, do people read all of the wiki info in order to know everything? should I study everything? because it's a lot [06:40:16] it is necesary? [06:40:22] I'm calling it an evening, but hopefully others can field any other Qs you may have [06:40:37] oh, ok, thanks anyways! [06:40:49] it is really late so it's mostly my fault [06:40:50] I would not recommend reading every single help doc end to end, no [06:41:35] oh, thanks, I was getting worried, I have checked some articles, but the structure was confusing for me since it's really technical [06:41:37] There's a lot to learn with mediawiki, so I'd recommend focusing on one small task at a time and work your way up, consulting as needed [06:41:44] thanks [06:42:15] Each thing you learn makes the next easier as you get a better baseline understanding of how it works and why [06:42:51] And you don't need to know everything to have a pretty great wiki that gets the job done [06:51:29] [1/4] I will ask something else and leave it so I can read if someone could help me with this thing [06:51:29] [2/4] [06:51:30] [3/4] Ianother thing I noticed is that there is an extension for translating (UniversalLanguageSelector and translate), do you recommend it for translation a wiki? if the answer is a yes, the wiki language is set as english, couldn't this bring me problems since it could have other languages and it would be like a half lie? I am still researching on how to do it, so it's not such an impo [06:51:30] [4/4] rtant question right now. But I think it's interesting because my wiki is for a niche comunity which has a lot of different languages [06:56:57] [1/2] There is a guide on this: https://meta.miraheze.org/wiki/Help:How_to_support_multiple_languages_on_my_wiki [06:56:57] [2/2] The translate extension is pretty complicated and I would not recommend it unless you test it out thoroughly on https://publictestwiki.com/ and are sure it is what you need. MediaWiki allows you to have a multi-language setup by default and you can start with that. [07:00:43] cool, I will try that, I think a wiki like the one that I am doing may benefit of various languages [07:03:13] thanks [10:50:29] [1/2] is there a way to disable audio preloading with EmbedVideo? we have a soundtrack page that loads literally every single audio in there for some reason automatically. [10:50:29] [2/2] https://casualtiesunknown.miraheze.org/wiki/Soundtrack [11:26:41] It's a feature of any html5-based audio player. Template:Audio allows you to adjust preload settings. [13:02:57] [1/2] The following is a true reflection of my personal feelings. [13:02:58] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1542519793289134150/1787824922907.jpg?ex=6a918701&is=6a903581&hm=a4f3e76e0d3e7fed90940b08f1259705559e159f5be19f05489f7d1d866c41de& [13:10:45] I’m the weird person who loves getting pings and im always a little disappointed it’s some bot-related nonsense (spam or benign) [13:35:27] yep, this is why I disabled those notifications like "you made your first edit" [14:34:40] Hai can someone help me set up my wiki? Is my 1st time doing it [14:40:14] If I make a global user page, will I be able to override it on a Wiki if I want to? For example, there is some info that would be good to have on a global user page to show up everywhere, but some info is only relevant to certain Wikis. [14:48:41] if you make a user page on a local wiki, that will override the global user page [14:49:44] What do you need help with? [15:04:58] I want a real wiki looking wiki [15:05:15] What is a “real wiki”? [15:05:52] Well a realistic page [15:27:37] [1/2] i still kinda have no clue how to write the fix in here [15:27:37] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1542556196781826098/image.png?ex=6a91a8e8&is=6a905768&hm=ec27e3460f203cf3cc7fadf5263c23a5be0dd56a99ac5d4842992d0952132933& [15:29:30] https://community.fandom.com/wiki/Help:Infoboxes#How_to_use_multiple_images_or_videos [15:29:54] While their ad serving is atrocious, they have pretty darn good help docs. [15:30:10] Our PI implementation is basically a direct borrow from their syntax. [15:34:36] no im just wondering [15:34:38] actually nah [15:34:44] i guess i dont have to fix template [15:34:53] just add and /gallery tags [15:34:58] on already generated infoboxes [15:44:40] is it possible to and resize images on gallery? [15:45:45] Still fixing stuff overtime on wiki [15:45:49] after migration [15:45:58] [1/3] was it possible for the tabbers to be scrollable like it does on Fandom? [15:45:58] [2/3] https://cdn.discordapp.com/attachments/407537962553966603/1542560816577126531/image.png?ex=6a91ad36&is=6a905bb6&hm=1697c77de47d137174425abcc10571bd631a38aaf10c6d262a7c284e592e04cb& [15:45:59] [3/3] https://cdn.discordapp.com/attachments/407537962553966603/1542560817013325874/image.png?ex=6a91ad36&is=6a905bb6&hm=235da804f53f7ca13a0ff38f4fc838a0786b213fcdbbfb04412a21665e97731e& [15:47:14] also about that, for some reason our infobox style broke with transfer too [15:47:19] for some reason its black [15:47:30] but supposed to be like one in fandom or those on main page from wiki [15:48:14] Yes [15:49:02] If you use gallery tags, yes, will require css if it doesn't do it by default [15:49:57] Any styling fixes will require you to dig into the CSS or pose a more specific question over in #support [15:50:31] is css you mean just the usual we do, in normal source edit? [15:50:36] just change code [15:50:40] like right now [15:51:08] In MediaWiki:Common.css. not the source editor [15:51:13] ok then [15:52:01] ill try to find some info about it to learn how to do it [15:52:16] for scrollable function on tabber [15:52:31] You can change the skin (design) of the Wiki to look more like the one you want. If you want a really custom design, you'll have to write CSS code [15:53:48] An LLM is not going to give you information on how to do it - easiest thing to do is go to Fandom wiki, inspect the element that is scrollable, then apply that css to your own wiki [15:54:13] ok [15:54:53] i dont use llm anymore though, i just read how to do stuff now [15:55:35] May want to try an extension like Stylus or using your own personal CSS (User:yourusername/common.css) to test your changes due to caching [15:56:10] i did use my own sandbox for testing, that was very useful and helpful tool for me tbh [15:56:26] i managed to make my own design and still working on it a bit [15:56:59] before publishing it into the global css [15:58:32] Nice [16:09:54] Sorry for the delayed reply but yes! I got access to GSC and I'd be happy to hear if there's anything I can do to help with this SEO issue [16:21:31] JANE!!! :D [16:34:42] does Miraheze Meta have a breezewiki redirect thing [16:35:00] i wanna link to fandom wikis but not actually link the fandom.com link [17:02:16] i waited for 4 days before my wiki got approve and somehow unmotivated due this wait queue [17:22:06] Hewwo (sorry I immediately had to jump into meetings) 🎉 [17:22:20] All good! [17:22:25] Mind if I ask for help? [17:28:22] [1/2] Sure~ [17:28:22] [2/2] (I'm still in meetings so can't guarantee a fast response tho) [17:45:15] ? [18:00:41] Apparently that was based on TabberNeue extension, you can replace with and you get that style of scrolling. [18:04:10] But honestly would be much better if someone can make CSS without having to ever use TabberNeue cuz compatibility reasons. [18:05:24] I searched in #support and no one done a CSS solution for that [awkwardflushed](https://cdn.discordapp.com/emojis/938118335495831563.gif?size=48&animated=true&name=awkwardflushed&lossless=true) [18:15:05] [1/3] Our apologies for the wait and hoping you're able to find that motivation again. [18:15:05] [2/3] Unfortunately we receive thousands of requests per month and only have a handful of human reviews available to volunteer their time at any particular time. [18:15:05] [3/3] Wishing you all success on your project now that it's approved. [20:05:15] [1/2] Is it down 💔💔💔💔💔💔💔💔 [20:05:16] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1542626068652097618/IMG_2650.png?ex=6a91e9fb&is=6a90987b&hm=ec2c96be7211751fe2bd9d1c64d407a5caf94a1ec1646314f0f26c8a560c628d& [20:05:20] is anyone else... [20:05:23] :( [20:05:34] EXACTLY the moment i wanna edit something too 😭😭😭 [20:05:35] I'm also getting a bad gateway [20:05:36] we all meet again [20:05:49] looking [20:05:57] Real [20:06:06] see you guys at the next outage [20:06:08] 😭😭 [20:06:40] Still stabler than wiki.gg. 😉 [20:07:02] Bad gateway? [20:07:47] [1/2] Something went wrong [20:07:47] [2/2] If this keeps happening, let us know. [20:07:53] We're aware [20:07:55] :AvaThonk: [20:08:05] geez [20:08:10] my edit is held hostage.. [20:08:29] bam im back [20:08:36] Same I was just editing something 😭 [20:08:43] miraheze is kill [20:08:55] we're not dead [20:08:58] Just napping [20:09:04] yay [20:09:55] [1/2] gonna 502 for a bit brb [20:09:56] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1542627233083031603/Tumblr_l_418234840540850.gif?ex=6a91eb10&is=6a909990&hm=44db43fa9003446ea7be0d934ef691f75ad20e59b3127e67fc15d0c38ee99bfd& [20:10:00] I can't even close the tab, it's three in the morning and I gotta nap 💔 [20:10:11] [1/2] my wiki looks AWESOME 😋😋😋 [20:10:11] [2/2] https://cdn.discordapp.com/attachments/407537962553966603/1542627306344947732/IMG_2652.png?ex=6a91eb22&is=6a9099a2&hm=3949e30326d3bcb65113e2081189e1016dc438ad77289e86b667cd34d4ab8902& [20:10:11] Go to bed then [20:10:22] rate the wiki 1-10 guys [20:10:52] what are the white squares [20:10:53] damn it [20:10:58] that's actually cool [20:11:00] usual images from Minerva [20:11:06] I just want to add two sentences before bed [20:11:22] We will still be there when you wake up [20:11:23] Started on this wiki like 11 days ago [20:11:27] with some other people [20:11:29] neat [20:11:32] I’m helping them move from fandom [20:11:35] "For some weird reason, I write novels on wiki" [20:12:51] yay it’s loading again [20:12:58] We're back <3 [20:13:09] very nice, keep up the good work [20:13:34] The nap is over [20:13:38] Please enjoy your wikis [20:13:40] been on this for two years now I think, and my wiki is still at a beta phase since I'm its sole contrib lol [20:13:43] But do sleep if it's 3am [20:13:46] [1/2] Her gaze lingered on those three characters, remaining fixed there for a long time. In that instant, her mind seemed to go blank, leaving nothing but those few simple characters imprinted on her vision. [20:13:46] [2/2] Although the three characters before her were utterly ordinary, she found herself unable to grasp their full meaning. [20:13:49] Now I go to bed [20:13:55] 😎 [20:14:40] Sorry about those issues all. Should all be fixed now. [20:16:01] thank youu [20:16:24] Thank you ❤️‍🩹❤️‍🩹 [20:17:03] yippie [20:17:13] beta? [20:19:02]