Time Nick Message 16:22 MTDiscord @grorp are you fine with the videos from https://github.com/luanti-org/luanti/pull/14918 and https://github.com/luanti-org/luanti/pull/14933 being used under the docs licensing? 16:23 MTDiscord also for videos in docs, pretty sure we dont want those in the repo right? not sure where to store those. i could host them, or convert videos to gifs? etc 16:23 MTDiscord tbh this is the kind of thing we might actually want LFS for 16:23 MTDiscord or just store them externally, yeah 16:27 MTDiscord 2.68 MB for video, 7.82MiB for gif. so tldr not converting it to gif 16:28 MTDiscord lol 16:30 MTDiscord if im hosting them does anyone care about domain, or do we want something like largefiles.docs.luanti.org? 17:14 MTDiscord why not just lfs.luanti.org? 17:15 MTDiscord heh, well lfs has a different meaning in the lua ecosystem 😄 17:15 MTDiscord should be under docs since its for docs 17:15 MTDiscord I assume wsor wants it to be only for the docs site, so putting it in a root subdomain wouldn't be necessary 17:15 MTDiscord Yeah the question is whether it'll always be only for docs 🤷 just putting it out there 17:17 MTDiscord gonna work on https://github.com/luanti-org/dev.luanti.org/issues/181 (renamed to just "categorize pages"), seems we have agreement on categories so I'll put up another proposal of where pages fit, which pages will be split, etc 17:21 MTDiscord so i guess in summary 1. what to do with large files 2. if wsor hosts a. under his own domain b. subdomain of docs.luanti.org 17:26 MTDiscord I still like hosting with Git LFS, and if we do that it should be under a subdomain of luanti.org or docs.luanti.org. No preferences beyond that 17:27 MTDiscord you only get like a gig through github, and its bandwidth limited iirx 17:27 MTDiscord and thats shared across the org 17:35 MTDiscord vs the 800gb and 20tb of traffic i have on my vps that i dont really use at all currently 17:38 MTDiscord 3. external hosting 17:38 MTDiscord ....such as? 17:39 MTDiscord unless you have an example, thats basically 2 unless someone else is volunteering 17:49 MTDiscord can someone share a source for this? 17:49 MTDiscord the "gig through github" claim, that is 17:50 MTDiscord https://docs.github.com/en/billing/managing-billing-for-your-products/managing-billing-for-git-large-file-storage/about-billing-for-git-large-file-storage or just look at billling for any org you have 17:51 MTDiscord Nice, thanks. Is there a way to use Git LFS but set the host to something other than GitHub? I do think we should avoid this 1 GB monthly bandwidth issue, seems like we'd run into issues relatively fast if we start incorporating multiple videos 17:52 MTDiscord I just want to use Git LFS because it's a mature tool, if there are others that the team is more familiar with and comfortable using on a public project like this, I'm all for it 17:52 MTDiscord mature and simple* 17:53 MTDiscord https://github.com/git-lfs/git-lfs/discussions/5694 17:53 MTDiscord so far your the only one pushing git lfs 17:53 MTDiscord I know I know but nobody has mentioned an alternative! 17:54 MTDiscord thats the whole purpose of 2 🤦 17:54 MTDiscord looks like the answer is yes, we can use Git LFS 17:54 MTDiscord but how would it integrate into the git repo? 17:54 MTDiscord just file hosting suffices? 17:54 MTDiscord running git lfs server < just dumping some files on a host 17:55 MTDiscord https://metacrane.com/ :juanchi_face: 17:55 MTDiscord y'all have probably done this more than me. I don't know how it'd work, but if you have an idea that would work well with several videos I'm all for it 17:55 MTDiscord (jokes aside, metacrane is for file sharing, it doesn't retain files long lol) 17:55 MTDiscord I'm going back to my categorization hole lol 17:55 MTDiscord but surely there's some free file host 17:56 MTDiscord you can put stuff on archive.org for example 17:56 MTDiscord sure, but you want one thats fast and not sketch 18:00 celeron55 it's trivial to host a couple of predetermined video files but if they need to be updated in any way ever, it becomes complicated 18:04 MTDiscord https://docs.luanti.org/protection/ is a stub, where would we put it if we do categorize it though? 18:05 [MatrxMT] Maybe the gameplay category? 18:05 MTDiscord uh.... content dev? 18:15 MTDiscord i like how the git lfs test server says > not in a production ready state. but then like half the internet is like, its fine, ship it 18:16 MTDiscord there also is https://github.com/git-lfs/git-lfs/wiki/Implementations but everyone is just like use the git lfs test server 18:18 MTDiscord i can see why, since most independent ones are over s3 or so, integrated into a git host platform, or obsolete 18:29 MTDiscord new proposal for all existing pages and a category name change to "For players", "For creators", etc.https://github.com/luanti-org/dev.luanti.org/issues/181#issuecomment-2646470440 19:09 MTDiscord anyways, after poking around, my opinion is they are video, and diffs for videos are worthless anyways. should just host them and be odne with it 19:15 MTDiscord Re videos: sure. both have some outdatedness, so could redo them, but I suppose they still show the gist well enough. 19:23 MTDiscord For file hosting outside of git, how will folks contribute? Just open an issue saying "please store this file so I can add a link to it in this page?" If files are stored in-repo like Git LFS does it, we guarantee highest-quality storage and no additional friction. I may be missing something with the "vanilla file hosting" approach, it's very new to me (Signing off to take a nap, just putting a thought out there) 19:32 MTDiscord yes ish 19:32 MTDiscord the problem with git lfs is actually hosting it 20:21 MTDiscord also github pages size limit is 1gb, which for html/images/etc is rather large. putting in videos would start to chew into that 21:29 MTDiscord Can you explain what this link meant? For me it means we can host files outside GitHub and get around that 1GiB limitation 21:34 MTDiscord Ah sorry, you said GH Pages, not GH LFS. The 1GB got me. Yeah if we want to serve videos that will be a significant problem. If you have a source for that I'm curious to see if they mention workarounds or if we should look at a replacement to GH Pages 21:57 MTDiscord https://tenor.com/view/facedesk-gif-5907213 21:58 MTDiscord 1gb is more than plenty for a website. Anyone is going to charge you some point for video due to how big it is. 21:59 MTDiscord Github pages isn't for you to host some Comercial site on 22:02 MTDiscord Does anyone else have an objection to #2 ? 22:11 MTDiscord not really, but there's kind of an obvious bus factor kind of question 22:11 MTDiscord and, as mark asks, how will uploads work? will we use a standardized file hosting solution and if so, how does auth work? 22:14 MTDiscord wsor could just sync whatever is being hosted with an archive.org collection item? 22:16 MTDiscord (I don't know what IA provides for API options, if it could be as simple as an rsync/rclone) 22:16 MTDiscord but in that case if something happens, someone can download the stuff from the "cold" storage at IA, upload to their own server to serve it, c55 changes the DNS and now someone else is hosting it 22:16 MTDiscord doesn't need to be more complicated for now 22:17 MTDiscord so yeah, I have no objections to this 22:18 MTDiscord Basically what roller said, or a provide a zip bundle that yall could just back up. 22:19 MTDiscord At least initially I'll just host files (send em to me), but whip up something for call to upload. Or use some existing solution, haven't looked super in depth yet 22:24 MTDiscord just give us ssh access. what could go wrong ;) 22:36 MTDiscord https://tenor.com/view/nah-han-sung-kang-fast-x-no-gif-9009623534519168477 22:39 MTDiscord Wrong? We'll use it as a proxy :juanchi_face: 22:41 MTDiscord Thoughts on this domain name? 22:55 MTDiscord RE large files, I'm still very confused on how it'll all work, but I'll trust you guys to figure it out. Seems asking for sources is now a no-no, I just wanted to learn more 😦 23:02 MTDiscord You where giving a source at every turn as far as I can see. Got a place where that isn't the case? 23:02 MTDiscord Step 1: Upload file to web server Step 2: Add link/embed to file on docs page 23:07 MTDiscord seems fine. personally i kind of want to go for something funnier like stuff.docs.luanti.org. files.docs.luanti.org would also be fine i suppose. 23:08 MTDiscord cdn :p 23:10 MTDiscord samsinventory.docs.luanti.org 23:15 MTDiscord im down for some trolling 23:16 MTDiscord How do others contribute files? Why did wsor mention GH Pages 1 GB limit? 23:16 MTDiscord 👀 i like 23:18 MTDiscord 1. https://discord.com/channels/369122544273588224/926231483155378176/1338273034393620601 + https://discord.com/channels/369122544273588224/926231483155378176/1338230985984311440 2. should be obvious that even if you using external git lfs to store more than 1gb, it isnt going to matter when that all is deployed to page which is 1gb limited in size. big things dont fit in small holes 😉 23:19 MTDiscord does anyone have objections to this one? 23:24 MTDiscord I mean, if this is the solution everyone else feels is best, I won't stop ya. I guess we won't be expecting new folks to send in videos any time soon 23:27 MTDiscord If we use external Git LFS, won't it already be deployed to our custom webserver? And that way anyone can edit the repo to see the list of videos, run them locally, update/replace them as-needed, etc? I'm worried how version control or overall project management will work with large files if we don't use git, but maybe that's not a primary concern here. In short, not sure what GH Pages has to do with external Git LFS. They're very 23:27 MTDiscord separate in my understanding, but maybe I'm missing something 23:51 MTDiscord There is no need for big version control needs here. This isn't a reproducible build artifact, it's just a file which ultimately somehow needs to reach users. The file should be uploaded at the time a PR is opened so it is available to reviewers and links can be checked. That's all. 23:52 MTDiscord We could put it on YouTube for all I care, but then we'd probably get someone complaining about nonfree stuff again :P 23:52 MTDiscord If wsor cares they can set up GC on their server (kill everything that doesn't have a link to it in current master periodically) but that probably won't be needed anytime soon if ever. 23:55 MTDiscord Really, all we need is file hosting, and if wsor has a decent VPS to provide that (and we have backups), sounds good to me. Git LFS is sort of just the same but with extra steps: The "pointer" (link) is managed by Git. 23:58 MTDiscord Again, git LFS allows folks to view all current files and contribute new ones. It's unclear to me how we'll handle that in the long term 23:59 MTDiscord Again, git lfs is sized limited, and we would eventually have to pay github 23:59 MTDiscord Also this is just for videos (at this time) which should be rare