You can automate a task to analyze the network traffic (though don’t underestimate human checks - remember the guy that noticed something was off by like 0.1% and discovered the logistics attack on Linux?).

Also, you can probably trust hardware made yourself that’s more than that, like FPGA.

Can’t you just check network connections for suspicious activity? At some point the thing affected by the KTH would send an outbound signal either of data collected, or inbound signals if it’s updating the backdoor.

Looking at their git, it seems it’s still technically mantained, but not often.

https://github.com/IceWhaleTech/CasaOS/discussions/2386

I wouldn’t use it for anything requiring much security, but for other stuff it’s probably fine?

Isn’t CasaOS deprecated now and replaced with ZimaOS? Also, does that mean you’re running it in something like Gnome Boxes? Because from what I remember CasaOS was customized Debian

You’re probably too young to know what 69 means I guess based on your responses, let alone ever had the chance to do a 69, so fair enough.

And I guess weed is much more legal these days than before, so less need for a code number.

42 is what you were thinking of with your first answer btw, and it’s the meaning of everything.

1337 you might come across if you start coding. 1ts M0r3 0utd4t3d.

Already planning on them adding Rustdesk in case of issues in the future actually 😅

I know it doesn’t need hourly updates but something that relies on other data (in this case LLMs) probably needs yearly updates at the very least to ensure better compatibility with newer models.

It’s a good reference guide, yes, but it’s not good for beginners. The linked TRaSH guide seems better but I think are still a lot.

The issue I’ve found when searching for resources for them is that there’s really no guide me for people who know very little but want to do this and guides them in the proper steps from beginning to end. I have an IT degree and even I remember struggling a little bit when I first delved into self hosting because I never really studied networking, and networking feels like a different field entirely. Right now self hosting in general reminds me of the early days of Slackware (maybe even SLS) Linux (for those that remember) - you kind of have to ask around and figure things out on your own through a bunch of lookup.

I’m trying to ease the friction a little bit for those that want too start, and want to see if an LLM that can quickly define some words and tell you not only where to start but the steps after that based on your skill/knowledge level can ease some of that friction.

At least until one day self hosting becomes about as easy as modern Linux.

I am interested in this in general too. I have a 3090 which I know isn’t much but have been thinking of trying to get a second 3090 and using an NVLink to increase to 48Gb. Mostly for learning and testing purposes, and then to eventually offer to donate to my wife’s local school district a local model they own (since teachers aren’t supposed to put student info online, that includes private LLM models like ChatGPT, but they keep accidentally doing so anyway).

But one project at a time, and setting up this LLM would help my two friends if they have issues (it’s easy to forget for people like us that to nearly everyone else, setting up Jellyfin properly with remote access as well as things like Docker are not easy, even when they have base level knowledge), but it might help others in the future too that might then get interested in self hosting. A 24/7 guide can make a difference I think in someone actually trying self hosting or not.

I asked mostly because I haven’t seen any guides like that. The long video guides are also usually outdated or a very specific method that’s more advanced (like bare metal setup or using ignition)

My plan was to lead them through something like what I use which is base Debian using Dockge and a reverse proxy (though I’m looking into KDE Plasma BigScreen). I think they might be able to figure it out with help and some general written instructions and the AI for further questions.

Is GPT4all still up to date though? I see the last release was in 2024

Any step-by-step text guides you’d recommend? They’re not exactly tech beginners, but they’re also not quite knowledgeable yet. I guided them through Linux install but they use Bazzite and mostly stick to Bazaar on it for any programs they need.

And the Arr Stack, and KitchenOwl, and LibreCloset. They also want something for YouTube, but haven’t decided what they might like the most yet - was thinking of testing KDE’s new Plasma BigScreen and seeing how Waydroid does at running S-tube.

If that worked well enough, then I’d probably try setting them up with that

I have the Alpaca Flatpak, can I set this up in that or is Ollama better? I’m running on Debian

Wait it has built in reverse proxy?

Nice! Maybe I’ll try the beta. Been wanting to tinker around with my set up recently

Does it work with a reverse proxy?

They’re great for less tech savvy people, though terrible if you do know more and want to muck about your system more.

The coconut nut is a giant nut If you eat too much, you’ll get very fat Now, the coconut nut is a big, big nut But this delicious nut is not a nut

It’s the coco fruit (It’s the coco fruit) Of the coco tree (Of the coco tree) From the coco palm family!

Ayayayayai

Haven’t tried it myself but can you run Nginx or Traefik in it, or would it give issues connecting to other containers?