• 0 Posts
  • 25 Comments
Joined 1 year ago
cake
Cake day: June 4th, 2025

help-circle

  • I recently gave Strata a shot for my local AI. I’m very impressed with the performance they have eeked out of my hardware. I’ve got a rather beefy gaming desktop I built as an AI server back when the current craze started, before prices started going up, but models up until this point really failed to take full advantage of that hardware. Strata (which uses a Qwen model) both simplified the setup process, and it maxes out the hardware when running.

    Strata acts like an OpenAI compatible API server, I then have Hermes as a “harness” to make an “agent”, which I interact with on “buzz”, which is like discord, but made for bots. Although Hermes also supports discord and several other chat platforms.

    If you have the hardware to run Strata, I recommend setting it up, it comes with a basic chat interface, which you can then grill to assist you with setting up Hermes and whatever else.

    One thing I didn’t mention, is security. I highly recommend you treat AI as unpredictable, unreliable, and capable of being taken over by bad actors. This isn’t a problem for a pure chat interface, but Hermes gives the AI tools to do things, and those tools could be used to take over your computer, scan your network, and create all kinds of havoc. For my part, Hermes is running in a virtual machine which is on an isolated network. I keep tight control on what it does and doesn’t have access to in my network main network. That may not be something you have the hardware or knowledge to do, at the very least I recommend running Hermes in a docker container, and not giving it access to your personal desktop nor credentials to things like your email account.


  • I think most of the comments misunderstood you, or I did.

    Keeping a dedicated admin separate from your daily use user is best practice. In a business setting it is a critical security line, and also seriously helps with auditing and logging. It makes sure that if my computer gets compromised, the active cookies and session tokens are all a standard user. It’s not fool proof, but it really reduces risk.

    That said, in my home lab, I don’t bother with that separation. It’s far more work than the effort justifies, when the worst result of your systems being compromised is your media library not being available. What you will want, in any case, is a “break glass” account into every system you setup to use SSO. A local administrator that isn’t tied to SSO available in case your IDP is down, certificates expire, or you accidentally paint yourself into a corner (and you will).

    I recommend, if you don’t already, using a password manager like BitWarden and having every single local admin be a long, randomly generated password.





  • If you know someone in IT, it’s worth asking them what their company does with old computers. At my last place, we sent off old PCs to recyclers, old often only being 3 years or so. Most of them were basic i5s with 16GB of RAM, but they were more than powerful enough for a good docker host. I’ve got small stack of them that I rescued from the recycle pile.

    Not to mention the laptops that went to the recyclers. Of course, many of you might think that is wasteful, but the recyclers were refurbishing them and reselling. We got them off our hands for free, and they got to make a few bucks off them.



  • The hardware requirements are quite steep, but I’ve got local AI running in my house. It’s mostly just there for when I want to screw around with it, but technically I could setup OpenClaw and point it to my AI server to use as its brain.

    I’m not stupid enough to do that on any real computer I use, but it might be cool to do on a VM where I can tightly control what it can see and have access to. Of course, that limits its usefulness, but security has a cost.

    At the same time, I can see the allure of a real digital assistant. I’m old enough to remember when professionals had personal assistants that not only helped them keep track of their work life, but also their personal life. Scheduling their personal life like doctors appointments or house repairs. Dealing with vendors to make sure stuff actually gets done, and making sure they are in the right place at the right time. That would be rad to have.







  • I spent some time last week learning both Ansible and Podman Quadlets. They are a powerful duo, especially for self hosting.

    Ansible is a desired state system for Linux. Letting you define a list of servers and what their configuration should be, like “have podman installed” and “have this file at this location with this content”.

    Podman quadlets is a system for defining podman containers as a service. You define the container, volumes, and networks all in essentially Systemd unit files.

    Mixing the two together, I can have my entire podman setup in a format that can be pushed to any server in seconds.

    And of course everything is text files that git well.




  • As others have mentioned, the websites tend to be limited both by resolution and functionality.

    My TV supports CEC(most do these days) which will pass the remote input onto the devices connected to it, like a computer. Which means with Plasma Big Picture I can navigate with my remote, and any app that supports navigation with simple arrow key input would work great.

    Unfortunately, the streaming websites, last time I tried, absolutely suck at that and assume you are navigating with a mouse.



  • I’m a big fan of syncthing. It doesn’t rely on cloud services for storage, and can work 100% locally if you want it to.

    It isn’t perfect. It has a model of running a web server for managing the service which is a little strange. Because it is not backed by any cloud storage it means you are on your own to make sure you keep your copies safe.

    With those two issues understood, it is simple, fast, free, and and supported almost everywhere. I have it on my phone, laptop, desktop, and as a docker container on my NAS. Everything stays synced and the NAS does backups of the data.