I glance at The War Zone occasionally (twz.com) to see if there’s anything interesting and worth posting here on the Threadiverse.
Off-and-on trying out an account over at @tal@oleo.cafe due to scraping bots bogging down lemmy.today to the point of near-unusability.
- 2 Posts
- 295 Comments
tal@lemmy.todayto
Selfhosted@lemmy.world•Check if you need to update all your stuff - again.English
42·12 days agodid you get hacked? check.
$ grep “Accepted password” /var/log/messages
That’s a really bad check unless you have an external box receiving logs and you’re looking there, because the first thing that a sophisticated attacker is going to do if they get in as root is remove the signs of their presence.
tal@lemmy.todayto
Selfhosted@lemmy.world•Check if you need to update all your stuff - again.English
18·12 days agoNow, now. Starbucks is a very successful business.
tal@lemmy.todayto
Selfhosted@lemmy.world•How much pain should I expect upgrading my server from Debian 12 to 13?English
31·18 days agoI’ll probably follow the official documentation
I just apt update, apt upgrade, modify my apt sources to point at the new distro, repeat. If something breaks, I’ll go fix it.
I wouldn’t anticipate problems, though.
tal@lemmy.todayto
Selfhosted@lemmy.world•[AIT] Experiences with using openclaw as a sex/roleplaying chatbot without GPU?English
81·29 days agoI’ve already got a 128GB Framework Desktop that I picked up prior to the memory shortage for AI compute stuff, but if I didn’t…
In 2028, I expect memory prices to start coming down.
The GPU hardware itself isn’t really the limiting factor, but rather available memory.
I just don’t think that I’d be willing to put in massive amounts of effort trying to work around hardware limitations (or spend a bunch of money, which is the other route, outbidding people for the limited supply of memory) to get a local AI compute setup going in 2026 or 2027 when the hardware situation should change substantially in the not-so-distant future.
Specifically on generating literary erotica, my own experience is that quality is substantially better with larger, dense models. I’ve read that MoE models, like Qwen, are not very good at it, and my limited experimentation with Qwen supports that, though I haven’t tried to aggressively track the latest versions.
If you look at this thread:
…while the OP in that thread is talking about using Qwen 3.6 for erotic role-play (ERP), other users are not generally all that enthusiastic about Qwen 3.6.
In general, I think that /r/SillyTavernAI favors /u/TheDrummer’s models—which are not merely abliterated base models, but ERP-oriented finetunes—for ERP.
EDIT: If you are after generating erotica, my own experience is that TheDrummer’s Cydonia, which is recommended in that thread, is the best smaller (consumer GPU-runnable) model, though it starts to get nonsensical once the history grows large enough. I don’t know if you’d get a tolerable response rate out of that on a CPU-only setup. The best quality I feel I’ve seen has been out of the Llama-3-based AnubisLemonade, but I think that it’s going to be painful to run that on even a very high-end CPU-only setup. On my 128GB, unified memory setup, I use a Q6_K quantitization of that with llama.cpp run with (checks)
--direct-io --fit-off --no-mmproj -c0 -ngl 99 --dry-multiplier 0.8 --cache-type-k q8_0 --cache-type-v q8_0 --flash-attn onand a 128k token context window.I’m presently using Vulkan for compute with llama.cpp, though my experience with ComfyUI is that ROCm 10.1 is (finally) stable and effective on Strix Halo hardware, and I’ve been meaning to look into how llama.cpp handles ROCm now. In the past, llama.cpp had ROCm win on prompt processing performance and Vulkan win on inference performance; I’d been using Vulkan because ROCm releases had been having problems on that hardware and because I used a large context window and unchanging-from-prompt-to-prompt history with llama.cpp, so prompt processing time didn’t matter much, since one could rely on the cache to avoid most of the prompt processing, and inference time did matter.
The quantitization there is done to get response time down rather than because the system is memory-constrained.
In your case, the performance constraints may be quite different.
Often discrete GPU-based users (more bandwidth than my system, but much less memory) aim to use a small context window and have the system modify the history for each prompt, so they can’t leverage their K-V cache but can play tricks with things like RAG to keep a small context window and still keep a lot of relevant information, injecting relevant information into the history on each prompt. The problem they run into is generally trying to work around limited memory, not being able to store large models and a lot of history.
On my unified-memory setup, I use a large context window, leverage my memory, and rely on cache to keep performance acceptable. I’ve got plenty of memory, so I don’t have to worry about large model size or having loads of history, but have less memory bandwidth, so response time is the issue that I work on. So I use very different models and techniques from what’s optimal for a discrete GPU user.
Not sure what the best route for a CPU-only setup is. I’d expect that to be less memory-constrained than a GPU user, but be compute-constrained.
I think it’s fine. Want to explain why you think that it’s an issue?
tal@lemmy.todayto
Selfhosted@lemmy.world•What’s next, I’ll need some more storageEnglish
41·1 month agoI mean, you can stick a USB hub on a port and have multiple devices connected to it…
I don’t presently, but back when I was working on a large codebase and needing to know when a painfully long compile finished, I used an XMPP client and server.
If you’re a developer for an important open source project, they might.
Attacking the xz project wasn’t done because the attacker cared about anything that the xz maintainer had. It was because he was trusted and the software he maintained had been given a fair bit of trust by certain maintainers and could be compromised and used as a vector into other systems that indirectly relied on that open-source project.
I don’t use Mastodon, but I don’t know if it’s possible to do this particular combination:
without owning a domain
users on the local server should still be able to follow accounts on other Mastodon servers
Like, a client that supports having accounts on multiple Mastodon servers would work. Then they have a local account, and they have an unrelated account elsewhere on another Mastodon server and follow people using that, so that the “following” has nothing to do with your local server.
But if you want federated behavior, where a user connects to your server and has their account there tell the local Mastodon server to pull down posts from another users somewhere out on another Mastodon server, you might need to have a certificate on your server that other servers recognize as valid, which in practice would mean one signed by a public CA.
I don’t know for certain whether this is actually necessary, but I could believe that it is.
The big concern with filesystems becoming corrupt is that all of the data can be lost on a filesystem. Most of the time, this doesn’t show up, but if you lose power at just the wrong time, it can happen. With FAT, HFS, ext2, and similar filesystems that were vulnerable to corruption on power loss, that was a real risk.
So having some kind of power source to make an unclean shutdown unlikely avoids the risk of a really, really bad scenario.
The general shift away from reliance on those filesystems has mitigated the really-bad-case that drove a lot of UPS use.
Databases are probably the most-critical case where applications update a file on disk constantly, and where corruption would be bad. As long as they live on a filesystem that itself can’t become corrupt on power loss, they’re normally structured with a carefully-ordered series of writes and use of write barriers so that they cannot become corrupt.
An individual file can be partially written out. Like, say I’m saving a file in Photoshop, and I have only written half of that file. What winds up on the disk is the first half of of a Photoshop file. That’s an invalid Photoshop file. For some applications, that can matter. Like, say (a) I chose to overwrite an old file and (b) the application doesn’t atomically store the new file (like, write it out, fsync(), and then rename the new file over the old) and © there’s no backup or other system in place.
Or, even aside from partially writing out a file, I can entirely lose work that isn’t saved at all, if I’m not using a software package that makes use of some sort of autosave system. If I haven’t saved all day, then, well, all of that unsaved work is going to go away if there’s a power loss.
That’s a much smaller potential data loss, but, sure…power loss can cause data loss, even if it doesn’t produce that “everything is lost” filesystem corruption.
I’m not asserting that there’s no utility to a UPS; quite the contrary, as my comment was explaining to OP why there is use some people have for having NUT even if he personally doesn’t care much about it for his use case. I’m just pointing out that some of the major reasons for having a UPS+host-side-software combination that existed in, say, the 1990s aren’t really much of a thing in 2026. That was that you really did not want machines using filesystems normally used then to perform an unclean shutdown. Even with a UPS and host-side software like NUT, you can have data loss, as NUT cannot force all software to save unsaved data; there’s no standardized mechanism for forcing applications to save. If the PC is attended, you might get a warning and have a chance to manually save, but that’ll be the best that’ll happen, and if the PC is unattended, well, that save isn’t going to happen. But what NUT and similar software can do is to, when the UPS battery level gets low, trigger a clean shutdown. That ensures that the OS has time to perform a clean shutdown, and on filesystems that have a risk of filesystem corruption if the power is cut—FAT, HFS, ext2, and similar—a UPS with host-side software would avoid that case from arising.
If someone wants to have a UPS in 2026 on filesystems that don’t have those limitations, that’s fine. They may want to have, say, a five minute window to save their work if they are at the PC when power loss occurs. It may help avoid problems that arise from software that cannot cleanly handle power loss—I that Steam can, if power loss occurs while it is updating itself, wind up in a broken state from which it cannot automatically recover when restarted, as I’ve done that myself.
But generally, if you lose power on a system in 2026, you aren’t facing a “I might lose the contents of my hard drive” scenario.
ext4 is merely journaled, which means that there are rare instances where it can be corrupted, but recovery is fast.
None of these things mean that the filesystem becomes corrupted; the filesystem will be in a filesystem consistent state when remounted. You can have a write that is partially performed on a file, but that does not cause the filesystem to become corrupt when it does not complete being written. The journal can contain that write, but it can not yet be committed, and won’t yet be visible to a user. But that doesn’t make the filesystem corrupt; the commit itself is atomic.
And even if the filesystem doesn’t become corrupted, individual files can become inconsistent or incomplete.
Sure, but that is not filesystem corruption, and I addressed it in my comment.
Modern filesystems can corrupt as well with unclean shutdown. They are just less likely to do so.
It shouldn’t be possible for them to become corrupt on an unclean shutdown, at all. Not at the filesystem level. It isn’t just a question of probability.
It’s possible that there is some bug in the implementation of a filesystem that causes it to violate its guarantees.
There could be, oh…hardware bugs, say, where hardware violates guarantees.
Files can be partially-written. Software might not handle that, though properly-written software designed like a DBMS will be set up so that a partially-written file will not become corrupt at the file level.
Some filesystems permit disabling features that guard against filesystem corruption.
But absent something like that, it should not be possible for one of the filesystems to become corrupt on an unclean shutdown, at all.
Well, they might want that save-data-and-clean-shutdown functionality. I mean, I don’t personally care all that much for my use case, but it’s a legit want. Like, say you have a USB flash drive plugged into your machine. Those normally ship formatted with exFAT, a Microsoft filesystem derived from the elderly FAT16 filesystem, and most people use them like that, as pretty much every OS out there can read FAT. FAT can become corrupt in the event of power loss. Or say you’ve been working on something in some application that doesn’t do auto-save and have a day of work accrued in the thing and then you get a power loss. Having a few minutes notice to clean up and shut down is legit important, same way that a laptop will issue low power warnings on a battery. This makes sure that you get that notification.
I think that in general, the clean shutdown functionality isn’t as important these days as it was in the 1990s, as most machines are using journalled filesystems that don’t become corrupt on power loss these days. NTFS (Windows land), HFS+ (MacOS X), or ext4 or btrfs (Linux) for most of their storage. But, I mean, there are going to be people who want it. I don’t think that someone has to be wanting complexity for the sake of complexity for them to have a use case where that applies.
EDIT: Looks like HFS+ actually got replaced with a newer FS a few years back as the default on MacOS.
I was reading a homelab discussion about NUTs (Network UPS Tools) that left me scratching my head and wondering "…why? Is complexity for complexities sake part of homelabs? Isn’t this a huge overkill for one machine? Just…use a UPS? "
So, you don’t need to run any software at all on a host on a UPS. You don’t need NUT or anything similar. You can just plug a PC into a UPS.
However, traditionally, the purpose of a UPS isn’t “just power a machine through an extended outage”. It’s to provide enough time to cleanly shut down a machine. Save work, and—once upon a time, filesystems that weren’t cleanly unmounted could become corrupt—unmount filesystems.
It can also provide time for something like a backup generator, if you have something like that up. The UPS may only have enough juice to run the PC for a few minutes. If you look at traditional UPS units, they have very limited amounts of time that they can keep a PC running. They aren’t aimed at the “whole house multi-day keep things running” capability that some lithium ion battery setups are these days.So traditionally, one would have software on a machine that takes some action, like shutting it down cleanly, when the battery gets low.
If what you have a UPS for is to keep a PC running through momentary power interruptions, and you don’t care about, say, remotely monitoring power status, then, sure. NUT isn’t necessary. Same thing if you just want to provide a short amount of buffer time to let a generator that comes on automatically in an outage fire up.
But if you want remote monitoring of power status or you want hosts to shut down cleanly, then it may be useful. For some people, that’s the reason that they have a UPS at all.
I have seen recommended the GL·INet Flint 2 GL-MT6000 https://openwrt.org/toh/gl.inet/gl-mt6000
I’ve used a Flint 2 GL-MT6000. Works fine for me. If you want a high-spec new OpenWRT machine, it’s near the top end, from my skim. It may be overkill if you don’t intend to do anything elaborate.
and is also failing a lot lately (it loses internet connection at least once a week and needs restarting).
So, you’re still going to need to have a cable modem or DSL modem or whatever, if you have cable or DSL service, and it (or some other hardware, if you can get that working) going to be necessary for that bit. There are three pieces to this equation: a modem or whatever translates your satellite/long-range-wireless/cable/DSL/etc link to your ISP to Ethernet. A wireless access point, to provide WiFi. A router, to NAT connections, do things like setting up what traffic goes where, what’s blocked, etc. The Flint 2 will act as a wireless access point and as a router. But it doesn’t have a modem built in.
You can turn off a lot of functionality on your ISP-provided router, but you’re going to keep it in the loop (with the Flint 2 plugged into it) unless you have the ability to use an alternative modem. It may be possible to replace it with a different modem, depending upon your particular situation; I believe that some ISPs may embed authentication information in the modem specifically to keep people from using alternatives.
Thus, if the ISP-provided router keeps failing in that configuration, this isn’t going to fix your problem. You can reduce the functionality that the thing uses, like, maybe throw it into bridge mode (which just passes traffic through, doesn’t NAT anything) and let the Flint 2 act as a router. That’ll reduce what the ISP-provided router does, and if that’s triggering some bug on the thing, that might resolve your problem.
If the existing router is honestly failing in some way—like, once it has problems, it never comes back without a reboot, isn’t just connectivity problems—you might request a replacement.
If none of the above fixes your problem (i.e. the ISP-provided router, stays in the loop and keeps failing and only a reboot fixes things) a mitigation, albeit not a fix, would be to set something up on your network to ping the outside world and then power-cycle the router automatically if it fails for a certain amount of time.
tal@lemmy.todayto
Selfhosted@lemmy.world•UK/EU homelabbers: would you host a hardened Pi so I can watch baseball I already pay for?English
4·3 months agoAlso, part of the point of Tor is to let various types of traffic reside in the noise.
It’s like…say the only encrypted emails being sent contained stuff that one’s government didn’t like. It’d kind of stand out.
I mean, I am not, but if you feel strongly enough about making a stand on that particular issue and you’re willing to deal with a smaller userbase than Linux and all that comes with that, like more-limited developer time and hardware support, sure.
If you don’t specifically want NetBSD, though, and are happy with FreeBSD, I’d probably use FreeBSD instead. Larger userbase than NetBSD.
EDIT: I would point out, though, that there’s going to be a lot of packaged software in BSD distros where the upstream projects will have LLM-generated code in them, regardless of the specific position that the BSD distro takes, so either way, you’re going to be running LLM-generated code.