minus-squareMasterNerd@lemm.eetoSelfhosted@lemmy.world•Is it possible to run a LLM on a mini-pc like the GMKtec K8 and K9?linkfedilinkEnglisharrow-up3arrow-down1·2 years agoI don’t have any experience with them honestly so I can’t help you there linkfedilink
minus-squareMasterNerd@lemm.eetoSelfhosted@lemmy.world•Is it possible to run a LLM on a mini-pc like the GMKtec K8 and K9?linkfedilinkEnglisharrow-up5·2 years agoLook into ollama. It shouldn’t be an issue if you stick to 7b parameter models linkfedilink
I don’t have any experience with them honestly so I can’t help you there