minus-squarehyperhypervisor@programming.devtoSelfhosted@lemmy.world•Getting Started with Self Hosted LLMlinkfedilinkEnglisharrow-up4·3 years agoOk. I haven’t tried it so I’ll take your word for it. I’m just offering an easier alternative since the topic was “getting started” linkfedilink
minus-squarehyperhypervisor@programming.devtoSelfhosted@lemmy.world•Getting Started with Self Hosted LLMlinkfedilinkEnglisharrow-up5·3 years agoIirc it can run anything llama.cpp can because it just uses that under the hood. linkfedilink
minus-squarehyperhypervisor@programming.devtoSelfhosted@lemmy.world•Getting Started with Self Hosted LLMlinkfedilinkEnglisharrow-up8·3 years agoThere’s also llamafile, super simple: download and run it. linkfedilink
Ok. I haven’t tried it so I’ll take your word for it. I’m just offering an easier alternative since the topic was “getting started”