minus-squarecoja@lemmy.mltoSelfhosted@lemmy.world•What would be the cheapest and most cost-effeciant way of self hosting LLMslinkfedilinkarrow-up3·edit-24 months agoNot sure about the setup, but I believe 7600XT would be the best buy, it has 16GB VRAM and it’s supported now linkfedilink
coja@lemmy.ml to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.com · 11 months agoDeploy the cracklemmy.mlimagemessage-square4fedilinkarrow-up18arrow-down10
arrow-up18arrow-down1imageDeploy the cracklemmy.mlcoja@lemmy.ml to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.com · 11 months agomessage-square4fedilink
Not sure about the setup, but I believe 7600XT would be the best buy, it has 16GB VRAM and it’s supported now