coffee_with_cream@sh.itjust.workstoSelfhosted@lemmy.world•Self-Hosted AI is pretty darn coolEnglish
9·
2 months agoUncensored models are so much better, too. chatGPT is like one of those plastic children’s toy hammers vs real models are titanium hammers
You probably want 48gb of vram or more to run the good stuff. I recommend renting GPU time instead of using your own hardware, via AWS or other vendors - runpod.io is pretty good.