projectmoon

OpenWebUI connected tabbyUI’s OpenAI endpoint. I will try reducing temperature and seeing if that makes it more accurate.

Context was set to anywhere between 8k and 16k. It was responding in English properly, and then about halfway to 3/4s of the way through a response, it would start outputting tokens in either a foreign language (Russian/Chinese in the case of Qwen 2.5) or things that don’t make sense (random code snippets, improperly formatted text). Sometimes the text was repeating as well. But I thought that might have been a template problem, because it seemed to be answering the question twice.

Otherwise, all settings are the defaults.

I tried it with both Qwen 14b and Llama 3.1. Both were exl2 quants produced by bartowski.

Perplexica works. It can understand ollama and custom OpenAI providers.

Super useful guide. However after playing around with TabbyAPI, the responses from models quickly become jibberish, usually halfway through or towards the end. I’m using exl2 models off of HuggingFace, with Q4, Q6, and FP16 cache. Any tips? Also, how do I control context length on a per-model basis? max_seq_len in config.json?

Not necessarily. While of course in many many cases, open source is a volunteer effort, there’s usually some implicit transaction going on. Whether that’s improving the software for yourself and passing that on to others, being a business and improving a library or something you use that helps your project generate revenue, or even a straight up commercial transaction.

But in all these cases, the open source project can be taken by you (or others) and you can do whatever you want with it. In the case of Winamp here, you cannot do any of that. It would be different if they were paying for contributions. But they’re not, so.

They basically want free labor.

Lol. Git itself can act as a server over the git protocol. Might have been easier 🤪

There’s plenty of git forges that aren’t GitHub. Git itself has nothing to do with central servers and can theoretically be used in a completely decentralized manner.

Ah right. What I really meant to ask was if it can do protocols other than http.

Which I don’t think it can…

Are you able to tunnel ports other than 80 and 443 through Cloudflare?

How will you handle the planned rewrite of Iceshrimp?

Definitely a good way to do it. Photoprism supports uploading to WebDAV for sharing. Could front a CDN upload with a web dav server 🤔

Yeah, that sounds like a good idea. I am using photoprism for photo management. It doesn’t really support S3 or any CDN. You could use a fuse filesystem or something, but it’s very slow.

Where are you uploading galleries? Just your own HDD connected to a static website?

There’s a lava flow on the other side of the barrier that was built. It’s inching into the new construction at the edge of the town and has already consumed one house. Probably it will keep going, possibly to the harbor.

Fluffy is also a desktop client.

Tasks.org syncs with various services. Those services may or may not have a web UI. I use it with Nextcloud tasks, which has a serviceable web UI.

If you download it from Fdroid, it doesn’t have a subscription. And it has all the features unlocked.

Block the meme communities. It makes things much better. I wish there was a way to relegate certain things to a separate feed without completely blocking them. But right now block is the only tool.