There are so many out there, with varying benefits, risks, and ethics. I’d like to know what to recommend when asked, and also what I could use for myself.
Some areas that could be good for discussion:
- Locally hosted models (both for low and high powered devices)
- Open source models (also calling out “open source” models that aren’t actually open source)
- Privacy friendly tools/frontends (ex. DuckDuckGo’s AI chat for anonymous use of some “free” models)
- Unified interfaces for multiple models, or ‘pay as you go’ platforms instead of paying for individual subscriptions
Depending on the features and intensity you use, you may save lots of money by self hosting openwebui and connecting to openai via their API.
You can also host openwebui directly on your local PC no need for a server.
Pay per token is much cheaper for me.
Nope, I’m sticking with money well spent thanks