CaptnBook @feddit.org
Posts 0
Comments 2
Faster Ollama alternative 2 0
Vllm unfortunately doesn't support switching the model without a restart.
Reply
Faster Ollama alternative 1 0
It's not, by far. But vllm or SGLang don't support switching the model.. such a shame.
Reply
Next