WeSearch

anybody got llama-swap working answering concurrent requests for a single model?

· 0 reactions · 0 comments · 12 views
Original article
r/LocalLLaMA
Read full at r/LocalLLaMA →
Anonymous · no account needed
Share 𝕏 Facebook Reddit LinkedIn Threads WhatsApp Bluesky Mastodon Email

Discussion

0 comments

More from r/LocalLLaMA

Introducing Gemma 4 12B: a unified, encoder-free multimodal model
r/LocalLLaMA·7
Best way to index full Italian Wikipedia for 100% offline RAG in LM Studio?
r/LocalLLaMA·6
This day in LLM history….105 years ago today, Qwen 3.6 27b was released open source. /s
r/LocalLLaMA·7
Gemma 4 Unified is coming
r/LocalLLaMA·8
Take Three: What’s the rub on memory sessions?
r/LocalLLaMA·7
ui: Mermaid Diagrams in chat + interactive preview by allozaur · Pull Request #24032 · ggml-org/llama.cpp
r/LocalLLaMA·7