till/managarten
1
0
Fork 0
mirror of https://github.com/Memo-2023/mana-monorepo.git synced 2026-05-15 20:39:41 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 4
managarten/services/mana-llm/src/utils
History
Till-JS 1495dbe476 ✨ feat(mana-llm): add central LLM abstraction service 
Python/FastAPI service providing unified OpenAI-compatible API for
Ollama and cloud LLM providers (OpenRouter, Groq, Together).

Features:
- Chat completions with streaming (SSE)
- Vision/multimodal support
- Embeddings generation
- Multi-provider routing (provider/model format)
- Prometheus metrics
- Optional Redis caching
2026-01-29 22:01:00 +01:00
..
__init__.py ✨ feat(mana-llm): add central LLM abstraction service 2026-01-29 22:01:00 +01:00
cache.py ✨ feat(mana-llm): add central LLM abstraction service 2026-01-29 22:01:00 +01:00
metrics.py ✨ feat(mana-llm): add central LLM abstraction service 2026-01-29 22:01:00 +01:00