managarten/services/mana-llm
Till-JS 1495dbe476 feat(mana-llm): add central LLM abstraction service
Python/FastAPI service providing unified OpenAI-compatible API for
Ollama and cloud LLM providers (OpenRouter, Groq, Together).

Features:
- Chat completions with streaming (SSE)
- Vision/multimodal support
- Embeddings generation
- Multi-provider routing (provider/model format)
- Prometheus metrics
- Optional Redis caching
2026-01-29 22:01:00 +01:00
..
src feat(mana-llm): add central LLM abstraction service 2026-01-29 22:01:00 +01:00
tests feat(mana-llm): add central LLM abstraction service 2026-01-29 22:01:00 +01:00
.env.example feat(mana-llm): add central LLM abstraction service 2026-01-29 22:01:00 +01:00
.gitignore feat(mana-llm): add central LLM abstraction service 2026-01-29 22:01:00 +01:00
CLAUDE.md feat(mana-llm): add central LLM abstraction service 2026-01-29 22:01:00 +01:00
docker-compose.dev.yml feat(mana-llm): add central LLM abstraction service 2026-01-29 22:01:00 +01:00
docker-compose.yml feat(mana-llm): add central LLM abstraction service 2026-01-29 22:01:00 +01:00
Dockerfile feat(mana-llm): add central LLM abstraction service 2026-01-29 22:01:00 +01:00
pyproject.toml feat(mana-llm): add central LLM abstraction service 2026-01-29 22:01:00 +01:00
requirements.txt feat(mana-llm): add central LLM abstraction service 2026-01-29 22:01:00 +01:00