mirror of
https://github.com/Memo-2023/mana-monorepo.git
synced 2026-05-16 19:39:40 +02:00
1495dbe476
Python/FastAPI service providing unified OpenAI-compatible API for Ollama and cloud LLM providers (OpenRouter, Groq, Together). Features: - Chat completions with streaming (SSE) - Vision/multimodal support - Embeddings generation - Multi-provider routing (provider/model format) - Prometheus metrics - Optional Redis caching
5 lines
126 B
Python
5 lines
126 B
Python
"""Utility modules."""
|
|
|
|
from .metrics import get_metrics, metrics_middleware
|
|
|
|
__all__ = ["get_metrics", "metrics_middleware"]
|