mirror of
https://github.com/Memo-2023/mana-monorepo.git
synced 2026-05-14 20:21:09 +02:00
1495dbe476
Python/FastAPI service providing unified OpenAI-compatible API for Ollama and cloud LLM providers (OpenRouter, Groq, Together). Features: - Chat completions with streaming (SSE) - Vision/multimodal support - Embeddings generation - Multi-provider routing (provider/model format) - Prometheus metrics - Optional Redis caching
23 lines
304 B
Text
23 lines
304 B
Text
# Core
|
|
fastapi>=0.115.0
|
|
uvicorn[standard]>=0.32.0
|
|
pydantic>=2.10.0
|
|
pydantic-settings>=2.6.0
|
|
|
|
# HTTP Client
|
|
httpx>=0.28.0
|
|
|
|
# Streaming
|
|
sse-starlette>=2.2.0
|
|
|
|
# Caching (optional)
|
|
redis>=5.2.0
|
|
|
|
# Metrics
|
|
prometheus-client>=0.21.0
|
|
|
|
# Dev
|
|
pytest>=8.3.0
|
|
pytest-asyncio>=0.24.0
|
|
pytest-httpx>=0.35.0
|
|
ruff>=0.8.0
|