managarten/services/mana-llm/src/models/__init__.py
Till JS e757470cb0 feat(mana-llm): add OpenAI-style tools + tool_calls passthrough
Extends the chat-completions surface so callers can ask any provider
to call named functions and get structured tool_calls back. Wired
through all three provider adapters so the planner and companion can
switch off the fragile JSON-parsing pathway.

- Request: tools[], tool_choice, assistant tool_calls, tool-role
  messages with tool_call_id.
- Response: MessageResponse.tool_calls, Choice.finish_reason adds
  "tool_calls", DeltaContent streams tool_calls.
- Google provider: Tool(function_declarations=...) build, result
  normalised (args dict → JSON string), function_response parts on
  a user turn for tool-role messages.
- OpenAI-compat: 1:1 passthrough of the OpenAI spec.
- Ollama: /api/chat passthrough; model-level capability check via a
  TOOL_CAPABLE_OLLAMA_PATTERNS whitelist (llama3.1+, qwen2.5+,
  mistral, command-r, …) — unsupported models rejected rather than
  silently falling back to prose.
- Router: model_supports_tools() check upfront for both streaming
  and non-streaming paths; ProviderCapabilityError bubbles as 400.

No silent downgrade. Missing tool support = explicit error.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-20 15:22:48 +02:00

47 lines
886 B
Python

"""Pydantic models for OpenAI-compatible API."""
from .requests import (
ChatCompletionRequest,
EmbeddingRequest,
FunctionSpec,
Message,
ToolChoice,
ToolSpec,
)
from .responses import (
ChatCompletionResponse,
ChatCompletionStreamResponse,
Choice,
DeltaContent,
EmbeddingData,
EmbeddingResponse,
MessageResponse,
ModelInfo,
ModelsResponse,
StreamChoice,
ToolCall,
ToolCallFunction,
Usage,
)
__all__ = [
"ChatCompletionRequest",
"ChatCompletionResponse",
"ChatCompletionStreamResponse",
"Choice",
"DeltaContent",
"EmbeddingData",
"EmbeddingRequest",
"EmbeddingResponse",
"FunctionSpec",
"Message",
"MessageResponse",
"ModelInfo",
"ModelsResponse",
"StreamChoice",
"ToolCall",
"ToolCallFunction",
"ToolChoice",
"ToolSpec",
"Usage",
]