till/managarten
1
0
Fork 0
mirror of https://github.com/Memo-2023/mana-monorepo.git synced 2026-05-20 20:06:43 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 5
managarten/services/mana-stt/scripts
History
Till-JS 60394076e5 ✨ feat(mana-stt): add vLLM integration for Voxtral transcription 
- Add vllm_service.py as proxy to vLLM server for Voxtral 3B/4B
- Add voxtral_api_service.py for Mistral API fallback
- Update main.py with /transcribe/voxtral endpoint using vLLM
- Add /transcribe/auto endpoint with automatic fallback chain
- Create setup-vllm.sh and start-vllm-voxtral.sh scripts
- Add launchd plist files for Mac Mini deployment
- Add install-services.sh for automated service installation

Architecture:
- vLLM server runs Voxtral models on port 8100
- mana-stt proxies to vLLM with Mistral API fallback
- Fallback chain: vLLM -> Mistral API

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-02-11 16:10:00 +01:00
..
setup-vllm.sh ✨ feat(mana-stt): add vLLM integration for Voxtral transcription 2026-02-11 16:10:00 +01:00
start-vllm-voxtral.sh ✨ feat(mana-stt): add vLLM integration for Voxtral transcription 2026-02-11 16:10:00 +01:00