till/managarten
1
0
Fork 0
mirror of https://github.com/Memo-2023/mana-monorepo.git synced 2026-05-17 00:19:41 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 4

feat(local-llm): add Gemma 2 + allow HF/MLC hosts in CSP

Browse source 
WebLLM was blocked by connect-src — model config and weight shards live
on huggingface.co (+ cdn-lfs.* for LFS), and the WebGPU model_lib WASM
comes from raw.githubusercontent.com (binary-mlc-llm-libs). Also wires
Gemma 2 2B/9B into the model registry so /llm-test picks them up.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
Till JS 2026-04-08 18:00:57 +02:00
parent ed746297b5
commit 4fd5ff3199
2 changed files with 22 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

8
apps/mana/apps/web/src/hooks.server.ts
View file

@ -108,6 +108,14 @@ window.__PUBLIC_GLITCHTIP_DSN__ = ${JSON.stringify(PUBLIC_GLITCHTIP_DSN)};
PUBLIC_MANA_LLM_URL_CLIENT,
PUBLIC_MANA_EVENTS_URL_CLIENT,
'wss://sync.mana.how',
// @mana/local-llm (WebLLM) downloads model weights + config from
// the mlc-ai HuggingFace repos and the WebGPU model library WASM
// from the binary-mlc-llm-libs GitHub raw host.
'https://huggingface.co',
'https://*.huggingface.co',
'https://cdn-lfs.huggingface.co',
'https://cdn-lfs-us-1.huggingface.co',
'https://raw.githubusercontent.com',
// Allow all localhost ports in development
...(isDev ? ['http://localhost:*', 'ws://localhost:*'] : []),
].filter(Boolean),