4 commits

Author	SHA1	Message	Date
Till JS	313779f439	fix(crawler): skip TLS verification for outgoing crawl requests ... Required for Docker Desktop Mac (TLS proxy) and sites with self-signed/expired certificates. Crawlers routinely need this. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>	2026-03-27 22:31:03 +01:00
Till JS	d0ef6676b5	fix(crawler): set SSL_CERT_FILE for HTTPS in Alpine container ... Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>	2026-03-27 22:24:56 +01:00
Till JS	3e2558a63a	fix(crawler): use background context for crawl jobs (outlive HTTP request) ... Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>	2026-03-27 22:15:36 +01:00
Till JS	64f7f768eb	feat(infra): add Go web crawler (mana-crawler-go) ... Goroutine-based crawler replacing NestJS mana-crawler: - goquery for HTML parsing (title, content, links, metadata) - robots.txt checker with 24h cache - Worker pool with configurable concurrency + rate limiting - PostgreSQL for job/result storage - Same API surface: POST/GET/DELETE /api/v1/crawl 11 MB binary, ~15 MB Docker image vs ~200 MB NestJS. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>	2026-03-27 22:10:45 +01:00