till/managarten
1
0
Fork 0
mirror of https://github.com/Memo-2023/mana-monorepo.git synced 2026-05-23 17:46:42 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions 5
managarten/services/mana-search-go/CLAUDE.md
Till JS 4b0f5a29fd feat(mana-search): rewrite search service from NestJS to Go 
Replaces the NestJS mana-search service with a Go implementation for
lower resource usage and faster startup. All 7 API endpoints are 1:1
compatible (search, extract, bulk extract, engines, health, metrics,
cache clear). Uses go-readability for content extraction and
html-to-markdown for Markdown conversion. Redis cache with graceful
degradation, Prometheus metrics, and structured JSON logging.

Binary: 22 MB vs ~200+ MB node_modules.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-27 21:58:40 +01:00

2.3 KiB
Raw Blame History

mana-search (Go)

Go replacement for the NestJS mana-search service. Unified web search and content extraction microservice using SearXNG + Redis.

Architecture

  • Language: Go 1.25
  • Search Engine: SearXNG (meta-search)
  • Cache: Redis (graceful degradation if unavailable)
  • Metrics: Prometheus
  • Port: 3021

Endpoints

Search

  • POST /api/v1/search — Web search via SearXNG
  • GET /api/v1/search/engines — List available engines
  • GET /api/v1/search/health — Search service health + cache stats
  • DELETE /api/v1/search/cache — Clear all cached results

Extract

  • POST /api/v1/extract — Extract content from URL (readability + optional markdown)
  • POST /api/v1/extract/bulk — Bulk extract (max 20 URLs, configurable concurrency)

System

  • GET /health — Health check (SearXNG + Redis)
  • GET /metrics — Prometheus metrics

Commands

go run ./cmd/server          # Dev
go build -o bin/mana-search ./cmd/server  # Build
go test ./...                # Test

Environment Variables

Variable Default Description
PORT 3021 Server port
SEARXNG_URL http://localhost:8080 SearXNG base URL
SEARXNG_TIMEOUT 15000 SearXNG timeout (ms)
SEARXNG_DEFAULT_LANGUAGE de-DE Default search language
REDIS_HOST localhost Redis host
REDIS_PORT 6379 Redis port
REDIS_PASSWORD Redis password
CACHE_SEARCH_TTL 3600 Search cache TTL (seconds)
CACHE_EXTRACT_TTL 86400 Extract cache TTL (seconds)
EXTRACT_TIMEOUT 10000 Content extraction timeout (ms)
EXTRACT_MAX_LENGTH 50000 Max extracted text length (chars)
CORS_ORIGINS localhost:3000,5173,8081 Allowed CORS origins

Search Categories

Category Engines
general Google, Bing, DuckDuckGo, Brave, Wikipedia
news Google News, Bing News
science arXiv, Google Scholar, PubMed
it GitHub, StackOverflow, NPM, MDN

Docker

Uses the same docker-compose.dev.yml from services/mana-search/ for SearXNG + Redis.

# Start SearXNG + Redis
cd services/mana-search && docker-compose -f docker-compose.dev.yml up -d

# Run Go service
cd services/mana-search-go && go run ./cmd/server