Operations

This section collects the operator-facing concerns for running LocalAI in production: request middleware, cloud and MITM proxies, and backend monitoring. These pages are about running and governing a LocalAI instance rather than about a specific inference feature.

Pages

• Middleware: PII filtering and intelligent routing - per-model PII redaction and policy-based request routing.
• Cloud passthrough proxy - forward requests to OpenAI, Anthropic, or any compatible provider.
• MITM proxy for Claude Code / Codex CLI - redact PII from cloud-AI traffic without LocalAI holding API keys.
• Backend Monitor - monitor, pre-load, and shut down running model backends.