https://localai.io/operations/index.htmlOperator-facing runtime, proxy, and monitoring concernsHugoenhttps://localai.io/features/backend-monitor/index.htmlMon, 01 Jan 0001 00:00:00 +0000https://localai.io/features/backend-monitor/index.htmlLocalAI provides endpoints to monitor and manage running backends. The /backend/monitor endpoint reports the status and resource usage of loaded models, /backend/load pre-loads a model into memory, and /backend/shutdown allows stopping a model’s backend process. All three are admin-only. Monitor API Method: GET Endpoints: /backend/monitor, /v1/backend/monitor Request The model to monitor is passed as a query parameter:https://localai.io/features/middleware/index.htmlMon, 01 Jan 0001 00:00:00 +0000https://localai.io/features/middleware/index.htmlPer-model PII redaction and policy-based request routinghttps://localai.io/features/cloud-proxy/index.htmlMon, 01 Jan 0001 00:00:00 +0000https://localai.io/features/cloud-proxy/index.htmlForward requests to OpenAI, Anthropic, or any compatible providerhttps://localai.io/features/mitm-proxy/index.htmlMon, 01 Jan 0001 00:00:00 +0000https://localai.io/features/mitm-proxy/index.htmlRedact PII from cloud-AI traffic without LocalAI holding API keys