https://localai.io/docs/advanced/index.htmlAdvanced usageHugoenWed, 09 Sep 2026 22:21:32 +0200https://localai.io/docs/advanced/index.htmlMon, 01 Jan 0001 00:00:00 +0000https://localai.io/docs/advanced/index.htmlModel Configuration with YAML Files LocalAI uses YAML configuration files to define model parameters, templates, and behavior. You can create individual YAML files in the models directory or use a single configuration file with multiple models. Quick Example: name: gpt-3.5-turbo parameters: model: luna-ai-llama2-uncensored.ggmlv3.q5_K_M.bin temperature: 0.3 context_size: 512 threads: 10 backend: llama-cpp template: completion: completion chat: chat For a complete reference of all available configuration options, see the Model Configuration page.https://localai.io/docs/advanced/vram-management/index.htmlMon, 01 Jan 0001 00:00:00 +0000https://localai.io/docs/advanced/vram-management/index.htmlWhen running multiple models in LocalAI, especially on systems with limited GPU memory (VRAM), you may encounter situations where loading a new model fails because there isn’t enough available VRAM. LocalAI provides several mechanisms to automatically manage model memory allocation and prevent VRAM exhaustion:https://localai.io/docs/advanced/model-configuration/index.htmlMon, 01 Jan 0001 00:00:00 +0000https://localai.io/docs/advanced/model-configuration/index.htmlLocalAI uses YAML configuration files to define model parameters, templates, and behavior. This page provides a complete reference for all available configuration options. Overview Model configuration files allow you to: Define default parameters (temperature, top_p, etc.) Configure prompt templates Specify backend settings Set up function calling Configure GPU and memory options And much more Configuration File Locations You can create model configuration files in several ways:https://localai.io/docs/advanced/reverse-proxy-tls/index.htmlMon, 01 Jan 0001 00:00:00 +0000https://localai.io/docs/advanced/reverse-proxy-tls/index.htmlConfigure LocalAI behind a TLS termination reverse proxy (HAProxy, Apache, Nginx, APISIX)