LocalAI provides a variety of images to support different environments. These images are available on quay.io and Docker Hub.

For All-in-One image with a pre-configured set of models and backends, see the AIO Images.

For GPU Acceleration support for Nvidia video graphic cards, use the Nvidia/CUDA images, if you don’t have a GPU, use the CPU images. If you have AMD or Mac Silicon, see the build section.

See Also

Last updated 25 Mar 2024, 22:04 +0100 . history