For installing LocalAI in Kubernetes, the deployment file from the examples can be used and customized as prefered:

  kubectl apply -f

For Nvidia GPUs:

  kubectl apply -f

Alternatively, the helm chart can be used as well:

  # Install the helm repository
helm repo add go-skynet
# Update the repositories
helm repo update
# Get the values
helm show values go-skynet/local-ai > values.yaml

# Edit the values value if needed
# vim values.yaml ...

# Install the helm chart
helm install local-ai go-skynet/local-ai -f values.yaml

Last updated 22 Jun 2024, 12:16 +0200 . history