Features

⚡ GPU acceleration

📖 Text generation (GPT)

📈 Reranker

🗣 Text to audio (TTS)

🎨 Image generation

🧠 Embeddings

🥽 GPT Vision

✍️ Constrained Grammars

🆕🖧 Distributed Inference

🔈 Audio to text

🔥 OpenAI functions and tools

💾 Stores

🖼️ Model gallery