Open-source AI gateway

Routify streamlines requests to 150+ open & closed source models with a unified API and easy-to-use UI. It supports caching, fallbacks, logging, load-balancing and can be self-hosted.

Github

Routing

Define custom routes to your AI models with ease.

API Keys management

Manage your provider API keys in one place and rotate them easily.

Monitoring

Monitor your prompts, responses, and usage with our built-in UI.

Cost Limiting

Set a cost limit for your AI usage to avoid unexpected bills.

Load Balancing

Balance the requests between multiple AI models and providers.

Failover

Set up fallbacks for your AI models to avoid downtime.

How it works

Try the cloud version for free

Get Started