Features
Everything the gateway does, in one place.
One OpenAI-compatible endpoint with routing, failover, caching and zero chat retention in front of every major provider.
01 — Routing
Send every request to the right place.
- Smart routing
nicrron/auto picks per request; nicrron/reasoning, nicrron/coding and nicrron/fastest pin the job. DeepSeek V4 Pro and GPT-6 Sol for reasoning, Claude Opus 5.5 and Kimi K2.7 Code for code.
Routing modes- Failover and circuit breakers
EWMA latency per provider, breakers on degraded endpoints, and ordered fallback arrays that cascade on 429 or 5xx before the first byte.
How health is scored- Exact response caching
Deterministic requests are served from Redis in about 12 ms at no cost, scoped to your account and keyed by the full request.
Caching rules- Prompt-cache discounts
Upstream cache reads pass through: 90% off with Anthropic, 50% off with OpenAI, recorded in usage.
Cache pricing
02 — Modalities
Chat is the start.
- Embeddings
OpenAI text-embedding-3, Mistral mistral-embed and codestral-embed, and the Voyage 4 family behind /v1/embeddings with fallback chains.
Embeddings API- Video and images
Seedance 2.0 with native audio, Veo 3.1, Kling and Hailuo for video, Nano Banana for images. Async jobs, exact cost charged upfront, refunded on failure.
Media API- Speech and transcription
OpenAI-compatible TTS from $15 per million characters with six-plus voices, and Whisper at $0.006 per minute billed on true audio duration.
Audio API
03 — Operations
Run it as a team.
- Teams and shared wallets
Pooled credits per organization with Owner, Admin, Developer and Viewer roles and invitations.
Teams and roles- Webhook alerts
HMAC-SHA256 signed payloads to any HTTPS endpoint when balance crosses a threshold or daily spend spikes.
Configure alerts- Logs and export
Filter live traffic by date, provider, status and cost. Export RFC 4180 CSV or structured JSON in one click.
Observability- Model Arena
Run two or three models on the same prompt and compare time to first token, tokens per second and cost, with a blind mode.
Arena
04 — Trust
Metered, never read.
- Zero data retention
Chat, embedding and audio payloads stream through memory only. Nothing is written to disk or a database; only token counts and hashes are kept.
Privacy guarantee
Two lines to switch.
Base URL and key. The rest of your OpenAI SDK code stays as it is.