multi-router.aidocs

Getting Started

Overview

What Multi-Router is, and how its parts fit together.

Multi-Router is a platform for sending requests to AI models from many providers through one API, and for managing the routing, prompts, credentials, spend and records of those requests. Applications send OpenAI- or Anthropic-format requests to Multi-Router with one API key, and routers decide which model and provider serve each request. Teams change models, prompts and providers on the router, with no change to application code, and see every request in Traffic.

How it works

A request reaches a model in four steps:

  1. An organization adds provider keys for the providers it uses, such as Anthropic, OpenAI or AWS Bedrock.
  2. It creates routers, each with the model, provider and settings for one job, such as a support bot.
  3. Applications call Multi-Router with an API key, naming the router in the model field.
  4. Multi-Router serves the request from the router's provider, and records it in Traffic with its cost.

What you can do

Multi-Router covers these areas, each with its own section:

AreaCovers
Providers & ModelsProvider keys, the model catalog, regions and variants, model groups and custom models.
RoutingStatic, Adaptive, fallback and weighted routers, Claude, Codex and Gemini Proxies, aliases and router settings.
PromptsVersioned prompts, written in Multi-Router or kept in GitHub, bound to routers.
Agents & EditorsCoding agents, editors and chat apps through Multi-Router.
API AccessAPI keys, scopes, router access and rate limits.
ObservabilityTraffic, request detail, request logging and cost.
Organizations & PeopleAccounts, organizations, people and roles.
Single Sign-OnSigning in through the company's identity provider.
User Provisioning (SCIM)Managing people from the identity provider.
Self-Service ProvisioningTools policies and the Portal, for setting up AI tools.
Machine IdentityWorkloads that authenticate with their platform identity.
Budgets & Spend ControlCaps, notifications and blocks on spend.
Self-HostingRunning Multi-Router in your own infrastructure.
API ReferenceEvery /v1 endpoint.

Next steps

The Quickstart sends a first request in a few steps. Teams moving an existing application start with Using an SDK, and Key Concepts defines the terms used across these docs.

Quickstart
Was this helpful?