Providers & Models
Provider Key
Add, configure, rotate, transfer and remove the credentials Multi-Router uses to call model providers.
A provider key is the credential for one of your accounts with a model provider, such as an Anthropic API key or an AWS Bedrock access key, and Multi-Router uses it to call that provider on your behalf. Each provider key belongs to one organization, each organization holds its own keys, and each organization has one default key per provider. Provider keys are created and changed in the dashboard, on the LLM Provider Keys page in the profile menu, or through the API with /v1/provider-keys. Provider key secrets are encrypted at rest and in transit, and a saved secret is never displayed or returned.
Who can manage provider keys
Provider keys are managed by the admins of the organization that holds them. An admin of a named organization adds, edits, disables, deletes, transfers and sets default keys for that organization, and an account admin does the same for the keys held by the account itself. Organization members use the organization's keys through its routers.
The provider keys page
The provider keys page shows every key in the selected organization, grouped by provider. The Providers list on the left shows each provider with its number of keys and the name of its default key, or Not configured when it has none, and selecting a provider shows its keys with a summary such as 2 keys · default production. Each key row shows the following:
| Item | Meaning |
|---|---|
| Name | The key's label. |
| Description | Shown below the name when set. |
| Default | The key is the organization's default key for the provider. |
| Disabled | The key is disabled and serves no requests. |
| Region badge | The data residency of an OpenAI key set to US, EU or UAE. |
| Secret prefix | The first 10 characters of the secret, followed by dots. |
| sha256 | The beginning of the secret's fingerprint, with the full value in the tooltip. Two keys that hold the same secret have the same fingerprint. |
| Created | The date the key was added. |
| Disabled date | The date the key was disabled, for a disabled key. |
Each row offers the following actions:
| Action | Available | Effect |
|---|---|---|
| Make default | On enabled keys that are not the default | Makes the key the provider's default key. |
| Edit | Always | Opens the edit panel. |
| Transfer | Always | Copies or moves the key to another organization. |
| Disable | On enabled keys | Stops new requests from using the key. |
| Enable | On disabled keys | Resumes the key's use. |
| Delete | While the key is disabled | Asks to confirm, then removes the key permanently. The secret cannot be recovered. |
Adding a provider key
Adding a provider key stores a credential for one provider in the selected organization:
- Open LLM Provider Keys from the profile menu.
- Select the provider in the Providers list. A provider with no keys opens the new-key form directly; otherwise select Add <Provider> key.
- Complete the form titled New <Provider> key, then select Save key.
| Provider | Fields |
|---|---|
| Anthropic | Name, API key, Description. |
| Google Gemini | Name, API key, Description. |
| Cohere | Name, API key, Description. |
| DeepSeek | Name, API key, Description. |
| Fireworks | Name, API key, Description. |
| Groq | Name, API key, Description. |
| Mistral | Name, API key, Description. |
| Together | Name, API key, Description. |
| xAI | Name, API key, Description. |
| Z.ai | Name, API key, Description. |
| OpenAI | Name, Region (Global, United States, Europe or UAE), API key, Description. The Region is the data residency of the OpenAI project the key belongs to. |
| AWS Bedrock | Access key (SigV4) or API key (bearer); Name, AWS Region, AWS Access Key ID, Secret access key or Bedrock API key, Description. See AWS Bedrock. |
| Google Vertex | Name, Google Cloud project ID, Google Cloud location, Service-account JSON, Description. See Google Vertex. |
| Custom endpoint | Name, Base URL, API format (OpenAI Chat Completions), API key, Description. See Supported Providers. |
Name is required and up to 80 characters, names are labels and can repeat, and Description is optional and up to 2,000 characters. Multi-Router trims spaces from the secret and rejects an empty one, and checks every provider setting when the key is saved. A Google Vertex key is verified with Google when it is saved; the secrets of other providers are checked by the provider, so an invalid secret returns the provider's authentication error on the first request that uses it. A key added while its provider has no default becomes the default.
Obtaining a provider secret
Each provider issues the secret Multi-Router stores. Create a key that only Multi-Router uses:
| Provider | Where to create it | Typical prefix |
|---|---|---|
| Anthropic | Claude Console, Settings, API Keys | sk-ant- |
| OpenAI | OpenAI Platform, API keys, within a project | sk-proj- |
| Google Gemini | Google AI Studio, Get API key | AIza |
| Cohere | Cohere dashboard, API Keys (a production key) | |
| DeepSeek | DeepSeek Platform, API keys | sk- |
| Fireworks | Fireworks, Settings, API Keys | fw_ |
| Groq | GroqCloud console, API Keys | gsk_ |
| Mistral | Mistral console, API Keys | |
| Together | Together, Settings, API Keys | |
| xAI | xAI Console, API Keys | xai- |
| Z.ai | Z.ai Open Platform, API Keys | |
| AWS Bedrock | See AWS Bedrock | |
| Google Vertex | See Google Vertex |
The default key
The default key is the key an organization uses for a provider when a router names no key. A key added while its provider has no default becomes the default, so the first key for each provider is the default, and Make default on another enabled key of the same provider replaces it. Disabling the default key leaves it as the default, so requests that rely on it fail until it is enabled again or another key is made the default. Deleting the default key makes the oldest enabled key of the same provider the default, and leaves the provider with no default when it has no other enabled key; a key enabled later becomes the default only through Make default.
Which key a request uses
Multi-Router selects the provider key for each request from the router that serves it:
| Request | Key used |
|---|---|
| Static router with a key | The key set on the router. |
| Static router set to Org-default key | The organization's default key for the router's provider. |
| Alias | The key of the router the alias points to. |
| Fallback or weighted router | The key of each member router. |
| Claude Proxy with organization credentials | The key set on the Claude Proxy, or, on the Custom route, the key the Claude Proxy assigns to each model in its model group. |
| Claude Proxy with developer credentials | The developer's own Anthropic credential, sent with the request. |
| Adaptive Router | The key set for the member's provider, or the key set on that member. |
| Codex Proxy with an organization key | The OpenAI key set on the Codex Proxy. |
| Codex Proxy without a key | The developer's own OpenAI API key, sent with the request. |
| Gemini Proxy | The Gemini key set on the Gemini Proxy. |
Static routers created with POST /v1/routers name a key in routing.provider_key_id, which must be an enabled key of the router's provider in the same organization. Static routers created in the dashboard can select Org-default key instead, which follows the default as it changes, starting with the next request. See Routing.
| Example | Result |
|---|---|
Router names openai-prod; the default is openai-dev | Uses openai-prod. |
Router set to Org-default key; the default is openai-dev | Uses openai-dev, and openai-prod after Make default on it. |
| Router set to Org-default key; the default key is disabled | Returns provider_key_disabled. |
| Router names a key that has been deleted | Returns router_pinned_key_missing. |
| Fallback router whose members use different keys | Each member uses its own key. |
Editing a key
Editing changes a key's details without changing its secret. Edit opens a panel titled Edit <name> with Name and Description, plus Region for an OpenAI key, and Google Cloud project ID and Google Cloud location for a Google Vertex key; select Save to apply it. A changed Vertex project or location is verified with Google before it is saved. The provider, the secret, and the region and credentials of an AWS Bedrock key are fixed; to change them, add a new key.
Rotating a key
Rotating a key replaces it with a new key that holds a new secret, without interrupting requests:
- Add a new provider key with the new secret.
- If the old key is the default for its provider, select Make default on the new key.
- Change every router, Claude Proxy and model group that names the old key to the new key, and change the key in any policy that names it.
- Disable the old key and confirm that requests continue to succeed.
- Delete the old key, then revoke the old secret with the provider.
With the API, POST /v1/provider-keys/{id}/rotate replaces the secret of a key in place, keeping its id, so routers, Claude Proxies and model groups that name the key need no change.
Disabling and deleting a key
Disabling a key stops Multi-Router from using it while keeping it for later use. Requests already in progress complete, and new requests from routers that name the key, or that rely on it as the default, return provider_key_disabled. A key named by a Claude Proxy can be disabled only after the Claude Proxy's key is replaced or removed. Enabling a Google Vertex key verifies it with Google again.
Deleting a key removes it permanently. A key must be disabled before it is deleted, and a key named by a model in a model group can be deleted only after it is removed from the group. Routers that name a deleted key return router_pinned_key_missing until they are changed to another key.
Copying and moving keys between organizations
Transfer copies or moves a provider key to another organization in the same account. It requires the admin role in both organizations, and an account admin is an admin of every organization in the account.
- Select Transfer on the key's row, and choose Copy or Move.
- Choose the Destination org. The list shows the organizations in the account where you are an admin, other than the current one, and shows the account itself under the account's name.
- Change Name in destination and Description if needed; both start with the key's current values.
- Select Copy to <organization> or Move to <organization>.
| Copy | Move | |
|---|---|---|
| Source organization | Keeps its key unchanged. | The key is removed. |
| Allowed when | Always. | No router or model group in the source organization names the key. Otherwise the panel lists them. |
| Source default | Unchanged. | The oldest enabled key of the same provider becomes the default, or the provider has no default. |
The secret, provider settings, enabled state and fingerprint carry over. The transferred key becomes the destination's default when it is enabled and the destination has no default for its provider. When the destination already holds a key of the same provider with the same secret, the panel warns An identical key already exists in <organization> as <name>, and the transfer can still proceed.
Security practices
Security practices for provider keys follow from how Multi-Router uses them:
| Practice | Description |
|---|---|
| Grant inference only | Multi-Router uses a key only to call models, so create the key with only that permission: the IAM policy on the AWS Bedrock page, the Vertex AI User role on Google Vertex, and a key restricted to model calls where the provider supports it. |
| Use a key per environment | An organization holds several keys per provider and each router names its own key, so production and test traffic can use different secrets and be disabled independently. |
| Keep the secret in your secret manager | Multi-Router never displays a saved secret. Record the key's owner and rotation schedule in its Description. |
| Rotate on a schedule | The Created date shows each key's age. Rotate with the steps above. |
| Respond to exposure | Disable the key in Multi-Router, which stops new requests from using it, then revoke the secret with the provider. |
| Check fingerprints | Keys with the same fingerprint hold the same secret, which shows where one secret is used across keys and organizations. |
Errors
Requests and router changes return the following errors for provider keys, each with HTTP status 400:
| Error | Returned | Cause | Resolution |
|---|---|---|---|
no_provider_key_configured | On requests | The router names no key and the organization has no default key for the provider. | Add a key for the provider, or select Make default on an enabled key. |
provider_key_disabled | On requests, and when saving a router with /v1/routers | The key named by the router, or the default key, is disabled. | Enable the key, or change the router or the default to an enabled key. |
router_pinned_key_missing | On requests | The router names a key that has been deleted. | Change the router to a current key. |
provider_key_mismatch | On requests, and when saving a router with /v1/routers | The key belongs to a different provider than the router's model. | Set a key of the correct provider. |
provider_key_not_found | When saving a router with /v1/routers | The router names a key that is not in the organization. | Use a key id from GET /v1/provider-keys. |
key_residency_mismatch | On requests and router saves | The region of the router or request differs from the region of its OpenAI key, or the key's region is invalid. | Use a key with the matching region, or edit the key. |
key_not_found | When saving a Claude Proxy | The Claude Proxy uses organization credentials and names no key, a key not in the organization, or a disabled key. | Set an enabled key on the Claude Proxy. |
key_vendor_mismatch | When saving a Claude Proxy | The key belongs to a different provider than the Claude Proxy's route. | Set a key of the route's provider. |
key_region_mismatch | When saving a Claude Proxy | A Bedrock API key was created for a region other than the Claude Proxy's region. | Use a key for the Claude Proxy's region, or an access key (SigV4). |
credential_not_allowed | When saving a Claude Proxy | Developer credentials are used on a route other than Anthropic, or the Custom route names a single key. | Use organization credentials, with a key for each model on the Custom route. |
The dashboard reports the following when a key action is refused:
| Action | Refused when |
|---|---|
| Add | A required field is empty, a field is too long, or a provider setting is invalid, such as a Bedrock region or a Vertex service account Google does not accept. |
| Edit | A field is too long, or a changed Vertex project or location fails verification. |
| Make default | The key is disabled, a Vertex key fails verification, or the default changed at the same time. |
| Enable | A Vertex key fails verification. |
| Disable | A Claude Proxy names the key. |
| Delete | The key is enabled, a Claude Proxy or model group names it, or it changed at the same time. |
| Transfer | The destination is the current organization, you are not an admin of both organizations, or, for a move, a router or model group names the key. |
Managing keys with the API
The /v1/provider-keys endpoints act on the provider keys of the API key's organization. Reads never return a secret; a create or rotate returns the new secret once. Scopes are cumulative: provider_keys:delete includes write, and write includes read.
| Method | Path | Description | Scope |
|---|---|---|---|
| GET | /v1/provider-keys | List keys, including disabled keys, paged with limit (1 to 200, default 50) and cursor. | provider_keys:read |
| POST | /v1/provider-keys | Add a key from name, provider, secret and the provider's settings. Accepts dry_run. | provider_keys:write |
| GET | /v1/provider-keys/{id} | Get one key. | provider_keys:read |
| PATCH | /v1/provider-keys/{id} | Change name, description, enabled, is_default, the Bedrock region, the Vertex project and location, or the OpenAI region. Accepts dry_run. | provider_keys:write |
| POST | /v1/provider-keys/{id}/rotate | Replace the secret, keeping the key id. | provider_keys:write |
| POST | /v1/provider-keys/{id}/transfer | Copy or move the key to another organization. | provider_keys:write; a move also provider_keys:delete |
| DELETE | /v1/provider-keys/{id} | Delete a disabled key that nothing uses. | provider_keys:delete |
Each key has its id, prefixed llpk_, used in provider_key_id, with name, description, provider, key_prefix, enabled, is_default, its etag, and the provider's section: bedrock with region, auth_mode and access_key_id; vertex with project_id and region; openai with data_residency; or custom with base_url and api_format. See Provider Keys in the API Reference for every field and error.