Skip to main content

What Is a Provider

Each model on the platform may be backed by multiple providers. Providers are service nodes organized by source and cost — different providers have different pricing multipliers and model availability. When you send a request, the system automatically selects an available provider based on your token configuration. If a provider fails or times out, the system automatically retries another one — fully transparent to your code.

Available Providers

About official

official is a provider group that bundles nodes from OpenAI, Anthropic, Google, DeepSeek, and other major official platforms. When you select official, the system performs intelligent routing and failover across all official nodes — no need to specify each vendor individually.

How to Choose


Configuring Providers in a Token

When creating or editing a token, you can set the default routing behavior for that token.

Provider List

Specifies which providers this token is allowed to use.
  • Leave empty (recommended): Automatically routes across all available providers for best availability
  • Single provider: e.g. official — routes only through official nodes
  • Multiple providers: Comma-separated, e.g. official_cheap,mix — tried in order or by sort strategy

Provider-Only Mode

  • Off (default): Specified providers are prioritized; falls back to others if all fail
  • On: Strictly limited to the specified providers — if all fail, returns an error with no fallback

Sort Strategy

When multiple providers are specified, controls the order they are tried:
  • Manual (default): Tried in the order you listed them
  • Latency: Prioritizes the fastest-responding provider
  • Price: Prioritizes the lowest-cost provider
  • Throughput: Prioritizes the highest-throughput provider

Overriding Providers Per Request

You can also temporarily override token settings for a single request via headers — no token changes needed.
Providers specified via headers are still subject to your account permissions.

Examples

Try discounted official first, fall back to mixed on failure
Strict official-only, no fallback allowed
Set default headers in your SDK client