What Is a Provider
Each model on the platform may be backed by multiple providers. Providers are service nodes organized by source and cost — different providers have different pricing multipliers and model availability. When you send a request, the system automatically selects an available provider based on your token configuration. If a provider fails or times out, the system automatically retries another one — fully transparent to your code.Available Providers
| ID | Name | Description |
|---|---|---|
official | Official | A provider group that aggregates direct connections to all major official platforms (OpenAI, Anthropic, Google, etc.); highest stability |
official_cheap | Official (Discounted) | A cost-optimized version of official channels; high stability at a lower price |
mix | Mixed | Multi-source mixed channels; lowest price, widest model coverage |
About official
official is a provider group that bundles nodes from OpenAI, Anthropic, Google, DeepSeek, and other major official platforms. When you select official, the system performs intelligent routing and failover across all official nodes — no need to specify each vendor individually.
How to Choose
| Your need | Recommended config |
|---|---|
| Maximum stability, price not a concern | official |
| Good stability with better value | official_cheap |
| Lowest cost, minor instability acceptable | mix |
| Try discounted official first, fall back to mixed | official_cheap,mix |
Configuring Providers in a Token
When creating or editing a token, you can set the default routing behavior for that token.Provider List
Specifies which providers this token is allowed to use.- Leave empty (recommended): Automatically routes across all available providers for best availability
- Single provider: e.g.
official— routes only through official nodes - Multiple providers: Comma-separated, e.g.
official_cheap,mix— tried in order or by sort strategy
Provider-Only Mode
- Off (default): Specified providers are prioritized; falls back to others if all fail
- On: Strictly limited to the specified providers — if all fail, returns an error with no fallback
Sort Strategy
When multiple providers are specified, controls the order they are tried:- Manual (default): Tried in the order you listed them
- Latency: Prioritizes the fastest-responding provider
- Price: Prioritizes the lowest-cost provider
- Throughput: Prioritizes the highest-throughput provider
Overriding Providers Per Request
You can also temporarily override token settings for a single request via headers — no token changes needed.| Header | Effect |
|---|---|
X-Provider-Order | Specifies the providers and order for this request |
X-Provider-Only | "true" enables strict mode — no fallback |
X-Provider-Sort | Overrides the sort strategy (latency / price / throughput) |
X-Provider-Ignore | Providers to skip for this request, stacked on top of token config |
Providers specified via headers are still subject to your account permissions.