What Is a Provider
Each model on the platform may be backed by multiple providers. Providers are service nodes organized by source and cost — different providers have different pricing multipliers and model availability. When you send a request, the system automatically selects an available provider based on your token configuration. If a provider fails or times out, the system automatically retries another one — fully transparent to your code.Available Providers
About official
official is a provider group that bundles nodes from OpenAI, Anthropic, Google, DeepSeek, and other major official platforms. When you select official, the system performs intelligent routing and failover across all official nodes — no need to specify each vendor individually.
How to Choose
Configuring Providers in a Token
When creating or editing a token, you can set the default routing behavior for that token.Provider List
Specifies which providers this token is allowed to use.- Leave empty (recommended): Automatically routes across all available providers for best availability
- Single provider: e.g.
official— routes only through official nodes - Multiple providers: Comma-separated, e.g.
official_cheap,mix— tried in order or by sort strategy
Provider-Only Mode
- Off (default): Specified providers are prioritized; falls back to others if all fail
- On: Strictly limited to the specified providers — if all fail, returns an error with no fallback
Sort Strategy
When multiple providers are specified, controls the order they are tried:- Manual (default): Tried in the order you listed them
- Latency: Prioritizes the fastest-responding provider
- Price: Prioritizes the lowest-cost provider
- Throughput: Prioritizes the highest-throughput provider
Overriding Providers Per Request
You can also temporarily override token settings for a single request via headers — no token changes needed.Providers specified via headers are still subject to your account permissions.