Toknix provides production-grade concurrency limits by default, preventing unexpected starvation across multi-tenant deployments.
Default Limits
| Tier | Concurrent Requests | Requests / Min (RPM) | Tokens / Min (TPM) |
|---|---|---|---|
| Standard Account | 100 concurrent | 3,000 RPM | 5,000,000 TPM |
| High-Volume Enterprise | 500+ concurrent | 10,000+ RPM | 25,000,000+ TPM |
Handling 429 Responses
When your request frequency exceeds the concurrency ceiling, Toknix responds with HTTP 429 Too Many Requests along with a Retry-After header indicating seconds to wait:
json
{
"error": {
"message": "Rate limit exceeded. Concurrency ceiling reached (100 active connections).",
"type": "rate_limit_error",
"param": null,
"code": "rate_limit_exceeded"
}
}High-Volume Scaling
If your production workload requires higher concurrency thresholds or dedicated throughput pools, reach out via the console or support channels to adjust your account limits.