Reference
Limits and your data
What we keep from a request and what we do not keep, who processes your prompts, and the limits on size, length and requests.
What we keep
We do not keep your prompts or the answers of the model. A request goes through us to the model, and the answer goes back to you. We record data about the request: the model, the token counts, the cost, the time, the route that served it, and the request id. Our database has no column for the text. The full policy is on the privacy page.
We record a failed or refused request in the same way: the status, the error code and the model. We delete these records after 90 days.
Who processes your prompts
We do not train a model on your requests. To answer a request, we send it to third-party AI suppliers and model providers. They process your prompts and the answers, possibly in other countries, and their terms apply there.
Limits
| Limit | Value |
|---|---|
| Requests | 60 a minute for each API key. See Rate limits |
| Requests at the same time | No separate limit. Each request holds its maximum cost from your balance until it completes, so many large requests at the same time can get a 402 error |
| Prompt length | The context window of the model. See context_window in GET /v1/models |
| Output length | 128,000 tokens for max_tokens, or less if the model has a lower limit |
| Request body | 100 MB, the limit of the network that we use |
| Request time | We set no time limit. For a long answer, use a stream. A chat stream sends a keep-alive comment after 15 seconds without data, so that a proxy does not close it |
| Starter balance only | The starter models, 4,096 output tokens, prompts of 40,000 characters and 5 requests a minute |
Report a problem
Send the x-request-id of the response, your request and the result that you expected to
team@kontinentai.com. The status page shows if the API answers and which models answered
in our last test. See Request ids.