Reference

Limits and your data

What we keep from a request and what we do not keep, who processes your prompts, and the limits on size, length and requests.

What we keep

We do not keep your prompts or the answers of the model. A request goes through us to the model, and the answer goes back to you. We record data about the request: the model, the token counts, the cost, the time, the route that served it, and the request id. Our database has no column for the text. The full policy is on the privacy page.

We record a failed or refused request in the same way: the status, the error code and the model. We delete these records after 90 days.

Who processes your prompts

We do not train a model on your requests. To answer a request, we send it to third-party AI suppliers and model providers. They process your prompts and the answers, possibly in other countries, and their terms apply there.

Limits

LimitValue
Requests60 a minute for each API key. See Rate limits
Requests at the same timeNo separate limit. Each request holds its maximum cost from your balance until it completes, so many large requests at the same time can get a 402 error
Prompt lengthThe context window of the model. See context_window in GET /v1/models
Output length128,000 tokens for max_tokens, or less if the model has a lower limit
Request body100 MB, the limit of the network that we use
Request timeWe set no time limit. For a long answer, use a stream. A chat stream sends a keep-alive comment after 15 seconds without data, so that a proxy does not close it
Starter balance onlyThe starter models, 4,096 output tokens, prompts of 40,000 characters and 5 requests a minute

Report a problem

Send the x-request-id of the response, your request and the result that you expected to team@kontinentai.com. The status page shows if the API answers and which models answered in our last test. See Request ids.