Rate limits
Two separate limits: concurrency (how many scrapes run at once) and request rate (API calls per second, per key).
Two separate limits: concurrency (how many scrapes run at once) and request rate (API calls per second, per key).
Concurrency
Your concurrency limit is how many scrapes run at the same time across the whole account — sync requests, jobs and structured calls share it. It grows with lifetime credits purchased (see Credits); GET /v1/account shows your limit and what is in flight.
A sync request with no free slot fails immediately:
429 CONCURRENCY_LIMITwithRetry-After: 1.An async job never fails for concurrency: it waits in your queue.
Request rate
Separately, each API key may make a bounded number of calls per second (50 by default), counting every endpoint — including cheap ones like polling a job. Exceeding it is 429 RATE_LIMITED.
Header | Meaning |
|---|---|
| Calls allowed per window. |
| Calls left in the current window. |
| Unix time (seconds) when a call frees up. |
| On a 429: seconds to wait. |
Stop polling: The usual way to hit the rate limit is polling job status in a loop. Pass
callback_urlinstead and let us tell you.