A straightforward API
Choose a crawler, send your inputs, and download your results. The same workflow for every endpoint.
Read the API specification →Collect public posts and conversations with a simple API.
One workspace. Your data, in every detail.
curl -X POST '/v1/crawlers/instagram-posts/run' \
-H 'X-API-Key: cn_YOUR_API_KEY' \
-H 'Content-Type: application/json' \
-d '{"params":{
"username":"leomessi",
"amount":12
}}'{
"job_id": "example-job-id",
"status": "queued",
"status_url": "/v1/jobs/example-job-id",
"usage": {
"requests_used": 1,
"request_limit": 5
}
}Go from a public profile or post to data you can use.
Choose a crawler, send your inputs, and download your results. The same workflow for every endpoint.
Read the API specification →Keep the fields returned by the source. Inspect the output in the explorer and export JSON or CSV.
Explore output examples →A prepaid balance, deducted per returned record. Status checks and downloads don't cost extra.
See the rates →CRAWLER LIBRARY
Loading available crawlers…
Trial keys use request allowances. Paid balances are charged per returned record. Status checks and downloads are free.
Returns HTTP 202 with a job ID. Poll its status URL, then download the results.
Illustrative sample — no live request yet.
Add balance when you need it. Pay for the records you receive.
Captions, media details, and source fields.
Explore Posts ↗Public conversations, ready for your workflow.
Explore Comments ↗Payments are currently in test mode. Account access and crawler runtime limits still apply.
Create and verify an account, generate an API key, and choose a crawler. You can also use an administrator-issued trial key.
Submitting a request creates a job. Poll its status, then download its records in JSON or CSV.
Yes. Set a record limit, or turn it off to collect available records within the crawler's runtime limit.
Fund a prepaid balance. Paid jobs deduct the crawler's rate for each unique returned record. Trials use request allowances.
CRAWLNEST CONTROL ROOM
Publish crawlers, issue trial keys, and monitor requests.
Use the private password created on your server.
Upload one standalone .py spider. Source stays private. Saving creates a draft; publishing makes its documentation and API available.
Keys are shown once and stored as hashes. Quotas count accepted jobs, including jobs that later fail.
Copy this key now. It will not be displayed again.
One pool for every crawler, including browser requests and pagination.
Changes apply when a job starts. With routing enabled, proxy failures stop the request; traffic never falls back to your home IP.
Prepaid USD balance, charged per unique returned record. Test and live balances are separate.
Enter USD per 1,000 records. Each job keeps the rate that applied when it was accepted.
Create a fixed-price one-time USD product in Dodo, then enter its product ID. Product price becomes the balance credited; tax is not added to the wallet.
Refunds and disputes freeze the affected wallet for review. Key expiry and administrator revocation still control API access.