API Reference

POST /crawler

Add new URLs or update existing URLs for crawling and indexing.

Payload

{
  "action": "FETCH",
  "indexPublicKey": "SITEKEY",
  "url": "http://foo.com/bar.html"
}

Response

{
  "message": "Scheduled",
  "docId": "doc id"
}

Indexing is executed within a minute from the API call.

Returns HTTP 202 ACCEPTED with payload e.g.

Please note that the Crawl API endpoint requires authentication. See authentication for more information.

Need more help?

We’re always happy to help with code or other questions you might have. Search our documentation, contact support, or connect with our sales team.