POST /v1/crawler
Add new URLs or update existing URLs for crawling and indexing.
{
"action": "FETCH",
"indexPublicKey": "SITEKEY",
"url": "http://foo.com/bar.html"
}
| Field | Description | Type |
|---|---|---|
| action | Add new URLs or update existing URLs to crawl and index | string |
| indexPublicKey | The public site key | string |
| url | The document URL | string |
{
"message": "Scheduled",
"docId": "doc id"
}
| Field | Description | Type | Notes |
|---|---|---|---|
| message | Information on recrawl status | string | |
| docId | The Id generated for the document | string | URL encoded as md5 hash. |
Indexing is executed within a minute from the API call.
Returns HTTP 202 ACCEPTED with payload e.g.
Please note that the Crawl API endpoint requires authentication. See authentication for more information.
We’re always happy to help with code or other questions you might have. Search our documentation, contact support, or connect with our sales team.