POST /v1/crawler
Add new URLs or update existing URLs for crawling and indexing.
{ "action": "FETCH", "indexPublicKey": "SITEKEY", "url": "http://foo.com/bar.html" }
Field | Description | Type | Notes |
---|---|---|---|
action | Add new URLs or update existing URLs to crawl and index | string | Acceptable values: FETCH |
indexPublicKey | The public site key | string | A sitekey is an identifier of your AddSearch account that can be found in the dashboard |
url | The document URL | string | A full URL of your document including protocol (http/https), domain, and path. Example: https://www.example.com/page.html |
{ "message": "Scheduled", "docId": "doc id" }
Field | Description | Type | Notes |
---|---|---|---|
message | Information on recrawl status | string | |
docId | The Id generated for the document | string | URL encoded as md5 hash. |
Indexing is executed within a minute from the API call.
Returns HTTP 202 ACCEPTED with payload e.g.
Please note that the Crawl API endpoint requires authentication. See authentication for more information.
We’re always happy to help with code or other questions you might have. Search our documentation, contact support, or connect with our sales team.