Indexing and Crawling

AddSearch crawls your website and indexes the content for the search. Read more about our crawlers and follow the instructions on adding content for the search.

Adding Multiple Domains to Search
AJAX Crawling – Indexing of Dynamic Content
Authenticated Crawling
Canonical Links
Choosing the Search Index
Crawler Status
Crawling Frequency
Defining Custom Fields
Defining Featured Image for Thumbnails
Defining Page’s Publishing Time
Determining the Language of Webpages
Excluding Content
Excluding Single Page
Exporting Indexed URLs and IDs
Failure during Demo Creation
Index Meta Keywords
Index Tools Page Status
Indexing and Filtering PDFs, Microsoft Word and Powerpoint Documents
Indexing and Updating Single Pages
Real-time Indexing with RSS Feeds or API
Requesting Full Recrawl of Search Index
Restricting Search to a Certain Area of Your Website
Setting Up Ignored URL Parameters
Use Meta Tags to Optimize Your Search Results
Using Custom Fields Manager
Using Text Extraction Rules
Whitelisting AddSearch Bot
Whitelisting AddSearch to Work with Content Security Policy

Was this helpful?

Let us know if you liked the post. That’s the only way we can improve.

Need more help?

We’re always happy to help with code or other questions you might have. Search our documentation, contact support, or connect with our sales team.

Was this helpful?

Need more help?

All tags