AddSearch
  • Product
    • OVERVIEW All you need to know about our site search.
    • Design & Search UI Migration and design done by our team.
    • Ranking Management Control order and content of search results.
    • Analytics Advanced statistics on how your search is performing.
    • Personalization Show unique search results to each user.
    • Frequently Bought Together Increase your ROI with Frequently Bought Together
    • Indexing Data Index your content automatically with our Indexing API or state of the art Crawler
    • WordPress Plugin Smooth integration of our lightning-fast search.
    • SOLUTIONS Adapt search to your needs
    • Enterprise
    • Ecommerce
    • Media
    • B2B
    • Education
    • Docs & Helpdesk
    • Book a demo
  • Pricing
    • Professional Premium Enterprise
    • Compare prices
  • Partners
  • Resources
    • Blog Explore our tips and the latest search industry trends
    • Webinars Register for future events or watch on-demand webinars.
    • Customer Stories Find how companies like yours drive business results with AddSearch.
    • The State of Site Search Original research about the role of site search in different organization.
  • Support
    • Documentation Guides to using our product
    • Indexing Search UI Result Management and Ranking Installation Analytics
    • Contact Support
    • API Reference Explore dev tools to make a fully custom search
    • FAQ Answers to Frequently Asked Questions
    • Product Updates Learn about the latest updates from our product team
Login Signup
  • Product
    OVERVIEW All you need to know about our site search. Design & Search UI Migration and design done by our team. Ranking Management Control order and content of search results. Analytics Advanced statistics on how your search is performing. Personalization Show unique search results to each user. Frequently Bought Together Increase your ROI with Frequently Bought Together Indexing Data Index your content automatically with our Indexing API or state of the art Crawler WordPress Plugin Smooth integration of our lightning-fast search.
    SOLUTIONS Adapt search to your needs Enterprise Ecommerce Media B2B Education Docs & Helpdesk
    Book a demo
  • Pricing
    Professional Professional $99 Easy-to-use and fast search solution for small websites
    Premium Premium $499 Advanced search solution for websites and eCommerce
    Enterprise Enterprise Custom Fully-tailored solution for large websites and Enterprise needs with implementation support
    Compare prices
  • Partners
  • Resources
    Blog Explore our tips and the latest search industry trends Webinars Register for future events or watch on-demand webinars. Customer Stories Find how companies like yours drive business results with AddSearch. The State of Site Search Original research about the role of site search in different organization.
  • Support
    Documentation Guides to using our product
    Indexing Search UI Result Management and Ranking Installation Analytics
    Contact Support
    API Reference Explore dev tools to make a fully custom search FAQ Answers to Frequently Asked Questions Product Updates Learn about the latest updates from our product team
AddSearch
Login Signup
  • Indexing and Crawling
    • Choosing the Search Index
    • Adding Multiple Domains to Search
    • Determining the Language of Webpages
    • Indexing PDF, DOCX and PPTX Files
    • Whitelisting AddSearch Bot
    • Crawling adjustment
    • Indexing and Updating Single Pages
    • Real-time Indexing with RSS Feeds or API
    • Excluding Content
    • Restricting Search to a Certain Area
    • Crawling content within pages
    • Defining Featured Image for Thumbnails
    • Defining Page’s Publishing Time
    • Defining Custom Fields
    • Using Custom Fields Manager
  • Building Search UI
    • Search designer
    • Different Search Result Views
    • Custom Implementation
    • Go to API Reference
    • Search UI Library
    • Go to Search UI Library (GitHub)
    • Introduction
    • Getting Started
    • Create Autocomplete Suggestions
    • Look and Feel of Ready-Made Views
    • Customizing Look & Feel
    • Defining Category Information with Aliases
    • Showing Meta Description in Search Results
    • Additional Settings
    • Implementing Search Suggestions Autocomplete
    • Search Filters
  • Result Management and Ranking
    • Search Algorithm
    • Ranking Adjustment
    • Site Areas – Boost Ranking or Exclude a Site Section
    • Pinned Results – Curate Results for Specific Keywords
    • Promotions
    • Date Boost
    • Field Weights
    • Custom Fields Boost
    • Exact Match Boost
    • Relevancy
    • Progressive Ranking Tool
    • What are Custom Fields?
    • Configuring Search Suggestions Autocomplete
    • Synonyms – Add Keywords with Similar Meaning
    • Stemming and Language Settings
    • Hidden Keywords – Add New Keywords to Pages
  • Installation
    • Installation Guidelines
    • Configurable installation
    • Custom installation
    • Supported CMS Platforms
    • CMS-Specific Guidelines
    • Drupal
    • HubSpot
    • Jimdo
    • Joomla
    • PrestaShop
    • Shopify
    • Sitefinity
    • WordPress
    • WooCommerce
  • Analytics
    • Analytics Dashboard
    • Integrating with Google Analytics
    • Excluding AddSearch Bot from Google Analytics Traffic
    • Getting Analytics Data from Search API Usage
  • Personalization
    • Overview
  • Account Management
    • Users
    • User Roles and Management
    • Multi-Factor Authentication
    • Billing
    • Subscribing to AddSearch
    • Adding Another AddSearch Account
    • Updating Billing Information
    • Billing and Invoicing
    • Canceling Subscription

Indexing and Crawling

AddSearch crawls your website and indexes the content for the search. Read more about our crawlers and follow the instructions on adding content for the search.

  • Adding Multiple Domains to Search
  • AJAX Crawling – Indexing of Dynamic Content
  • Authenticated Crawling
  • Canonical Links
  • Choosing the Search Index
  • Crawler Status
  • Crawling Frequency
  • Defining Custom Fields
  • Defining Featured Image for Thumbnails
  • Defining Page’s Publishing Time
  • Determining the Language of Webpages
  • Excluding Content
  • Excluding Single Page
  • Exporting Indexed URLs and IDs
  • Failure during Demo Creation
  • Index Meta Keywords
  • Index Tools Page Status
  • Indexing and Filtering PDFs, Microsoft Word and Powerpoint Documents
  • Indexing and Updating Single Pages
  • Real-time Indexing with RSS Feeds or API
  • Requesting Full Recrawl of Search Index
  • Restricting Search to a Certain Area of Your Website
  • Setting Up Ignored URL Parameters
  • Use Meta Tags to Optimize Your Search Results
  • Using Custom Fields Manager
  • Using Text Extraction Rules
  • Whitelisting AddSearch Bot
  • Whitelisting AddSearch to Work with Content Security Policy

Was this helpful?

Let us know if you liked the post. That’s the only way we can improve.
Need more help?

We’re always happy to help with code or other questions you might have. Search our documentation, contact support, or connect with our sales team.

All tags
Analytics API API Reference Archive Billing coveo Dashboard Dev Indexing Installation Language Settings Personalization Ready-made View Result Management and Ranking Search UI Search UI Library Structured Data Users
AddSearch
AddSearch Oy
PL 8
FI-02611 Espoo
Finland
info@addsearch.com
Corporate ID #: 2545782-4
VAT ID #: FI25457824
  • About Us
    • About AddSearch
    • Careers
    • Contact Info
    • Contact Support
    • Product
    • Product Updates
    • Join Agency Partner Program
    • Pricing
  • Resources
    • Documentation
    • API reference
    • Webinars
    • Blog
    • Customers
    • Privacy Policy
    • Terms & Conditions
  • Useful Contents
    • Search Index
    • Google Custom Search
    • Autocomplete Search
    • Site Search Statistics
    • Faceted Search
    • Voice Search
    • Search UI Design