You can exclude a single document from the search index with robots.txt and robots tag. AddSearch also allows you to define exclusions using Site areas from the AddSearch dashboard.
If you have deleted a web page from your website AddSearch will automatically exclude the document from the search index. This may take some time depending on the frequency of updates.
If you wish to update the index manually after you have deleted the page follow these instructions.
Follow the instructions to exclude single documents from the search index.
To exclude obsolete-page.php page from all search engine’s search indices use the following snippet:
User-agent: * Disallow: /obsolete-page.php
To exclude obsolete-page.php from the AddSearch search index, use the following snippet:
User-agent: AddSearchBot Disallow: /obsolete-page.php
To exclude a page from all search engine’s indices with robots meta tag, place the following snippet into HEAD section of your page:
<meta name="robots" content="noindex" />
To exclude a page from the AddSearch’s index with robots meta tag, replace the robots name value with addsearchbot and place the following snippet into HEAD section of your page:
<meta name="addsearchbot" content="noindex" />
You can exclude a single page using 1) Site areas to set exclusion rule and 2) updating the status of the indexed to excluded with the Index tools re-crawl with the following instructions:
To update the index after setting the rules, follow these instructions:
The contents of the indexed page appear below Page status and actions.
The indexed page will be excluded in a few seconds time. You can check the updated status of the page with clicking the Check status button.