How to Prevent Folders from Being Crawled (256270)



The information in this article applies to:

  • Microsoft Site Server 3.0

This article was previously published under Q256270

SYMPTOMS

When Site Server 3.0 Search does a file crawl, your search results may display FrontPage control files located in _vti folders. You may not want the information returned to your users.

CAUSE

When Search does a file crawl, it moves through the subdirectory tree under the start address and indexes the documents contained there. FrontPage creates _vti folders, along with several other FrontPage-only folders, under many folders in the Web.

RESOLUTION

To keep these folders from being indexed, perform the following steps:
  1. Open the properties for the catalog.
  2. On the Sites tab, and add a new rule for the site you are crawling. If it is the local file system, then add a site for localhost.
  3. Select this new site, choose Properties, click Add, type the following, and then set it to Crawl:

    d:\inetpub\wwwroot

  4. Click Add, type the following, and then set it to Avoid:

    d:\inetpub\wwwroot\*_vti*\*

Both values should be modified for your local file system and the avoid should occur before the crawl. Index Server will then avoid any folders that start with _vti. Note that these steps can be used to exclude any folder type that you do not want to index.

Modification Type:MajorLast Reviewed:3/10/2000
Keywords:kbprb KB256270