NavDirCheck
 
Type

Long

Default

0

Allowed range

Minimum: 0

Maximum: 705

Recommended range

Minimum: 0

Maximum: 705

Required

no

Configuration section

[Default] and [SpiderJob]

Description

A bitwise mask number used to determine where and how the connector checks for the NavDirAllowCSVs and NavDirDisallowCSVs strings. If the URL of a page does not contain one of the NavDirAllowCSVs strings or does contain one of the NavDirDisallowCSVs strings, the connector does not process the page. You can create the number by adding together some of the following numbers as appropriate:

URL: 1
You must enter 1 to enable the connector to check whether the URL of a page contains any of the strings specified in the parameter NavDirAllowCSVs or NavDirDisallowCSVs.

Case insensitive: 64
If you add 64 to the URL value, the connector checks the URL of a page for a case-insensitive match for the strings specified in the parameter NavDirAllowCSVs or NavDirDisallowCSVs.

Before download: 128
If you add 128 to the URL value, the connector checks whether the URL has any NavDirAllowCSVs or NavDirDisallowCSVs strings before the page is downloaded.

Valid site structure: 512
If you enter 512, the connector rechecks the NavDirAllowCSVs and NavDirDisallowCSVs values for the site to ensure the site is still valid before it updates it. If you do not include this setting, then changes to these values are never checked. If the site is not valid, it is not downloaded.

If you enter 0, the connector does not check for the NavDirAllowCSVs or NavDirDisallowCSVs strings.

Example

NavDirCheck=193

In this example, the connector checks the URLs of pages, before the page is downloaded, for case-insensitive matches for the strings specified in NavDirAllowCSVs and NavDirDisallowCSVs.

See also

NavDirAllowCSVs

NavDirDisallowCSVs