NavSiteCheck
 
Type

Long

Default

0

Allowed range

Minimum: 0

Maximum: 193

Recommended range

Minimum: 0

Maximum: 193

Required

no

Configuration section

[Default] and [SpiderJob]

Description

A bitwise mask number used to determine where and how the connector checks for the NavSiteAllowCSVs and NavSiteDisallowCSVs strings. If the URL of a page does not contain one of the NavSiteAllowCSVs strings or does contain one of the NavSiteDisallowCSVs strings, the connector does not process the page. You can create the number by adding together some of the following numbers as appropriate:

URL: 1
You must enter 1 to enable the connector to check whether the URL of a page contains any of the strings specified in the parameter NavSiteAllowCSVs or NavSiteDisallowCSVs.

Case insensitive: 64
If you add 64 to the URL value, the connector checks the URL of a page for a case-insensitive match for the strings specified in the parameter NavSiteAllowCSVs or NavSiteDisallowCSVs.

Before download: 128
If you add 128 to the URL value, the connector checks whether the URL has any NavSiteAllowCSVs or NavSiteDisallowCSVs strings before the page is downloaded.

If you enter 0, the connector does not check for the NavSiteAllowCSVs or NavSiteDisallowCSVs strings.

Example

NavSiteCheck=65

In this example, the connector checks the URL of a page for case-insensitive matches for the strings specified in NavSiteAllowCSVs and NavSiteDisallowCSVs. If the URL contains any of the NavSiteDisallowCSVs strings or does not contain any of the NavSiteAllowCSVs strings, the connector discards the page.

See also

NavSiteAllowCSVs

NavSiteDisallowCSVs