LinkAllowCSVs
 
Type

String

Default

 

Allowed range

Minimum:  

Maximum:  

Recommended range

Minimum:  

Maximum:  

Required

no

Configuration section

[Default] and [SpiderJob]

Description

Strings a page must contain for the connector to follow links from the page. Multiple strings must be separated with commas (with no space before or after a comma). Use the parameter LinkCheck to specify the parts of the page the connector should look for these strings.

Example

LinkAllowCSVs=*news*,*home*

In this example, the connector determines whether the part of the page specified in the parameter LinkCheck contains the strings news and home (as part of a word or a whole word). If a page does not contain at least one of these strings, the connector processes the page, but does not follow the links.

See also

LinkCheck

LinkDisallowCSVs