StoreSiteStructure

The connector stores site structures. This makes the spidering process faster when the same site is spidered again. Disable this parameter if you do not want the connector to store site structures.

If StoreSiteStructure is enabled and the parameter DeleteProcess is set to DREREMOVE, pages that are not found by the connector are removed from the site structure file and from IDOL server.

If StoreSiteStructure is enabled, the parameter DeleteProcess is set to DREREMOVE, and the parameter SiteStructureCompactCopy is disabled, pages that are not found by the connector are removed from IDOL server, but the link to the page is kept in the site structure file and the connector attempts to follow the link on subsequent spider cycles.

Type: Boolean
Default: False
Required: No
Configuration Section: TaskName or Default
Example: StoreSiteStructure=True
See Also: SiteStructureCompactCopy

_HP_HTML5_bannerTitle.htm