SpiderAccept
 
Type

String

Default

*/*

Allowed range

Minimum:  

Maximum:  

Recommended range

Minimum:  

Maximum:  

Required

no

Configuration section

[Default] and [SpiderJob]

Description

The string the spider sends in its header to accept pages. If you enter */* all pages are accepted.

Example

SpiderAccept=*/*

See also