KeepHTTPHeader
 
Type

Boolean

Default

false

Required

no

Configuration section

[Default] or [SpiderJob]

Description

Set to true to extract the HTTP header of each file. Each header field from the file receives its own DREFIELD in the IDX output file, in the form of #DREFIELD HTTPHEADER_<field_name>.

Example

KeepHTTPHeader=true

In the IDX file, results resembling the following would appear:

#DREFIELD HTTPHEADER_Accept-Ranges="bytes"
#DREFIELD HTTPHEADER_Date="Fri, 23 May 2008 19:33:42 GMT"
#DREFIELD HTTPHEADER_Server="Apache"
#DREFIELD HTTPHEADER_Last-Modified="Thu, 26 Feb 2004 01:45:32 GMT"
#DREFIELD HTTPHEADER_ETag="537e2-30da-403d4fbc"
#DREFIELD HTTPHEADER_Content-Length="12506"
#DREFIELD HTTPHEADER_Content-Type="text/html; charset=utf-16"

See also