Store Content in IDOL Server > Fields > ReferenceType Fields > Use KillDuplicates and Combine on ReferenceType fields

Use KillDuplicates and Combine on ReferenceType fields
When you instruct IDOL server to eliminate duplicate document copies at index time using a specific ReferenceType field (by setting the KillDuplicates parameter in IDOL server configuration file, it automatically uses any field listed for PropertyFieldCSVs alongside this ReferenceType field in the IDOL server configuration to eliminate duplicate document copies as well.
However, IDOL server cannot use the same field for de–duplication as for the Combine action parameter, because the Combine operation clashes (carried out at query time) with IDOL server eliminating duplicate fields. This clash means that, if you want to eliminate duplicate document copies and use the Combine action parameter, you must set up separate ReferenceType fields for these processes.
Related Topics 
*
To use KillDuplicates and Combine on ReferenceType fields
1.
2.
In the [FieldProcessing] section, add two processes that identify ReferenceType fields (note that you must set up a field process to identify ReferenceType fields before you start indexing documents into IDOL server). One of them is used to eliminate duplicate copies of documents and the other one is used for the Combine operation.
For example:
[FieldProcessing]
0=MyFirstProcess
1=MySecondProcess
3=SetUpReferenceFields
4=SetUpMoreReferenceFields
3.
Create a section for the processes you added, and in each section, create a property for the respective process (you define a property later by one or more applicable configuration parameters). Identify the fields you want to associate with each process.
 
NOTE The properties you create must not have the same name as the processes.
For example:
[MyFirstProcess]
Property=MyFirstProperty
PropertyFieldCSVs=*/MyField,*/MySecondField
[MySecondProcess]
Property=MySecondProperty
PropertyFieldCSVs=*/MyThirdField
[SetUpReferenceFields]
Property=ReferenceFields
PropertyFieldCSVs=*/DREREFERENCE,*/URL
[SetUpMoreReferenceFields]
Property=MoreReferenceFields
PropertyFieldCSVs=*/DRETITLE
4.
Create a section for each of the properties and specify appropriate configuration settings for each. These configuration parameters define the processes that are applied to all the fields (or all documents that contain the fields) that you previously associated with the processes. For example:
[MyFirstProperty]
HiddenType=true
[MySecondProperty]
Index=true
[ReferenceFields]
ReferenceType=TRUE
TrimSpaces=TRUE
[MoreReferenceFields]
ReferenceType=TRUE
TrimSpaces=TRUE
5.
After you index documents into IDOL server, you can use, for example, the */DREREFERENCE field to eliminate duplicate copies of documents. (IDOL server then automatically also uses the */URL field for de–duplication because it is listed alongside */DREREFERENCE for PropertyFieldCSVs.) This leaves you free to use the */DRETITLE field for the Combine operation.