Store Content in IDOL Server > Index Data > Prevent Duplicate Documents

Prevent Duplicate Documents

Topics in this Section

You can configure IDOL server to implement deduplication when indexing documents. This process prevents storage of the same document or document content. If IDOL determines the document to index matches an existing document, it replaces the existing document with the new document.
*
*
*
Enable deduplication for all indexing jobs using the KillDuplicates configuration parameter in the [Server] section. See Enable Deduplication for all Index Jobs.
You can use the KillDuplicatesChecksumField configuration parameter with deduplication to prevent unnecessary updating of existing documents in IDOL. See Use KillDuplicatesChecksumField to Prevent Unnecessary Indexing.
You can also use the KillDuplicatesPreserveFields configuration parameter with deduplication to copy the specified IDX fields from an existing document to a newer version.
*
Enable deduplication for individual indexing jobs using the KillDuplicates action parameter in the DREADD and DREADDDATA actions. See Enable Deduplication for Individual Index Jobs.
Use the KeepExisting action parameter with deduplication to discard the incoming document instead of replacing the existing document, to keep the indexing load small. See Use KeepExisting to Minimize the Index Load.
*
*
*