A Boolean that specifies whether to treat all punctuation characters as part of a word token, rather than treating them as word boundaries. Setting this parameter to true is equivalent to setting the TangibleCharacters parameter to all punctuation characters.

This parameter has no effect when MatchWholeWord is set to false.

Note: If you set both the TokenWithPunctuation configuration parameter and the TokenWithPunctuation action, the action settings take precedence.

For more information on using TokenWithPunctuation to configure all punctuation marks as tangible characters, refer to IDOL Expert.

Type: Boolean
Default: False
Required: No
Configuration Section: Any section that you have defined for Eduction settings.
Example: TokenWithPunctuation=true
See Also: MatchWholeWord