MarkLogic 12 EA 1 Product Documentation
admin.databaseTokenizerOverride

admin.databaseTokenizerOverride(
   character as String,
   class as String
) as element(db.tokenizerOverride)

Summary

This function constructs a custom tokenizer override. For details, see Custom Tokenization in the Search Developer's Guide.

Parameters
character The character whose tokenization behavior should be overridden.
class The new tokenization class for the character. Allowed values are "word", "space", "punctuation", or "symbol".

Example

const admin = require('/MarkLogic/admin.xqy');
admin.databaseTokenizerOverride("-","word")

 //returns the new override for the character '-' 
    
Powered by MarkLogic Server | Terms of Use | Privacy Policy