admin.databaseTokenizerOverride

admin.databaseTokenizerOverride(
   character as String,
   class as String
) as element(db.tokenizerOverride)

This function constructs a custom tokenizer override. For details, see Custom Tokenization in the Search Developer's Guide.

Parameters
character	The character whose tokenization behavior should be overridden.
class	The new tokenization class for the character. Allowed values are "word", "space", "punctuation", or "symbol".

const admin = require('/MarkLogic/admin.xqy');
admin.databaseTokenizerOverride("-","word")

 //returns the new override for the character '-'