JavaScript admin.databaseTokenizerOverride

admin:database-tokenizer-override

admin:database-tokenizer-override(
   $character as xs:string,
   $class as xs:string
) as element(db:tokenizer-override)

Summary

This function constructs a custom tokenizer override. For details, see Custom Tokenization in the Search Developer's Guide.

Parameters
character	The character whose tokenization behavior should be overridden.
class	The new tokenization class for the character. Allowed values are "word", "space", "punctuation", or "symbol".

Example



xquery version "1.0-ml";

import module namespace admin = "http://marklogic.com/xdmp/admin"
      at "/MarkLogic/admin.xqy";

admin:database-tokenizer-override("-","word")
(: returns the new override for the character '-' :)