JavaScript admin.databaseTokenizerOverride

MarkLogic 10 Product Documentation
admin:database-tokenizer-override

admin:database-tokenizer-override(
   $character as xs:string,
   $class as xs:string
) as element(db:tokenizer-override)

Summary

This function constructs a custom tokenizer override. For details, see Custom Tokenization in the Search Developer's Guide.

Parameters
character	The character whose tokenization behavior should be overridden.
class	The new tokenization class for the character. Allowed values are "word", "space", "punctuation", or "symbol".

Example



xquery version "1.0-ml";

import module namespace admin = "http://marklogic.com/xdmp/admin"
      at "/MarkLogic/admin.xqy";

admin:database-tokenizer-override("-","word")
(: returns the new override for the character '-' :)

MarkLogic 10 Product Documentationadmin:database-tokenizer-override

Summary

Example

MarkLogic 10 Product Documentation
admin:database-tokenizer-override