MarkLogic 12 EA 1 Product Documentation
admin:database-tokenizer-override

admin:database-tokenizer-override(
   $character as xs:string,
   $class as xs:string
) as element(db:tokenizer-override)

Summary

This function constructs a custom tokenizer override. For details, see Custom Tokenization in the Search Developer's Guide.

Parameters
character The character whose tokenization behavior should be overridden.
class The new tokenization class for the character. Allowed values are "word", "space", "punctuation", or "symbol".

Example



xquery version "1.0-ml";

import module namespace admin = "http://marklogic.com/xdmp/admin"
      at "/MarkLogic/admin.xqy";

admin:database-tokenizer-override("-","word")
(: returns the new override for the character '-' :)
    
Powered by MarkLogic Server | Terms of Use | Privacy Policy