
MarkLogic 10 Product Documentation
admin.databaseTokenizerOverrideadmin.databaseTokenizerOverride(
   character as String,
   class as String
) as element(db.tokenizerOverride)
Summary
   This function constructs a custom tokenizer override. For details, see
 Custom Tokenization in the Search Developer's Guide.
  
	  
	  
	
	  
	    | Parameters | 
	  
	
	  
	    | character | 
	    
      The character whose tokenization behavior should be overridden.
     | 
	  
	  
	    | class | 
	    
      The new tokenization class for the character. Allowed values are "word", "space", "punctuation", or "symbol".
     | 
	  
	
Example
const admin = require('/MarkLogic/admin.xqy');
admin.databaseTokenizerOverride("-","word")
 //returns the new override for the character '-' 
    
  
    Copyright © 2025 MarkLogic Corporation. MARKLOGIC is a
    registered trademark of MarkLogic Corporation.