org.xbib.elasticsearch.index.analysis.icu.segmentation

Interface IcuTokenizerConfig

All Known Implementing Classes:

DefaultIcuTokenizerConfig

public interface IcuTokenizerConfig

Class that allows for tailored Unicode Text Segmentation on a per-writing system basis.

Method Summary

Modifier and Type	Method and Description
boolean	combineCJ()
com.ibm.icu.text.BreakIterator	getBreakIterator(int script) Return a breakiterator capable of processing a given script.
java.lang.String	getType(int script, int ruleStatus) Return a token type value for a given script and BreakIterator rule status.

Method Detail

getBreakIterator

com.ibm.icu.text.BreakIterator getBreakIterator(int script)

Return a breakiterator capable of processing a given script.

Parameters:

script - script

Returns:

iterator

getType

java.lang.String getType(int script,
                         int ruleStatus)

Return a token type value for a given script and BreakIterator rule status.

Parameters:

script - script

ruleStatus - rule status

Returns:

type

combineCJ

boolean combineCJ()

Returns:

true if Han, Hiragana, and Katakana scripts should all be returned as Japanese