org.lionsoul.jcseg.tokenizer

Class SearchSeg

java.lang.Object

org.lionsoul.jcseg.tokenizer.ASegment

org.lionsoul.jcseg.tokenizer.SearchSeg

All Implemented Interfaces:

ISegment

public class SearchSeg
extends ASegment

search mode implementation all the possible combination will be returned, and build it for search of course.

Since:

1.9.8

Author:

chenxin

Field Summary

Fields inherited from class org.lionsoul.jcseg.tokenizer.ASegment

behindLatin, config, ctrlMask, dic, ialist, idx, isb, reader, wordPool

Fields inherited from interface org.lionsoul.jcseg.tokenizer.core.ISegment

CHECK_CE_MASk, CHECK_CF_MASK, CHECK_EC_MASK, START_SS_MASK

Constructor Summary

Constructors

Constructor and Description
SearchSeg(JcsegTaskConfig config, ADictionary dic)
SearchSeg(Reader input, JcsegTaskConfig config, ADictionary dic)

Method Summary

Modifier and Type	Method and Description
protected IChunk	getBestCJKChunk(char[] chars, int index) here we don't have to do anything
protected IWord	getNextCJKWord(int c, int pos) get the next CJK word from the current position of the input stream and this function is the core part the most segmentation implements

Methods inherited from class org.lionsoul.jcseg.tokenizer.ASegment

appendLatinSyn, appendWordFeatures, enSecondSeg, findCHName, findCHName, getConfig, getDict, getNextLatinWord, getNextMatch, getNextMixedWord, getNextPunctuationPairWord, getPairPunctuationText, getStreamPosition, next, nextCJKSentence, nextCNNumeric, nextLatinString, nextLatinWord, nextLetterNumber, nextOtherNumber, pushBack, pushBack, readNext, reset, setConfig, setDict

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SearchSeg

public SearchSeg(JcsegTaskConfig config,
                 ADictionary dic)
          throws IOException

Throws:

IOException

SearchSeg

public SearchSeg(Reader input,
                 JcsegTaskConfig config,
                 ADictionary dic)
          throws IOException

Throws:

IOException

Method Detail

getNextCJKWord

protected IWord getNextCJKWord(int c,
                               int pos)
                        throws IOException

get the next CJK word from the current position of the input stream and this function is the core part the most segmentation implements

Overrides:

getNextCJKWord in class ASegment

Returns:

IWord could be null and that mean we reached a stop word

Throws:

IOException

See Also:

ASegment.getNextCJKWord(int, int)

getBestCJKChunk

protected IChunk getBestCJKChunk(char[] chars,
                                 int index)
                          throws IOException

here we don't have to do anything

Specified by:

getBestCJKChunk in class ASegment

Returns:

IChunk

Throws:

IOException

See Also:

ASegment.getBestCJKChunk(char[], int)