org.lionsoul.jcseg.tokenizer

Class SimpleSeg

java.lang.Object

org.lionsoul.jcseg.tokenizer.ASegment

org.lionsoul.jcseg.tokenizer.SimpleSeg

All Implemented Interfaces:

ISegment

public class SimpleSeg
extends ASegment

Jcseg simple segmentation implements extend from ASegment

Author:

chenxin

Field Summary

Fields inherited from class org.lionsoul.jcseg.tokenizer.ASegment

behindLatin, config, ctrlMask, dic, ialist, idx, isb, reader, wordPool

Fields inherited from interface org.lionsoul.jcseg.tokenizer.core.ISegment

CHECK_CE_MASk, CHECK_CF_MASK, CHECK_EC_MASK, START_SS_MASK

Constructor Summary

Constructors

Constructor and Description
SimpleSeg(JcsegTaskConfig config, ADictionary dic)
SimpleSeg(Reader input, JcsegTaskConfig config, ADictionary dic)

Method Summary

Modifier and Type	Method and Description
IChunk	getBestCJKChunk(char[] chars, int index) an abstract method to gain a CJK word from the current position.

Methods inherited from class org.lionsoul.jcseg.tokenizer.ASegment

appendLatinSyn, appendWordFeatures, enSecondSeg, findCHName, findCHName, getConfig, getDict, getNextCJKWord, getNextLatinWord, getNextMatch, getNextMixedWord, getNextPunctuationPairWord, getPairPunctuationText, getStreamPosition, next, nextCJKSentence, nextCNNumeric, nextLatinString, nextLatinWord, nextLetterNumber, nextOtherNumber, pushBack, pushBack, readNext, reset, setConfig, setDict

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SimpleSeg

public SimpleSeg(JcsegTaskConfig config,
                 ADictionary dic)
          throws IOException

Throws:

IOException

SimpleSeg

public SimpleSeg(Reader input,
                 JcsegTaskConfig config,
                 ADictionary dic)
          throws IOException

Throws:

IOException

Method Detail

getBestCJKChunk

public IChunk getBestCJKChunk(char[] chars,
                              int index)
                       throws IOException

Description copied from class: ASegment

an abstract method to gain a CJK word from the current position. simpleSeg and ComplexSeg is different to deal this, so make it a abstract method here

Specified by:

getBestCJKChunk in class ASegment

Returns:

IChunk

Throws:

IOException

See Also:

ASegment.getBestCJKChunk(char[], int)