org.lionsoul.jcseg.tokenizer

Class DelimiterSeg

java.lang.Object

org.lionsoul.jcseg.tokenizer.DelimiterSeg

All Implemented Interfaces:

ISegment

public class DelimiterSeg
extends Object
implements ISegment

delimiter segment algorithm implementation extended from common segment interface ISegment

Author:

chenxin

Field Summary

Fields

Modifier and Type	Field and Description
protected LinkedList<IWord>	wordPool

Fields inherited from interface org.lionsoul.jcseg.tokenizer.core.ISegment

CHECK_CE_MASk, CHECK_CF_MASK, CHECK_EC_MASK, START_SS_MASK

Constructor Summary

Constructors

Constructor and Description
DelimiterSeg(JcsegTaskConfig config, ADictionary dic) method to create a new ISegment
DelimiterSeg(Reader input, JcsegTaskConfig config, ADictionary dic) method to create a new ISegment

Method Summary

Modifier and Type	Method and Description
JcsegTaskConfig	getConfig() get the current JcsegTaskConfig instance
char	getDelimiter() get the current delimiter
ADictionary	getDic() get the current dictionary instance
int	getStreamPosition() get the current length of the stream
IWord	next() segment a word from a char array from a specified position.
protected void	pushBack(int data) push back the data to the stream
protected int	readNext() read the next char from the current position
void	reset(Reader input) reset the reader
void	setConfig(JcsegTaskConfig config) set the current configuration
void	setDelimiter(char delimiter) set the delimiter default to whitespace
void	setDic(ADictionary dic) set the current dictionary

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

wordPool

protected LinkedList<IWord> wordPool

Constructor Detail

DelimiterSeg

public DelimiterSeg(JcsegTaskConfig config,
                    ADictionary dic)
             throws IOException

method to create a new ISegment

Parameters:

input -

maxLen -

Throws:

IOException

DelimiterSeg

public DelimiterSeg(Reader input,
                    JcsegTaskConfig config,
                    ADictionary dic)
             throws IOException

method to create a new ISegment

Parameters:

input -

delimiter -

maxLen -

Throws:

IOException

Method Detail

reset

public void reset(Reader input)
           throws IOException

Description copied from interface: ISegment

reset the reader

Specified by:

reset in interface ISegment

Throws:

IOException

getStreamPosition

public int getStreamPosition()

Description copied from interface: ISegment

get the current length of the stream

Specified by:

getStreamPosition in interface ISegment

Returns:

int

readNext

protected int readNext()
                throws IOException

read the next char from the current position

Returns:

int

Throws:

IOException

pushBack

protected void pushBack(int data)
                 throws IOException

push back the data to the stream

Parameters:

data -

Throws:

IOException

next

public IWord next()
           throws IOException

Description copied from interface: ISegment

segment a word from a char array from a specified position.

Specified by:

next in interface ISegment

Returns:

IWord

Throws:

IOException

getDelimiter

public char getDelimiter()

get the current delimiter

Returns:

char

setDelimiter

public void setDelimiter(char delimiter)

set the delimiter default to whitespace

Parameters:

delimiter -

getDic

public ADictionary getDic()

get the current dictionary instance

Returns:

ADictionary

setDic

public void setDic(ADictionary dic)

set the current dictionary

Parameters:

dic -

getConfig

public JcsegTaskConfig getConfig()

get the current JcsegTaskConfig instance

Returns:

JcsegTaskConfig

setConfig

public void setConfig(JcsegTaskConfig config)

set the current configuration

Parameters:

config -