com.northconcepts.datapipeline.core

Class ParsingReader

java.lang.Object

com.northconcepts.datapipeline.core.DataObject

com.northconcepts.datapipeline.core.Endpoint

com.northconcepts.datapipeline.core.DataEndpoint

com.northconcepts.datapipeline.core.DataReader

com.northconcepts.datapipeline.core.AbstractReader

com.northconcepts.datapipeline.core.ParsingReader

Direct Known Subclasses:

CombinedLogReader

public abstract class ParsingReader
extends AbstractReader

Abstract super-class for obtaining records from a text stream using a parser.

Nested Class Summary

Nested classes/interfaces inherited from class com.northconcepts.datapipeline.core.DataEndpoint

DataEndpoint.State

Field Summary

Fields

Modifier and Type	Field and Description
protected long	lineNumber
protected Parser	parser
protected StringBuilder	valueBuffer

Fields inherited from class com.northconcepts.datapipeline.core.AbstractReader

currentRecord, fieldNames, lastRow, startingRow

Fields inherited from class com.northconcepts.datapipeline.core.DataReader

fieldLineage, recordLineage

Fields inherited from class com.northconcepts.datapipeline.core.DataEndpoint

lastRecord, PRODUCT, PRODUCT_VERSION, VENDOR, XML_INPUT_FACTORY_KEY

Fields inherited from class com.northconcepts.datapipeline.core.Endpoint

BUFFER_SIZE, captureElapsedTime, DEFAULT_READ_BUFFER_SIZE

Fields inherited from class com.northconcepts.datapipeline.core.DataObject

id, log, name, TIMESTAMP_FORMAT

Constructor Summary

Constructors

Constructor and Description
ParsingReader(File file)
ParsingReader(File file, String charsetName)
ParsingReader(Reader reader)

Method Summary

Modifier and Type	Method and Description
DataException	addExceptionProperties(DataException exception) Adds this endpoint's current state to a DataException.
protected Record	addLineage(Record record)
int	available() Returns the number of records that can probably be read without blocking.
protected boolean	fillRecord(Record record)
String	getCharsetName()
long	getLineNumber()
protected boolean	isDigit(int c)
protected boolean	isLetter(int c)
boolean	isLineageSupported()
protected boolean	isNewLine(int c)
protected void	match(int c)
protected void	matchCHARACTER()
protected void	matchDIGIT()
protected void	matchDIGITS()
protected void	matchDOUBLE()
protected void	matchINTEGER()
protected void	matchLINE()
protected void	matchNEWLINE()
protected void	matchNEWLINES()
void	open() Makes this endpoint ready for reading or writing.
protected boolean	peekCHARACTER()

Methods inherited from class com.northconcepts.datapipeline.core.AbstractReader

getFieldNames, getLastRow, getStartingRow, isFieldNamesInFirstRow, isSkipEmptyRows, read, readImpl, setFieldNames, setFieldNames, setFieldNamesInFirstRow, setLastRow, setSkipEmptyRows, setStartingRow

Methods inherited from class com.northconcepts.datapipeline.core.DataReader

getBufferSize, getNestedEndpoint, getNestedReader, getRootEndpoint, getRootReader, isExhausted, isSaveLineage, peek, pop, push, setSaveLineage, skip

Methods inherited from class com.northconcepts.datapipeline.core.DataEndpoint

close, decrementRecordCount, enableJmx, getLastRecord, getRecordCount, getRecordCountAsBigInteger, getRecordCountAsString, incrementRecordCount, isRecordCountBigInteger, resetRecordCount, toString

Methods inherited from class com.northconcepts.datapipeline.core.Endpoint

addElapsedtime, assertClosed, assertNotOpened, assertOpened, finalize, getClosedOn, getDescription, getElapsedTime, getElapsedTimeAsString, getOpenedOn, getOpenElapsedTime, getOpenElapsedTimeAsString, getSelfTime, getSelfTimeAsString, getState, isCaptureElapsedTime, isClosed, isOpen, setCaptureElapsedTime, setDescription

Methods inherited from class com.northconcepts.datapipeline.core.DataObject

exception, exception, exception, getId, getName, resetID

Methods inherited from class java.lang.Object

clone, equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

parser

protected final Parser parser

valueBuffer

protected StringBuilder valueBuffer

lineNumber

protected long lineNumber

Constructor Detail

ParsingReader

public ParsingReader(File file)

ParsingReader

public ParsingReader(File file,
                     String charsetName)

ParsingReader

public ParsingReader(Reader reader)

Method Detail

getLineNumber

public long getLineNumber()

getCharsetName

public String getCharsetName()

open

public void open()
          throws DataException

Description copied from class: DataEndpoint

Makes this endpoint ready for reading or writing.

Overrides:

open in class AbstractReader

Throws:

DataException

available

public int available()

Description copied from class: DataReader

Returns the number of records that can probably be read without blocking.

Overrides:

available in class DataReader

addExceptionProperties

public DataException addExceptionProperties(DataException exception)

Description copied from class: Endpoint

Adds this endpoint's current state to a DataException. Since this method is called whenever an exception is thrown, subclasses should override it to add their specific information.

Overrides:

addExceptionProperties in class AbstractReader

fillRecord

protected boolean fillRecord(Record record)
                      throws Throwable

Specified by:

fillRecord in class AbstractReader

Throws:

Throwable

matchDOUBLE

protected void matchDOUBLE()

matchINTEGER

protected void matchINTEGER()

matchDIGITS

protected void matchDIGITS()

matchDIGIT

protected void matchDIGIT()

peekCHARACTER

protected boolean peekCHARACTER()

matchCHARACTER

protected void matchCHARACTER()

matchNEWLINES

protected void matchNEWLINES()

matchNEWLINE

protected void matchNEWLINE()

matchLINE

protected void matchLINE()

isLetter

protected boolean isLetter(int c)

isDigit

protected boolean isDigit(int c)

isNewLine

protected boolean isNewLine(int c)

match

protected void match(int c)

isLineageSupported

public boolean isLineageSupported()

Overrides:

isLineageSupported in class DataReader

addLineage

protected Record addLineage(Record record)

Overrides:

addLineage in class DataReader