com.northconcepts.datapipeline.avro.pipeline.input

Class AvroPipelineInput

java.lang.Object

com.northconcepts.datapipeline.foundations.core.Bean

com.northconcepts.datapipeline.foundations.core.FoundationObject

com.northconcepts.datapipeline.foundations.pipeline.PipelineObject

com.northconcepts.datapipeline.foundations.pipeline.PipelineInput

com.northconcepts.datapipeline.foundations.pipeline.input.FileSourcePipelineInput

com.northconcepts.datapipeline.avro.pipeline.input.AvroPipelineInput

All Implemented Interfaces:

DataExceptionContributor, JsonSerializable, RecordSerializable, XmlSerializable, DataReaderFactory, JavaCodeGenerator, Serializable

public class AvroPipelineInput
extends FileSourcePipelineInput

See Also:

Serialized Form

Field Summary

Fields inherited from class com.northconcepts.datapipeline.foundations.core.FoundationObject

internalId, internalName, log, TIMESTAMP_FORMAT

Fields inherited from interface com.northconcepts.datapipeline.core.RecordSerializable

SERIALIZED_CLASS_NAME, TYPE

Fields inherited from interface com.northconcepts.datapipeline.core.XmlSerializable

XML_SERIALIZED_CLASS_NAME

Constructor Summary

Constructors

Constructor and Description
AvroPipelineInput()

Method Summary

Modifier and Type	Method and Description
DataReader	createDataReader()
AvroPipelineInput	fromRecord(Record source) Loads this instance's state from a record and returns this (for fluid API call chaining).
AvroPipelineInput	fromXmlElement(Element pipelineInputElement)
void	generateJavaCode(JavaCodeBuilder code)
FileSource	getFileSource()
int	getMaxInvalidRecords() Indicates the number of broken Avro records to skip before this reader should fail (default 1000).
String	getName()
AvroPipelineInput	setFileSource(FileSource fileSource)
AvroPipelineInput	setMaxInvalidRecords(int maxInvalidRecords) Indicates the number of broken Avro records to skip before this reader should fail (default 1000).
Record	toRecord()
Element	toXmlElement(Document document)

Methods inherited from class com.northconcepts.datapipeline.foundations.pipeline.PipelineInput

getNestedPipelineInput, getRootPipelineInput, isLineageSupported, isSaveLineage, setSaveLineage

Methods inherited from class com.northconcepts.datapipeline.foundations.core.FoundationObject

addExceptionProperties, assertValid, assertValid, clone, exception, exception, exception, getInternalId, getInternalName, resetInternalId

Methods inherited from class com.northconcepts.datapipeline.foundations.core.Bean

toString

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface com.northconcepts.datapipeline.core.RecordSerializable

fromArrayValue, fromArrayValue, fromArrayValue, fromJson, fromJson, newInstanceFromRecord, newInstanceFromRecord, toArrayValue, toJson, toJson, toJson, toRecord

Methods inherited from interface com.northconcepts.datapipeline.core.JsonSerializable

newInstanceFromJson

Methods inherited from interface com.northconcepts.datapipeline.core.XmlSerializable

forEachGrandChildElement, fromXml, fromXml, getAttribute, getAttribute, getAttribute, getAttribute, getAttribute, getAttribute, getAttribute, getAttribute, getAttribute, getAttribute, getChildElement, getChildElements, newInstanceFromXml, newInstanceFromXml, setAttribute, toXml, toXml, toXml, toXml, toXml, writeXml, writeXml

Methods inherited from interface com.northconcepts.datapipeline.core.DataExceptionContributor

addExceptionProperties, contributeExceptionProperties, contributeExceptionProperties

Constructor Detail

AvroPipelineInput

public AvroPipelineInput()

Method Detail

getMaxInvalidRecords

public int getMaxInvalidRecords()

Indicates the number of broken Avro records to skip before this reader should fail (default 1000).

setMaxInvalidRecords

public AvroPipelineInput setMaxInvalidRecords(int maxInvalidRecords)

Indicates the number of broken Avro records to skip before this reader should fail (default 1000).

createDataReader

public DataReader createDataReader()

generateJavaCode

public void generateJavaCode(JavaCodeBuilder code)

getFileSource

public FileSource getFileSource()

Specified by:

getFileSource in class FileSourcePipelineInput

setFileSource

public AvroPipelineInput setFileSource(FileSource fileSource)

Specified by:

setFileSource in class FileSourcePipelineInput

getName

public String getName()

Overrides:

getName in class FileSourcePipelineInput

toRecord

public Record toRecord()

Specified by:

toRecord in interface RecordSerializable

Overrides:

toRecord in class PipelineInput

fromRecord

public AvroPipelineInput fromRecord(Record source)

Description copied from interface: RecordSerializable

Loads this instance's state from a record and returns this (for fluid API call chaining). For fluid API call chaining, the overridden method should change the declared return type to its class.

Specified by:

fromRecord in interface RecordSerializable

Overrides:

fromRecord in class PipelineInput

Returns:

this instance.

toXmlElement

public Element toXmlElement(Document document)

Specified by:

toXmlElement in interface XmlSerializable

Overrides:

toXmlElement in class PipelineInput

fromXmlElement

public AvroPipelineInput fromXmlElement(Element pipelineInputElement)

Specified by:

fromXmlElement in interface XmlSerializable

Overrides:

fromXmlElement in class PipelineInput