Package com.northconcepts.datapipeline.core

Core DataPipeline classes for reading, writing, and processing data.

See: Description

Interface Summary

Interface	Description
DataExceptionContributor	An interface for classes capable of adding context/information to exceptions usually to aid in identifying and troubleshooting issues.
INodeVisitor
IParser
JsonSerializable	The interface implemented by classes to participate in serialization to and from JSON.
RecordContainer
RecordSerializable	The interface implemented by classes to participate in serialization to and from Record.
SequenceWriter.DataWriterFactory
SequenceWriter.ISequenceStrategy
Session	Session is the base type for objects that can contain temporary, non-persistent data in Data Pipeline.
ValueNodeContainer	A general interface for nodes that allow values to be added to itself.
XmlSerializable	The interface implemented by classes to participate in serialization to and from XML.

Class Summary

Class	Description
AbstractReader	Abstract super-class, with some common logic, for reading records.
AbstractWriter	Abstract super-class, with some common logic, for writing records.
ArrayValue	ArrayValue holds an ordered collection (also known as a sequence) of persistent data.
AsyncMultiReader	AsyncMultiReader reads from one or more source DataReaders asynchronously using a separate thread for each one.
AsyncReader	A proxy that reads data asynchronously using a separate thread.
AsyncTaskReader	A proxy that uses multiple threads to process incoming data, where the work applied to the incoming data is specified by the a DataReaderDecorator.
AsyncWriter	A proxy that writes data asynchronously using a separate thread.
BinaryWriter	Abstract super-class for writing records to a binary stream.
CompositeValue
ConcurrentRecordList
DataEndpoint	Abstract super-class for reading and writing records.
DataEndpointGroup	Helper class--makes it easy to work with multiple readers and writers as a single unit.
DataObject	Abstract super-class for classes that work with data and require a consistent error handling mechanism.
DataReader	Abstract super-class for reading records.
DataWriter	Abstract super-class for writing records.
DebugReader	A proxy that prints records passing through to a stream in a human-readable format
DebugWriter	A proxy that prints records passing through to a stream in a human-readable format
Endpoint
Field	Field holds persistent key-value data as part of a record.
FieldComparator	See FieldPath for supported field name expressions.
FieldDeclarations
FieldList	See FieldPath for supported field name expressions.
FieldPath	An abstract representation for the location of a field within a record.
Functions	Functions is the entry point for adding new method aliases to the dynamic expression language.
LimitReader	A proxy that can skip a number of upstream records, limit the number of records sent downstream, or both.
LinedTextWriter	Abstract super-class for writing records to a text stream.
LineParser
Message
Messages	Thread-local container for messages and exceptions originating in asynchronous operations.
MultiWriter	Writes records to multiple DataWriter.
MultiWriter.AvailableCapacityWriteStrategy	Writes each record to a single writer by choosing the one with the highest available capacity (DataWriter.available() If all writers have identical capacities, this strategy behaves like MultiWriter.RoundRobinWriteStrategy and writes to each writer in turn.
MultiWriter.ReplicateCloneWriteStrategy	Writes a clone (to prevent side effects) of each record to all writers.
MultiWriter.ReplicateWriteStrategy	Writes each record to all writers.
MultiWriter.RoundRobinWriteStrategy	Divides records evenly between all writers by cycling through the list and writing each record to a single writer in turn.
MultiWriter.WriteStrategy
Node	Node is the base class for all persistent data in Data Pipeline.
NodeVisitor
NullReader	A data source that produces no records.
NullWriter	Discards records.
Parser
ParsingReader	Abstract super-class for obtaining records from a text stream using a parser.
PipedReader
PipedWriter
ProxyReader	Abstract super-class for obtaining records from another DataReader, possibly transforming them along the way.
ProxyWriter	Abstract super-class for writing records to another DataWriter, possibly transforming them along the way.
Record	Record holds persistent data in key-value fields as it flows through the pipeline.
RecordComparator
RecordList
RemoveDuplicatesReader	A proxy that removes duplicate records.
SequenceReader	Combines one or more DataReaders into a single stream by reading from each until empty then moving to the next.
SequenceWriter	Writes to sequence of data writers created by a factory in turn and rolled based on a ISequenceStrategy policy.
SequenceWriter.ElapsedTimeSequenceStrategy
SequenceWriter.OrSequenceStrategy
SequenceWriter.RecordCountSequenceStrategy
SequenceWriter.SchedulerSequenceStrategy
SequenceWriter.Sequence
Session.SessionImpl
SingleValue
SortingReader	A proxy that sorts records.
StreamWriter	Writes records to a stream in a human-readable format.
StringParser
TeeReader	A proxy reader that also writes every record passing through it to a DataWriter.
TextReader	Abstract super-class for obtaining records from a text stream.
TextStreamWriter	Abstract super-class for writing records to a text stream.
TextWriter	Abstract super-class for writing records to a text stream.
TimedReader	Reads an underlying DataReader for a maximum period of time or until the source DataReader is finished.
ValueNode<T>	ValueNode is the base class for all persistent values held in fields and arrays.

Enum Summary

Enum	Description
DataEndpoint.State
FieldType	FieldType lists of all field data types used in records.
Message.Level
Node.DuplicateNodeAction	DuplicateNodeAction lists all actions that can be taken automatically when a target field already exists during a record copy or lookup.
Node.NodeType	NodeType lists all concrete data node types used in Data Pipeline.
Record.State
StreamWriter.Format

Exception Summary

Exception	Description
DataException	Indicates an error has occurred during the course of execution.

Package com.northconcepts.datapipeline.core Description

Core DataPipeline classes for reading, writing, and processing data.