Package com.northconcepts.datapipeline.transform

Restructure data using a variety of built-in and customizable operations.

See: Description

Interface Summary

Interface	Description
RemoveDuplicateFields.IDuplicateFieldsPolicy

Class Summary

Class	Description
BasicFieldTransformer	See FieldPath for supported field name expressions.
BasicFieldTransformer.Operation
BasicFieldTransformer.SingleValueOperation
BasicFieldTransformer.StringOperation
CopyField	Creates a duplicate field with the specified target name.
ExcludeFields	Deprecated use RemoveFields
FastRenameField	An performant alternative to RenameField that assumes 1) a flat table structure (no nested fields or arrays), 2) columns are always in the same position from row to row 3) no missing fields (nulls field values are okay), and 4) the target name does not already exist (otherwise there will be two fields with the same name).
FieldTransformer	See FieldPath for supported field name expressions.
FlattenRecord	Flattens an array field by creating one record for each value.
IncludeFields	Deprecated use SelectFields
MoveFieldAfter	See FieldPath for supported field name expressions.
MoveFieldBefore	See FieldPath for supported field name expressions.
MoveFieldToIndex	A transformer used to move a named field to a new position.
Ngrams	Extracts each run/sequence of N words from the source field and stores them in a target field as an array.
RemoveDuplicateFields	Removes or collapses multiple fields with the same name in each record.
RemoveFields	See FieldPath for supported field name expressions.
RenameField	See FieldPath for supported field name expressions.
SelectFields	Select and arrange fields according to the supplied field names -- like an SQL SELECT statement.
SetBatchSequenceNumberField	Adds a sequence (auto increment) field that is incremented with the step value when the value(s) in the specified watch fields differs from the previous record.
SetCalculatedField	See FieldPath for supported field name expressions.
SetField	See FieldPath for supported field name expressions.
SetGroupSequenceNumberField	Adds a sequence (auto increment) field that is incremented with the step value as long as the value(s) in the specified watch fields remain the same as the previous record.
SetSequenceNumberField	Adds a sequence (auto increment) field with the specified increment (step).
SetUuidField	Adds a field with a randomly generated UUID as its value.
SplitArrayField	Flattens an array field by creating one record for each value.
SplitWords	Flattens an array field by creating one record for each value.
Transformer
TransformingReader	A proxy that applies transformations to records passing through.
TransformingWriter	A proxy that applies transformations to records passing through.

Enum Summary

Enum	Description
RemoveDuplicateFields.DuplicateFieldsPolicy

Package com.northconcepts.datapipeline.transform Description

Restructure data using a variety of built-in and customizable operations.