com.northconcepts.datapipeline.foundations.tools

Class GenerateEntityFromDataset

java.lang.Object

com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset

public class GenerateEntityFromDataset
extends Object

A utility class for generating EntityDef code from a DataReader.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	GenerateEntityFromDataset.FieldTypeSelectionMode

Constructor Summary

Constructors

Constructor and Description
GenerateEntityFromDataset()

Method Summary

Modifier and Type	Method and Description
EntityDef	createEntity(Dataset dataset)
FieldDef	createFieldDef(Column column)
EntityDef	generateEntity(DataReader reader)
int	getColumnStatsReaderThreads() Indicates how many threads should be used to read and analyze the data in each column (defaults to 2).
String	getEntityName()
GenerateEntityFromDataset.FieldTypeSelectionMode	getFieldTypeSelectionMode() Gets the field type selection mode.
long	getMaxWaitTimeMillis()
long	getMinRecords()
boolean	isUseInferredType() Deprecated. Use getFieldTypeSelectionMode() instead.
GenerateEntityFromDataset	setColumnStatsReaderThreads(int columnStatsReaderThreads) Indicates how many threads should be used to read and analyze the data in each column (defaults to 2).
GenerateEntityFromDataset	setEntityName(String entityName)
GenerateEntityFromDataset	setFieldTypeSelectionMode(GenerateEntityFromDataset.FieldTypeSelectionMode fieldTypeSelectionMode) Indicates how the field type should be selected for each column.
GenerateEntityFromDataset	setMaxWaitTimeMillis(long maxWaitTimeMillis)
GenerateEntityFromDataset	setMinRecords(long minRecords)
GenerateEntityFromDataset	setUseInferredType(boolean useInferredType) Deprecated. Use setFieldTypeSelectionMode(FieldTypeSelectionMode) instead.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GenerateEntityFromDataset

public GenerateEntityFromDataset()

Method Detail

generateEntity

public EntityDef generateEntity(DataReader reader)

createEntity

public EntityDef createEntity(Dataset dataset)

createFieldDef

public FieldDef createFieldDef(Column column)

getMinRecords

public long getMinRecords()

setMinRecords

public GenerateEntityFromDataset setMinRecords(long minRecords)

getMaxWaitTimeMillis

public long getMaxWaitTimeMillis()

setMaxWaitTimeMillis

public GenerateEntityFromDataset setMaxWaitTimeMillis(long maxWaitTimeMillis)

getEntityName

public String getEntityName()

setEntityName

public GenerateEntityFromDataset setEntityName(String entityName)

getColumnStatsReaderThreads

public int getColumnStatsReaderThreads()

Indicates how many threads should be used to read and analyze the data in each column (defaults to 2).

setColumnStatsReaderThreads

public GenerateEntityFromDataset setColumnStatsReaderThreads(int columnStatsReaderThreads)

Indicates how many threads should be used to read and analyze the data in each column (defaults to 2).

isUseInferredType

@Deprecated
public boolean isUseInferredType()

Deprecated. Use getFieldTypeSelectionMode() instead.

Indicates if the most frequently inferred type should be used as the field type instead of the best fit of the actual types (defaults to true).

* For example: if a column contains strings which appears to be dates the inferred field type for that column will be date and the best fit would be string.

setUseInferredType

@Deprecated
public GenerateEntityFromDataset setUseInferredType(boolean useInferredType)

Deprecated. Use setFieldTypeSelectionMode(FieldTypeSelectionMode) instead.

Indicates if the most frequently inferred type should be used as the field type instead of the best fit of the actual types (defaults to true).

* For example: if a column contains strings which appears to be dates the inferred field type for that column will be date and the best fit would be string.

getFieldTypeSelectionMode

public GenerateEntityFromDataset.FieldTypeSelectionMode getFieldTypeSelectionMode()

Gets the field type selection mode.

The default is GenerateEntityFromDataset.FieldTypeSelectionMode.INFERRED.

setFieldTypeSelectionMode

public GenerateEntityFromDataset setFieldTypeSelectionMode(GenerateEntityFromDataset.FieldTypeSelectionMode fieldTypeSelectionMode)

Indicates how the field type should be selected for each column.

The default is GenerateEntityFromDataset.FieldTypeSelectionMode.INFERRED.