com.northconcepts.datapipeline.foundations.tools

Class GenerateEntityFromDataset

java.lang.Object

com.northconcepts.datapipeline.foundations.tools.GenerateEntityFromDataset

public class GenerateEntityFromDataset
extends Object

A utility class for generating EntityDef code from a DataReader.

Constructor Summary

Constructors

Constructor and Description
GenerateEntityFromDataset()

Method Summary

Modifier and Type	Method and Description
EntityDef	createEntity(Dataset dataset)
FieldDef	createFieldDef(Column column)
EntityDef	generateEntity(DataReader reader)
int	getColumnStatsReaderThreads() Indicates how many threads should be used to read and analyze the data in each column (defaults to 2).
String	getEntityName()
long	getMaxWaitTimeMillis()
long	getMinRecords()
boolean	isUseInferredType() Indicates if the most frequently inferred type should be used as the field type instead of the best fit of the actual types (defaults to true).
GenerateEntityFromDataset	setColumnStatsReaderThreads(int columnStatsReaderThreads) Indicates how many threads should be used to read and analyze the data in each column (defaults to 2).
GenerateEntityFromDataset	setEntityName(String entityName)
GenerateEntityFromDataset	setMaxWaitTimeMillis(long maxWaitTimeMillis)
GenerateEntityFromDataset	setMinRecords(long minRecords)
GenerateEntityFromDataset	setUseInferredType(boolean useInferredType) Indicates if the most frequently inferred type should be used as the field type instead of the best fit of the actual types (defaults to true).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GenerateEntityFromDataset

public GenerateEntityFromDataset()

Method Detail

generateEntity

public EntityDef generateEntity(DataReader reader)

createEntity

public EntityDef createEntity(Dataset dataset)

createFieldDef

public FieldDef createFieldDef(Column column)

getMinRecords

public long getMinRecords()

setMinRecords

public GenerateEntityFromDataset setMinRecords(long minRecords)

getMaxWaitTimeMillis

public long getMaxWaitTimeMillis()

setMaxWaitTimeMillis

public GenerateEntityFromDataset setMaxWaitTimeMillis(long maxWaitTimeMillis)

getEntityName

public String getEntityName()

setEntityName

public GenerateEntityFromDataset setEntityName(String entityName)

getColumnStatsReaderThreads

public int getColumnStatsReaderThreads()

Indicates how many threads should be used to read and analyze the data in each column (defaults to 2).

setColumnStatsReaderThreads

public GenerateEntityFromDataset setColumnStatsReaderThreads(int columnStatsReaderThreads)

Indicates how many threads should be used to read and analyze the data in each column (defaults to 2).

isUseInferredType

public boolean isUseInferredType()

Indicates if the most frequently inferred type should be used as the field type instead of the best fit of the actual types (defaults to true).

* For example: if a column contains strings which appears to be dates the inferred field type for that column will be date and the best fit would be string.

setUseInferredType

public GenerateEntityFromDataset setUseInferredType(boolean useInferredType)

Indicates if the most frequently inferred type should be used as the field type instead of the best fit of the actual types (defaults to true).

* For example: if a column contains strings which appears to be dates the inferred field type for that column will be date and the best fit would be string.