com.northconcepts.datapipeline.jdbc

Class JdbcMultiWriter

java.lang.Object

com.northconcepts.datapipeline.core.DataObject

com.northconcepts.datapipeline.core.Endpoint

com.northconcepts.datapipeline.core.DataEndpoint

com.northconcepts.datapipeline.core.DataWriter

com.northconcepts.datapipeline.core.ProxyWriter

com.northconcepts.datapipeline.jdbc.JdbcMultiWriter

public class JdbcMultiWriter
extends ProxyWriter

Writes records to a database table using 1 or more connections; each connection writing asynchronously using a separate thread.

Nested Class Summary

Nested classes/interfaces inherited from class com.northconcepts.datapipeline.core.DataEndpoint

DataEndpoint.State

Field Summary

Fields inherited from class com.northconcepts.datapipeline.core.DataEndpoint

lastRecord, PRODUCT, PRODUCT_VERSION, VENDOR, XML_INPUT_FACTORY_KEY

Fields inherited from class com.northconcepts.datapipeline.core.Endpoint

BUFFER_SIZE, captureElapsedTime, DEFAULT_READ_BUFFER_SIZE

Fields inherited from class com.northconcepts.datapipeline.core.DataObject

id, log, name, TIMESTAMP_FORMAT

Constructor Summary

Constructors

Constructor and Description
JdbcMultiWriter(DataSource dataSource, int connections, int maxQueuedRecordsPerConnection, String tableName)
JdbcMultiWriter(DataSource dataSource, int connections, int maxQueuedRecordsPerConnection, String tableName, IInsert insert)
JdbcMultiWriter(JdbcConnectionFactory factory, int connections, int maxQueuedRecordsPerConnection, String tableName)
JdbcMultiWriter(JdbcConnectionFactory factory, int connections, int maxQueuedRecordsPerConnection, String tableName, IInsert insert)

Method Summary

Modifier and Type	Method and Description
DataException	addExceptionProperties(DataException exception) Adds this endpoint's current state to a DataException.
protected JdbcWriter	createJdbcWriter(Connection connection, String tableName, IInsert insertStrategy)
AsyncWriter	getAsyncWriter(int index)
int	getBatchSize()
int	getConnections()
DataException	getException() Returns an exception thrown by one of the internal AsyncWriters if any.
List<DataException>	getExceptions() Returns all exceptions thrown by the internal AsyncWriters (the list will not be null, but may contain no elements).
IInsert	getInsert()
Integer	getJdbcType(Class<?> type) The Types constant (or a database specific value) assigned to the specified Java class type using setJdbcType(Class, int) or null if none was set.
JdbcWriter	getJdbcWriter(int index)
boolean	isCommitBatch() Indicates if this writer should call commit on each connection after every batch is sent, otherwise, commit is called after the final batch update (default is false).
boolean	isDebug() Indicates if the generated SQL should be logged (default false).
void	open() Makes this endpoint ready for reading or writing.
void	rethrowAsyncException() Re-throws an exception thrown by one of the internal AsyncWriters or returns silently if no exceptions were thrown.
JdbcMultiWriter	setBatchSize(int batchSize) Sets the number of records to chunk together in batch updates.
JdbcMultiWriter	setCommitBatch(boolean commitBatch) Indicates if this writer should call commit on each connection after every batch is sent, otherwise, commit is called after the final batch update (default is false).
JdbcMultiWriter	setDebug(boolean debug) Indicates if the generated SQL should be logged (default false).
JdbcMultiWriter	setJdbcType(Class<?> type, int jdbcType) Forces field values of the specified Java class type to be sent to the database using PreparedStatement.setObject(parameterIndex, fieldValue, jdbcType) (instead of the appropriate PreparedStatement.setXXX() method for its field's type).
JdbcMultiWriter	setJdbcType(String fieldName, int jdbcType) The given Java object will be converted to the given targetSqlType before being sent to the database.
protected void	writeImpl(Record record) Overridden by subclasses to write the specified record to this DataWriter.

Methods inherited from class com.northconcepts.datapipeline.core.ProxyWriter

available, close, getNestedWriter, interceptRecord, map, map, setNestedDataWriter, setNestedDataWriter

Methods inherited from class com.northconcepts.datapipeline.core.DataWriter

getNestedEndpoint, getRootEndpoint, getRootWriter, write

Methods inherited from class com.northconcepts.datapipeline.core.DataEndpoint

decrementRecordCount, enableJmx, getLastRecord, getRecordCount, getRecordCountAsBigInteger, getRecordCountAsString, incrementRecordCount, isRecordCountBigInteger, resetRecordCount, toString

Methods inherited from class com.northconcepts.datapipeline.core.Endpoint

addElapsedtime, assertClosed, assertNotOpened, assertOpened, finalize, getClosedOn, getDescription, getElapsedTime, getElapsedTimeAsString, getOpenedOn, getOpenElapsedTime, getOpenElapsedTimeAsString, getSelfTime, getSelfTimeAsString, getState, isCaptureElapsedTime, isClosed, isOpen, setCaptureElapsedTime, setDescription

Methods inherited from class com.northconcepts.datapipeline.core.DataObject

exception, exception, exception, getId, getName, resetID

Methods inherited from class java.lang.Object

clone, equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

JdbcMultiWriter

public JdbcMultiWriter(DataSource dataSource,
                       int connections,
                       int maxQueuedRecordsPerConnection,
                       String tableName,
                       IInsert insert)

JdbcMultiWriter

public JdbcMultiWriter(DataSource dataSource,
                       int connections,
                       int maxQueuedRecordsPerConnection,
                       String tableName)

JdbcMultiWriter

public JdbcMultiWriter(JdbcConnectionFactory factory,
                       int connections,
                       int maxQueuedRecordsPerConnection,
                       String tableName,
                       IInsert insert)
                throws DataException

Throws:

DataException

JdbcMultiWriter

public JdbcMultiWriter(JdbcConnectionFactory factory,
                       int connections,
                       int maxQueuedRecordsPerConnection,
                       String tableName)
                throws DataException

Throws:

DataException

Method Detail

getConnections

public int getConnections()

getJdbcWriter

public JdbcWriter getJdbcWriter(int index)

getAsyncWriter

public AsyncWriter getAsyncWriter(int index)

getBatchSize

public int getBatchSize()

setBatchSize

public JdbcMultiWriter setBatchSize(int batchSize)

Sets the number of records to chunk together in batch updates. Updates are not batched if this value is 1 or less. JdbcWriter defaults to non batching updates.

isCommitBatch

public boolean isCommitBatch()

Indicates if this writer should call commit on each connection after every batch is sent, otherwise, commit is called after the final batch update (default is false).

setCommitBatch

public JdbcMultiWriter setCommitBatch(boolean commitBatch)

Indicates if this writer should call commit on each connection after every batch is sent, otherwise, commit is called after the final batch update (default is false).

getInsert

public IInsert getInsert()

setJdbcType

public JdbcMultiWriter setJdbcType(String fieldName,
                                   int jdbcType)

The given Java object will be converted to the given targetSqlType before being sent to the database.

Note that this method may be used to pass database-specific abstract data types.

Parameters:

fieldName -

jdbcType - the object containing the JDBC Type parameter value

setJdbcType

public JdbcMultiWriter setJdbcType(Class<?> type,
                                   int jdbcType)

Forces field values of the specified Java class type to be sent to the database using PreparedStatement.setObject(parameterIndex, fieldValue, jdbcType) (instead of the appropriate PreparedStatement.setXXX() method for its field's type). This method may be used to pass database-specific abstract data types.

Parameters:

type - the Java class type to override.

jdbcType - one of the Types constants or a database specific value.

getJdbcType

public Integer getJdbcType(Class<?> type)

The Types constant (or a database specific value) assigned to the specified Java class type using setJdbcType(Class, int) or null if none was set.

Returns:

one of the Types constants or a database specific value.

isDebug

public boolean isDebug()

Indicates if the generated SQL should be logged (default false).

setDebug

public JdbcMultiWriter setDebug(boolean debug)

Indicates if the generated SQL should be logged (default false).

open

public void open()
          throws DataException

Description copied from class: DataEndpoint

Makes this endpoint ready for reading or writing.

Overrides:

open in class ProxyWriter

Throws:

DataException

createJdbcWriter

protected JdbcWriter createJdbcWriter(Connection connection,
                                      String tableName,
                                      IInsert insertStrategy)

writeImpl

protected void writeImpl(Record record)
                  throws Throwable

Description copied from class: DataWriter

Overridden by subclasses to write the specified record to this DataWriter.

Overrides:

writeImpl in class ProxyWriter

Throws:

Throwable

getException

public DataException getException()

Returns an exception thrown by one of the internal AsyncWriters if any.

getExceptions

public List<DataException> getExceptions()

Returns all exceptions thrown by the internal AsyncWriters (the list will not be null, but may contain no elements).

rethrowAsyncException

public void rethrowAsyncException()
                           throws DataException

Re-throws an exception thrown by one of the internal AsyncWriters or returns silently if no exceptions were thrown.

Throws:

DataException

addExceptionProperties

public DataException addExceptionProperties(DataException exception)

Description copied from class: Endpoint

Adds this endpoint's current state to a DataException. Since this method is called whenever an exception is thrown, subclasses should override it to add their specific information.

Overrides:

addExceptionProperties in class ProxyWriter