Integrations
DataPipeline comes with several add-ons for you to integrate with a variety of systems.
| Name | Description |
|---|---|
| Amazon S3 | Amazon S3 file system
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-filesystems-amazons3</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-filesystems-amazons3:10.0.0' |
| Avro | Apache Avro files
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-avro</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-avro:10.0.0' |
| Bloomberg | Bloomberg message reader
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-bloomberg</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-bloomberg:10.0.0' |
Email reader
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-email</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-email:10.0.0' |
|
Google analytics, calendar, contacts, Gmail
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-google</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-google:10.0.0' |
|
Instagram readers
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-instagram</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-instagram:10.0.0' |
|
| Jira | Jira readers
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-jira</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-jira:10.0.0' |
| JMS | Java Message Service reader/writer
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-jms</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-jms:10.0.0' |
| Kafka | Kafka
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-kafka</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-kafka:10.0.0' |
| Mailchimp | Mailchimp
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-mailchimp</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-mailchimp:10.0.0' |
| MongoDB | MongoDB
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-mongodb</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-mongodb:10.0.0' |
| Orc | Optimized Row Columnar (ORC) reader/writer
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-orc</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-orc:10.0.0' |
| Orc-s3 | Optimized Row Columnar (ORC) reader/writer
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-orc-s3</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-orc-s3:10.0.0' |
| Parquet | Apache Parquet
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-parquet</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-parquet:10.0.0' |
| Parquet-s3 | Apache Parquet
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-parquet-s3</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-parquet-s3:10.0.0' |
PDF
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-pdf</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-pdf:10.0.0' |
|
| RTF | MS Word
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-rtf</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-rtf:10.0.0' |
| Template | Write text for websites, email, and other text formats using FreeMarker templates
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-template</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-template:10.0.0' |
| Trello | Trello
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-trello</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-trello:10.0.0' |
Twitter V1 API
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-twitter</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-twitter:10.0.0' |
|
| Twitter2 | Twitter V2 API
Maven
<dependencies>
<dependency>
<groupId>com.northconcepts</groupId>
<artifactId>northconcepts-datapipeline-integrations-twitter2</artifactId>
<version>10.0.0</version>
<scope>compile</scope>
</dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-twitter2:10.0.0' |
