Integrations

DataPipeline comes with several add-ons for you to integrate with a variety of systems.

Name Description
Amazon S3
Amazon S3 file system
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-filesystems-amazons3</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-filesystems-amazons3:8.0.0'
Avro
Apache Avro files
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-avro</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-avro:8.0.0'
Bloomberg
Bloomberg message reader
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-bloomberg</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-bloomberg:8.0.0'
Email
Email reader
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-email</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-email:8.0.0'
Google
Google analytics, calendar, contacts, Gmail
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-google</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-google:8.0.0'
Instagram
Instagram readers
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-instagram</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-instagram:8.0.0'
Jira
Jira readers
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-jira</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-jira:8.0.0'
JMS
Java Message Service reader/writer
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-jms</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-jms:8.0.0'
Kafka
Kafka
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-kafka</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-kafka:8.0.0'
Mailchimp
Mailchimp
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-mailchimp</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-mailchimp:8.0.0'
MongoDB
MongoDB
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-mongodb</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-mongodb:8.0.0'
Orc
Optimized Row Columnar (ORC) reader/writer
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-orc</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-orc:8.0.0'
Parquet
Apache Parquet
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-parquet</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-parquet:8.0.0'
PDF
PDF
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-pdf</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-pdf:8.0.0'
RTF
MS Word
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-rtf</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-rtf:8.0.0'
Template
Write text for websites, email, and other text formats using FreeMarker templates
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-template</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-template:8.0.0'
Trello
Trello
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-trello</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-trello:8.0.0'
Twitter
Twitter V1 API
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-twitter</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-twitter:8.0.0'
Twitter2
Twitter V2 API
Maven
<dependencies>
  <dependency>
    <groupId>com.northconcepts</groupId>
    <artifactId>northconcepts-datapipeline-integrations-twitter2</artifactId>
    <version>8.0.0</version>
    <scope>compile</scope>
  </dependency>
</dependencies>
Gradle
compile 'com.northconcepts:northconcepts-datapipeline-integrations-twitter2:8.0.0'
Mobile Analytics