Lightweight Data Integration for Java
Add data processing functions to your applications, services, and batch jobs using Java or other JVM languages.
Configure pipelines and components in XML or JSON to change quickly without redeployments.
Why Use Data Pipeline
Build ETL in Java
Code your extract, transform, load pipelines using a high performance language that fits your team's skills, has a mature toolset, and is easy to understand and maintain.
Run Pipelines Locally
Develop and test pipelines locally on your desktop using your existing development and debugging tools.
Track changes in Git or other source control systems, code review ETL logic with your team, and plug pipeline development into your CI/CD process.
Enhance the engine to fit your unique needs. Plug in your own logic or modify existing behavior to your specific requirements.
Embedded or Standalone
Integrate pipelines into your web, mobile, desktop, and batch applications or run them as separate, standalone jobs.
Stream Real-Time or Batch
Set your pipelines to run on a schedule, when data is available, when an event or manual trigger occurs, or you can run them continuously to gain insight in real-time.
Trusted by Many