All posts by The DataPipeline Team

About The DataPipeline Team

We make Data Pipeline — a lightweight ETL framework for Java. Use it to filter, transform, and aggregate data on-the-fly in your web, mobile, and desktop apps. Learn more about it at northconcepts.com.

10 Java Data Integration Libraries for 2021

10 Java Data Integration Libraries for 2021

Updated: September 2021

With data being produced from many sources in a variety of formats it’s imperative for businesses to have a sane way to gain useful insight. Data integration is the process of transforming data from one or more sources into a form that can be loaded into a target system or used for analysis and business intelligence.

Continue reading

25 Machine Learning and Artificial Intelligence Conferences

52 Machine Learning and Artificial Intelligence Conferences in 2017 and 2018

Machine learning and artificial intelligence in general are two of today’s hottest skills.  AI and ML conferences provide a place for you to improve your skills, discuss trends, and exchange ideas with other data scientists, developers, and entrepreneurs.  Whether you’re new to the world of machine learning, trying to stay up-to-date, or just looking to network, there’s a conference happening for you.  This article lists over 50 conferences taking place around the world for you to consider attending.

Continue reading

18 ETL Tools for Java Developers

ETL Tools for Java Developers

Updated: July 2021

ETL is a process for performing data extraction, transformation and loading. The process extracts data from a variety of sources and formats, transforms it into a standard structure, and loads it into a database, file, web service, or other system for analysis, visualization, machine learning, etc.

ETL tools come in a wide variety of shapes.  Some run on your desktop or on-premise servers, while others run as SaaS in the cloud.  Some are code-based, built on standard programming languages that many developers already know.  Others are built on a custom DSL (domain specific language) in an attempt to be more intentional and require less code.  Others still are completely graphical, only offering programming interfaces for complex transformations.

What follows is a list of ETL tools for developers already familiar with Java and the JVM (Java Virtual Machine) to clean, validate, filter, and prepare your data for use.

Continue reading

24 Conferences Data Scientists Should Attend in 2021 and 2022

20 Conferences Data Scientists Should Attend

Updated: August 2021

Being a data scientist means dedication to continuous learning.  One great way to keep learning, improve your network, and get exposed to different views is to attend conferences.

Since 2020 organizers have been opting for online virtual conferences instead of in person conferences. In 2021 the same trend continues although some conferences are also being scheduled to be attended in person in the second half of the year.

Data science conferences are one of the best ways to learn, develop new skills, meet and discuss ideas and discover how others are applying AI, analytics and machine learning in their work.

Here are several conferences for data scientist you should consider attending.

Continue reading