All posts by The DataPipeline Team

About The DataPipeline Team

We make Data Pipeline — a lightweight ETL framework for Java. Use it to filter, transform, and aggregate data on-the-fly in your web, mobile, and desktop apps. Learn more about it at northconcepts.com.

How to Upsert Data in Relational Databases (2023)

UPSERT
Relational databases play a crucial role in storing, managing, and analyzing data. One common challenge developers face is inserting data where a matching record might already exist. The “upsert” operation, short for “update or insert,” provides a solution to this problem. While not all database management systems (DBMSs) have a built-in “upsert” command, the concept can still be achieved using their built-in features. In this blog, we’ll explore the upsert operation, how it works, and how to perform upserts in different databases.

Continue reading

11 FinTech Conferences You Should Attend in 2023 and 2024

 

June 2022

The internet’s globalization has been one of the main drivers of enabling FinTech to grow exponentially. A term that once only referred to banks and financial institutions’ back-office activities nowadays describes a broad assortment of solutions that incorporate E-commerce, intertwining personal and commercial transactions. The rapid technological advances happening in this industry are allowing companies and entrepreneurs to get together to discuss regulations, new advances, and potential investment opportunities.

We’ve gathered this list of fintech conferences you should consider attending in-person or virtually.

Continue reading

11 Java Data Integration Libraries (2023)

11 Java Data Integration Libraries for 2022

Updated: May 2023

With data being produced from many sources in a variety of formats businesses must have a sane way to gain useful insight. Data integration is the process of transforming data from one or more sources into a form that can be loaded into a target system or used for analysis and business intelligence.

Data integration libraries take some programming burden from the shoulders of developers by abstracting data processing and transformation tasks and allowing the developer to focus on tasks that are directly related to the application logic.

Continue reading