All posts by The DataPipeline Team

About The DataPipeline Team

We make Data Pipeline — a lightweight ETL framework for Java. Use it to filter, transform, and aggregate data on-the-fly in your web, mobile, and desktop apps. Learn more about it at northconcepts.com.

Data Pipeline 2.1 Released

We are happy to announce that Data Pipeline 2.1 is now released. We have added a great deal of enhancements below:

  • support for Excel 2003 XLS files
  • support for Excel XLSX (XML format) files
  • added FixedWidthReader.setLastFieldConsumesRemaining(boolean lastFieldConsumesRemaining) functionality
  • added ExcelReader.setUseSheetColumnCount(boolean useSheetColumnCount) functionality
  • added more string utils to BasicFieldTransformer
  • added ConditionalTransformer class
  • added TransformingReader.add(Filter filter, Transformer ... transformer) functionality
  • setField now has type-specific constructors
  • added Eclipse project files
  • added Ant build project
  • bug-fix: whitespace (like tab) can now be used as the field separator in CSVReader
  • bug-fix: handle null variable names in expressions