All Examples

  1. Add Array Fields to Entities Schema DataPipeline Foundations
  2. Add Attributes and Tags to Schemas Schema DataPipeline Foundations
  3. Add Calculated Fields to a Decision Table Calculated Field DataPipeline Foundations Decision Table
  4. Add Calculated Fields to a Decision Tree Calculated Field Decision Tree DataPipeline Foundations
  5. Add Indexes to Entities Schema DataPipeline Foundations
  6. Add Jira Comments Jira
  7. Add Nested Entities as Fields Schema DataPipeline Foundations
  8. Add Non-Persistent Data to Records and Fields In-Memory Out-of-band data
  9. Add Primary Keys to Entities Schema DataPipeline Foundations
  10. Add Relationship Between Entities Schema DataPipeline Foundations
  11. Add Values To An Array Using GroupByReader Version 10.1.0 Aggregate
  12. Add a Decision Table to a Pipeline DataPipeline Foundations Decision Table
  13. Add a Decision Tree to a Pipeline Decision Tree DataPipeline Foundations
  14. Add a Sequence Number Column Transform Assign Field Calculated Field
  15. Add a Sequence Number Column for Repeat Values Transform Assign Field Calculated Field
  16. Add a Sequence Number Column when Values Change Transform Assign Field Calculated Field
  17. Add my own Functions Expression Language Assign Field Customize Functions
  18. Automatically Map Data And Exclude Fields Declaratively Declarative Data Mapping DataPipeline Foundations Version 8.1.0 XML
  19. Blacklist and Whitelist Functions in DP Expression Language Expression Language Customize Functions
  20. Buffer Records by Time Period or Count Streaming data
  21. Build DataMappingPipeline Declaratively from Json Declarative JSON Data Mapping DataPipeline Foundations
  22. Build DataMappingPipeline Declaratively from XML Declarative Data Mapping DataPipeline Foundations XML
  23. Build DataMappingPipeline Programmatically Data Mapping DataPipeline Foundations
  24. Cache Lookup Values Transform Lookup JDBC Cache
  25. Capture Data Not Joined in a Lookup Lookup
  26. Capture Data that Failed Data Mapping Validation Data Mapping DataPipeline Foundations
  27. Compare Records Using Diff Diff DataPipeline Foundations
  28. Compare Schemas Using Diff Diff Schema DataPipeline Foundations
  29. Compile and Run a Job Fixed Width CSV Job management
  30. Compress a Parquet File Parquet
  31. Compress an Orc File ORC
  32. Conditionally Map Data Field from Source to Target Data Mapping DataPipeline Foundations
  33. Conditionally Transform Data Transform Assign Field Filter JSON Simple
  34. Conditionally Write to Multiple Files Transform Multi-writer Threading
  35. Conditionally map Data from Source to Target Data Mapping DataPipeline Foundations
  36. Configure AmazonS3FileSystem Using Client Amazon S3
  37. Configure the Insert Strategy used in JdbcMultiWriter JDBC JDBC Multi-Writer Version 8.1.0 JDBC Insert Strategy
  38. Continue After an Error Exceptions
  39. Convert CSV to Inferred Data Types Pipeline Dataset DataPipeline Foundations Analyze Data
  40. Convert JSON to CSV CSV JSON Conversion Simple
  41. Convert JSON to Parquet JSON Conversion Parquet
  42. Convert Unstructured JSON to Parquet JSON Conversion Parquet
  43. Convert a Single Source DataReader into Many JSON Conversion Simple Avro Threading XML
  44. Copy a Field Transform Copy Field
  45. Create Custom Pipeline Action Pipeline Customize DataPipeline Foundations
  46. Create Custom Pipeline Input Pipeline DataPipeline Foundations
  47. Create Custom Pipeline Output Pipeline DataPipeline Foundations
  48. Create Hyperlink In Excel Version 10.1.0 MS Excel
  49. Create Jira Issue Jira
  50. Create a JsonPipelineInput Declaratively From Xml Declarative Pipeline DataPipeline Foundations XML
  51. Create a JsonPipelineInput Declaratively from JSON Declarative JSON Pipeline DataPipeline Foundations
  52. Create a JsonPipelineInput Programmatically Pipeline DataPipeline Foundations
  53. Create an XmlPipelineInput Declaratively From Xml Declarative Pipeline DataPipeline Foundations XML
  54. Create an XmlPipelineInput Declaratively from Json Declarative JSON Pipeline DataPipeline Foundations
  55. Create an XmlPipelineInput Programmatically Pipeline DataPipeline Foundations
  56. Debug my Code Debug
  57. Declaratively Map Data Declarative Data Mapping DataPipeline Foundations
  58. Declaratively Map Data Using Positions Declarative Data Mapping DataPipeline Foundations
  59. Declaratively Map Data with Source and Target Schema Declarative Schema Data Mapping DataPipeline Foundations
  60. Declaratively Map XML Files Declarative Data Mapping DataPipeline Foundations XML
  61. Declaratively Set Default Values for Missing Data Declarative Schema DataPipeline Foundations
  62. Declaratively Transform Records using Schema Declarative Schema DataPipeline Foundations
  63. Delete Jira Issue Jira
  64. Detect Date and Time Patterns in Strings DataPipeline Foundations Analyze Data
  65. Detect Numbers in Strings DataPipeline Foundations Analyze Data
  66. Detect Primary Keys In a Dataset Schema Dataset DataPipeline Foundations
  67. Evaluate a Decision Table DataPipeline Foundations Decision Table
  68. Evaluate a Decision Table with Lookup Lookup DataPipeline Foundations Decision Table
  69. Evaluate a Decision Tree Decision Tree DataPipeline Foundations
  70. Evaluate a Decision Tree with Lookup Lookup Decision Tree DataPipeline Foundations
  71. Execute an Action in a Decision Table DataPipeline Foundations Decision Table
  72. Execute an Action in a Decision Tree Decision Tree DataPipeline Foundations
  73. Extract Bigrams, Trigrams, and Ngrams Transform Analyze Data XML
  74. Filter Columns with All Null Values Pipeline DataPipeline Foundations
  75. Filter Json Records in a Pipeline Filter Pipeline DataPipeline Foundations
  76. Filter Json Records in a Pipeline Declaratively from Json Declarative Filter JSON Pipeline DataPipeline Foundations
  77. Filter Json Records in a Pipeline Declaratively from Xml Declarative Filter Pipeline DataPipeline Foundations XML
  78. Filter Records Expression Language Transform Filter Rules
  79. Filter Twitter in Real Time Filter Twitter Streaming data
  80. Filter Twitter in Real Time Using v2 API Twitter2 Filter Streaming data
  81. Find The Minimum Maximum Average Sum Count Transform Stats CSV Aggregate Conversion STDOUT
  82. Freeze Panes in Excel Version 10.1.0 MS Excel
  83. Generate Java Beans from a Database JDBC Code Generation DataPipeline Foundations
  84. Generate MySQL DDL Programmatically Code Generation MySQL
  85. Generate MySQL INSERT Statements Programmatically Code Generation MySQL Database
  86. Generate MySql DDL From CSV CSV Code Generation Schema MySQL DataPipeline Foundations
  87. Generate MySql INSERT Statements From CSV CSV Code Generation MySQL Database
  88. Generate Parquet Schema By Analyzing All Records CSV Parquet
  89. Generate Parquet Schema By Analyzing Initial Records CSV Parquet
  90. Generate PostgreSQL DDL From Excel Code Generation Schema MS Excel PostgreSQL DataPipeline Foundations
  91. Generate PostgreSQL DDL Programmatically Code Generation PostgreSQL
  92. Generate PostgreSql DDL From CSV CSV Code Generation Schema PostgreSQL DataPipeline Foundations
  93. Generate SQL Queries Programmatically JDBC MySQL Microsoft SQL Server PostgreSQL
  94. Generate Schema From JDBC JDBC Schema DataPipeline Foundations
  95. Generate Schema Java Code Code Generation Schema DataPipeline Foundations
  96. Generate Union and Sub-Select SQL Queries Programmatically JDBC MySQL Microsoft SQL Server PostgreSQL
  97. Generate a PDF Simple PDF XML
  98. Generate a Word Document JSON Simple RTF
  99. Generate toRecord And fromRecord Using The GenerateRecordSerializers Tool Code Generation Serialization
  100. Get a Query Param from a URL Transform Assign Field
  101. Group Records by TimePeriod or Count Aggregate
  102. Handle Exceptions Exceptions
  103. Handle Filtered Records Transform Assign Field Calculated Field Fixed Width Filter
  104. Handle Transforming Reader Failures Exceptions Transform Filter Rename Field XML
  105. Handle Transforming Writer Failures Exceptions Transform Calculated Field Fixed Width Filter Conversion
  106. Handle Validation Failures Filter Validate XML
  107. How To Read An XML File With A Byte Order Mark (BOM) XML
  108. How to Convert Tabular Data to Trees Using Aggregation Transform CSV Sort
  109. Infer Date Time from a CSV File Pipeline Dataset DataPipeline Foundations Analyze Data
  110. Insert Multiple Rows to Oracle Using Insert All JDBC Version 8.1.0 Oracle Database JDBC Insert Strategy
  111. Insert Multiple Rows to Oracle Using Select Union JDBC Version 8.1.0 Oracle Database JDBC Insert Strategy
  112. Join CSV Files CSV
  113. Load Snapshot of Dataset Pipeline DataPipeline Foundations
  114. Log Diagnostic Information Debug
  115. Log Job Progress Job management STDOUT
  116. Look Up Jira Transition IDs Jira
  117. Lookup Data in a Database Transform Lookup JDBC
  118. Lookup Data in any Data Reader Transform Lookup
  119. Lookup Using RecordList Transform Lookup Version 10.1.0
  120. Lookup in a Flat File Transform Lookup
  121. Manipulate Fields Transform Conversion In-Memory
  122. Map Data Using Automatic Mapping And Exclude Fields CSV Data Mapping DataPipeline Foundations Version 8.1.0
  123. Map Data from Source to Target Data Mapping DataPipeline Foundations
  124. Map Data from Source to Target in a Pipeline Data Mapping DataPipeline Foundations
  125. Map Data from Source to Target in a Pipeline with Validation Data Mapping DataPipeline Foundations
  126. Map Data from Source to Target with Lookup Data Mapping DataPipeline Foundations
  127. Map Data with Rule Based Validation Data Mapping DataPipeline Foundations
  128. Map Data with Schema Based Validation Data Mapping DataPipeline Foundations
  129. Map Records in Pipeline using Schema Pipeline Schema DataPipeline Foundations
  130. Map Records using Schema Schema DataPipeline Foundations
  131. Measure Data Lineage Performance Data Lineage Performance Debug
  132. Measure Data being Read and Written Meter
  133. Measure Performance of Reader and Writer Performance
  134. My Data Reader Customize
  135. My Data Writer Customize
  136. My Filter Filter Customize
  137. My Lookup Lookup Customize
  138. My Proxy Reader Transform Customize
  139. My Proxy Writer Transform Customize
  140. My Transformer Transform Customize
  141. Obtain Statistics Meter Stats MS Excel
  142. Open and Close Several Data Readers and Data Writers at Once JDBC
  143. Pipe a Writer to a Reader Push Pipe Threading
  144. Profile Performance Performance
  145. Read A CSV File using Multithreading CSV Threading
  146. Read An ORC file from Amazon S3 Amazon S3 ORC
  147. Read An ORC file from Amazon S3 using a Temporary File Amazon S3 ORC
  148. Read Big Decimal And Big Integer In JSON Version 10.1.0 JSON
  149. Read Big Decimal In JSON JSON
  150. Read BigDecimal and BigInteger from an Excel file MS Excel
  151. Read Concatenated JSON JSON
  152. Read Emails Email STDOUT
  153. Read Excel Formatting And Styles Version 10.1.0 MS Excel
  154. Read From A Collection Java Streams Version 10.1.0 In-Memory Lambda
  155. Read Google Analytics Social Interactions Google
  156. Read Google Analytics goal conversions Google
  157. Read Google Analytics views Google
  158. Read Google Calendar Google
  159. Read Google Contacts Google
  160. Read Google Gmail Messages Google Email
  161. Read Hyperlink From Excel Version 10.1.0 MS Excel
  162. Read JSON Records From File JSON
  163. Read Jira Comments Jira
  164. Read Jira issues Jira
  165. Read Json Lines JSON JSON Lines
  166. Read Json Lines As Record JSON JSON Lines
  167. Read MailChimp Contacts MailChimp
  168. Read MailChimp Contacts Using the RESTful Client API MailChimp
  169. Read Parquet from Amazon S3 Amazon S3 Parquet
  170. Read Parquet from Amazon S3 using a Temporary File Amazon S3 Parquet
  171. Read Selected Fields from a Parquet File Parquet
  172. Read Selected Fields from an Orc File ORC
  173. Read Shopify Inventory Items E-commerce Shopify
  174. Read Shopify Inventory Levels E-commerce Shopify
  175. Read Shopify Orders E-commerce Shopify
  176. Read Shopify Store Locations E-commerce Shopify
  177. Read Trello Cards Trello
  178. Read Tweets from a User's Timeline Using v2 API Twitter2 Twitter STDOUT
  179. Read UUID from PostgreSQL JDBC UUID PostgreSQL Job management
  180. Read XML Records From File XML
  181. Read a Bloomberg Message File Bloomberg
  182. Read a CSV File CSV
  183. Read a Fixed-width File / Fixed-length Record File Fixed Width
  184. Read a JSON Stream JSON Conversion XPath STDOUT
  185. Read a PDF File PDF
  186. Read a Parquet File Parquet
  187. Read a Patient File CSV Simple
  188. Read a Set of Files CSV Batch
  189. Read a Simple JSON File JSON Simple
  190. Read a Simple XML File Simple XML
  191. Read a Tab Separated Values File CSV
  192. Read a Web Server Log STDOUT Web Server Logs
  193. Read a binary Excel file (.xlsb) MS Excel 9.2
  194. Read an Avro File Avro
  195. Read an Orc File ORC
  196. Read an XML File XPath XML
  197. Read an XML File (2) Transform JDBC Conversion XPath XML
  198. Read and Transform Data in Parallel Transform Threading
  199. Read and Write CSV as String CSV
  200. Read and Write Kafka Events Kafka
  201. Read and Write Unsigned Numbers in Parquet Files Version 8.1.0 Parquet
  202. Read and Write to an EventBus EventBus Threading
  203. Read from Amazon S3 Amazon S3
  204. Read from CSV And Writer to Excel Pipeline DataPipeline Foundations
  205. Read from Gmail Email STDOUT
  206. Read from JMS Queue In-Memory JMS
  207. Read from JMS Topic In-Memory JMS
  208. Read from Java beans Java Beans XPath
  209. Read from Memory CSV In-Memory
  210. Read from MongoDB CSV MongoDB STDOUT
  211. Read from a Database JDBC
  212. Read from an Excel File MS Excel
  213. Read from database using OPINIONATED type mapping JDBC
  214. Read from database using ORIGINAL type mapping JDBC
  215. Read from database using STRICT type mapping JDBC
  216. Read using TimedReader Performance
  217. Remove Duplicates Transform Remove Duplicates (Dedup)
  218. Remove Fields Transform Exclude Fields
  219. Remove/Retain Duplicate Fields Transform Remove Duplicates (Dedup)
  220. Rename Duplicate Fields Transform Rename Field
  221. Rename Fields Containing Spaces and Symbols Transform Rename Field
  222. Rename Fields Quickly in Flat And Tabular Data Transform Tabular Data Flat Data Performance Rename Field Fast Version 8.1.0
  223. Rename a Field Transform Rename Field
  224. Save and Load DataMapping to XML Data Mapping DataPipeline Foundations XML
  225. Save and Load DecisionTable to XML DataPipeline Foundations Decision Table XML
  226. Save and Load DecisionTree to XML Decision Tree DataPipeline Foundations XML
  227. Save and Load Diff to Record Diff Dataset DataPipeline Foundations
  228. Save and Restore Pipeline from JSON Pipeline DataPipeline Foundations
  229. Search Followers of a Twitter User Using v2 API Twitter2 STDOUT
  230. Search Twitter for Tweets Transform Twitter MS Excel Copy Field Multi-writer STDOUT
  231. Search Twitter for Tweets Using v2 API Twitter2 STDOUT
  232. Search for Jira Issues by Multiple IDs Jira
  233. Search for a Record Expression Language Filter Search In-Memory
  234. Select and Arrange Fields Transform Include Fields
  235. Serialize DataMapping containing special characters to XML Data Mapping Serialization DataPipeline Foundations XML
  236. Serialize RecordList to and from JSON JSON Serialization
  237. Serialize RecordList to and from XML Dataset Serialization XML
  238. Serialize and Deserialize Data CSV Native Serialization STDOUT
  239. Serialize and Deserialize Records Serialization STDOUT
  240. Set Default Values for Missing Data Schema DataPipeline Foundations
  241. Set a Calculated Field Programmatically Transform Assign Field Calculated Field
  242. Set a Calculated Field at Runtime Expression Language Transform Assign Field Calculated Field
  243. Set a Field Transform Assign Field
  244. Show Column Statistics Pipeline Dataset DataPipeline Foundations Analyze Data
  245. Show Data Mapping Model Problems Data Mapping DataPipeline Foundations
  246. Show Schema Model Problems Schema DataPipeline Foundations
  247. Show Unique Values in Column Pipeline DataPipeline Foundations Analyze Data
  248. Show the Columns and Tables of a Schema JDBC DataPipeline Foundations
  249. Skip First Line Using Limit Reader CSV
  250. Sort ArrayValues Using Custom Comparator Sort
  251. Sort Records Transform Sort
  252. Specify Lookup Values Programmatically Transform Lookup
  253. Store Dataset In Memory Dataset DataPipeline Foundations
  254. Store Dataset on Disk Dataset DataPipeline Foundations
  255. Stream Record Fields Java Streams Streaming data
  256. Throttle Data being Read Throttle
  257. Throttle Data being Written Throttle
  258. Transform Records using Schema Schema DataPipeline Foundations
  259. Transition Jira Issue Jira
  260. Truncate large Excel cell values MS Excel 9.2
  261. Update Jira Issue Jira
  262. Upsert Records With Multiple JDBC Connections JDBC Upsert JDBC Multi-Writer Version 8.1.0
  263. Upsert Records to MySql or MariaDB JDBC Upsert MySQL
  264. Upsert Records to Oracle JDBC Upsert Oracle Database
  265. Upsert Records to PostgreSql JDBC Upsert PostgreSQL
  266. Upsert Records to Sybase JDBC Upsert Sybase Microsoft SQL Server
  267. Upsert Records to a Database Using Insert and Update JDBC Upsert
  268. Upsert Records to a Database Using Merge JDBC Upsert
  269. Upsert Variable Field Records JDBC Upsert
  270. Use Data Lineage with CsvReader CSV Data Lineage Debug
  271. Use Data Lineage with ExcelReader Data Lineage MS Excel Debug
  272. Use Data Lineage with FixedWidthReader Fixed Width Data Lineage Debug
  273. Use Data Lineage with JdbcReader JDBC Data Lineage Debug
  274. Use Data Lineage with Lookup Lookup Data Lineage Debug
  275. Use Data Lineage with OrcReader Data Lineage ORC Debug
  276. Use Data Lineage with ParquetReader Data Lineage Parquet Debug
  277. Use Functions In Transformers Java Streams Transform Version 10.1.0 Filter Customize Lambda
  278. Use Multi Threading in a Single Job Threading
  279. Use Predicates in Filters Java Streams Transform Version 10.1.0 Filter Customize Lambda
  280. Use SchemaFilter to Validate Records in a Pipeline Schema DataPipeline Foundations
  281. Use Streaming Excel for Reading MS Excel
  282. Use Streaming Excel for Writing CSV MS Excel
  283. Use a Custom AWS S3 Endpoint with AmazonS3FileSystem Amazon S3 Version 8.2.0
  284. Use a Retrying Reader Avro Retrying
  285. Use a Retrying Writer Avro Retrying
  286. Use an EventBus EventBus DataPipeline Foundations
  287. Use an EventBus in a Pipeline EventBus Threading
  288. Use partial wildcards in XPath when reading JSON JSON XPath 9.2
  289. Use partial wildcards in XPath when reading XML XPath 9.2 XML
  290. Validate Data using Entity Inheritance Validate Schema DataPipeline Foundations
  291. Validate Data using Nested Entities Validate Schema DataPipeline Foundations
  292. Validate Incoming Data Expression Language Transform Validate Rules
  293. Validate Record Fields Schema DataPipeline Foundations
  294. Validate Records using Fields and Rules Schema DataPipeline Foundations
  295. Validate Records using Rules Schema DataPipeline Foundations
  296. Validate Root Record Using Schema Filter Validate Schema
  297. Validate a Field Schema DataPipeline Foundations
  298. Validate a Value Schema DataPipeline Foundations
  299. Write A Parquet File Containing Spaces And Symbols In Column Names Transform CSV Parquet
  300. Write A Parquet File Using Database Table Schema JDBC Version 8.1.0 Database Parquet
  301. Write An ORC file to Amazon S3 using a Temporary File Amazon S3 ORC
  302. Write An Orc file to Amazon S3 Amazon S3 ORC
  303. Write Arrays and Nested Records to XML using FreeMarker Templates Template In-Memory Freemarker XPath XML
  304. Write CSV To XML Using FreeMarker Templates Template CSV XML
  305. Write Concatenated JSON
  306. Write Concatenated JSON With Nested Data JSON Streaming data
  307. Write Database View To Parquet File JDBC Version 8.1.0 Database Parquet
  308. Write Excel Formatting And Styles Version 10.1.0 MS Excel
  309. Write Excel to Amazon S3 Amazon S3 MS Excel
  310. Write HTML using FreeMarker Templates Template HTML In-Memory
  311. Write JSON Lines JSON In-Memory JSON Lines
  312. Write JSON Lines With Nested Data JSON JSON Lines
  313. Write Key-Value Fields to MapWriter In-Memory
  314. Write Parquet to Amazon S3 Amazon S3 Parquet
  315. Write Parquet to Amazon S3 Using a Temporary File Amazon S3 Parquet
  316. Write UUID to JSON file JSON UUID
  317. Write a CSV File to Database (1) CSV JDBC
  318. Write a CSV File to Database (2) CSV JDBC
  319. Write a CSV File to a Fixed Width / Fixed Length Record File Fixed Width CSV
  320. Write a JSON File using FreeMarker Templates Template JSON In-Memory Freemarker XPath
  321. Write a Parquet File Parquet
  322. Write a Parquet file using Schema Parquet
  323. Write a Parquet file using schema from EntityDef Schema Parquet
  324. Write a Parquet file using the schema derived from any dataset Parquet
  325. Write a Parquet file using the schema from a database query JDBC Version 8.1.0 Parquet
  326. Write a Sequence of Files by Elapsed Time CSV Simple
  327. Write a Sequence of Files by Record Count CSV Simple
  328. Write a Simple JSON File JSON Simple
  329. Write a Simple XML File Simple XML
  330. Write an Avro File Avro
  331. Write an Orc File ORC
  332. Write an XML File Programmatically Template In-Memory XML
  333. Write an XML File using FreeMarker Templates Template In-Memory Freemarker XPath XML
  334. Write my own Data Reader Customize
  335. Write my own Data Writer Customize
  336. Write my own Filter or Validator Transform Filter Validate Customize
  337. Write my own Lookup Transform Lookup Customize
  338. Write my own Transformer Transform Customize
  339. Write to A Data Writer using Tee Reader Multi-writer STDOUT
  340. Write to Amazon S3 Using Multipart Streaming Amazon S3
  341. Write to Excel CSV MS Excel
  342. Write to JMS Queue In-Memory JMS
  343. Write to JMS Topic In-Memory JMS
  344. Write to JSON Stream (Simple) JSON In-Memory Simple
  345. Write to JSON Stream Programmatically Template JSON In-Memory
  346. Write to Memory CSV In-Memory
  347. Write to MongoDB CSV MongoDB
  348. Write to Several Data Writers at Once In-Memory MS Excel Multi-writer
  349. Write to XML Stream (Simple) In-Memory Simple XML
  350. Write to a Database Using Custom Jdbc Insert Strategy JDBC JDBC Insert Strategy
  351. Write to a Database Using Generic Upsert Strategy JDBC Upsert
  352. Write to a Database Using Merge Upsert Strategy JDBC Upsert
  353. Write to a Database Using Merge Upsert Strategy with Batch JDBC Upsert
  354. Write to a Database Using Multi Row Prepared Statement Insert Strategy JDBC JDBC Insert Strategy
  355. Write to a Database Using Multi Row Statement Insert Strategy JDBC JDBC Insert Strategy
  356. Write to a Database Using Multiple Connections JDBC JDBC Multi-Writer MS Excel
  357. Write to the Console STDOUT

All Examples

Mobile Analytics