IRI Blog Articles

Diving Deeper into Data Management

 

 

Optimizing Talend Transforms with IRI CoSort

September 14, 2016 Data Transformation
Thumbnail image for Optimizing Talend Transforms with IRI CoSort

Talend has been on the market for a few years now, and its flexible UI components make it a very reasonable choice for developers when it comes to customization. Talend Studio is built in Java, which gives it a certain degree of control and flexibility in managing its performance. That said, however, I found that […]

Read the full article →

Wicked Shell in the IRI Workbench

September 8, 2016 IRI Workbench
Thumbnail image for Wicked Shell in the IRI Workbench

As we transition IRI Workbench to the Neon version of Eclipse™ in 2017, the Easy Shell feature that facilitated command-line executions of job and batch scripts will no longer be available. But for those who want to run IRI or other jobs on the command line without leaving the workbench (which you still of course […]

Read the full article →

Executing Batch Flows in IRI Workbench

September 8, 2016 ETL
Thumbnail image for Executing Batch Flows in IRI Workbench

Batch files contain commands in plain text that can be executed by the command line interpreter of the operating system to accomplish a specific purpose. Windows batch files usually have an extension of .bat or .cmd, while Linux and Unix usually have .sh or no extension at all. We could have a batch file with […]

Read the full article →

Storing Your Stuff: Integration Methods for Big Data

September 7, 2016 Big Data
Thumbnail image for Storing Your Stuff: Integration Methods for Big Data

“That’s all you need in life, a little place for your stuff.  That’s all your house is, a place to keep your stuff.  If you didn’t have so much stuff, you wouldn’t need a house. You could just walk around all the time. A house is just a pile of stuff with a cover on it.” […]

Read the full article →

A Fresh Look at Data Preparation

September 7, 2016 Big Data
Thumbnail image for A Fresh Look at Data Preparation

To analyze data successfully, it must first be prepared successfully. Poor quality data creates poor results. Worse yet is data that takes too long to collect and clean because it is too big or too foreign. Raw data is usually unfit even for the imagination, much less making decisions. Traditional BI architects and big data scientists […]

Read the full article →

Single Job Execution Options in IRI Workbench

August 17, 2016 IRI Workbench
Thumbnail image for Single Job Execution Options in IRI Workbench

IRI Workbench not only has several ways to create jobs, but also several ways to execute them. This article focuses on IRI Workbench execution options for scripts based on the SortCL program language, which covers IRI CoSort (transform/report), NextForm (migrate/replicate), FieldShield (classify/mask), and RowGen (test data) jobs. In addition to IRI Workbench execution, these jobs […]

Read the full article →

Browsing the Operational Data Store (ODS)

August 4, 2016 Big Data
Thumbnail image for Browsing the Operational Data Store (ODS)

What Is an ODS? An operational data store (or “ODS”) is another paradigm for integrating enterprise data that is relatively simpler than a data warehouse (DW). The ODS is a central database (DB) where data that has been integrated from disparate sources undergoes specific functions. Like a DW (in which an ODS is often a […]

Read the full article →

Using the Voracity Pivot / Unpivot Wizard

July 22, 2016 ETL
Thumbnail image for Using the Voracity Pivot / Unpivot Wizard

A new wizard in the IRI Workbench GUI for Voracity can pivot or unpivot relational data. A pivot transformation converts rows to columns and is helpful when dealing with denormalized tables. Unpivot converts columns to rows and can be used to create reports based on normalized tables. Because the wizard front-ends the CoSort SortCL program […]

Read the full article →