IRI Blog Articles

Diving Deeper into Data Management

 

 

Talend has been on the market for a few years now, and its flexible UI components make it a very reasonable choice for developers when it comes to customization. Talend Studio is built in Java, which gives it a certain degree of control and flexibility in managing its performance. That said, however, I found that […]

{ 0 comments }

Wicked Shell in the IRI Workbench

September 8, 2016 IRI Workbench
Thumbnail image for Wicked Shell in the IRI Workbench

As we transition IRI Workbench to the Neon version of Eclipse™ in 2016, the Easy Shell feature that facilitated command-line executions of job and batch scripts will no longer be available. But for those who want to use the command line without leaving the workbench, another plug-in called Wicked Shell fits the bill even better. […]

Read the full article →

Executing Batch Flows in IRI Workbench

September 8, 2016 ETL
Thumbnail image for Executing Batch Flows in IRI Workbench

Batch files contain commands in plain text that can be executed by the command line interpreter of the operating system to accomplish a specific purpose. Windows batch files usually have an extension of .bat or .cmd, while Linux and Unix usually have .sh or no extension at all. We could have a batch file with […]

Read the full article →

Storing Your Stuff: Integration Methods for Big Data

September 7, 2016 Big Data
Thumbnail image for Storing Your Stuff: Integration Methods for Big Data

“That’s all you need in life, a little place for your stuff.  That’s all your house is, a place to keep your stuff.  If you didn’t have so much stuff, you wouldn’t need a house. You could just walk around all the time. A house is just a pile of stuff with a cover on it.” […]

Read the full article →

A Fresh Look at Data Preparation

September 7, 2016 Big Data
Thumbnail image for A Fresh Look at Data Preparation

To analyze data successfully, it must first be prepared successfully. Poor quality data creates poor results. Worse yet is data that takes too long to collect and clean because it is too big or too foreign. Raw data is usually unfit even for the imagination, much less making decisions. Traditional BI architects and big data scientists […]

Read the full article →

Single Job Execution Options in IRI Workbench

August 17, 2016 IRI Workbench
Thumbnail image for Single Job Execution Options in IRI Workbench

IRI Workbench not only has several ways to create jobs, but also several ways to execute them. This article focuses on IRI Workbench execution options for scripts based on the SortCL program language, which covers IRI CoSort (transform/report), NextForm (migrate/replicate), FieldShield (classify/mask), and RowGen (test data) jobs. In addition to IRI Workbench execution, these jobs […]

Read the full article →

Browsing the Operational Data Store (ODS)

August 4, 2016 Big Data
Thumbnail image for Browsing the Operational Data Store (ODS)

What Is an ODS? An operational data store (or “ODS”) is another paradigm for integrating enterprise data that is relatively simpler than a data warehouse (DW). The ODS is a central database (DB) where data that has been integrated from disparate sources undergoes specific functions. Like a DW (in which an ODS is often a […]

Read the full article →