{"id":9980,"date":"2016-04-08T14:18:45","date_gmt":"2016-04-08T18:18:45","guid":{"rendered":"http:\/\/www.iri.com\/blog\/?p=9980"},"modified":"2024-10-23T15:43:54","modified_gmt":"2024-10-23T19:43:54","slug":"creating-a-voracity-flow-from-a-wizard-part-1-of-2","status":"publish","type":"post","link":"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/","title":{"rendered":"Creating a Voracity Flow from a Wizard (Part 1 of 2)"},"content":{"rendered":"

Abstract:\u00a0<\/em>The IRI Voracity<\/a> data management platform provides data integration tools, including data pipeline automation for high-performance ETL (Extract-Transform-Load) operations<\/span>. This article is the first in another series on how to create and use high-performance ETL workflows in the IRI Workbench <\/span>GUI for Voracity<\/span><\/a>. It follows the <\/span>first series<\/span><\/a> of articles on creating flows from existing CoSort\/SortCL (ETL) job scripts. <\/span><\/p>\n

In this article, we create an Voracity ETL workflow using one of the built-in job creation wizards in the toolbar menu of IRI Workbench. Many ETL tools do not provide wizard-driven job design; for Voracity, this is only one of several ways to build out your jobs.<\/span><\/p>\n

Remember that flows contain\u00a0 and other data processing steps, which are illustrated in flow and transform mapping diagrams in IRI Workbench. They are saved in .flow files for execution from IRI Workbench or serialized as .sh or .bat files for execution from inside or outside IRI Workbench. Wizards can be used to create either job scripts or flows that include them.<\/span><\/p>\n

This flow matches data in an Oracle table called PATIENT_RECORD with billing information from the PATIENTBILLING table, then sends it to collections. Some of the data in the PATIENT_RECORD table is sensitive. After extracting the data from the table, this phase of the job will mask some of the columns and eliminate others.<\/span><\/p>\n

We will begin by creating a project in IRI Workbench called WizardFlow to hold all the files associated with this Flow.<\/span><\/p>\n

Create the Flow<\/b><\/h3>\n

In this case, running the job wizard to completion will build a complete ETL flow, which can be modified later. To launch the wizard and begin creating the Flow, click the stopwatch icon in the toolbar to reveal the CoSort job menu. Select <\/span>New Sort Job<\/b> and type PatientInfoProtect for the <\/span>File name<\/b>. Select the <\/span>Create flow<\/b> radio button and click <\/span>Next<\/b>.<\/span><\/p>\n

\"Job<\/a><\/p>\n

Define the Source<\/b><\/h3>\n

Our source is the table PATIENT_RECORD. To create the source definition, select <\/span>Add Data Source<\/b> in the <\/span>Data Source<\/b> dialog. Because the source is a table, select the <\/span>ODBC<\/b> radio button and click <\/span>Browse<\/b>. In the <\/span>ODBC Table Selection <\/b>dialog, select the <\/span>Data source name<\/b> and select the <\/span>Table name <\/b>PATIENT_RECORD from the drop-downs, then click <\/span>OK<\/b>.<\/span><\/p>\n

\"ODBC<\/a><\/p>\n

Click <\/span>OK <\/b>again to return to the <\/span>Data Sources <\/b>dialog. We now need to create the field or column definitions. \u00a0Select <\/span>Discover Metadata<\/b> to bring up the <\/span>Setup Options<\/b> dialog. Type PatientRecord for the <\/span>File Name<\/b> field and click <\/span>Next<\/b>.<\/span><\/p>\n

In the <\/span>Data Source Identification <\/b>dialog, verify that the information about your table is correct, then click <\/span>Next<\/b> to open the <\/span>Field Data Viewer and Editor<\/b>. The upper half contains a sample of the data from the table, along with the column names. The bottom half contains the column names, CoSort-equivalent data types, position, and data types in the source table.<\/span><\/p>\n

\"Field<\/a><\/p>\n

Click <\/span>Finish<\/b>, then click <\/span>Yes<\/b> to copy the fields into the <\/span>Data Sources<\/b> tree. This saves the field definitions to a reusable data definition file (DDF) so it can be referenced in this or another job. Click <\/span>Next <\/b>to open the<\/span> Sort <\/b>dialog where we will define a key.<\/span><\/p>\n

Define the Sort Key(s)<\/b><\/h3>\n

Because the next phase of this flow will join on the IDNUMBER field, we can sort on it by defining that field as the key.<\/span><\/p>\n

Select IDNUMBER from the <\/span>Input Fields<\/b> box and select <\/span>Add Key<\/b>. IDNUMBER is now displayed in the <\/span>Key Fields<\/b> box. You can repeat the process for as many keys as necessary for the sort. In this instance, we only need one key. Click <\/span>Next<\/b> to go to the <\/span>Data Targets<\/b> dialog.<\/span><\/p>\n

\"New<\/a><\/p>\n

Define the Target<\/b><\/h3>\n

Select <\/span>Add Data Target<\/b> in the <\/span>Data Target<\/b> dialog. Select the <\/span>File<\/b> radio button, then type PatientInfoProtected.dat in the <\/span>File<\/b> field, and click <\/span>OK<\/b>.<\/span><\/p>\n

In the <\/span>Data Targets<\/b> dialog, select <\/span>Target Field Layout<\/b>. The top half of the dialog has source definitions and the bottom half has target definitions. Initially, all of the input fields have been copied to the targets. If you want, you can click the trash can icon and delete all the fields in the target PatientInfoProtected.dat, and then drag the desired fields from the source to the target.<\/span><\/p>\n

Since we want most of the fields, we will, instead, remove the fields that we don\u2019t want. \u00a0We want to remove AGE, EMAIL, DRIVING_LICENSE, and SSN. For each one, right-click on the field and select <\/span>Remove<\/b>. With those fields gone, the field positions need to be recalculated by clicking the <\/span>1-2-3<\/b> icon.<\/span><\/p>\n

Apply Protection<\/b><\/h3>\n

There are fields for two credit card numbers. These need to be masked so that only the last 4 digits of the numbers are displayed. \u00a0Right-click on the field CREDIT_CARD1 > <\/span>Apply Rule<\/b> > <\/span>Create Rule<\/b>.<\/span><\/p>\n

Click <\/span>Masking Function<\/b> under <\/span>Protection Rules<\/b> and verify that the <\/span>Library location<\/b> has our project name. Type CreditCardMask for the <\/span>Rule name<\/b>, and click <\/span>Next.<\/b><\/p>\n

\"New<\/a><\/p>\n

In the <\/span>Masking Function<\/b> dialog, select the <\/span>Define mask<\/b> radio button. Type * for <\/span>Mask character<\/b>, 1 for <\/span>Start position<\/b>, 12 for <\/span>Length<\/b>, then click <\/span>Add to table<\/b>. The definition is added to the table at the bottom. Click <\/span>Finish<\/b>.<\/span><\/p>\n

\"Masking<\/a><\/p>\n

We have returned to the <\/span>Target Field Layout <\/b>dialog and now want to mask the other credit card field. \u00a0We already created the masking rule for credit cards, so we want to use that rule. Right-click on the field CREDIT_CARD2 > <\/span>Apply Rule<\/b> > <\/span>Browse Rule<\/b>. When the <\/span>Field Rule Library<\/b> dialog displays, select the rule named CreditCardMask and click <\/span>OK<\/b>.<\/span><\/p>\n

\"Field<\/a><\/p>\n

The two credit card fields now have the <\/span>Field<\/b> designation of <\/span>Function<\/b>, and the field names have been changed to MASK_CREDIT_CARD1 and MASK_CREDIT_CARD2 because these are now derived fields.<\/span><\/p>\n

\"Target<\/a><\/p>\n

Click <\/span>OK<\/b> to return to the <\/span>Data Targets<\/b> dialog where the tree outline is displayed in the box on the left. Click <\/span>Finish<\/b>.<\/span><\/p>\n

\"New<\/a><\/p>\n

PatientInfoProtect.flow is now part of the project and displays in the editor. In the project, rename the flow to Collections.flow and then expand the flow. Right-click Batch: PatientInfoProtect.scl \u00a0> <\/span>New Representation<\/b> > <\/span>new flow diagram.<\/b> For <\/span>Representation name<\/b>, type Collections Flow Diagram in the <\/span>New Representation<\/b> dialog, and click <\/span>OK<\/b>.<\/span><\/p>\n

A flow is created and displayed in the editor. It consists of a gray flowlet block that contains a green <\/span>Start<\/b> block and a brown Transform Mapping Block named PatientInfoProtect.scl.<\/span><\/p>\n

The <\/span>Start <\/b>block has an arrow connected to the icon for input table NIGHTLY.PATIENT_RECORD in the Transform Mapping Block. There is also an output file icon named PatientInfoProtected.dat.<\/span><\/p>\n

Let\u2019s change the name of the batch and the name of the flowlet from PatientInfoProtect.scl to Collections. Click in the white space around the flowlet. Then in the <\/span>Properties <\/b>view at the bottom of the screen, select <\/span>Base<\/b>, and type Collections in the <\/span>Name<\/b> field. Now click in the flowlet and do the same. The names are changed in the editor and in the <\/span>Project Explorer<\/b>.<\/span><\/p>\n

\"IRI<\/a><\/p>\n

Double-click in the Transform Mapping Block and name the diagram PatientInfoProtect Transform Mapping Diagram. Click <\/span>OK<\/b>. This displays a detailed diagram of the job PatientInfoProtect.scl that we created using the <\/span>New Sort Job<\/b> option from the <\/span>CoSort Menu<\/b>.<\/span><\/p>\n

The input file with fields is displayed in the <\/span>Input Data<\/b> block. You can follow the fields through the <\/span>Action <\/b>block where, in this case, the sort key is defined. Then follow the fields into the file block in the <\/span>Output Data<\/b> block. Notice that not all the fields were mapped into the output, and that the two fields where masking was applied have orange instead of blue connecting arrows. This is because a masking function is applied to the values in the original fields before being accepted to the output. For a more detailed explanation of these blocks, see <\/span>Creating Voracity Flows Using Existing IRI Scripts (Part 1).<\/span><\/i><\/p>\n

\"Input<\/a><\/p>\n

Now, go back to the Collections Flow Diagram in the editor. To create the job script PatientInfoProtect.scl and the batch file for this flow, right-click in the editor > <\/span>IRI Diagram Actions<\/b> > <\/span>Export Flow Component<\/b>. Select <\/span>Windows <\/b>from the <\/span>Platform<\/b> drop-down and verify that Collections.bat is in the <\/span>File name<\/b> field. This is the name of the file that will execute the flow. Click <\/span>Finish<\/b>. The CoSort\/SortCL Job script and batch file are created and placed in the project. \u00a0<\/span><\/p>\n

Following are the batch script and the job script it can execute. This is done from within IRI Workbench directly, through its task scheduler, any third-party job scheduler, or from the command line:<\/span><\/p>\n

Collections.bat<\/span><\/p>\n

@echo off\r\n <\/span>sortcl \/SPECIFICATION=PatientInfoProtect.scl<\/span><\/pre>\n
PatientInfoProtect.scl<\/span><\/p>\n
\/INFILE=\"NIGHTLY.PATIENT_RECORD;DSN=Oracle_qa2;UID=nightly;PWD=N321ghtly;\"\r\n     \/ALIAS=NIGHTLY_PATIENT_RECORD\r\n     \/PROCESS=ODBC\r\n     \/FIELD=(IDNUMBER, TYPE=ASCII, POSITION=1, SEPARATOR=\"\\t\", EXT_FIELD=\"IDNUMBER\")\r\n     \/FIELD=(NAME, TYPE=ASCII, POSITION=2, SEPARATOR=\"\\t\", EXT_FIELD=\"NAME\")\r\n     \/FIELD=(AGE, TYPE=ASCII, POSITION=3, SEPARATOR=\"\\t\", EXT_FIELD=\"AGE\")\r\n     \/FIELD=(EMAIL, TYPE=ASCII, POSITION=4, SEPARATOR=\"\\t\", EXT_FIELD=\"EMAIL\")\r\n     \/FIELD=(PHONE, TYPE=ASCII, POSITION=5, SEPARATOR=\"\\t\", EXT_FIELD=\"PHONE\")\r\n     \/FIELD=(CREDIT_CARD1, TYPE=ASCII, POSITION=6, SEPARATOR=\"\\t\", EXT_FIELD=\"CREDIT_CARD1\")\r\n     \/FIELD=(CREDIT_CARD2, TYPE=ASCII, POSITION=7, SEPARATOR=\"\\t\", EXT_FIELD=\"CREDIT_CARD2\")\r\n     \/FIELD=(DRIVING_LICENSE, TYPE=ASCII, POSITION=8, SEPARATOR=\"\\t\", EXT_FIELD=\"DRIVING_LICENSE\")\r\n     \/FIELD=(SSN, TYPE=ASCII, POSITION=9, SEPARATOR=\"\\t\", EXT_FIELD=\"SSN\")\r\n     \/FIELD=(CITY, TYPE=ASCII, POSITION=10, SEPARATOR=\"\\t\", EXT_FIELD=\"CITY\")\r\n     \/FIELD=(STATE, TYPE=ASCII, POSITION=11, SEPARATOR=\"\\t\", EXT_FIELD=\"STATE\")\r\n\r\n\/SORT\r\n     \/KEY=(IDNUMBER, TYPE=ASCII)\r\n     \r\n\/OUTFILE=PatientInfoProtected\r\n     \/PROCESS=RECORD\r\n     \/FIELD=(IDNUMBER, TYPE=ASCII, POSITION=1, SEPARATOR=\"\\t\", EXT_FIELD=\"IDNUMBER\")\r\n     \/FIELD=(NAME, TYPE=ASCII, POSITION=2, SEPARATOR=\"\\t\", EXT_FIELD=\"NAME\")\r\n     \/FIELD=(PHONE, TYPE=ASCII, POSITION=3, SEPARATOR=\"\\t\", EXT_FIELD=\"PHONE\")\r\n\u00a0\u00a0\u00a0\u00a0\u00a0\/FIELD=(MASK_CREDIT_CARD1=replace_chars(CREDIT_CARD1, \"*\", 1, 12), TYPE=ASCII, POSITION=4, SEPARATOR=\"\\t\", EXT_FIELD=\"CREDIT_CARD1\")\r\n\u00a0\u00a0\u00a0\u00a0\u00a0\/FIELD=(MASK_CREDIT_CARD2=replace_chars(CREDIT_CARD2, \"*\", 1, 12), TYPE=ASCII, POSITION=5, SEPARATOR=\"\\t\", EXT_FIELD=\"CREDIT_CARD2\")\r\n     \/FIELD=(CITY, TYPE=ASCII, POSITION=6, SEPARATOR=\"\\t\", EXT_FIELD=\"CITY\")\r\n     \/FIELD=(STATE, TYPE=ASCII, POSITION=7, SEPARATOR=\"\\t\", EXT_FIELD=\"STATE\")<\/pre>\n

\nIn the next article<\/a>, we will use another CoSort job wizard in IRI Workbench to create a Transform Mapping Block that will be added to the flowlet created in this article. The output from the script, represented here by the Transform Mapping Block, will become one of the inputs for a new Transform Mapping Block.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"
Abstract:\u00a0The IRI Voracity data management platform provides data integration tools, including data pipeline automation for high-performance ETL (Extract-Transform-Load) operations. This article is the first in another series on how to create and use high-performance ETL workflows in the IRI Workbench GUI for Voracity. It follows the first series of articles on creating flows from existing<\/p>\n
Read More<\/a><\/div>\n","protected":false},"author":10,"featured_media":9991,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[776,91],"tags":[44,1862,632,1112,100,131,46,102,1113,789,967,50,1114,284,1096,68,193,1013],"class_list":["post-9980","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-etl","category-iri-workbench","tag-cosort","tag-data-integration-tools","tag-data-source","tag-discover-metadata","tag-etl","tag-etl-tool","tag-etl-tools","tag-extract-transform-load","tag-input","tag-iri-voracity","tag-job-wizard","tag-oracle","tag-output","tag-protection","tag-sort-key","tag-sortcl","tag-testing-etl","tag-voracity-etl"],"acf":[],"yoast_head":"\nCreating a Voracity Flow from a Wizard (Part 1 of 2) - IRI<\/title>\n<meta name=\"description\" content=\"Learn how to create and use ETL workflows in the IRI Voracity data integration platform via job wizards for faster data pipeline automation.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Creating a Voracity Flow from a Wizard (Part 1 of 2)\" \/>\n<meta property=\"og:description\" content=\"Learn how to create and use ETL workflows in the IRI Voracity data integration platform via job wizards for faster data pipeline automation.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/\" \/>\n<meta property=\"og:site_name\" content=\"IRI\" \/>\n<meta property=\"article:published_time\" content=\"2016-04-08T18:18:45+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-10-23T19:43:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2016\/07\/IRI-Development-Project-Explorer.png\" \/>\n\t<meta property=\"og:image:width\" content=\"624\" \/>\n\t<meta property=\"og:image:height\" content=\"434\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Susan Gegner\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Susan Gegner\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"9 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/\"},\"author\":{\"name\":\"Susan Gegner\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/87be5da567628ab9396ca81170f36d63\"},\"headline\":\"Creating a Voracity Flow from a Wizard (Part 1 of 2)\",\"datePublished\":\"2016-04-08T18:18:45+00:00\",\"dateModified\":\"2024-10-23T19:43:54+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/\"},\"wordCount\":1487,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2016\/07\/IRI-Development-Project-Explorer.png\",\"keywords\":[\"CoSort\",\"data integration tools\",\"data source\",\"discover metadata\",\"ETL\",\"ETL tool\",\"ETL tools\",\"extract transform load\",\"input\",\"IRI Voracity\",\"job wizard\",\"Oracle\",\"output\",\"protection\",\"sort key\",\"SortCL\",\"testing ETL\",\"Voracity ETL\"],\"articleSection\":[\"ETL\",\"IRI Workbench\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/\",\"url\":\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/\",\"name\":\"Creating a Voracity Flow from a Wizard (Part 1 of 2) - IRI\",\"isPartOf\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2016\/07\/IRI-Development-Project-Explorer.png\",\"datePublished\":\"2016-04-08T18:18:45+00:00\",\"dateModified\":\"2024-10-23T19:43:54+00:00\",\"description\":\"Learn how to create and use ETL workflows in the IRI Voracity data integration platform via job wizards for faster data pipeline automation.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#primaryimage\",\"url\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2016\/07\/IRI-Development-Project-Explorer.png\",\"contentUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2016\/07\/IRI-Development-Project-Explorer.png\",\"width\":624,\"height\":434,\"caption\":\"IRI Development - Project Explorer\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.iri.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Creating a Voracity Flow from a Wizard (Part 1 of 2)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.iri.com\/blog\/#website\",\"url\":\"https:\/\/www.iri.com\/blog\/\",\"name\":\"IRI\",\"description\":\"Total Data Management Blog\",\"publisher\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.iri.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\",\"name\":\"IRI\",\"url\":\"https:\/\/www.iri.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"contentUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"width\":750,\"height\":206,\"caption\":\"IRI\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/87be5da567628ab9396ca81170f36d63\",\"name\":\"Susan Gegner\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/2b1ca5592a65d44483351292cf1ae00a?s=96&d=blank&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/2b1ca5592a65d44483351292cf1ae00a?s=96&d=blank&r=g\",\"caption\":\"Susan Gegner\"},\"url\":\"https:\/\/www.iri.com\/blog\/author\/susang\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Creating a Voracity Flow from a Wizard (Part 1 of 2) - IRI","description":"Learn how to create and use ETL workflows in the IRI Voracity data integration platform via job wizards for faster data pipeline automation.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/","og_locale":"en_US","og_type":"article","og_title":"Creating a Voracity Flow from a Wizard (Part 1 of 2)","og_description":"Learn how to create and use ETL workflows in the IRI Voracity data integration platform via job wizards for faster data pipeline automation.","og_url":"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/","og_site_name":"IRI","article_published_time":"2016-04-08T18:18:45+00:00","article_modified_time":"2024-10-23T19:43:54+00:00","og_image":[{"width":624,"height":434,"url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2016\/07\/IRI-Development-Project-Explorer.png","type":"image\/png"}],"author":"Susan Gegner","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Susan Gegner","Est. reading time":"9 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#article","isPartOf":{"@id":"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/"},"author":{"name":"Susan Gegner","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/87be5da567628ab9396ca81170f36d63"},"headline":"Creating a Voracity Flow from a Wizard (Part 1 of 2)","datePublished":"2016-04-08T18:18:45+00:00","dateModified":"2024-10-23T19:43:54+00:00","mainEntityOfPage":{"@id":"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/"},"wordCount":1487,"commentCount":0,"publisher":{"@id":"https:\/\/www.iri.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2016\/07\/IRI-Development-Project-Explorer.png","keywords":["CoSort","data integration tools","data source","discover metadata","ETL","ETL tool","ETL tools","extract transform load","input","IRI Voracity","job wizard","Oracle","output","protection","sort key","SortCL","testing ETL","Voracity ETL"],"articleSection":["ETL","IRI Workbench"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/","url":"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/","name":"Creating a Voracity Flow from a Wizard (Part 1 of 2) - IRI","isPartOf":{"@id":"https:\/\/www.iri.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#primaryimage"},"image":{"@id":"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2016\/07\/IRI-Development-Project-Explorer.png","datePublished":"2016-04-08T18:18:45+00:00","dateModified":"2024-10-23T19:43:54+00:00","description":"Learn how to create and use ETL workflows in the IRI Voracity data integration platform via job wizards for faster data pipeline automation.","breadcrumb":{"@id":"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#primaryimage","url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2016\/07\/IRI-Development-Project-Explorer.png","contentUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2016\/07\/IRI-Development-Project-Explorer.png","width":624,"height":434,"caption":"IRI Development - Project Explorer"},{"@type":"BreadcrumbList","@id":"https:\/\/www.iri.com\/blog\/iri\/iri-workbench\/creating-a-voracity-flow-from-a-wizard-part-1-of-2\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.iri.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Creating a Voracity Flow from a Wizard (Part 1 of 2)"}]},{"@type":"WebSite","@id":"https:\/\/www.iri.com\/blog\/#website","url":"https:\/\/www.iri.com\/blog\/","name":"IRI","description":"Total Data Management Blog","publisher":{"@id":"https:\/\/www.iri.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.iri.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.iri.com\/blog\/#organization","name":"IRI","url":"https:\/\/www.iri.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","contentUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","width":750,"height":206,"caption":"IRI"},"image":{"@id":"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/87be5da567628ab9396ca81170f36d63","name":"Susan Gegner","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/2b1ca5592a65d44483351292cf1ae00a?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2b1ca5592a65d44483351292cf1ae00a?s=96&d=blank&r=g","caption":"Susan Gegner"},"url":"https:\/\/www.iri.com\/blog\/author\/susang\/"}]}},"jetpack_featured_media_url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2016\/07\/IRI-Development-Project-Explorer.png","_links":{"self":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/9980"}],"collection":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/comments?post=9980"}],"version-history":[{"count":20,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/9980\/revisions"}],"predecessor-version":[{"id":18071,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/9980\/revisions\/18071"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/media\/9991"}],"wp:attachment":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/media?parent=9980"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/categories?post=9980"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/tags?post=9980"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}