{"id":8604,"date":"2015-12-17T15:18:47","date_gmt":"2015-12-17T20:18:47","guid":{"rendered":"http:\/\/www.iri.com\/blog\/?p=8604"},"modified":"2018-07-10T11:13:45","modified_gmt":"2018-07-10T15:13:45","slug":"creating-change-data-capture-reports-in-iri-workbench","status":"publish","type":"post","link":"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/","title":{"rendered":"Creating Change Data Capture Reports in IRI Workbench"},"content":{"rendered":"

There is now a bulk\/batch Change Data Capture (CDC<\/a>) wizard in the IRI Workbench GUI for Voracity<\/a>, built on Eclipse\u2122. This new graphical report builder compares previous and current data sources based on a flag field you select, and gives you the option of producing five different targets — Cumulative, Delete, Equal, Insert, and Update — or any combination thereof.<\/p>\n

As this how-to article shows, the new CDC wizard also allows you to select a delta field where you can add a text description of your transaction type. In this example, I\u2019m specifying \u201cDELETE\u201d, \u201cEQUAL\u201d, \u201cINSERT\u201d, and \u201cUPDATE\u201d in my Cumulative report.<\/p>\n

On the input screen, you enter the two data sources (tables or files), and the format and metadata available (or that you create<\/a>) for each. You also enter the field that is your flag for each data file. In this case, we use checksum,\u00a0but it could be a transaction date, etc.<\/p>\n

\"\"<\/a><\/span><\/p>\n

The next page is where you enter the join condition:<\/p>\n

\"\"<\/a><\/span><\/p>\n

On the final output page, you specify the targets, formats, and metadata for each report type you want produced. You can select as many report types as needed. You can also select a delta if your report has a description of that transaction type.<\/p>\n

Because you may have standard company terminology you need to use, you can type in your delta description. In this case, I only need that description in the cumulative report. Note that I can use conditional\u00a0\/INCLUDE logic for incremental reports on flat files like these, and for database sources, \/QUERY logic, as shown in this example<\/a> of incremental data replication in an IRI job script.<\/p>\n

\"\"<\/a><\/span><\/p>\n

When you click \u2018Finish\u2019 the wizard produces a single CoSort SortCL<\/a>\u00a0job script that Voracity users can schedule<\/a>\u00a0or run from the GUI or in a command-line or batch environment.<\/p>\n

The script contains multiple \/CONDITION statements to differentiate the type of transaction. The DELTA_FLAG field in my Cum.data output file contains an If-Then-Else statement that determines which delta description to use. The other report outputs use Include and Omit statements to pull the proper transaction type into the report:<\/p>\n

\"\"<\/a><\/span><\/p>\n

The script can be modified to add headers, counts, formatting, etc. to your report — even cross-calculations that would show the differences in values between \u2018previous\u2019 and \u2018current.\u2019 After modifying my script to add a header and running the script, my output for the Cumulative report looks like this:<\/p>\n

\"\"<\/a><\/span><\/p>\n

For more information on Change Data Capture (CDC) in Voracity and why it’s a better approach to DB-log-based CDC, visit:
\nhttp:\/\/www.iri.com\/solutions\/business-intelligence\/embedded-bi\/change-data-capture<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

There is now a bulk\/batch Change Data Capture (CDC) wizard in the IRI Workbench GUI for Voracity, built on Eclipse\u2122. This new graphical report builder compares previous and current data sources based on a flag field you select, and gives you the option of producing five different targets — Cumulative, Delete, Equal, Insert, and Update<\/p>\n

Read More<\/a><\/div>\n","protected":false},"author":43,"featured_media":8611,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[32,776,91],"tags":[218,82,987,71,986,92,546,789,850,1104,68,96],"class_list":["post-8604","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-business-intelligence","category-etl","category-iri-workbench","tag-cdc","tag-change-data-capture","tag-compare-data-sources","tag-eclipse","tag-graphical-report-builder","tag-gui","tag-iri-cosort","tag-iri-voracity","tag-iri-workbench","tag-json","tag-sortcl","tag-wizard"],"acf":[],"yoast_head":"\nCreating Change Data Capture Reports in IRI Workbench - IRI<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Creating Change Data Capture Reports in IRI Workbench\" \/>\n<meta property=\"og:description\" content=\"There is now a bulk\/batch Change Data Capture (CDC) wizard in the IRI Workbench GUI for Voracity, built on Eclipse\u2122. This new graphical report builder compares previous and current data sources based on a flag field you select, and gives you the option of producing five different targets — Cumulative, Delete, Equal, Insert, and UpdateRead More\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/\" \/>\n<meta property=\"og:site_name\" content=\"IRI\" \/>\n<meta property=\"article:published_time\" content=\"2015-12-17T20:18:47+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2018-07-10T15:13:45+00:00\" \/>\n<meta name=\"author\" content=\"Claudia Irvine\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Claudia Irvine\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/\"},\"author\":{\"name\":\"Claudia Irvine\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/72af50bbb317610e193e96392081f9b0\"},\"headline\":\"Creating Change Data Capture Reports in IRI Workbench\",\"datePublished\":\"2015-12-17T20:18:47+00:00\",\"dateModified\":\"2018-07-10T15:13:45+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/\"},\"wordCount\":443,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/12\/t_Creating-Change-Data-Capture-Reports-in-IRI-Workbench-Claudia-Irvine-1-2.jpg\",\"keywords\":[\"CDC\",\"Change Data Capture\",\"compare data sources\",\"Eclipse\",\"graphical report builder\",\"GUI\",\"IRI CoSort\",\"IRI Voracity\",\"IRI Workbench\",\"JSON\",\"SortCL\",\"wizard\"],\"articleSection\":[\"Business Intelligence (BI)\",\"ETL\",\"IRI Workbench\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/\",\"url\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/\",\"name\":\"Creating Change Data Capture Reports in IRI Workbench - IRI\",\"isPartOf\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/12\/t_Creating-Change-Data-Capture-Reports-in-IRI-Workbench-Claudia-Irvine-1-2.jpg\",\"datePublished\":\"2015-12-17T20:18:47+00:00\",\"dateModified\":\"2018-07-10T15:13:45+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#primaryimage\",\"url\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/12\/t_Creating-Change-Data-Capture-Reports-in-IRI-Workbench-Claudia-Irvine-1-2.jpg\",\"contentUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/12\/t_Creating-Change-Data-Capture-Reports-in-IRI-Workbench-Claudia-Irvine-1-2.jpg\",\"width\":624,\"height\":784},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.iri.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Creating Change Data Capture Reports in IRI Workbench\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.iri.com\/blog\/#website\",\"url\":\"https:\/\/www.iri.com\/blog\/\",\"name\":\"IRI\",\"description\":\"Total Data Management Blog\",\"publisher\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.iri.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\",\"name\":\"IRI\",\"url\":\"https:\/\/www.iri.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"contentUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"width\":750,\"height\":206,\"caption\":\"IRI\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/72af50bbb317610e193e96392081f9b0\",\"name\":\"Claudia Irvine\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/fb33dee44756bd13ac23f1342c2bb7b2?s=96&d=blank&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/fb33dee44756bd13ac23f1342c2bb7b2?s=96&d=blank&r=g\",\"caption\":\"Claudia Irvine\"},\"url\":\"https:\/\/www.iri.com\/blog\/author\/claudiai\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Creating Change Data Capture Reports in IRI Workbench - IRI","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/","og_locale":"en_US","og_type":"article","og_title":"Creating Change Data Capture Reports in IRI Workbench","og_description":"There is now a bulk\/batch Change Data Capture (CDC) wizard in the IRI Workbench GUI for Voracity, built on Eclipse\u2122. This new graphical report builder compares previous and current data sources based on a flag field you select, and gives you the option of producing five different targets — Cumulative, Delete, Equal, Insert, and UpdateRead More","og_url":"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/","og_site_name":"IRI","article_published_time":"2015-12-17T20:18:47+00:00","article_modified_time":"2018-07-10T15:13:45+00:00","author":"Claudia Irvine","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Claudia Irvine","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#article","isPartOf":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/"},"author":{"name":"Claudia Irvine","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/72af50bbb317610e193e96392081f9b0"},"headline":"Creating Change Data Capture Reports in IRI Workbench","datePublished":"2015-12-17T20:18:47+00:00","dateModified":"2018-07-10T15:13:45+00:00","mainEntityOfPage":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/"},"wordCount":443,"commentCount":0,"publisher":{"@id":"https:\/\/www.iri.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/12\/t_Creating-Change-Data-Capture-Reports-in-IRI-Workbench-Claudia-Irvine-1-2.jpg","keywords":["CDC","Change Data Capture","compare data sources","Eclipse","graphical report builder","GUI","IRI CoSort","IRI Voracity","IRI Workbench","JSON","SortCL","wizard"],"articleSection":["Business Intelligence (BI)","ETL","IRI Workbench"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/","url":"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/","name":"Creating Change Data Capture Reports in IRI Workbench - IRI","isPartOf":{"@id":"https:\/\/www.iri.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#primaryimage"},"image":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/12\/t_Creating-Change-Data-Capture-Reports-in-IRI-Workbench-Claudia-Irvine-1-2.jpg","datePublished":"2015-12-17T20:18:47+00:00","dateModified":"2018-07-10T15:13:45+00:00","breadcrumb":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#primaryimage","url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/12\/t_Creating-Change-Data-Capture-Reports-in-IRI-Workbench-Claudia-Irvine-1-2.jpg","contentUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/12\/t_Creating-Change-Data-Capture-Reports-in-IRI-Workbench-Claudia-Irvine-1-2.jpg","width":624,"height":784},{"@type":"BreadcrumbList","@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/creating-change-data-capture-reports-in-iri-workbench\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.iri.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Creating Change Data Capture Reports in IRI Workbench"}]},{"@type":"WebSite","@id":"https:\/\/www.iri.com\/blog\/#website","url":"https:\/\/www.iri.com\/blog\/","name":"IRI","description":"Total Data Management Blog","publisher":{"@id":"https:\/\/www.iri.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.iri.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.iri.com\/blog\/#organization","name":"IRI","url":"https:\/\/www.iri.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","contentUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","width":750,"height":206,"caption":"IRI"},"image":{"@id":"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/72af50bbb317610e193e96392081f9b0","name":"Claudia Irvine","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/fb33dee44756bd13ac23f1342c2bb7b2?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/fb33dee44756bd13ac23f1342c2bb7b2?s=96&d=blank&r=g","caption":"Claudia Irvine"},"url":"https:\/\/www.iri.com\/blog\/author\/claudiai\/"}]}},"jetpack_featured_media_url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/12\/t_Creating-Change-Data-Capture-Reports-in-IRI-Workbench-Claudia-Irvine-1-2.jpg","_links":{"self":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/8604"}],"collection":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/users\/43"}],"replies":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/comments?post=8604"}],"version-history":[{"count":10,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/8604\/revisions"}],"predecessor-version":[{"id":10797,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/8604\/revisions\/10797"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/media\/8611"}],"wp:attachment":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/media?parent=8604"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/categories?post=8604"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/tags?post=8604"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}