{"id":13824,"date":"2020-06-15T11:32:24","date_gmt":"2020-06-15T15:32:24","guid":{"rendered":"http:\/\/www.iri.com\/blog\/?p=13824"},"modified":"2020-06-22T17:57:06","modified_gmt":"2020-06-22T21:57:06","slug":"data-quality-rules-workbench","status":"publish","type":"post","link":"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/","title":{"rendered":"Data Quality Rules in IRI Workbench"},"content":{"rendered":"<p><a href=\"https:\/\/www.iri.com\/products\/workbench\">IRI Workbench<\/a> now contains a section of data cleansing, enrichment, and validation rules called <i>Data Quality Rules<\/i> for use in IRI CoSort data transformation and IRI Voracity ETL, reporting and data wrangling jobs. The selected rules automatically serialize many of the <a href=\"https:\/\/www.iri.com\/solutions\/data-integration\/implement\/data-quality\">data quality functions<\/a>, long supported in their common <a href=\"https:\/\/www.iri.com\/products\/cosort\/sortcl\">SortCL<\/a> program, into task scripts or batch workflows ready for execution, modification, sharing, or expansion.<\/p>\n<figure id=\"attachment_13842\" class=\"thumbnail wp-caption aligncenter style=\"width: 510px\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-13842\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/VoracityDQ-1024x1024.png\" alt=\"IRI Voracity Data Quality Functionality\" width=\"500\" height=\"500\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/VoracityDQ-1024x1024.png 1024w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/VoracityDQ-150x150.png 150w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/VoracityDQ-300x300.png 300w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/VoracityDQ-768x768.png 768w\" sizes=\"(max-width: 500px) 100vw, 500px\" \/><figcaption class=\"caption wp-caption-text\">Data quality functions in IRI CoSort and IRI Voracity<\/figcaption><\/figure>\n<p>While some of these rules may be found in other categories, there is now a centralized page for them. The data quality rules are further divided into Field Rules and Section Rules, depending on how they are applied in SortCL scripts.<\/p>\n<p><a href=\"\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-13829 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule.png\" alt=\"\" width=\"501\" height=\"499\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule.png 511w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule-150x150.png 150w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule-300x300.png 300w\" sizes=\"(max-width: 501px) 100vw, 501px\" \/><\/a><\/p>\n<h5><b>Field Rules<\/b><\/h5>\n<h6><b><i>Alignment<\/i><\/b><\/h6>\n<p>This rule is used to align data. It is helpful for unifying the format of data, and in generating values for lookup (set) files where their column data need to be right- or left-aligned.<\/p>\n<p>When used in the virtual record layout (inrec) or target (output) section of a job script, this rule aligns the field string without its leading or trailing fill characters. The remaining length of the target field is populated with spaces or a pad character.<\/p>\n<p>For example, on this input source:<\/p>\n<pre>McKinley William \u00a0 \u00a0 \u00a0 1897-1901\u00a0\r\nRoosevelt Theodore \u00a0 \u00a0 1901-1909\u00a0\r\nTaft William H.\u00a0 \u00a0 \u00a0 \u00a0 1909-1913\u00a0\r\nWilson Woodrow \u00a0 \u00a0 \u00a0 \u00a0 1913-1921\u00a0\r\nHarding Warren G.\u00a0 \u00a0 \u00a0 1921-1923<\/pre>\n<p>the president field can be shifted to the right using right-align.<\/p>\n<pre>\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0McKinley William 1897-1901\u00a0\r\n\u00a0\u00a0\u00a0 Roosevelt Theodore 1901-1909\u00a0\r\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Taft William H. 1909-1913\u00a0\r\n\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Wilson Woodrow 1913-1921\u00a0\r\n\u00a0\u00a0\u00a0\u00a0 Harding Warren G. 1921-1923<\/pre>\n<p><a href=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-alignment.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-13830 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-alignment.png\" alt=\"\" width=\"511\" height=\"443\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-alignment.png 511w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-alignment-300x260.png 300w\" sizes=\"(max-width: 511px) 100vw, 511px\" \/><\/a><\/p>\n<h6><b><i>Compound Data Values<\/i><\/b><\/h6>\n<p>Compound data values allow you to specify a standard format for data that you can use for enrichment, lookup transformations, and synthesis (test data generation). This rule does two things:\u00a0 It creates a set file containing the compound data and assigns that set file in the rule.<\/p>\n<p>In the example below, a US-formatted telephone number is created in the wizard using parenthesis and a dash and populated with either custom-ranged or randomly-generated numbers:<\/p>\n<p><a href=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-compound-data.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-13831 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-compound-data.png\" alt=\"\" width=\"511\" height=\"482\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-compound-data.png 511w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-compound-data-300x283.png 300w\" sizes=\"(max-width: 511px) 100vw, 511px\" \/><\/a><\/p>\n<h6><b><i>String Quality Functions<\/i><\/b><\/h6>\n<p>This rule opens a page with a list of functions that can be applied to strings. It contains items such as changing case, substring, and trim.<\/p>\n<p>For example, sub_string can change this input:<\/p>\n<pre>McKinley, William\r\nRoosevelt, Theodore\r\nTaft, William H.\r\nWilson, Woodrow\r\nHarding, Warren G.<\/pre>\n<p>to this output:<\/p>\n<pre>McKin\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \r\nRoose\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \r\nTaft,\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \r\nWilso\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \r\nHardi<\/pre>\n<p><a href=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-string-quality-functions.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-13832 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-string-quality-functions.png\" alt=\"\" width=\"587\" height=\"534\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-string-quality-functions.png 587w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-string-quality-functions-300x273.png 300w\" sizes=\"(max-width: 587px) 100vw, 587px\" \/><\/a><\/p>\n<h5><b>Section Rules<\/b><\/h5>\n<h6><b><i>Contains Value Test<\/i><\/b><\/h6>\n<p>This rule applies a test to a field to see if the value specified is included in the field. That result is used to filter rows specified in the section or in a conditional if-then-else statement that creates a new field with data specific to whether the test passed or failed. See the Lookup Value Test below for an example with an if-then-else-statement.<\/p>\n<p>For example, this condition and filter created by the details in the screenshot below,<\/p>\n<pre>\/CONDITION=(CONTAINS_TEST, TEST=(isholding(LAST_NAME, \"Smith\")))\r\n\/INCLUDE WHERE CONTAINS_TEST<\/pre>\n<p>sends only qualifying rows (where the last name is Smith) to the target.<\/p>\n<p><a href=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-value-test.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-13833 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-value-test.png\" alt=\"\" width=\"511\" height=\"443\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-value-test.png 511w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-value-test-300x260.png 300w\" sizes=\"(max-width: 511px) 100vw, 511px\" \/><\/a><\/p>\n<h6><b><i>Data Type Test<\/i><\/b><\/h6>\n<p>This rule can be used to validate and include or exclude data on the basis of its actual type. Multiple types of data type or format tests are available from this function\u2019s drop-down menu. The result is used in the section as a filter or in an if-then-else statement.<\/p>\n<p>For example, this condition and filter created by the details in the screenshot,<\/p>\n<pre>\/CONDITION=(DATA_TYPE_TEST, TEST=(isempty(LAST_NAME)))\r\n\/OMIT WHERE DATA_TYPE_TEST<\/pre>\n<p>omits the record if the value of the last name field is empty.<\/p>\n<p><a href=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-type-test.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-13834 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-type-test.png\" alt=\"\" width=\"511\" height=\"443\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-type-test.png 511w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-type-test-300x260.png 300w\" sizes=\"(max-width: 511px) 100vw, 511px\" \/><\/a><\/p>\n<h6><b><i>Lookup Value Test<\/i><\/b><\/h6>\n<p>This rule checks to see if the value in the specified field is included in the specified set file or table. The result is used in the section as a filter or in an if-then-else statement.<\/p>\n<p>For example, the details in this screenshot create a field created from the set file to test against, a condition to compare the value from the set file to make sure it matches that data (and doesn\u2019t return null), and another field that uses that condition to return the desired value.<\/p>\n<pre>\/FIELD=(LOOKUP_LAST_NAME, TYPE=ASCII, POSITION=9, SEPARATOR=\"\\t\", \r\n   SET=\"C:\/IRI\/cosort100\/sets\/names\/names_last.set\" [LAST_NAME] DEFAULT=\"FALSE\")\r\n\/CONDITION=(LOOKUP_LAST_NAME_TEST, TEST=(NOT ispattern(LOOKUP_LAST_NAME, \r\n   \"FALSE\")))\r\n\/FIELD=(IF_FIELD, TYPE=ASCII, POSITION=10, SEPARATOR=\"\\t\", \r\n   IF LOOKUP_LAST_NAME_TEST THEN LAST_NAME ELSE \"Missing\")<\/pre>\n<p>The result is if the LAST_NAME is contained in the set file, it will return the last name, else it will return \u201cMissing\u201d.<\/p>\n<p><a href=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-value-test-2.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-13835 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-value-test-2.png\" alt=\"\" width=\"511\" height=\"443\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-value-test-2.png 511w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-value-test-2-300x260.png 300w\" sizes=\"(max-width: 511px) 100vw, 511px\" \/><\/a><\/p>\n<h6><b><i>Pattern Test<\/i><\/b><\/h6>\n<p>This rule compares the value in the specified field to a pattern to determine if it matches.\u00a0 The result is used in the section as a filter or in an if-then-else statement.<\/p>\n<p>For example, this condition and filter created by the details in the screenshot,<\/p>\n<pre>\/CONDITION=(PATTERN_TEST, TEST=(ispattern(EMAIL, \r\n\"\\\\b[\\\\w._%+-]+@[\\\\w.-]+\\\\.[A-Za-z]{2,4}\\\\b\")))\r\n\/INCLUDE WHERE PATTERN_TEST<\/pre>\n<p>only includes records that have a properly formatted email address.<\/p>\n<p><a href=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-pattern-test.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-13836 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-pattern-test.png\" alt=\"\" width=\"515\" height=\"443\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-pattern-test.png 515w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-pattern-test-300x258.png 300w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-pattern-test-350x300.png 350w\" sizes=\"(max-width: 515px) 100vw, 515px\" \/><\/a><\/p>\n<h6><b><i>Value Range Test<\/i><\/b><\/h6>\n<p>Finally, this rule determines if the value in the specified field is in the range specified.\u00a0 The result is used in the section as a filter or in an if-then-else statement.<\/p>\n<p>For example, these two conditions and two filters created by the details in the screenshot,<\/p>\n<pre>\/CONDITION=(LOW_END, TEST=(SALARY LT 1500))\r\n\/CONDITION=(HIGH_END, TEST=(SALARY GT 5000))\r\n\/INCLUDE WHERE LOW_END\r\n\/INCLUDE WHERE HIGH_END<\/pre>\n<p>test that the salary value is within the range of 1500 to 5000.<\/p>\n<p><a href=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-valve-range-test.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-13837 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/data-quality-valve-range-test.png\" alt=\"\" width=\"511\" height=\"443\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-valve-range-test.png 511w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/data-quality-valve-range-test-300x260.png 300w\" sizes=\"(max-width: 511px) 100vw, 511px\" \/><\/a><\/p>\n<p>For more information on each rule, all the dialogs include help and tips upon hover to guide the user. If you need help implementing Voracity data mapping, data quality, data masking, or test data generation rules in IRI Workbench, contact or your <a href=\"https:\/\/www.iri.com\/partners\/resellers\">IRI representative<\/a> or email <a href=\"mailto:voracity@iri.com\">voracity@iri.com<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>IRI Workbench now contains a section of data cleansing, enrichment, and validation rules called Data Quality Rules for use in IRI CoSort data transformation and IRI Voracity ETL, reporting and data wrangling jobs. The selected rules automatically serialize many of the data quality functions, long supported in their common SortCL program, into task scripts or<\/p>\n<div><a class=\"btn-filled btn\" href=\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/\" title=\"Data Quality Rules in IRI Workbench\">Read More<\/a><\/div>\n","protected":false},"author":43,"featured_media":13829,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[363,1,776,91],"tags":[366,5,1163,100,789,850,68],"class_list":["post-13824","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-quality","category-data-transformation2","category-etl","category-iri-workbench","tag-data-quality-2","tag-data-transformation","tag-data-wrangling","tag-etl","tag-iri-voracity","tag-iri-workbench","tag-sortcl"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v23.4 (Yoast SEO v23.4) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Data Quality Rules in IRI Workbench - IRI<\/title>\n<meta name=\"description\" content=\"IRI Workbench now contains a section of data cleansing, enrichment, and validation rules called Data Quality Rules for use in IRI CoSort data transformation\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Data Quality Rules in IRI Workbench\" \/>\n<meta property=\"og:description\" content=\"IRI Workbench now contains a section of data cleansing, enrichment, and validation rules called Data Quality Rules for use in IRI CoSort data transformation\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/\" \/>\n<meta property=\"og:site_name\" content=\"IRI\" \/>\n<meta property=\"article:published_time\" content=\"2020-06-15T15:32:24+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-06-22T21:57:06+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule.png\" \/>\n\t<meta property=\"og:image:width\" content=\"511\" \/>\n\t<meta property=\"og:image:height\" content=\"509\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Claudia Irvine\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Claudia Irvine\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/\"},\"author\":{\"name\":\"Claudia Irvine\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/72af50bbb317610e193e96392081f9b0\"},\"headline\":\"Data Quality Rules in IRI Workbench\",\"datePublished\":\"2020-06-15T15:32:24+00:00\",\"dateModified\":\"2020-06-22T21:57:06+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/\"},\"wordCount\":796,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule.png\",\"keywords\":[\"data quality\",\"data transformation\",\"data wrangling\",\"ETL\",\"IRI Voracity\",\"IRI Workbench\",\"SortCL\"],\"articleSection\":[\"Data Quality (DQ&#041;\",\"Data Transformation\",\"ETL\",\"IRI Workbench\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/\",\"url\":\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/\",\"name\":\"Data Quality Rules in IRI Workbench - IRI\",\"isPartOf\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule.png\",\"datePublished\":\"2020-06-15T15:32:24+00:00\",\"dateModified\":\"2020-06-22T21:57:06+00:00\",\"description\":\"IRI Workbench now contains a section of data cleansing, enrichment, and validation rules called Data Quality Rules for use in IRI CoSort data transformation\",\"breadcrumb\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#primaryimage\",\"url\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule.png\",\"contentUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule.png\",\"width\":511,\"height\":509},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.iri.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Data Quality Rules in IRI Workbench\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.iri.com\/blog\/#website\",\"url\":\"https:\/\/www.iri.com\/blog\/\",\"name\":\"IRI\",\"description\":\"Total Data Management Blog\",\"publisher\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.iri.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\",\"name\":\"IRI\",\"url\":\"https:\/\/www.iri.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"contentUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"width\":750,\"height\":206,\"caption\":\"IRI\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/72af50bbb317610e193e96392081f9b0\",\"name\":\"Claudia Irvine\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/fb33dee44756bd13ac23f1342c2bb7b2?s=96&d=blank&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/fb33dee44756bd13ac23f1342c2bb7b2?s=96&d=blank&r=g\",\"caption\":\"Claudia Irvine\"},\"url\":\"https:\/\/www.iri.com\/blog\/author\/claudiai\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Data Quality Rules in IRI Workbench - IRI","description":"IRI Workbench now contains a section of data cleansing, enrichment, and validation rules called Data Quality Rules for use in IRI CoSort data transformation","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/","og_locale":"en_US","og_type":"article","og_title":"Data Quality Rules in IRI Workbench","og_description":"IRI Workbench now contains a section of data cleansing, enrichment, and validation rules called Data Quality Rules for use in IRI CoSort data transformation","og_url":"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/","og_site_name":"IRI","article_published_time":"2020-06-15T15:32:24+00:00","article_modified_time":"2020-06-22T21:57:06+00:00","og_image":[{"width":511,"height":509,"url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule.png","type":"image\/png"}],"author":"Claudia Irvine","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Claudia Irvine","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#article","isPartOf":{"@id":"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/"},"author":{"name":"Claudia Irvine","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/72af50bbb317610e193e96392081f9b0"},"headline":"Data Quality Rules in IRI Workbench","datePublished":"2020-06-15T15:32:24+00:00","dateModified":"2020-06-22T21:57:06+00:00","mainEntityOfPage":{"@id":"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/"},"wordCount":796,"commentCount":0,"publisher":{"@id":"https:\/\/www.iri.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule.png","keywords":["data quality","data transformation","data wrangling","ETL","IRI Voracity","IRI Workbench","SortCL"],"articleSection":["Data Quality (DQ&#041;","Data Transformation","ETL","IRI Workbench"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/","url":"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/","name":"Data Quality Rules in IRI Workbench - IRI","isPartOf":{"@id":"https:\/\/www.iri.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#primaryimage"},"image":{"@id":"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule.png","datePublished":"2020-06-15T15:32:24+00:00","dateModified":"2020-06-22T21:57:06+00:00","description":"IRI Workbench now contains a section of data cleansing, enrichment, and validation rules called Data Quality Rules for use in IRI CoSort data transformation","breadcrumb":{"@id":"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#primaryimage","url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule.png","contentUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule.png","width":511,"height":509},{"@type":"BreadcrumbList","@id":"https:\/\/www.iri.com\/blog\/data-quality\/data-quality-rules-workbench\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.iri.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Data Quality Rules in IRI Workbench"}]},{"@type":"WebSite","@id":"https:\/\/www.iri.com\/blog\/#website","url":"https:\/\/www.iri.com\/blog\/","name":"IRI","description":"Total Data Management Blog","publisher":{"@id":"https:\/\/www.iri.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.iri.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.iri.com\/blog\/#organization","name":"IRI","url":"https:\/\/www.iri.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","contentUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","width":750,"height":206,"caption":"IRI"},"image":{"@id":"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/72af50bbb317610e193e96392081f9b0","name":"Claudia Irvine","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/fb33dee44756bd13ac23f1342c2bb7b2?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/fb33dee44756bd13ac23f1342c2bb7b2?s=96&d=blank&r=g","caption":"Claudia Irvine"},"url":"https:\/\/www.iri.com\/blog\/author\/claudiai\/"}]}},"jetpack_featured_media_url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/new-data-quality-rule.png","_links":{"self":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/13824"}],"collection":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/users\/43"}],"replies":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/comments?post=13824"}],"version-history":[{"count":10,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/13824\/revisions"}],"predecessor-version":[{"id":13846,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/13824\/revisions\/13846"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/media\/13829"}],"wp:attachment":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/media?parent=13824"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/categories?post=13824"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/tags?post=13824"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}