{"id":7971,"date":"2015-05-25T11:07:58","date_gmt":"2015-05-25T15:07:58","guid":{"rendered":"http:\/\/www.iri.com\/blog\/?p=7971"},"modified":"2024-05-20T13:10:56","modified_gmt":"2024-05-20T17:10:56","slug":"scd-type-1","status":"publish","type":"post","link":"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/","title":{"rendered":"SCD Type 1"},"content":{"rendered":"<p>Dimensional data that change slowly or unpredictably is captured in <a href=\"http:\/\/www.iri.com\/blog\/data-transformation2\/introduction-to-slowly-changing-dimensions-scd\/\" target=\"_blank\" rel=\"noopener\">Slowly Changing Dimensions<\/a> (SCD) analyses. In a data warehouse environment, a dimension table has a primary key that uniquely identifies each record and other pieces of information that are known as the dimensional data.<\/p>\n<p>All the update methods for the different SCD types can be accomplished using the <a href=\"http:\/\/www.iri.com\/products\/cosort\/sortcl\" target=\"_blank\" rel=\"noopener\">SortCL<\/a> program in <a href=\"http:\/\/www.iri.com\/products\/cosort\" target=\"_blank\" rel=\"noopener\">IRI CoSort<\/a>. In the <a href=\"http:\/\/www.iri.com\/products\/voracity\" target=\"_blank\" rel=\"noopener\">IRI Voracity<\/a> data integration platform (<a href=\"https:\/\/www.iri.com\/solutions\/data-integration\">ETL tool<\/a>) powered by CoSort, there is a fit-for-purpose wizard (see below) to aid in creating the SCD job scripts the SortCL program runs.<\/p>\n<p>Most SCD types use a full outer join to match records from the original data source with records in the update source based on equating a key from each. Records with matches need to be updated. Records in the update source that do not have a match need to be added to the master.<\/p>\n<p>This article covers the SCD Type 1 model, where new information from the update data overwrites original information in the master source. \u00a0Records in the update source without matches are added to the new master. As this model involves overwriting old values with the current values, and maintains no history, it is not often used.<\/p>\n<p>The update is accomplished by joining with respect to the field ProductCode. For this example, the current data will be the source file master1.dat and update.dat is used to change values or add records in the current master source.<\/p>\n<p>The master1.dat source contains:<\/p>\n\n<table id=\"tablepress-10\" class=\"tablepress tablepress-id-10\">\n<thead>\n<tr class=\"row-1 odd\">\n\t<th class=\"column-1\">ProductCode<\/th><th class=\"column-2\">Cost<\/th><th class=\"column-3\">StartDate<\/th>\n<\/tr>\n<\/thead>\n<tbody class=\"row-hover\">\n<tr class=\"row-2 even\">\n\t<td class=\"column-1\">C123<\/td><td class=\"column-2\">125.50<\/td><td class=\"column-3\">20110228<\/td>\n<\/tr>\n<tr class=\"row-3 odd\">\n\t<td class=\"column-1\">F112<\/td><td class=\"column-2\">2365.00<\/td><td class=\"column-3\">20120101<\/td>\n<\/tr>\n<tr class=\"row-4 even\">\n\t<td class=\"column-1\">G101<\/td><td class=\"column-2\">19.25<\/td><td class=\"column-3\">20110930<\/td>\n<\/tr>\n<tr class=\"row-5 odd\">\n\t<td class=\"column-1\">J245<\/td><td class=\"column-2\">450.50<\/td><td class=\"column-3\">20110430<\/td>\n<\/tr>\n<tr class=\"row-6 even\">\n\t<td class=\"column-1\">S022<\/td><td class=\"column-2\">98.75<\/td><td class=\"column-3\">20110515<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<!-- #tablepress-10 from cache -->\n<p>In this case, the update data will all have the same StartDate. The update.dat source contains records with the following values:<\/p>\n\n<table id=\"tablepress-11\" class=\"tablepress tablepress-id-11\">\n<thead>\n<tr class=\"row-1 odd\">\n\t<th class=\"column-1\">ProductCode<\/th><th class=\"column-2\">Cost<\/th><th class=\"column-3\">StartDate<\/th>\n<\/tr>\n<\/thead>\n<tbody class=\"row-hover\">\n<tr class=\"row-2 even\">\n\t<td class=\"column-1\">F112<\/td><td class=\"column-2\">2425.00<\/td><td class=\"column-3\">20120701<\/td>\n<\/tr>\n<tr class=\"row-3 odd\">\n\t<td class=\"column-1\">J245<\/td><td class=\"column-2\">550.50<\/td><td class=\"column-3\">20120701<\/td>\n<\/tr>\n<tr class=\"row-4 even\">\n\t<td class=\"column-1\">M447<\/td><td class=\"column-2\">101.75<\/td><td class=\"column-3\">20120701<\/td>\n<\/tr>\n<tr class=\"row-5 odd\">\n\t<td class=\"column-1\">S022<\/td><td class=\"column-2\">101.75<\/td><td class=\"column-3\">20120701<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<!-- #tablepress-11 from cache -->\n<p>The new dimensional table will have these values after the update:<\/p>\n\n<table id=\"tablepress-12\" class=\"tablepress tablepress-id-12\">\n<thead>\n<tr class=\"row-1 odd\">\n\t<th class=\"column-1\">ProductCode<\/th><th class=\"column-2\">Cost<\/th><th class=\"column-3\">StartDate<\/th>\n<\/tr>\n<\/thead>\n<tbody class=\"row-hover\">\n<tr class=\"row-2 even\">\n\t<td class=\"column-1\">C123<\/td><td class=\"column-2\">125.50<\/td><td class=\"column-3\">20110228<\/td>\n<\/tr>\n<tr class=\"row-3 odd\">\n\t<td class=\"column-1\">F112<\/td><td class=\"column-2\">2425.00<\/td><td class=\"column-3\">20120701<\/td>\n<\/tr>\n<tr class=\"row-4 even\">\n\t<td class=\"column-1\">G101<\/td><td class=\"column-2\">19.25<\/td><td class=\"column-3\">20110930<\/td>\n<\/tr>\n<tr class=\"row-5 odd\">\n\t<td class=\"column-1\">J245<\/td><td class=\"column-2\">550.50<\/td><td class=\"column-3\">20120701<\/td>\n<\/tr>\n<tr class=\"row-6 even\">\n\t<td class=\"column-1\">M447<\/td><td class=\"column-2\">139.25<\/td><td class=\"column-3\">20120701<\/td>\n<\/tr>\n<tr class=\"row-7 odd\">\n\t<td class=\"column-1\">S022<\/td><td class=\"column-2\">101.75<\/td><td class=\"column-3\">20120701<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<!-- #tablepress-12 from cache -->\n<p>In the <a href=\"https:\/\/www.iri.com\/products\/workbench\/voracity-gui\">IRI Workbench GUI menu for Voracity ETL jobs<\/a>, there is a wizard to assist in the creation of scripts for updating Dimensional files and tables. This wizard is located in the Voracity dropdown on the navigation bar. First you pick the SCD type. Then the window where you select the files that are used for processing the update is displayed.<\/p>\n<p><a href=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image001-e1450814725790.png\" rel=\"attachment wp-att-8681\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-8681\" src=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image001-e1450814725790.png\" alt=\"image001\" width=\"600\" height=\"589\" \/><\/a><\/p>\n<p>The next screen is for defining the join performed with the master and update sources<\/p>\n<p><a href=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image003-e1450814745791.png\" rel=\"attachment wp-att-8682\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-8682\" src=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image003-e1450814745791.png\" alt=\"image003\" width=\"600\" height=\"645\" \/><\/a><\/p>\n<p>Below is the sortcl job script that is produced when processing the two files master1.dat and update.dat:<\/p>\n<pre>\/INFILE=C:\/IRI\/CoSort95\/workbench.orig\/workspace\/SCD\/SCD1\/master1.dat\r\n  \/PROCESS=DELIMITED\r\n  \/ALIAS=master1\r\n  \/FIELD=(PRODUCTCODE, TYPE=ASCII, POSITION=1, SEPARATOR=\",\", FRAME='\\\"')\r\n  \/FIELD=(COST, TYPE=NUMERIC, POSITION=2, SEPARATOR=\",\", FRAME='\\\"')\r\n  \/FIELD=(STARTDATE, TYPE=ASCII, POSITION=3, SEPARATOR=\",\", FRAME='\\\"')\r\n\/INFILE=C:\/IRI\/CoSort95\/workbench.orig\/workspace\/SCD\/update.dat\r\n  \/PROCESS=DELIMITED\r\n  \/ALIAS=update\r\n  \/FIELD=(PRODUCTCODE, TYPE=ASCII, POSITION=1, SEPARATOR=\",\", FRAME='\\\"')\r\n  \/FIELD=(COST, TYPE=NUMERIC, POSITION=2, SEPARATOR=\",\", FRAME='\\\"')\r\n  \/FIELD=(STARTDATE, TYPE=ASCII, POSITION=3, SEPARATOR=\",\", FRAME='\\\"')\r\n\r\n\/JOIN FULL_OUTER NOT_SORTED master1 NOT_SORTED update WHERE MASTER1.PRODUCTCODE == UPDATE.PRODUCTCODE\r\n\r\n\/OUTFILE=\/master1.dat\r\n# This processes all except the new records\r\n  \/PROCESS=DELIMITED\r\n  \/FIELD=(MASTER1.PRODUCTCODE, TYPE=ASCII, POSITION=1, SEPARATOR=\",\", FRAME='\\\"')\r\n  \/FIELD=(COST_NEW, TYPE=NUMERIC, POSITION=2, SEPARATOR=\",\", FRAME='\\\"', IF MASTER1.PRODUCTCODE EQ UPDATE.PRODUCTCODE THEN UPDATE.COST ELSE MASTER1.COST)\r\n  \/FIELD=(STARTDATE_NEW, TYPE=ASCII, POSITION=3, SEPARATOR=\",\", FRAME='\\\"', IF MASTER1.PRODUCTCODE EQ UPDATE.PRODUCTCODE THEN UPDATE.STARTDATE ELSE MASTER1.STARTDATE)\r\n  \/INCLUDE WHERE MASTER1.PRODUCTCODE NE \"\"\r\n\/OUTFILE=master1.dat\r\n# This processes the new records to be added\r\n  \/PROCESS=DELIMITED\r\n  \/FIELD=(UPDATE.PRODUCTCODE, TYPE=ASCII, POSITION=1, SEPARATOR=\",\", FRAME='\\\"')\r\n  \/FIELD=(UPDATE.COST, TYPE=NUMERIC, POSITION=2, SEPARATOR=\",\", FRAME='\\\"')\r\n  \/FIELD=(UPDATE.STARTDATE, TYPE=ASCII, POSITION=3, SEPARATOR=\",\", FRAME='\\\"') I \r\n  \/INCLUDE WHERE MASTER1.PRODUCTCODE EQ \"\"<\/pre>\n","protected":false},"excerpt":{"rendered":"<p>Dimensional data that change slowly or unpredictably is captured in Slowly Changing Dimensions (SCD) analyses. In a data warehouse environment, a dimension table has a primary key that uniquely identifies each record and other pieces of information that are known as the dimensional data. All the update methods for the different SCD types can be<\/p>\n<div><a class=\"btn-filled btn\" href=\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/\" title=\"SCD Type 1\">Read More<\/a><\/div>\n","protected":false},"author":10,"featured_media":8682,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[32,1,776,3],"tags":[922,11,107,1742,328,101,927,46,924,925,546,789,926,921,928,87,68,923],"class_list":["post-7971","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-business-intelligence","category-data-transformation2","category-etl","category-vldb-operations","tag-categorical-variable","tag-data-filtering","tag-data-integration","tag-data-labeling","tag-data-management","tag-data-warehouse","tag-dimensional-data","tag-etl-tools","tag-filtering","tag-grouping","tag-iri-cosort","tag-iri-voracity","tag-labeling","tag-scd","tag-scripts","tag-slowly-changing-dimensions","tag-sortcl","tag-statistics"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v23.4 (Yoast SEO v23.4) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>SCD Type 1 - IRI<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"SCD Type 1\" \/>\n<meta property=\"og:description\" content=\"Dimensional data that change slowly or unpredictably is captured in Slowly Changing Dimensions (SCD) analyses. In a data warehouse environment, a dimension table has a primary key that uniquely identifies each record and other pieces of information that are known as the dimensional data. All the update methods for the different SCD types can beRead More\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/\" \/>\n<meta property=\"og:site_name\" content=\"IRI\" \/>\n<meta property=\"article:published_time\" content=\"2015-05-25T15:07:58+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-05-20T17:10:56+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image003-e1450814745791.png\" \/>\n\t<meta property=\"og:image:width\" content=\"600\" \/>\n\t<meta property=\"og:image:height\" content=\"645\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Susan Gegner\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Susan Gegner\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/\"},\"author\":{\"name\":\"Susan Gegner\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/87be5da567628ab9396ca81170f36d63\"},\"headline\":\"SCD Type 1\",\"datePublished\":\"2015-05-25T15:07:58+00:00\",\"dateModified\":\"2024-05-20T17:10:56+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/\"},\"wordCount\":385,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image003-e1450814745791.png\",\"keywords\":[\"categorical variable\",\"data filtering\",\"data integration\",\"data labeling\",\"data management\",\"data warehouse\",\"dimensional data\",\"ETL tools\",\"filtering\",\"grouping\",\"IRI CoSort\",\"IRI Voracity\",\"labeling\",\"SCD\",\"scripts\",\"slowly changing dimensions\",\"SortCL\",\"statistics\"],\"articleSection\":[\"Business Intelligence (BI&#041;\",\"Data Transformation\",\"ETL\",\"VLDB\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/\",\"url\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/\",\"name\":\"SCD Type 1 - IRI\",\"isPartOf\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image003-e1450814745791.png\",\"datePublished\":\"2015-05-25T15:07:58+00:00\",\"dateModified\":\"2024-05-20T17:10:56+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#primaryimage\",\"url\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image003-e1450814745791.png\",\"contentUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image003-e1450814745791.png\",\"width\":600,\"height\":645},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.iri.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"SCD Type 1\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.iri.com\/blog\/#website\",\"url\":\"https:\/\/www.iri.com\/blog\/\",\"name\":\"IRI\",\"description\":\"Total Data Management Blog\",\"publisher\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.iri.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\",\"name\":\"IRI\",\"url\":\"https:\/\/www.iri.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"contentUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"width\":750,\"height\":206,\"caption\":\"IRI\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/87be5da567628ab9396ca81170f36d63\",\"name\":\"Susan Gegner\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/2b1ca5592a65d44483351292cf1ae00a?s=96&d=blank&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/2b1ca5592a65d44483351292cf1ae00a?s=96&d=blank&r=g\",\"caption\":\"Susan Gegner\"},\"url\":\"https:\/\/www.iri.com\/blog\/author\/susang\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"SCD Type 1 - IRI","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/","og_locale":"en_US","og_type":"article","og_title":"SCD Type 1","og_description":"Dimensional data that change slowly or unpredictably is captured in Slowly Changing Dimensions (SCD) analyses. In a data warehouse environment, a dimension table has a primary key that uniquely identifies each record and other pieces of information that are known as the dimensional data. All the update methods for the different SCD types can beRead More","og_url":"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/","og_site_name":"IRI","article_published_time":"2015-05-25T15:07:58+00:00","article_modified_time":"2024-05-20T17:10:56+00:00","og_image":[{"width":600,"height":645,"url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image003-e1450814745791.png","type":"image\/png"}],"author":"Susan Gegner","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Susan Gegner","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#article","isPartOf":{"@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/"},"author":{"name":"Susan Gegner","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/87be5da567628ab9396ca81170f36d63"},"headline":"SCD Type 1","datePublished":"2015-05-25T15:07:58+00:00","dateModified":"2024-05-20T17:10:56+00:00","mainEntityOfPage":{"@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/"},"wordCount":385,"commentCount":0,"publisher":{"@id":"https:\/\/www.iri.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image003-e1450814745791.png","keywords":["categorical variable","data filtering","data integration","data labeling","data management","data warehouse","dimensional data","ETL tools","filtering","grouping","IRI CoSort","IRI Voracity","labeling","SCD","scripts","slowly changing dimensions","SortCL","statistics"],"articleSection":["Business Intelligence (BI&#041;","Data Transformation","ETL","VLDB"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/","url":"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/","name":"SCD Type 1 - IRI","isPartOf":{"@id":"https:\/\/www.iri.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#primaryimage"},"image":{"@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image003-e1450814745791.png","datePublished":"2015-05-25T15:07:58+00:00","dateModified":"2024-05-20T17:10:56+00:00","breadcrumb":{"@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#primaryimage","url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image003-e1450814745791.png","contentUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image003-e1450814745791.png","width":600,"height":645},{"@type":"BreadcrumbList","@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/scd-type-1\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.iri.com\/blog\/"},{"@type":"ListItem","position":2,"name":"SCD Type 1"}]},{"@type":"WebSite","@id":"https:\/\/www.iri.com\/blog\/#website","url":"https:\/\/www.iri.com\/blog\/","name":"IRI","description":"Total Data Management Blog","publisher":{"@id":"https:\/\/www.iri.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.iri.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.iri.com\/blog\/#organization","name":"IRI","url":"https:\/\/www.iri.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","contentUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","width":750,"height":206,"caption":"IRI"},"image":{"@id":"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/87be5da567628ab9396ca81170f36d63","name":"Susan Gegner","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/2b1ca5592a65d44483351292cf1ae00a?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2b1ca5592a65d44483351292cf1ae00a?s=96&d=blank&r=g","caption":"Susan Gegner"},"url":"https:\/\/www.iri.com\/blog\/author\/susang\/"}]}},"jetpack_featured_media_url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2015\/05\/image003-e1450814745791.png","_links":{"self":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/7971"}],"collection":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/comments?post=7971"}],"version-history":[{"count":24,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/7971\/revisions"}],"predecessor-version":[{"id":17445,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/7971\/revisions\/17445"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/media\/8682"}],"wp:attachment":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/media?parent=7971"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/categories?post=7971"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/tags?post=7971"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}