{"id":13768,"date":"2020-06-09T16:58:34","date_gmt":"2020-06-09T20:58:34","guid":{"rendered":"http:\/\/www.iri.com\/blog\/?p=13768"},"modified":"2020-06-11T16:48:41","modified_gmt":"2020-06-11T20:48:41","slug":"datadog-collecting-leveraging-data","status":"publish","type":"post","link":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/","title":{"rendered":"Feeding Datadog with Voracity Part 3: Collecting and Leveraging IRI-Wrangled Data"},"content":{"rendered":"<p><i>This article is third in a 4-part <a href=\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/\">series<\/a> on feeding the Datadog cloud analytic platform with different kinds of data from <\/i><a href=\"https:\/\/www.iri.com\/products\/voracity\"><i>IRI Voracity<\/i><\/a><i> operations. It focuses on visualizing Voracity-wrangled in Datadog. Other articles in the series cover: relative data preparation benchmarks, wrangling and feeding data to Datadog, and using <\/i><a href=\"https:\/\/www.iri.com\/products\/darkshield\"><i>DarkShield<\/i><\/a><i> search logs in Datadog security analytics.<\/i><\/p>\n<p>In the previous <a href=\"https:\/\/www.iri.com\/blog\/business-intelligence\/data-preparation-datadog-voractiy\/\">article<\/a> of this 4-part series, I demonstrated how to prepare data in Voracity and prepare Datadog to consume it in real-time. In this article, I will show how to collect and use Voracity-prepared \u201clog\u201d for Datadog visualizations and alerts. That \u2018log\u2019 is the resulting dataset (Voracity target) of the same UK company data mentioned in the first two articles.<\/p>\n<h5><b>Leveraging Voracity Data in Datadog<\/b><\/h5>\n<p>The <a href=\"https:\/\/www.iri.com\/products\/cosort\/sortcl\">SortCL<\/a> program powering IRI CoSort data manipulations and other IRI Voracity platform operations &#8212; like DW ETL and reporting, NextForm data migration, FieldShield data masking, and RowGen test data generation &#8212; can process data from many sources and formats.<\/p>\n<p>SortCL can sort and join one or more tables and files for example; apply filtering, masking, cleansing, and data transformation logic; create detail and summary reports; and, synthesize test data.<\/p>\n<p><a href=\"\/blog\/wp-content\/uploads\/2020\/06\/cosort-transform-convert-protect-report.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-13769 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/cosort-transform-convert-protect-report.png\" alt=\"\" width=\"799\" height=\"479\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/cosort-transform-convert-protect-report.png 1000w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/cosort-transform-convert-protect-report-300x180.png 300w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/cosort-transform-convert-protect-report-768x461.png 768w\" sizes=\"(max-width: 799px) 100vw, 799px\" \/><\/a><\/p>\n<p>In all cases, SortCL results can manifest in multiple targets and formats at once, including JSON and XML. Coincidentally, Datadog automatically parses JSON and XML files, which it calls logs.<\/p>\n<p>To collect Voracity target output as \u201clogs\u201d into Datadog, first ensure that the Datadog agent is running. You can do that by executing the command .\/agent status from the bin folder of the directory that the Datadog agent was installed.<\/p>\n<p>Execute jobs in Voracity from IRI Workbench or the command prompt, ensuring that the job target writes to the directory you specified for logging. When the job finishes, Datadog will immediately send the file(s) for logging.<\/p>\n<p>Once that data is in Datadog, and any facets of the data have been specified based on extracted attributes, you can work with and visualize the data.<\/p>\n<h5><b>Datadog Log Explorer<\/b><\/h5>\n<p>The logs ingested into Datadog can be queried to find specific data. In this example, I queried the UK company data file wrangled by SortCL for all companies starting with \u201cYORV\u201d that are private limited companies located in North Yorkshire.<\/p>\n<p>The syntax for that query is as follows:\u201dYORV* AND Private Limited Company AND North Yorkshire\u201d. This is just a simple example of the Datadog search <a href=\"https:\/\/docs.datadoghq.com\/logs\/search_syntax\/\">syntax<\/a>:<\/p>\n<p><a href=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-querycap.png\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-13770 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/datadog-querycap-1024x239.png\" alt=\"\" width=\"1024\" height=\"239\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-querycap-1024x239.png 1024w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-querycap-300x70.png 300w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-querycap-768x179.png 768w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-querycap.png 1600w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/p>\n<h5><b>Visualizations, Dashboards, and Alerts<\/b><\/h5>\n<p>As stated in the prior article, all the attributes extracted from the logs must be added as facets to be able to be used in visualizations and analytics. Once facets have been added, Datadog users can take advantage of rich visualization and analytical capabilities.<\/p>\n<p>Here is an example of a table metric generated by Datadog of UK Company data after attributes have been extracted from the Datadog logs, and facets have been applied:<\/p>\n<p><a href=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-metric.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-13774 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/datadog-metric-1024x399.png\" alt=\"\" width=\"804\" height=\"313\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-metric-1024x399.png 1024w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-metric-300x117.png 300w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-metric-768x300.png 768w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-metric.png 1441w\" sizes=\"(max-width: 804px) 100vw, 804px\" \/><\/a><\/p>\n<p>Facets can also be used to create visualizations, such as charts and graphs. Visualizations can be combined in a dashboard to create a single view of information. Dashboards can be customized in many ways, with different colors, time ranges of data, and many panels to choose from, including custom text and images.<\/p>\n<p>Here is an example of a Datadog dashboard visualization of that UK company data that I had pre-processed in IRI Voracity, and which Datadog had collected in real-time:<\/p>\n<p><a href=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-13775 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time-1024x454.png\" alt=\"\" width=\"801\" height=\"355\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time-1024x454.png 1024w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time-300x133.png 300w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time-768x340.png 768w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time.png 1451w\" sizes=\"(max-width: 801px) 100vw, 801px\" \/><\/a><\/p>\n<h5><b>Datadog Alerts<\/b><\/h5>\n<p>Datadog can also send alerts when certain values are detected in specified logs. Notifications can be sent by email, or via the integrations below.<\/p>\n<p><a href=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-notifcations.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-13777 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/datadog-notifcations-1024x485.png\" alt=\"\" width=\"750\" height=\"355\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-notifcations-1024x485.png 1024w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-notifcations-300x142.png 300w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-notifcations-768x363.png 768w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-notifcations.png 1399w\" sizes=\"(max-width: 750px) 100vw, 750px\" \/><\/a><\/p>\n<p>Alerts are set up by creating a monitor. Monitors can be set to trigger when certain thresholds or values are reached. Then, alerts can be sent through email, Google Hangouts chat, Slack, Microsoft Teams, and several other tools. No matter how you stay in contact with information, Datadog can alert you.<\/p>\n<p><a href=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-monitor-alerts.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-13778 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/datadog-monitor-alerts-1024x413.png\" alt=\"\" width=\"806\" height=\"325\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-monitor-alerts-1024x413.png 1024w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-monitor-alerts-300x121.png 300w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-monitor-alerts-768x310.png 768w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-monitor-alerts.png 1600w\" sizes=\"(max-width: 806px) 100vw, 806px\" \/><\/a><\/p>\n<p>In a possible sample alerting pipeline, data could be generated, then automatically pre-processed by a batch script running on a schedule that generates a SortCL script based on file name and calls SortCL to run that script.<\/p>\n<p>The result of the script is outputted as a file to a certain directory that is set up to automatically log to Datadog. Then, once the logs have been intaken by Datadog, an alert will be sent out if a certain value is detected, over\/under a threshold, etc.<\/p>\n<p>Examine Voracity\u2019s <a href=\"https:\/\/www.iri.com\/products\/voracity\/technical-details#capabilities\">capabilities<\/a> and Datadog\u2019s <a href=\"https:\/\/docs.datadoghq.com\/\">documentation<\/a> to appreciate more of what these combined technologies can do to speed business intelligence and data security pipelines.<\/p>\n<p>In the <a href=\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-security-analytics-darkshield\/\">next<\/a> and final article of this series, I will be working with data from another Voracity component, <a href=\"https:\/\/www.iri.com\/products\/darkshield\">IRI DarkShield<\/a>, which finds and masks PII in unstructured sources. Datadog can \u2018eat\u2019 DarkShield search logs (<i>.darkdata<\/i> files) to create visualizations and alerts that can help companies in their battle to improve data security.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This article is third in a 4-part series on feeding the Datadog cloud analytic platform with different kinds of data from IRI Voracity operations. It focuses on visualizing Voracity-wrangled in Datadog. Other articles in the series cover: relative data preparation benchmarks, wrangling and feeding data to Datadog, and using DarkShield search logs in Datadog security<\/p>\n<div><a class=\"btn-filled btn\" href=\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/\" title=\"Feeding Datadog with Voracity Part 3: Collecting and Leveraging IRI-Wrangled Data\">Read More<\/a><\/div>\n","protected":false},"author":119,"featured_media":13775,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[108,32],"tags":[1473,273,359,1472,100,789,981,68,1474],"class_list":["post-13768","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-big-data-2","category-business-intelligence","tag-alerts","tag-bi","tag-data-preparation","tag-datadog","tag-etl","tag-iri-voracity","tag-logging","tag-sortcl","tag-visualizations"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v23.4 (Yoast SEO v23.4) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Feeding Datadog with Voracity Part 3: Collecting and Leveraging IRI-Wrangled Data - IRI<\/title>\n<meta name=\"description\" content=\"The SortCL program powering IRI CoSort data manipulations and other IRI Voracity platform operations -- like DW ETL and reporting, NextForm data migration\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Feeding Datadog with Voracity Part 3: Collecting and Leveraging IRI-Wrangled Data\" \/>\n<meta property=\"og:description\" content=\"The SortCL program powering IRI CoSort data manipulations and other IRI Voracity platform operations -- like DW ETL and reporting, NextForm data migration\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/\" \/>\n<meta property=\"og:site_name\" content=\"IRI\" \/>\n<meta property=\"article:published_time\" content=\"2020-06-09T20:58:34+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-06-11T20:48:41+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1451\" \/>\n\t<meta property=\"og:image:height\" content=\"643\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Devon Kozenieski\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Devon Kozenieski\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/\"},\"author\":{\"name\":\"Devon Kozenieski\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/de972c035aaeecfc40a3ae2ea5ff7ba1\"},\"headline\":\"Feeding Datadog with Voracity Part 3: Collecting and Leveraging IRI-Wrangled Data\",\"datePublished\":\"2020-06-09T20:58:34+00:00\",\"dateModified\":\"2020-06-11T20:48:41+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/\"},\"wordCount\":806,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time.png\",\"keywords\":[\"alerts\",\"BI\",\"data preparation\",\"DataDog\",\"ETL\",\"IRI Voracity\",\"logging\",\"SortCL\",\"Visualizations\"],\"articleSection\":[\"Big Data\",\"Business Intelligence (BI&#041;\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/\",\"url\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/\",\"name\":\"Feeding Datadog with Voracity Part 3: Collecting and Leveraging IRI-Wrangled Data - IRI\",\"isPartOf\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time.png\",\"datePublished\":\"2020-06-09T20:58:34+00:00\",\"dateModified\":\"2020-06-11T20:48:41+00:00\",\"description\":\"The SortCL program powering IRI CoSort data manipulations and other IRI Voracity platform operations -- like DW ETL and reporting, NextForm data migration\",\"breadcrumb\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#primaryimage\",\"url\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time.png\",\"contentUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time.png\",\"width\":1451,\"height\":643},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.iri.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Feeding Datadog with Voracity Part 3: Collecting and Leveraging IRI-Wrangled Data\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.iri.com\/blog\/#website\",\"url\":\"https:\/\/www.iri.com\/blog\/\",\"name\":\"IRI\",\"description\":\"Total Data Management Blog\",\"publisher\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.iri.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\",\"name\":\"IRI\",\"url\":\"https:\/\/www.iri.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"contentUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"width\":750,\"height\":206,\"caption\":\"IRI\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/de972c035aaeecfc40a3ae2ea5ff7ba1\",\"name\":\"Devon Kozenieski\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e4c421588c1a85dd9a76146fe15528f7?s=96&d=blank&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e4c421588c1a85dd9a76146fe15528f7?s=96&d=blank&r=g\",\"caption\":\"Devon Kozenieski\"},\"url\":\"https:\/\/www.iri.com\/blog\/author\/devonk\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Feeding Datadog with Voracity Part 3: Collecting and Leveraging IRI-Wrangled Data - IRI","description":"The SortCL program powering IRI CoSort data manipulations and other IRI Voracity platform operations -- like DW ETL and reporting, NextForm data migration","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/","og_locale":"en_US","og_type":"article","og_title":"Feeding Datadog with Voracity Part 3: Collecting and Leveraging IRI-Wrangled Data","og_description":"The SortCL program powering IRI CoSort data manipulations and other IRI Voracity platform operations -- like DW ETL and reporting, NextForm data migration","og_url":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/","og_site_name":"IRI","article_published_time":"2020-06-09T20:58:34+00:00","article_modified_time":"2020-06-11T20:48:41+00:00","og_image":[{"width":1451,"height":643,"url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time.png","type":"image\/png"}],"author":"Devon Kozenieski","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Devon Kozenieski","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#article","isPartOf":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/"},"author":{"name":"Devon Kozenieski","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/de972c035aaeecfc40a3ae2ea5ff7ba1"},"headline":"Feeding Datadog with Voracity Part 3: Collecting and Leveraging IRI-Wrangled Data","datePublished":"2020-06-09T20:58:34+00:00","dateModified":"2020-06-11T20:48:41+00:00","mainEntityOfPage":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/"},"wordCount":806,"commentCount":0,"publisher":{"@id":"https:\/\/www.iri.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time.png","keywords":["alerts","BI","data preparation","DataDog","ETL","IRI Voracity","logging","SortCL","Visualizations"],"articleSection":["Big Data","Business Intelligence (BI&#041;"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/","url":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/","name":"Feeding Datadog with Voracity Part 3: Collecting and Leveraging IRI-Wrangled Data - IRI","isPartOf":{"@id":"https:\/\/www.iri.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#primaryimage"},"image":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time.png","datePublished":"2020-06-09T20:58:34+00:00","dateModified":"2020-06-11T20:48:41+00:00","description":"The SortCL program powering IRI CoSort data manipulations and other IRI Voracity platform operations -- like DW ETL and reporting, NextForm data migration","breadcrumb":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#primaryimage","url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time.png","contentUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time.png","width":1451,"height":643},{"@type":"BreadcrumbList","@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-collecting-leveraging-data\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.iri.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Feeding Datadog with Voracity Part 3: Collecting and Leveraging IRI-Wrangled Data"}]},{"@type":"WebSite","@id":"https:\/\/www.iri.com\/blog\/#website","url":"https:\/\/www.iri.com\/blog\/","name":"IRI","description":"Total Data Management Blog","publisher":{"@id":"https:\/\/www.iri.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.iri.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.iri.com\/blog\/#organization","name":"IRI","url":"https:\/\/www.iri.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","contentUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","width":750,"height":206,"caption":"IRI"},"image":{"@id":"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/de972c035aaeecfc40a3ae2ea5ff7ba1","name":"Devon Kozenieski","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e4c421588c1a85dd9a76146fe15528f7?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e4c421588c1a85dd9a76146fe15528f7?s=96&d=blank&r=g","caption":"Devon Kozenieski"},"url":"https:\/\/www.iri.com\/blog\/author\/devonk\/"}]}},"jetpack_featured_media_url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-real-time.png","_links":{"self":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/13768"}],"collection":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/users\/119"}],"replies":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/comments?post=13768"}],"version-history":[{"count":6,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/13768\/revisions"}],"predecessor-version":[{"id":13821,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/13768\/revisions\/13821"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/media\/13775"}],"wp:attachment":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/media?parent=13768"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/categories?post=13768"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/tags?post=13768"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}