{"id":13734,"date":"2020-06-05T16:35:06","date_gmt":"2020-06-05T20:35:06","guid":{"rendered":"http:\/\/www.iri.com\/blog\/?p=13734"},"modified":"2023-02-27T05:07:28","modified_gmt":"2023-02-27T10:07:28","slug":"datadog-with-voracity","status":"publish","type":"post","link":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/","title":{"rendered":"Feeding Datadog with Voracity Part 1: Datadog\u2019s Fast Friend"},"content":{"rendered":"<p><i>This article is first in a 4-part series on feeding the Datadog cloud analytic platform with different kinds of data from <\/i><a href=\"https:\/\/www.iri.com\/products\/voracity\"><i>IRI Voracity<\/i><\/a><i> operations. It focuses on the value of Datadog and Voracity together. Subsequent articles cover: <a href=\"https:\/\/www.iri.com\/blog\/business-intelligence\/data-preparation-datadog-voractiy\/\">preparing<\/a> data in Voracity and feeding it to Datadog; using Voracity-wrangled data in Datadog visualizations; and, using <\/i><a href=\"https:\/\/www.iri.com\/products\/darkshield\"><i>IRI DarkShield<\/i><\/a><i> search results in Datadog to improve data security.<\/i><\/p>\n<p>In previous articles linked <a href=\"https:\/\/www.iri.com\/solutions\/business-intelligence\/splunk\">here<\/a>, we explained how to index Splunk with target data for BI, and log data for SIEM analytics, directly from <a href=\"https:\/\/www.iri.com\/products\/voracity\">IRI Voracity<\/a> ETL\/wrangling and PII discovery jobs. Splunk users can leverage several purpose-built IRI connection options to accelerate their information production and improve data security. But what if you use <a href=\"https:\/\/www.datadog.com\">Datadog<\/a>?<\/p>\n<h5><b>What is Datadog?<\/b><\/h5>\n<p>Datadog is also a web-facing application for monitoring data feeds, analyzing trends, building analytic dashboard displays, and sending alerts. It was easy to configure Datadog to collect and work with data from the Voracity ecosystem.<\/p>\n<p><a href=\"\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-13737 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram.png\" alt=\"\" width=\"633\" height=\"336\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram.png 565w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram-300x159.png 300w\" sizes=\"(max-width: 633px) 100vw, 633px\" \/><\/a><\/p>\n<h5><b>What Datadog Eats<\/b><\/h5>\n<p>Datadog can work with log data from data and database profiling and discovery jobs in the<a href=\"https:\/\/www.iri.com\/products\/workbench\/discover-data\"> IRI Workbench<\/a> graphical IDE for Voracity, built on Eclipse\u2122, <i>and<\/i> <i>with <\/i>data targets from Voracity\u2019s back-end CoSort <a href=\"https:\/\/www.iri.com\/products\/cosort\/sortcl\">SortCL<\/a> engine in ETL, migration, data cleansing, masking, and reporting jobs.<\/p>\n<p>Of course, jobs in fit-for-purpose IRI products that Voracity <a href=\"https:\/\/www.iri.com\/products\/voracity\/technical-details#components\">subsumes<\/a> and SortCL drives &#8212; like CoSort, NextForm, FieldShield, DarkShield, and RowGen &#8212; are also included in this group. But no matter what the source or nature of the data you\u2019re feeding Datadog is, Datadog refers to that data as a \u201clog\u201d or \u201clogs\u201d.<\/p>\n<h5><b>How Datadog Eats<\/b><\/h5>\n<p>Data feeds, or \u201clogs\u201d from all Voracity-supported operations are not pushed to Datadog as they would be into Splunk through an app, add-on or forwarder. Instead, Datadog automatically <i>pulls Voracity output data up<\/i>, in real-time, from a collection agent on each machine getting the data.<\/p>\n<p><a href=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-agent.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-13739 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/datadog-agent-1024x343.png\" alt=\"\" width=\"899\" height=\"301\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-agent-1024x343.png 1024w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-agent-300x100.png 300w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-agent-768x257.png 768w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-agent.png 1321w\" sizes=\"(max-width: 899px) 100vw, 899px\" \/><\/a><\/p>\n<h5><b>Does Datadog Need Voracity?<\/b><\/h5>\n<p>In cases where there is a need for offline, big data preparation <i>before <\/i>data is emitted, and can be processed on infrastructure external to Datadog, Voracity can provide high-performance data wrangling. This may not be a typical case for Datadog, though it is for Voracity users in ETL and data lake environments who wish to hand-off blended results to Datadog for further analysis and display.<\/p>\n<p>We note that Datadog typically ingests data that streams in real-time from applications, software tools, DB caches and other log emitters. But again in this situation, Voracity is pre-processing an entire set of data sources destined for analysis in Datadog. In a later article, we will present a use case of streaming error and audit logs, plus operational security data from Voracity and the PII searching and masking results from its component <a href=\"https:\/\/www.iri.com\/products\/voracity\/technical-details#components\">products<\/a>, IRI DarkShield and CellShield EE.<\/p>\n<p>Datadog is a full-featured monitoring, dashboarding, and data processing service. Datadog ingests and processes log data as it comes in. While the first logs will show up within ten seconds, processing large amounts of data as logs into Datadog will take longer for all the logs to show up. The exact time varies by both volume and connection speed.<\/p>\n<p>Even with a very fast connection &#8212; like a 1GB\/s fiber channel &#8212; it will take Datadog additional time to process raw data even after it has been fully uploaded. Data is not visible in the Datadog Log Explorer for viewing, filtering, visualizations, etc. until it has been uploaded and processed.<\/p>\n<p>While Datadog is typically used to process smaller log files in near-real time, Voracity users can process very large files into much smaller subsets to lower the overall size of the data. For an entire 2.1 GB file, raw data preparation in Datadog (an initial stage of data indexing and optimization for logs to be visible for later filtering, sorting, and visualization in the Datadog Log Explorer) takes about 8 minutes, in addition to the 30 seconds it takes to upload into Datadog. Datadog processes the data as it comes, so the first logs from the file will be visible almost immediately. It takes about 8 minutes for all of the data from the file to be processed and visible in Datadog\u2019s log explorer.<\/p>\n<p>Datadog processes logs as they are uploaded, so slower speeds such as 500 MB\/s or even 200 MB\/s may make no difference in the total processing\/uploading time. However, at a certain threshold, likely 100 MB\/s or slower, the total processing\/uploading time becomes longer.<\/p>\n<p>Regardless of upload speeds however, Voracity can speed everything up by externally processing data ahead of Datadog. Voracity can sort, join, aggregate, reformat, filter, cleanse and mask data, among other <a href=\"https:\/\/www.iri.com\/products\/voracity\/features-benefits\">functions<\/a>. Voracity also excels at breaking very large files into files that contain just the data you want, in the format you need (like JSON or XML for Datadog).<\/p>\n<p><a href=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/08\/vorcity-flyer-front-2019-no-top-e1567188793648.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-16385 size-large\" src=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2021\/08\/voracity-flyer-front-no-banner-1024x695.png\" alt=\"IRI Voracity data management platform\" width=\"1024\" height=\"695\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2021\/08\/voracity-flyer-front-no-banner-1024x695.png 1024w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2021\/08\/voracity-flyer-front-no-banner-300x204.png 300w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2021\/08\/voracity-flyer-front-no-banner-768x521.png 768w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2021\/08\/voracity-flyer-front-no-banner-1536x1042.png 1536w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2021\/08\/voracity-flyer-front-no-banner-2048x1390.png 2048w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2021\/08\/voracity-flyer-front-no-banner.png 1110w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/a><\/p>\n<p>Voracity has the versatility to protect your data, while maintaining realism. With this, Voracity can preserve data fields without completely removing them or fully masking them. This can help users have an idea of what the data would be like, or generate sample dashboards without actually exposing any sensitive data.<\/p>\n<p>Voracity can also cleanse data, by removing or modifying data that is incorrect, incomplete, irrelevant, duplicated, or improperly formatted. IRI jobs are batchable and can be run on a schedule so that, at specified intervals of time, a check is run to determine if a new data source file is inserted into a directory or directories and a resulting IRI script is generated and run. The output file can then be specified in the batch script to be transferred to a directory that Datadog monitors. This allows IRI Voracity to fit in nicely with Datadog\u2019s typical data streaming flow.<\/p>\n<p>Preprocessing large files into smaller files with the conditional filtering ability of SortCL can considerably reduce the total amount of time to create a visualization in Datadog from raw data.<\/p>\n<p>How much exactly does SortCL accelerate this process? I will use a 2.1 GB file of United Kingdom company data as a benchmark.<\/p>\n<p>I used the SortCL program in Voracity to filter only the fields I want, with only records where the company\u2019s country of origin is England, the number of mortgages outstanding is greater than 1, and the town is not Cambridge. This results in an 84 MB file. It takes about 100 seconds for SortCL to run this script, then several seconds for the resulting file to be logged into Datadog.<\/p>\n<p>Compare this with logging the entire 2 GB file into Datadog, which takes about 38 seconds to upload and another 7 minutes for Datadog to process,then filter and sort in the same way SortCL did.<\/p>\n<p>While Datadog is very fast with these operations once the file has been processed, usually taking no more than a few seconds, there is still a considerable benefit by preprocessing with SortCL. In this example, SortCL saved about 5 minutes and 45 seconds, a time savings of about 328.5 percent.<\/p>\n<p>I was, ironically, able to use Datadog to visualize the savings:<\/p>\n<p><a href=\"\/blog\/wp-content\/uploads\/2020\/06\/datadog-comparison.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-13740 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/datadog-comparison.png\" alt=\"\" width=\"700\" height=\"275\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-comparison.png 764w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-comparison-300x118.png 300w\" sizes=\"(max-width: 700px) 100vw, 700px\" \/><\/a><\/p>\n<p>The smaller the Datadog log target that SortCL can make from a very large source (or sources), the bigger the advantage there is to using SortCL. You can see how SortCL in a CoSort product or Voracity platform context outperforms and accelerates other BI tools in the many data wrangling <a href=\"https:\/\/www.iri.com\/solutions\/business-intelligence\/bi-tool-acceleration\/overview\">benchmarks tabbed here<\/a>.<\/p>\n<p>In CellShield Version 2.0, a future release of CellShield that is included in the IRI Voracity suite, error and audit logs will be able to be directly logged to Datadog. The only specification necessary is an API key, which can be edited in an appsettings.json file or directly through the CellShield logging menu.<\/p>\n<p><a href=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-cellshield.png\"><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-13741 aligncenter\" src=\"\/blog\/wp-content\/uploads\/2020\/06\/datadog-cellshield-1024x473.png\" alt=\"\" width=\"790\" height=\"365\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-cellshield-1024x473.png 1024w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-cellshield-300x139.png 300w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-cellshield-768x355.png 768w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/datadog-cellshield.png 1324w\" sizes=\"(max-width: 790px) 100vw, 790px\" \/><\/a><\/p>\n<p>In the <a href=\"https:\/\/www.iri.com\/blog\/business-intelligence\/data-preparation-datadog-voractiy\/\">next<\/a> article of our series, I will demonstrate <i>how <\/i>to prepare data in Voracity for Datadog.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This article is first in a 4-part series on feeding the Datadog cloud analytic platform with different kinds of data from IRI Voracity operations. It focuses on the value of Datadog and Voracity together. Subsequent articles cover: preparing data in Voracity and feeding it to Datadog; using Voracity-wrangled data in Datadog visualizations; and, using IRI<\/p>\n<div><a class=\"btn-filled btn\" href=\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/\" title=\"Feeding Datadog with Voracity Part 1: Datadog\u2019s Fast Friend\">Read More<\/a><\/div>\n","protected":false},"author":119,"featured_media":13737,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[108,32,776],"tags":[184,809,1164,359,1163,1472,100,789,981,149,68],"class_list":["post-13734","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-big-data-2","category-business-intelligence","category-etl","tag-accelerated-business-intelligence","tag-analytics","tag-data-blending","tag-data-preparation","tag-data-wrangling","tag-datadog","tag-etl","tag-iri-voracity","tag-logging","tag-pii","tag-sortcl"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v23.4 (Yoast SEO v23.4) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Feeding Datadog with Voracity Part 1: Datadog\u2019s Fast Friend - IRI<\/title>\n<meta name=\"description\" content=\"Datadog is also a web-facing application for monitoring data feeds, analyzing trends, building analytic dashboard displays, and sending alerts.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Feeding Datadog with Voracity Part 1: Datadog\u2019s Fast Friend\" \/>\n<meta property=\"og:description\" content=\"Datadog is also a web-facing application for monitoring data feeds, analyzing trends, building analytic dashboard displays, and sending alerts.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/\" \/>\n<meta property=\"og:site_name\" content=\"IRI\" \/>\n<meta property=\"article:published_time\" content=\"2020-06-05T20:35:06+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-02-27T10:07:28+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram.png\" \/>\n\t<meta property=\"og:image:width\" content=\"565\" \/>\n\t<meta property=\"og:image:height\" content=\"300\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Devon Kozenieski\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Devon Kozenieski\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/\"},\"author\":{\"name\":\"Devon Kozenieski\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/de972c035aaeecfc40a3ae2ea5ff7ba1\"},\"headline\":\"Feeding Datadog with Voracity Part 1: Datadog\u2019s Fast Friend\",\"datePublished\":\"2020-06-05T20:35:06+00:00\",\"dateModified\":\"2023-02-27T10:07:28+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/\"},\"wordCount\":1285,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram.png\",\"keywords\":[\"accelerated business intelligence\",\"analytics\",\"data blending\",\"data preparation\",\"data wrangling\",\"DataDog\",\"ETL\",\"IRI Voracity\",\"logging\",\"PII\",\"SortCL\"],\"articleSection\":[\"Big Data\",\"Business Intelligence (BI&#041;\",\"ETL\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/\",\"url\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/\",\"name\":\"Feeding Datadog with Voracity Part 1: Datadog\u2019s Fast Friend - IRI\",\"isPartOf\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram.png\",\"datePublished\":\"2020-06-05T20:35:06+00:00\",\"dateModified\":\"2023-02-27T10:07:28+00:00\",\"description\":\"Datadog is also a web-facing application for monitoring data feeds, analyzing trends, building analytic dashboard displays, and sending alerts.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#primaryimage\",\"url\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram.png\",\"contentUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram.png\",\"width\":565,\"height\":300},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.iri.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Feeding Datadog with Voracity Part 1: Datadog\u2019s Fast Friend\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.iri.com\/blog\/#website\",\"url\":\"https:\/\/www.iri.com\/blog\/\",\"name\":\"IRI\",\"description\":\"Total Data Management Blog\",\"publisher\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.iri.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\",\"name\":\"IRI\",\"url\":\"https:\/\/www.iri.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"contentUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"width\":750,\"height\":206,\"caption\":\"IRI\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/de972c035aaeecfc40a3ae2ea5ff7ba1\",\"name\":\"Devon Kozenieski\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e4c421588c1a85dd9a76146fe15528f7?s=96&d=blank&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e4c421588c1a85dd9a76146fe15528f7?s=96&d=blank&r=g\",\"caption\":\"Devon Kozenieski\"},\"url\":\"https:\/\/www.iri.com\/blog\/author\/devonk\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Feeding Datadog with Voracity Part 1: Datadog\u2019s Fast Friend - IRI","description":"Datadog is also a web-facing application for monitoring data feeds, analyzing trends, building analytic dashboard displays, and sending alerts.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/","og_locale":"en_US","og_type":"article","og_title":"Feeding Datadog with Voracity Part 1: Datadog\u2019s Fast Friend","og_description":"Datadog is also a web-facing application for monitoring data feeds, analyzing trends, building analytic dashboard displays, and sending alerts.","og_url":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/","og_site_name":"IRI","article_published_time":"2020-06-05T20:35:06+00:00","article_modified_time":"2023-02-27T10:07:28+00:00","og_image":[{"width":565,"height":300,"url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram.png","type":"image\/png"}],"author":"Devon Kozenieski","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Devon Kozenieski","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#article","isPartOf":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/"},"author":{"name":"Devon Kozenieski","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/de972c035aaeecfc40a3ae2ea5ff7ba1"},"headline":"Feeding Datadog with Voracity Part 1: Datadog\u2019s Fast Friend","datePublished":"2020-06-05T20:35:06+00:00","dateModified":"2023-02-27T10:07:28+00:00","mainEntityOfPage":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/"},"wordCount":1285,"commentCount":0,"publisher":{"@id":"https:\/\/www.iri.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram.png","keywords":["accelerated business intelligence","analytics","data blending","data preparation","data wrangling","DataDog","ETL","IRI Voracity","logging","PII","SortCL"],"articleSection":["Big Data","Business Intelligence (BI&#041;","ETL"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/","url":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/","name":"Feeding Datadog with Voracity Part 1: Datadog\u2019s Fast Friend - IRI","isPartOf":{"@id":"https:\/\/www.iri.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#primaryimage"},"image":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram.png","datePublished":"2020-06-05T20:35:06+00:00","dateModified":"2023-02-27T10:07:28+00:00","description":"Datadog is also a web-facing application for monitoring data feeds, analyzing trends, building analytic dashboard displays, and sending alerts.","breadcrumb":{"@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#primaryimage","url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram.png","contentUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram.png","width":565,"height":300},{"@type":"BreadcrumbList","@id":"https:\/\/www.iri.com\/blog\/business-intelligence\/datadog-with-voracity\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.iri.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Feeding Datadog with Voracity Part 1: Datadog\u2019s Fast Friend"}]},{"@type":"WebSite","@id":"https:\/\/www.iri.com\/blog\/#website","url":"https:\/\/www.iri.com\/blog\/","name":"IRI","description":"Total Data Management Blog","publisher":{"@id":"https:\/\/www.iri.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.iri.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.iri.com\/blog\/#organization","name":"IRI","url":"https:\/\/www.iri.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","contentUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","width":750,"height":206,"caption":"IRI"},"image":{"@id":"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/de972c035aaeecfc40a3ae2ea5ff7ba1","name":"Devon Kozenieski","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e4c421588c1a85dd9a76146fe15528f7?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e4c421588c1a85dd9a76146fe15528f7?s=96&d=blank&r=g","caption":"Devon Kozenieski"},"url":"https:\/\/www.iri.com\/blog\/author\/devonk\/"}]}},"jetpack_featured_media_url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2020\/06\/iri-datadog-diagram.png","_links":{"self":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/13734"}],"collection":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/users\/119"}],"replies":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/comments?post=13734"}],"version-history":[{"count":11,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/13734\/revisions"}],"predecessor-version":[{"id":16433,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/13734\/revisions\/16433"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/media\/13737"}],"wp:attachment":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/media?parent=13734"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/categories?post=13734"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/tags?post=13734"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}