{"id":1692,"date":"2012-07-30T16:30:45","date_gmt":"2012-07-30T20:30:45","guid":{"rendered":"http:\/\/www.iri.com\/blog\/?p=1692"},"modified":"2024-09-06T15:58:45","modified_gmt":"2024-09-06T19:58:45","slug":"a-big-data-quandary-hardware-or-software-appliances-or-cosort","status":"publish","type":"post","link":"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/","title":{"rendered":"A Big Data Quandary: Hardware or Software &#8230; Appliances or CoSort?"},"content":{"rendered":"<p><span style=\"text-decoration: underline;\">Big Data Problem\u00a0<\/span><br \/>\nBig data volumes are growing exponentially. This phenomenon had been happening for years, but its pace began a more rapid acceleration in 2012.\u00a0 In 2023,\u00a0 90% of the world&#8217;s data had been created in just the two prior years, and according to <a href=\"https:\/\/rivery.io\/blog\/big-data-statistics-how-much-data-is-there-in-the-world\/\">this Rivery<\/a> article on Big Data Statistics, the volume of data continues doubling every two years.<\/p>\n<p>IRI has been aware of this trend since the company&#8217;s founding in the late 1970s. Its flagship <a title=\"CoSort Product Page\" href=\"http:\/\/www.iri.com\/products\/CoSort\" target=\"_blank\" rel=\"nofollow noopener\">CoSort<\/a> package is designed to handle growing data volumes through efficiencies in software algorithms and design, &#8220;portable&#8221; hardware exploitation techniques, and task consolidation (e.g. sort-join-aggregate-encrypt-report). The question this article poses is one of approach, given the &#8220;rise of the machines.&#8221;<\/p>\n<p><span style=\"text-decoration: underline;\"><a href=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room.jpg\" rel=\"nofollow\"><img loading=\"lazy\" decoding=\"async\" class=\"alignleft size-medium wp-image-2451\" title=\"server_room\" src=\"http:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room-300x222.jpg\" alt=\"big data\" width=\"300\" height=\"222\" srcset=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room-300x222.jpg 300w, https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room.jpg 463w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a>Hardware&#8217;s Limitation in Solving It<br \/>\n<\/span>Certainly computer performance has been accelerating in most every respect for decades. And for many, throwing hardware at the big data problem is merely second nature. However, the problem may be bigger than that. Consider <a title=\"Moore's Law Definition wiki\" href=\"http:\/\/en.wikipedia.org\/wiki\/Moore%27s_law\" target=\"_blank\" rel=\"nofollow noopener\">Moore&#8217;s Law<\/a>, in which CPU power only <strong>doubles<\/strong> every 18 months at best, and the inherent obsolescence, maintenance issues, and pure costs of a hardware-centric strategy.<\/p>\n<p>Something new to consider too is an expectation that this performance paradigm for big data may be coming to an end. \u00a0According to <a title=\"Moore's Law: the end is near-ish! by Gery Menegaz\" href=\"http:\/\/www.zdnet.com\/moores-law-the-end-is-near-ish-7000000972\/\" target=\"_blank\" rel=\"nofollow noopener\">Gery Menegaz<\/a>, his premise is that the end of Moore&#8217;s Law is near. \u00a0Time Magazine ran a similar story in May 2012 entitled <a title=\"The Collapse of Moore's Law: Physicist Says Its Already Happening by Matt Peckham\" href=\"http:\/\/techland.time.com\/2012\/05\/01\/the-collapse-of-moores-law-physicist-says-its-already-happening\/\" target=\"_blank\" rel=\"nofollow noopener\">the Collapse of Moore&#8217;s Law: \u00a0Physicist Says Its Already Happening<\/a>. \u00a0According to the Time article,<\/p>\n<blockquote><p><em>Given that, Kaku says that when Moore\u2019s Law finally collapses by the end of the next decade, we\u2019ll \u201csimply tweak [it]\u00a0a bit with chip-like computers in three dimensions.\u201d Beyond that, he says \u201cwe may have to go to molecular computers and perhaps late in the 21st\u00a0century quantum computers.\u201d<\/em><\/p><\/blockquote>\n<div>\n<p>For most users, however, their hardware is bought to handle, and to some extent scale, to meet the big data processing challenges they face or foresee. But the less efficiently the software running on it performs, the more hardware resources have to be spent overcoming the inefficiency. A example in our world might be buying an IBM p595 to run \/bin\/sort when a machine one third that size and cost running CoSort instead would produce the same result.<\/p>\n<p>Meanwhile, DB and ELT appliances like Exadata and Netezza built around hardware already require 6-7 figure investments. And while they can scale to take on larger loads, there is usually a limit to how much they can scale\u00a0 (certainly not exponentially), how much money can be spent on the attempt to keep scaling, and how willing people are to rely on a single vendor for every mission critical aspect of their workloads. And, is it a good idea to impose the overhead of big data transformation in databases that were designed for storage and retrieval (query) optimization instead?<\/p>\n<p>Even if all those questions had easy answers, how do computational problems (with even just linearly scaling big data growth) that require exponentially larger resource consumption (like sorting)\u00a0 get solved? Somehow the answer would not seem to lie in merely waiting for affordable quantum computing &#8230;<\/p>\n<p><span style=\"text-decoration: underline;\">The Role of Software<br \/>\n<\/span>As Hadoop and data warehouse architects know, Sorting &#8212; and the Join, Aggregate, and Loading operations in ETL that rely on Sorting &#8212; is at the heart of the big data processing challenge, and an exponential consumer of computing resources. As big data doubles, the resource requirements to sort it can triple. Therefore the algorithms, hardware exploitation techniques, and processing schemes involved with multi-platform, multi-core sorting software are the keys to managing this problem in scalable, affordable, and efficient ways.<\/p>\n<p><span style=\"text-decoration: underline;\">CoSort&#8217;s Contribution<\/span><br \/>\nCoSort performance scales linearly in volume, more along the lines of <a href=\"http:\/\/en.wikipedia.org\/wiki\/Amdahl%27s_law\" target=\"_blank\" rel=\"nofollow noopener\">Amdahl&#8217;s Law<\/a>. While <a title=\"CoSort Product Page\" href=\"http:\/\/www.iri.com\/products\/CoSort\" target=\"_blank\" rel=\"nofollow noopener\">CoSort<\/a> can transform hundreds of gigabytes of big data in minutes with a few dozen cores, other tools can take more than twice as long, don&#8217;t scale nearly as well, and\/or consume more memory and I\/O in the process. Perhaps more importantly, CoSort integrates sorting directly into related applications, and does all its heavy lifting outside the DB and BI layer where staging data would be less efficient.<\/p>\n<p>CoSort&#8217;s co-routine architecture moves records between the sorter and programs like <a title=\"SortCL Product Tool Page\" href=\"http:\/\/www.iri.com\/products\/CoSort\/SortCL\" target=\"_blank\" rel=\"nofollow noopener\">SortCL<\/a> (CoSort&#8217;s data transformation, filtering, lookup, reporting, migration, and protection utility) interactively, through memory. So as soon as the next sorted record is available, it can move into the application, load, etc.\u00a0 It looks to the app that it is reading an input file but in truth, the back end of source has not as yet been produced. And no, you will not get ahead of the sorter.<\/p>\n<p>At the end of 2015, CoSort also became the engine inside IRI&#8217;s modern big data management and manipulation platform, <a href=\"http:\/\/www.iri.com\/products\/voracity-platform\">Voracity<\/a>. Voracity can leverage either CoSort or Hadoop engines <a href=\"http:\/\/www.iri.com\/solutions\/big-data\/hadoop-optional\">seamlessly<\/a>.<\/p>\n<p><span style=\"text-decoration: underline;\">Conclusion<\/span><br \/>\nPhysical computing resources alone cannot be counted on to scale up to the problem of processing big data. The CoSort software environment is one in which required big data transformation and related jobs run not as standalone processes, but in parallel during the same I\/O pass.<\/p>\n<p>So, if you need a fast sort for some purpose other than just the time to sort, you should be thinking about what happens downstream from the sort, and the best ways to link such processes together. And once you have determined the best runtime paradigm, can you then combine high-performance hardware with such software to optimize performance? Can you stage DW data with CoSort in the database server side of Exadata, for example? Or would it make more sense to keep your IBM p595 and add CoSort to triple throughput? \u00a0Or if you&#8217;re intent on using Hadoop, consider using the same simple 4GL of CoSort or intuitive ETL mappings of Voracity to drive MapReduce 2, Spark, Storm, or Tez jobs.<\/p>\n<p>Let your budget, and your imagination, be your guides to tackling data growth.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Big Data Problem\u00a0 Big data volumes are growing exponentially. This phenomenon had been happening for years, but its pace began a more rapid acceleration in 2012.\u00a0 In 2023,\u00a0 90% of the world&#8217;s data had been created in just the two prior years, and according to this Rivery article on Big Data Statistics, the volume of<\/p>\n<div><a class=\"btn-filled btn\" href=\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/\" title=\"A Big Data Quandary: Hardware or Software &#8230; Appliances or CoSort?\">Read More<\/a><\/div>\n","protected":false},"author":8,"featured_media":2451,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[108,1,3],"tags":[25,44,77,6,5,106,100,46,225,226,68],"class_list":["post-1692","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-big-data-2","category-data-transformation2","category-vldb-operations","tag-big-data","tag-cosort","tag-data-migration-2","tag-data-sorting","tag-data-transformation","tag-elt","tag-etl","tag-etl-tools","tag-exadata","tag-netezza","tag-sortcl"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v23.4 (Yoast SEO v23.4) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>A Big Data Quandary: Hardware or Software ... Appliances or CoSort? - IRI<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A Big Data Quandary: Hardware or Software ... Appliances or CoSort?\" \/>\n<meta property=\"og:description\" content=\"Big Data Problem\u00a0 Big data volumes are growing exponentially. This phenomenon had been happening for years, but its pace began a more rapid acceleration in 2012.\u00a0 In 2023,\u00a0 90% of the world&#8217;s data had been created in just the two prior years, and according to this Rivery article on Big Data Statistics, the volume ofRead More\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/\" \/>\n<meta property=\"og:site_name\" content=\"IRI\" \/>\n<meta property=\"article:published_time\" content=\"2012-07-30T20:30:45+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-09-06T19:58:45+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"463\" \/>\n\t<meta property=\"og:image:height\" content=\"343\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Paul Friedland\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Paul Friedland\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/\"},\"author\":{\"name\":\"Paul Friedland\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/1127ccf5631e8b00cb23974bd1882ea9\"},\"headline\":\"A Big Data Quandary: Hardware or Software &#8230; Appliances or CoSort?\",\"datePublished\":\"2012-07-30T20:30:45+00:00\",\"dateModified\":\"2024-09-06T19:58:45+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/\"},\"wordCount\":996,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room.jpg\",\"keywords\":[\"big data\",\"CoSort\",\"data migration\",\"data sorting\",\"data transformation\",\"ELT\",\"ETL\",\"ETL tools\",\"Exadata\",\"Netezza\",\"SortCL\"],\"articleSection\":[\"Big Data\",\"Data Transformation\",\"VLDB\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/\",\"url\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/\",\"name\":\"A Big Data Quandary: Hardware or Software ... Appliances or CoSort? - IRI\",\"isPartOf\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room.jpg\",\"datePublished\":\"2012-07-30T20:30:45+00:00\",\"dateModified\":\"2024-09-06T19:58:45+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#primaryimage\",\"url\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room.jpg\",\"contentUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room.jpg\",\"width\":\"463\",\"height\":\"343\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.iri.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"A Big Data Quandary: Hardware or Software &#8230; Appliances or CoSort?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.iri.com\/blog\/#website\",\"url\":\"https:\/\/www.iri.com\/blog\/\",\"name\":\"IRI\",\"description\":\"Total Data Management Blog\",\"publisher\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.iri.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.iri.com\/blog\/#organization\",\"name\":\"IRI\",\"url\":\"https:\/\/www.iri.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"contentUrl\":\"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png\",\"width\":750,\"height\":206,\"caption\":\"IRI\"},\"image\":{\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/1127ccf5631e8b00cb23974bd1882ea9\",\"name\":\"Paul Friedland\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.iri.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/5d48eea2eec2c3bcb24db5080f6ab3c5?s=96&d=blank&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/5d48eea2eec2c3bcb24db5080f6ab3c5?s=96&d=blank&r=g\",\"caption\":\"Paul Friedland\"},\"url\":\"https:\/\/www.iri.com\/blog\/author\/paulf\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"A Big Data Quandary: Hardware or Software ... Appliances or CoSort? - IRI","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/","og_locale":"en_US","og_type":"article","og_title":"A Big Data Quandary: Hardware or Software ... Appliances or CoSort?","og_description":"Big Data Problem\u00a0 Big data volumes are growing exponentially. This phenomenon had been happening for years, but its pace began a more rapid acceleration in 2012.\u00a0 In 2023,\u00a0 90% of the world&#8217;s data had been created in just the two prior years, and according to this Rivery article on Big Data Statistics, the volume ofRead More","og_url":"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/","og_site_name":"IRI","article_published_time":"2012-07-30T20:30:45+00:00","article_modified_time":"2024-09-06T19:58:45+00:00","og_image":[{"width":463,"height":343,"url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room.jpg","type":"image\/jpeg"}],"author":"Paul Friedland","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Paul Friedland","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#article","isPartOf":{"@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/"},"author":{"name":"Paul Friedland","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/1127ccf5631e8b00cb23974bd1882ea9"},"headline":"A Big Data Quandary: Hardware or Software &#8230; Appliances or CoSort?","datePublished":"2012-07-30T20:30:45+00:00","dateModified":"2024-09-06T19:58:45+00:00","mainEntityOfPage":{"@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/"},"wordCount":996,"commentCount":0,"publisher":{"@id":"https:\/\/www.iri.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room.jpg","keywords":["big data","CoSort","data migration","data sorting","data transformation","ELT","ETL","ETL tools","Exadata","Netezza","SortCL"],"articleSection":["Big Data","Data Transformation","VLDB"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/","url":"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/","name":"A Big Data Quandary: Hardware or Software ... Appliances or CoSort? - IRI","isPartOf":{"@id":"https:\/\/www.iri.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#primaryimage"},"image":{"@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#primaryimage"},"thumbnailUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room.jpg","datePublished":"2012-07-30T20:30:45+00:00","dateModified":"2024-09-06T19:58:45+00:00","breadcrumb":{"@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#primaryimage","url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room.jpg","contentUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room.jpg","width":"463","height":"343"},{"@type":"BreadcrumbList","@id":"https:\/\/www.iri.com\/blog\/data-transformation2\/a-big-data-quandary-hardware-or-software-appliances-or-cosort\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.iri.com\/blog\/"},{"@type":"ListItem","position":2,"name":"A Big Data Quandary: Hardware or Software &#8230; Appliances or CoSort?"}]},{"@type":"WebSite","@id":"https:\/\/www.iri.com\/blog\/#website","url":"https:\/\/www.iri.com\/blog\/","name":"IRI","description":"Total Data Management Blog","publisher":{"@id":"https:\/\/www.iri.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.iri.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.iri.com\/blog\/#organization","name":"IRI","url":"https:\/\/www.iri.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","contentUrl":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2019\/02\/iri-logo-total-data-management-small-1.png","width":750,"height":206,"caption":"IRI"},"image":{"@id":"https:\/\/www.iri.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/1127ccf5631e8b00cb23974bd1882ea9","name":"Paul Friedland","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.iri.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/5d48eea2eec2c3bcb24db5080f6ab3c5?s=96&d=blank&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/5d48eea2eec2c3bcb24db5080f6ab3c5?s=96&d=blank&r=g","caption":"Paul Friedland"},"url":"https:\/\/www.iri.com\/blog\/author\/paulf\/"}]}},"jetpack_featured_media_url":"https:\/\/www.iri.com\/blog\/wp-content\/uploads\/2012\/07\/server_room.jpg","_links":{"self":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/1692"}],"collection":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/comments?post=1692"}],"version-history":[{"count":61,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/1692\/revisions"}],"predecessor-version":[{"id":17968,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/posts\/1692\/revisions\/17968"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/media\/2451"}],"wp:attachment":[{"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/media?parent=1692"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/categories?post=1692"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.iri.com\/blog\/wp-json\/wp\/v2\/tags?post=1692"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}