Before or Instead of Hadoop, Try This …
Before Big Data became a buzz word and Gartner hype cycle fodder (never mind falling into the ‘Trough of Disillusionment‘), companies like IRI were handling it. Read More
Data Profiling: Discovering Data Details
Data profiling, or data discovery, refers to the process of obtaining information from, and descriptive statistics about, various sources of data. The purpose of data profiling is to get a better understanding of the content of data, as well as its structure, relationships, and current levels of accuracy and integrity. Read More
An Introduction to Data Mining
Note: This article was originally drafted in 2015, but was updated in 2019 to reflect new integration between IRI Voracity and Knime (for Konstanz Information Miner), now the most powerful open source data mining platform available. Read More
Using Selection to Reduce Data Bulk (and Improve Data…
One of the best ways to speed up big data processing operations is to not process so much data in the first place; i.e. to eliminate unnecessary data ahead of time. Read More
Big Data Transformations with CoSort (Structured Data)
In 1992, Digital Equipment Corporation (DEC, long since acquired) asked IRI to develop a 4GL interface to CoSort in the syntax of the VAX VMS sort/merge utility. Read More
Speeding and Building on Unix bin/sort
The sort included with each Unix-based operating system is a standard command line program that prints lines of input or specified input files in the specified sorted order. Read More
Loading Big Data Faster
Loading Big Data? For more speed, Pre-Sort and Bulk LoadFinding more speed when loading big data is a challenge in ETL, reorg, and very large database (VLDB) index populate operations. Read More
A Big Data Quandary: Hardware or Software … Appliances…
Big Data Problem Big data volumes are growing exponentially. This phenomenon had been happening for years, but its pace began a more rapid acceleration in 2012. Read More
What is Hadoop?
Hadoop is an increasingly popular computing environment for distributed processing that business can use to analyze and store huge amounts of data. Some of the world’s largest and most data-intensive corporate users deploy Hadoop to consolidate, combine and analyze big data in both structured and complex sources. Read More
Unload Very Large Databases
One of the main concerns DBAs who need to unload big data from very large database (VLDB) tables have is speed. Faster unloading makes data accessible in different forms for different purposes and platforms. Read More
Introduction to IRI CoSort Data Manipulation [video]
IRI CoSort is the world’s #1 sort, and single-pass “super tool” for data transformation, reporting, and more. Use CoSort to migrate legacy sorts and data, accelerate BI, DB, and ETL tools, and replace SQL, shell scripts, and 3GL programs that can’t transform fast enough. Read More