This article is first in a 3-part series on CLF and ELF web log data, where we introduce these file formats. The next article covers IRI solutions for processing web log data, and the last demonstrates web log data masking to protect visitor identities and destinations.
The ability to directly move very large database (VLDB) data from/to, and manipulate it within IRI software is essential for those requiring:data integration (ETL) database acceleration (unloads, loads, reorgs, queries) database migration data masking (encryption, redaction, de-identification, etc.)
This is the final article in a three-part blog series introducing IRI’s new data structuring technology. The first blog introduces “dark data” and the unstructured sources the wizard can analyze.
Data and database migration are key considerations for any system implementation, upgrade, or consolidation. Data migration happens for many reasons, like appliance upgrades or enhancements, server maintenance, or data center relocation.
Every land line or cellular telephone call made over a Public Land Mobile Network (PLMN) creates one or more call records. These Call Detail Records (CDRs) or Usage Detail Records (UDRs) are generated by the mobile switching center (MSC) — the primary GSM/CDMA service delivery node responsible for routing voice calls, SMS, and other services.
Data profiling, or data discovery, refers to the process of obtaining information from, and descriptive statistics about, various sources of data. The purpose of data profiling is to get a better understanding of the content of data, as well as its structure, relationships, and current levels of accuracy and integrity.
One of the best ways to speed up big data processing operations is to not process so much data in the first place; i.e. to eliminate unnecessary data ahead of time.