Learn IRI Software

• Installation
• IRI Workbench
• Data Discovery
• Data Integration
• Data & Database Migration
• Data Governance
• Analytics & BI

Self-Directed Learning Site for IRI Software

This page links you to free, self-help content in the many data management objectives that IRI software products can help you achieve.

Please note that:

1. All IRI software users, from freemium to licensed subscribers, can access this material.  Only supported users, however, can get help from IRI beyond this content.
2. The IRI software product or licensing agreement you have may or not support the functionality, or entitle you to support for that feature even if the feature itself is enabled in your product. For more information, please refer to this product-feature matrix.
3. Additional training materials are available on request, custom designed for your company's requirements and certification-oriented learning. Please describe your material requirements below and an IRI services representative will contact you.

IRI Product Installation

• All IRI Workbench-supported Products
• IRI Workbench Demo Projects in Git
• DB Setup (J/ODBC Connections, e.g., MySQL)
  • ​MS SQL
  • ​Oracle
  • PostgreSQL
  • Salesforce
  • Snowflake
• Connection registry
• DSN files
• Multi-Table Filtering​

IRI Workbench - General

• Getting Started
• Job Design Methods
  1. New Job Wizards (see Welcome > First Steps)
  2. Dialogs (use ? for in-context Help)
  3. Script Editor & Outline (see product manuals for syntax)
  4. Video: Work Flow (Palette)
  5. erwin (AnalytiX DS) Mapping Manager
  6. Building Voracity Jobs in Your App via Gulfstream API
• Flow Design (how-to articles for Voracity ETL and other batch jobs)
  • Creating a Work Flow Using Existing Job (SortCL, etc.) Scripts (3 parts)
  • Creating a Work Flow from a Wizard (2 parts)
  • Creating a Work Flow from the Palette (2 parts)
    • Demo video
  • Creating & Executing SQL Statements
• Job Deployment
  • Command Line / Wicked Shell
  • Single Job Execution Options
  • Batch Job (Work Flow) Execution Options
  • Remote Connection/Executions
  • Running Voracity Jobs in Hadoop
    • ​When to Use Hadoop
      • Connecting to HortonWorks/Ambari
      • Connecting to Cloudera
      • Connecting to MapR
  • Running Voracity Jobs with KNIME
  • Cloud Considerations (pending)
    • Amazon EC2 
    • Oracle Cloud Infrastructure
    • MS Azure 
    • Google Cloud
• Job Scheduling
  • IRI Workbench Task Launcher
    • Eclipse Launch Configurations
    • Launch Configuration Groups
  • Oracle Job Scheduler
  • Stonebranch UAC

Data Discovery & Classification

• DB Profiling (includes 1+ table searching)
  • ER Diagramming
  • Multi-Table Filtering
  • Displaying Profiling Results in Splunk
• Flat-File Profiling
• Dark Data Search/Structure/Profile (unstructured text, documents, images, faces)
  • Unstructured Data Classification & Discovery Video
• NoSQL DB Data Class Search (and Mask)
• Structured Metadata Discovery
• IRI Metadata Search (via Git)
• Structured (DB & Flat-File) Data Classification
  • Demo video
  • Data Class Validation and Customization
  • Directory Data Class Search (structured files)
  • Classifying, Searching, and Masking Databases Schema-Wide
    • Schema-wide Data Class Search (all tables in 1 or more RDB schema)
      • Multi-Schema/DB Data Class Masking
        • Applying (masking or other) rules to classified RDB or flat-file data
  • Schema-wide Pattern Search (all tables in an RDB schema)
    • Schema Pattern Search to Data Class Association

Data Integration

• Data Integration Architectures (and Voracity's applications)
  • Enterprise Data Warehouse 
  • Logical Data Warehouse
  • Operational Data Store / Enterprise Data Hub
  • Production Analytic Platform (4-part series)
  • Data Lake
  • ETL vs. ELT
• ETL Job Design (see IRI Workbench > Flow Design above)
• ETL Execution (see IRI Workbench > Job Deployment above)
• Faster Extraction
• Data Transformation
  • Date Masking
  • Filtering
  • Video: Sort/Join/Aggregate
  • Video: Inner Join
  • Video: Left Outer Join
  • Video: Sort
    • z/OS MVS & VSE JCL (ICEMAN) conversions
    • Links to other plug'n'play sort replacements
    • CoSort v10 Best Practices
  • Video: Summary Aggregation
    • Video: IoT edge aggregation demo
  • Row-Column Pivoting
  • Set Lookups
• Fast Loading
• Change Data Capture
• Slowly Changing Dimensions
• DB-Specific Optimization (see tabs)
• Voracity ETL Workflow (wizard mode video; see Flow Design above)
  • Oracle to MongoDB Example
• Voracity ETL Job Preview (via live or test data)
• Legacy ETL Optimization
  • ​Accelerating Informatica
  • Accelerating DataStage
  • Accelerating Pentaho
  • Accelerating Talend
• Legacy ETL Tool Migration (via erwin/AnalytiX DS Code Automation Templates)
  • Re-platforming Informatica

Data & Database Migration

• File-Format Conversion
• Database Migration
• Database Subsetting
• Basic Data Replication
• Incremental Data Replication
  • Incremental Changes, Oracle to MongoDB
• Data Federation
• Schema (Relational to Star) Migration
• Vision File Conversion
• XML (Complex) Parse/Process

Data Governance

• Data Masking
  • Dynamic Data Masking (DDM)
    • IRI FieldShield in DB Apps
    • Triggered FieldShield functions in PL/SQL
    • Proxy-based JDBC SQL driver for apps (soon)
    • Dynamic decryption of encrypted production data
    • .NET and Java (Hadoop) API libraries 
      • FieldShield ("Sandkey") SDK
  • Static Data Masking (SDM)
    • Getting Started with FieldShield
      • Classifying, Searching, and Masking Databases Schema-Wide
    • Video: Single Table / File Masking demo
    • Which Data Masking Function Should I Use?
      • Blurring (Random Noise)
      • Bucketing (Generalization)
      • Deletion (GDPR Erasure)
      • Encryption
        • FieldShield Key Management in Azure Key Vault
        • Key Management in Townsend Alliance Key Manager
      • Hashing
      • Pseudonymization
      • Redaction
      • Tokenization
    • Multi-Table Masking (& Referential Integrity)
      • Rule-based (based on pattern-matching column names)
        • Video: Multi-table masking demo
      • Rule-based (based on Data Classes, and see Discovery above)
        • Data Class DB Masking Wizard
        • ​ Video: Data classification & masking demo
    • Multi-Flat-File Masking (in 1 or more directories)
      • Data Class File Masking
    • ​Applying Field Rules Using Classification
    • Discrete Sources, Types, and Targets
      • Amazon S3 in DarkShield
      • Apache Cassandra
        • Structured or unstructured collections via DarkShield
        • Structured collections (only) via FiedDShield
      • CSV
      • Dates & Ages
      • ElasticSearch via DarkShield (pending)
      • Excel Spreadsheets
        • via CellShield Personal Edition (PE)
        • via CellShield Enterprise Edition (EE)
        • via DarkShield (Video)
        • via FieldShield (pending)
      • HL7 (or see X12 via DarkShield, below)
      • JSON & XML Files via DarkShield path filtering
      • Live Feeds
      • MongoDB
        • Structured collections via Ex/Import 
        • Structured collections via J/ODBC
        • Structured collections via Native Driver
        • Structured & unstructured collections via DarkShield
      • NIDs & SSNs
      • NRIC
      • Pentaho
      • PostgreSQL
      • SAP HANA (subset and mask)
      • Salesforce
      • Snowflake DB
      • Splunk
      • Web Logs
      • X12 (via DarkShield, video)
  • Re-ID Risk Determination
    • Risk scoring wizard & blurring intro (video)
    • HIPAA Data Certification course
  • Unstructured (Dark) Data Masking
    • Getting Started with DarkShield
      • DarkShield Search/Mask How-to Video
      • DarkShield NER/ML How-to & FAQ Video
    • DarkShield CLI SDK
    • Analyzing DarkShield Search/Mask Results in Splunk
    • Universal Forwarder (sending search/mask logs to Splunk)
    • Adaptive Response to log events in Splunk ES
    • Invoking DarkShield from a Splunk Phantom Playbook 
• Data Quality
  • Data Quality Rule Wizards
  • Filter & De-Duplication
  • Fuzzy Searching
  • Data Validation
  • Data Unification (Homogenization, Reconciliation)
  • Finding Business Rule Violations
  • Finding Format Errors
• Master Data Management (MDM)
  • MD Consolidation
  • MDM Registry (pending)
  • Alternative (via GIT)
• Metadata Management
  • Teamwork (via GIT)
    • Version Control
    • Lineage (via Git)
    • Lineage & Impact Analysis (via Erwin/ADS)
    • Data & Metadata Lineage (built-in, pending)
    • Asset Security (via Git)
• Role Based Access Controls (RBAC)
  • AD-compatible IAM (pending)
• Test Data Management (TDM)
  • Goal Setting & Team Building
  • Test Data Needs Assessment
  • Test Data Generation & Provisioning
  • Test Data Sharing & Persistence
• Test (Synthetic) Data Generation, for:
  • RDBs via data masking (see SDM above)
  • RDBs via auto-parse/populate/generate (synthesis)
  • RDBs via masked table subsets (DB subsetting)
  • Single files via the job wizard
  • Specific formats or data classes
    • COBOL files
    • Customer (transaction) data
    • Personally Identifiable Information (PII) (fake PII for DevOps)
    • Credit Card Numbers
    • NIDs (US & Korea SSNs, Italy CF, Netherlands BSN)
    • UUIDs/GUIDs
    • Cassandra
    • MongoDB
    • Teradata
  • Weighted distributions
  • Java & Hadoop (API)
    • RowGen ("Outrigger") SDK

Analytics & BI

• Production Analytic Platform (4-part series)
• Embedded BI
  • see report examples in CoSort manual (SortCL program)
• IoT Edge Aggregation
• Change Data Capture
• Slowly Changing Dimensions
• Predictive Analytics
• Clickstream Analytics
• BIRT integration
• Splunk Integrations
  • Voracity add-on for Splunk
  • Voracity app for Splunk (Splunkbase download)
  • Voracity results in Splunk via Universal Forwarder
• Data Wrangling for Other BI & Analytic Tools
  • for DWDigest
  • for IBM Cognos
  • for Microsoft Power BI
  • for Oracle Visualization Desktop
  • for KNIME