Home » Products » CoSort
Big Data Manipulation - Fast, Flexible, Affordable  
 

Click here to listen to the BI Network's Solution Spotlight on CoSort, an executive interview with IRI's VP of Business Development on the history and current state of the CoSort package. Learn how and why CoSort has folded fast sorting into the disciplines of ETL, reporting, and data security.


CoSort Version 9.5 brings more speed, ease, versatility and value to big data processing.

Summary
The world's first commercial sort package continues to deliver maximum performance and broad data processing functionality for large files and DB tables. CoSort combines fast sorting in the same job scripts and I/O pass with:

• Major and Complex Data Transformations
• File Format and Data Type Conversions
• Custom Source/Target Mapping
• Batch, Summary, and Delta Reporting
• Field Encryption and Masking

Use CoSort for: mainframe sort and data migration projects; data warehouse staging, integration, and ETL; large database reorgs; business intelligence; data-centric security; and, application acceleration.
Selected Features
• Parallel sort, sum, reformat engine
• Easy 4GL for data staging, reporting
• Multi-file joins, dimensional lookups
• Field-level protections for data at risk
• Custom functions; e.g. data cleansing
• Filtering, selection, segmentation
• File compares, changed data capture
• Data type and file format conversion
• Expressions, validations, calculations
• Widely reusable text-based metadata
• Multiple UIs and metadata converters
• Replacements for many other sorts
• Best-of-breed dashboarding option
• Supports 24/34 COBIT control objectives
• Reasonable, perpetual-use pricing
The Sort Engine
CoSort was the first commercial sort package developed for open systems: CP/M in 1980, MS-DOS in 1982, Unix in 1985, and Windows in 1995. Repeatedly reported to be the the fastest commercial-grade sort product for SMP Unix systems, CoSort was also judged by PC Week to be the "top performing" sort on Windows. For more than three decades, CoSort has defined the state-of-the-art in big data sorting technology. From sort algorithms to memory management, and from multi-core exploitation to I/O optimization, there is no more proven performer than CoSort.

Being first and fast are just two reasons why CoSort is "The Open Systems Standard." For sorting details, see:
Solutions > Data Transformation > Sort/Merge

To accelerate your current sort function, or convert from a legacy sort product like SyncSort, to CoSort, see:
Products > CoSort > Sort PlugIns
Solutions > Sort Migration
Data Transformation, File Mapping, Reporting
For many CoSort users, however, speed is more than just how many gigabytes they can sort in a minute. It is also about how much data integration, staging, security, and presentation work they can accomplish in the same pass through their data. How many database sources and sequential files and formats can you transform (filter, sort, join, aggregate, remap, convert, and protect) -- while producing delta, detail, load, and report targets -- all in one job and I/O pass? For information on many of the combinable functions in CoSort, see:
This diagram
Solutions > Data Transformation
Solutions > File Interchange
Solutions > Business Intelligence


Q. This sounds like "solid, super-fast ETL and more" on the cheap. Is it, and how can all that happen in one product, place and pass?
A. Yes, it often is, and it's accomplished in CoSort's Sort Control Language (SortCL) program and Eclipse GUI.
SortCL is a self-documenting 4GL and program for data definition and manipulation called from the command line, in batch, from a free GUI built on Eclipse, or your application. SortCL is a popular coding and runtime alternative for data integration, staging, and reporting jobs now in more complex, slower environments like Perl, Python, and shell scripts, SQL procedures, ETL and ELT software, and programs written in C, Java, VB, and COBOL. For details, see:
Products > CoSort > SortCL
Products > CoSort > SortCL GUI
Products > CoSort > SortCL Metadata
Products > CoSort > Metadata Converters
Products > CoSort > APIs

Accelerating Applications

CoSort is not only a standalone platform for data manipulation and management, but also a "point solution" for speeding ETL operations and tools, like:

  • DataStage
  • Informatica
  • Oracle Warehouse Builder
  • Microsoft SSIS

database reorgs, SAS, Software AG Natural, and legacy COBOL programs -- wherever high-volume jobs need more speed.

You can use CoSort Sort PlugIns and API calls, or SortCL scripts to prepare (or franchise) large data sets through sorting, selection, and aggregation. The results of CoSort operations routinely feed database load utilities, BI tools and cubes, Excel, and custom applications. For details, see:

Solutions > ETL/DB Acceleration
Products > CoSort > COBOL Tools
Solutions > BI > Reporting Functions
FAQ > Flat Files

Integrated Field Encryption and Test Data Creation
For information security and compliance officers, CoSort can protect sensitive data at rest or in motion, and thus mitigate the risks that personally identifying information (PII) represents. Powerful field-level data encryption and masking functions are now built into SortCL so you can process and safeguard data at risk at the same time, and still allow access to your files, tables and everything around them. SortCL even produces an audit trail to verify compliance with privacy regulations.

These data masking features are also ideal for testing, development, and outsourcing. The same metadata also works in IRI's field level encryption and masking tool FieldShield, and test data generator RowGen. For details, see:
Solutions > Field Protection
Solutions > Test Data/Files

More broadly, CoSort's SortCL tool can address several aspects of information security and data governance -- including master data management, application auditing, data forensics and CobIT support. For details, see:
Solutions > Data Governance


Deliverables and Platform Availability
The CoSort package includes:
• multiple third-party sort plug-ins
• the SortCL program (and GUI)
• third-party metadata converters
• API libraries
• the COBOL tools described in this section.

Installation, tuning, and implementation documentation is extensive, and job logging options are described on the SortCL page. If you have technical questions, use the live chat feature or the contact page. For technical help, go to the Support section or contact your IRI representative.

CoSort for Unix has always been first to support commercially available Unix platforms, including these:

HP 9000 (PA-RISC and Itanium 2 systems) running HP-UX 9-11iv3 IBM RS/6000, pSeries, SP2, and ES9000 running AIX 3.2-6.1 and AIX/ESA Bull DPX/2 and Escala servers running AIX
Compaq (Digital) AlphaServers running Tru64 Unix 4-5 DECsystems running RISC/Ultrix and Digital/OSF SunFire, Sun UE and SPARCware running Solaris 5-10
Fujitsu, Solbourne and CS6400) running SunOS 2-4, Solaris 5-10 Apple (Mac) PowerPC running OS X 10.3 and x86 running 10.6 (Snow Leopard) Pyramid Reliant, NileMISserver and 9000[T] running DC/OSx
Silicon Graphics Challenge and lower running IRIX Sequent NUMA-Q and Symmetry running ptx and DYNIX (COFF and ELF) Data General AViiON running DG/UX
Siemens-Nixdorf RM running SINIX SCO Unix and UnixWare Solaris on Intel (x86)
Encore Infinity Fujitsu DS/90 Amdahl 5990/5
Convex C Wyse 5-9000 Interactive Unix
NCR MP-RAS FreeBSD for Intel Linux (see below)

CoSort for Linux runs on 32- and 64-bit Intel x86 and Itanium hardware, and is certified Red Hat Ready (for RHEL) and Novell YES! for SLES. CoSort for Linux runs on other chipsets as well. IBM Chiphopper-certified, Linux platforms include IBM eServer x, i, p and zSeries (mainframe). Additional ports include SLES (SuSE) 8-11 on the IBM POWER5-7 chips, and Linux variants like AsianUX, Centos, Debian, Fedora Core, Gentoo, Mandrake and Ubuntu.

CoSort for Windows runs on NT, XP, 2000/3/8/10, Vista, 7 and 8.

CoSort for Virtual machines runs on VMware and similar environments supporting the operating systems above.

Licensing and Support
CoSort license fees are assessed one time for perpetual use (i.e. not a lease, unless you want one) and fairly reflect the performance benefits derived from its host hardware. Fees are configuration-dependent, and discounts apply for additional licenses procured simultaneously, for multi-site licensing, non-profit institutions, and ISV runtime royalties.

Maintenance, including new releases and technical support, is free for the first year after licensing. For details, see:
FAQ > CoSort Pricing

United States Government and military agencies should note that the CoSort package is available through GSA Advantage (FSS 70), using either IRI's GSA Contract Award or that of an approved prime contractor. CoSort is otherwise sole-sourced in the USA by IRI, Inc. CoSort is also on the bidder lists for many U.S. city and state governments, and many companies' approved vendor lists. For details, see:
Customers > GSA Schedule

Request More Info:

* IRI WILL NOT share this info