Speed & Secure Sybase Operations

 

Next Steps
Overview DB2 UDB MongoDB MySQL Oracle PostgreSQL SAP HANA Snowflake SQL Server Sybase Teradata

Challenges

You may face one or more of these security issues:

  • Unloading and loading of large Sybase tables
  • Slow utility operations (e.g., reorgs) or queries
  • Unprotected personally identifiable information (PII)
  • Cumbersome database migration or replication
  • Generation of, or access to, test data sets
  • Activity monitoring, audit, and protection (DAM/DAP)

Specific performance diagnoses and tuning also take time, and may affect other users. Specialized data masking and test data management tools are expensive and too hard to use. Finally, stored SQL procedures may also be programmed inefficiently, require optimization, and then still take too long to run.

Solutions

To:

Use:

Speed Sybase Unloads

IRI FACT (Fast Extract) to dump transaction tables in parallel to flat files. FACT Supports Sybase IQ and ASE, OCS 15 and later. FACT is many times faster than other extract methods and is supported in IRI Workbench for standalone use, or with other IRI operations like ETL, reorg, and migration

Speed Transforms, Queries, and Loads

Use the SortCL program in the IRI CoSort product or IRI Voracity platform to filter, sort, join, and aggregate the extracts in parallel. The Sybase SQL Server Reference Manual recommends external pre-sort to accelerate index creation during database loads. Multiple tables created quickly in query index order should help speed queries.

Speed icon How to Speed Sybase Loads
X

How to Speed Sybase Loads

"CoSorting" data in the file system prior to loading Sybase can:

  • Speed load performance 2 and 10X
  • Remove the sorting aspect of the load
  • Reduce database and disk overhead
  • Increase load processing rate (rows per hour)

The recommended technique says to pre-sort flat files on the clustered index key. CoSort is designed to sort huge files in parallel, with performance scaling linearly in volume. You will want to create a clustered index. But first, eliminate the indexes by creating tables without indexes or triggers, or by dropping them from the table to be loaded. Then you can:

  • CoSort the data on the primary key index
  • bcp load the sorted table using fast bcp path (as there are no indexes on teh table)
  • Use the SQL command CREATE INDEX, using the SORTED_DATA option, to create the clustered index

CoSort's SortCL program can also transform and reformat data for database migrations and custom (detail, summary, and delta) reports, and protect sensitive data at the field level with a variety of encryption, masking, and other functions.

Speed Sybase Reorgs

Accelerate reorgs by performing them offline; i.e., use the file system instead of encumbering the database. The offline DB reorg wizard available to FACT and CoSort (or Voracity) users in the IRI Workbench combines FACT, CoSort and bcp in batch operations you can schedule and run in or outside the Workbench GUI.

Migrate & Replicate Sybase Data

Move data in and out of Sybase and other data sources with IRI NextForm DB edition or Voracity. Perform complex ETL, change data capture, and replication operations in Voracity.

Mask PII in Sybase

Find and classify PII through built-in data discovery and profiling tools. Then, build static data masking jobs for Sybase, SAP HANA, and other JDBC and ODBC-connected sources with the standalone IRI FieldShield package or Voracity platform. You can also score the risk of re-identification based on the remaining quasi-identifiers in your dataset.

For dynamic data masking, make a call to FieldShield functions in its SDK, or deploy custom redaction policies in the IRI Chakra MaxDB firewall for Sybase.

Generate & Populate Sybase Test Data

To rapidly populate Sybase with safe test data, use the high-volume test data generator, IRI RowGen. RowGen uses your data models to automatically generate the test data for an entire database with referential integrity, and is also built into the Voracity platform.

Monitor, Alert, Block & Audit

Connect to your Sybase instances in sniffing or gateway mode to control, watch, block and log access to all users and activities on a policy basis using IRI Chakra Max. Chakra Max is the database firewall industry's fastest-performing, lowest impact DAM/DAP system for more than 20 DB platforms, including Sybase ASE and IQ.

Request More Information

Live Chat

* indicates a required field.
IRI does NOT share your information.