Home » Solutions » File Interchange » Text
Process and Convert to/from Text Files 
Process and Convert Large Text Files Quickly

Challenges:
Structured text files are fixed or variable, sequential (flat) files that can be as small as one record or contain billions of archived rows from database extracts, web logs, transaction feeds, maiframe datasets and other applications.

You may need to:

• Sort a huge text file
• Extract data, or create a report, from a text file
• Convert between text and XML file formats
• Convert a text file to another format
• Encrypt or de-identify fields in an text file
• Load text data to a spreadhseet or database
• Reformat a text file from legacy or binary data
You may need to do more than one of these functions at the same time, and with many massive source and target files.


Solutions:

IRI delivers text and other file conversion functionality in two packages, which you can choose by the level of need:

Text File Conversion Only
Newly available from IRI is a low-cost, data migration product called NextForm. NextForm allows you to convert files in text to other formats (like CSV, LDIF, COBOL, XML, etc.) or from those other formats into flat text files. NextForm also supports data type conversion at the field level, and the remapping of record layouts.

Note that NextForm file definitions will work in SortCL so that you can re-use your metadata if you someday want to upgrade to CoSort's fast transformation, custom reporting, and/or data-centric protection functions.

Text File Processing & Conversion
With the CoSort package's SortCL tool, you can easily process portable text files that represent structured data at any volume level. Text files are the default /PROCESS type for both input and output files in SortCL jobs.

In fact, you can declare one or more text and non-text flatfiles for input and output as part of any CoSort SortCL program involving data:

• Transformation (sort, join, aggregate, remap)
• Conversion (data types and file formats)
• Protection (field encryption, masking, de-ID)
• Reporting (batch, detail, summary and deltas)
All of these actions - one or more at a time - are now available to data architects who need to work with CSV, XML, LDIF, ISAM, Vision, web log, text and other large, structured files.

Test Text Data
If you need to generate test data in text file formats, see IRI's RowGen product. RowGen uses the same layout metadata as CoSort and NextForm so you can easily move between test data generation and real data transformation.


See also:
Solutions > File Interchange
Solutions > File Transforms
Solutions > Reporting
Products > CoSort > SortCL
Products > NextForm
make text smaller make text larger print this pageemail this page
» Resources
» Next Steps
1-800-333-SORT
1-321-777-8889
Did you find what you were looking for on this page?
YesNoUnsure

What you were looking for:

Include your email address if you would like a response.