Re: 2. Re: How to compress data in RPGLE and save it in a file and

["Booth Martin" <Booth@xxxxxxxxxxxx>]

 "We are expecting around one million orders a day, ... I can easily do it
on PC platform"  After 100 days you will have around 100 million records. 
You can do that easily on a PC platform?  

My own reaction s that you are spending energy on the wrong issue.  Buy DASD
  If you are processing a million orders a day then all of your energy has
to go into performance issues not economic issues.   You need fast retrieval
 reliable responses, ease of maintenance, and big pipes.  

Compressing and expanding the data is going to take on a life of its own and
require lots of CPU capacity.  
  
 
---------------------------------------------------------
Booth Martin   http://www.MartinVT.com
Booth@xxxxxxxxxxxx
---------------------------------------------------------
 
-------Original Message-------
 
From: RPG programming on the AS400 / iSeries
Date: 12/31/03 11:41:53
To: 'rpg400-l@xxxxxxxxxxxx'
Subject: 2. Re: How to compress data in RPGLE and save it in a file and
 
Hi Scott,
 
Sorry for not explaining what I wanted.
 
We are expecting around one million orders a day, now some how on daily
basis we need to archive this data and be able to use it as needed.
 
Our thinking is that we will store the lookup data in regular file layout
(index file), which will be used to search records but rest of the data will
be in compress format or files.  User can search the records using Index
file and then we can uncompress the required data and use it.
 
I can easily do it on PC platform but wondering if there is any utility or
functionality within OS/400 which can help us to do what we are trying to
do.  Meaning save the disk space by compressing it and also be able to
recover data from compress mode within seconds.
 
Any idea how to solve this issue?  It's all regular data (numbers/strings).
For one order we have 100s of files and there are 100s of fields in each one
of them.  Don't ask why we have so many files and fields.  (FYI: It's all
custom development of many years). We would like to compress this data by
order number so that we can easily retrieve it.
 
Thanks