RE: a need for speed -- RPG400-L

Do I dare mention matching record processing?   Would the old-fashioned IP
logic, with matching records and an L1 break on the first, second, and forth
key fields be the way to go?  
 
---------------------------------
Booth Martin
http://www.martinvt.com
---------------------------------
---------------------------------
Booth Martin
http://www.martinvt.com
---------------------------------
-------Original Message-------
 
From: RPG programming on the AS400 / iSeries
Date: 08/19/05 08:42:56
To: RPG programming on the AS400 / iSeries
Subject: RE: a need for speed
 
Actually, we already have a process for this.  It takes 3 hours+ to run.
 
I plan to rewrite to increase the speed.  Hence the question.
 
There is actually another twist to this process.  See below:
 
Our telephone master file is splitted across two AS400.  One has 22M+ and
the other has 18M+ records.  The summary file needs to combine the record
from the two AS400.  To copy such a big file across to another system, index
it and run the process is probably too time consuming.  The plan is to
create summary file on each system first, then somehow combine them.  Not
sure if I can beat the 3 hours time of the existing process.  Is going to be
fun and probably will need some helps from you folks again.
 
thanks.
 
 
 
-----Original Message-----
From: rpg400-l-bounces@xxxxxxxxxxxx
[mailto:rpg400-l-bounces@xxxxxxxxxxxx]On Behalf Of Joel Fritz
Sent: Thursday, August 18, 2005 7:20 PM
To: RPG programming on the AS400 / iSeries
Subject: RE: a need for speed
 
 
 
One more thing to consider.  If this is a one off report, the easiest to
code approach is probably the best unless performance is abysmal.  If
it's a regular production job it kind of depends on how long both take.
If the run time is in hours it's probably worth optimizing it.  If it's
in minutes both ways it depends on how frequently it's run and whether
users are waiting with bated breath.
 
I wish I could remember the break even point between random and
sequential I/O, but I know it's completely counter intuitive.
 
<><><>-----Original Message-----
<><><>From: rpg400-l-bounces@xxxxxxxxxxxx
<><><>[mailto:rpg400-l-bounces@xxxxxxxxxxxx] On Behalf Of Tom Liotta
<><><>Sent: Thursday, August 18, 2005 5:04 PM
<><><>To: rpg400-l@xxxxxxxxxxxx
<><><>Subject: RE: a need for speed
<><><>
<><><>AFAIK, Booth's method would "work", but Scott's _could_
<><><>easily be faster. The ordering would be the same for both
<><><>and grouping would be defined the same. Scott
<><><>positions-to and READs the first and last record in every
<><><>group giving lowest and highest suffix (as long as
<><><>ordering and grouping are correct) in the group. Booth's
<><><>method would give the lowest suffix at L1-Detail time and
<><><>the highest at L1-Total time.
<><><>
<><><>However, Scott has a point when the average number of
<><><>records in groups exceeds some number. If records are
<><><>1000 bytes in size and groups average say 50000 records,
<><><>then maybe it's not such a good idea to read individual
<><><>records. But if groups average 5 records, then it hardly
<><><>matters whether records are all read or not -- most will
<><><>be physically read anyway and there'll be no READPs nor
<><><>any other complicating code paths internally.
<><><>
<><><>Tom Liotta
<><><>
<><><&gt;rpg400-l-request@xxxxxxxxxxxx wrote:
 
*****************************
NOTICE:
All e-mail sent to or from this e-mail address will be received or otherwise
recorded by
The Sharper Image corporate e-mail system and is subject to archival,
monitoring,
and review by and/or disclosure to Sharper Image security and other
management.
This message is intended only for the use of the addressee and may contain
information
that is privileged and confidential.
 
The contents of this message may contain personal views which are not the
views of The Sharper Image.
If you are not the intended recipient, dissemination of this communication
is prohibited.
*****************************
 
--
This is the RPG programming on the AS400 / iSeries (RPG400-L) mailing list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.
 
 
--
This is the RPG programming on the AS400 / iSeries (RPG400-L) mailing list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.
 
 
.