Darryl,
This can be easily done if the command is issued on the test system.
First create an SQL index or logical file on the source system that has the desired selection criteria.
Then create a DDM file on the test system that points to the logical on the source system.
Then run the CPYF command on the test system that uses the DDM file as the input.
We have a physical file on a source system that has 68 million records.
It has an SQL index whose selection criteria results in just 1626 entries.
The CPYF using the DDMF is almost instant and the test system ends up with just the desired 1626 entries.
Regards, Peter
-----Original Message-----
From: MIDRANGE-L [mailto:midrange-l-bounces@xxxxxxxxxxxx] On Behalf Of a4g atl
Sent: Friday, 11 August 2017 1:44 AM
To: midrange-l@xxxxxxxxxxxx
Subject: [IE] How can I speed up the copying of data using DDM and field selection.
We do not have a relational database entry for our production system so I cannot use SQL to copy data from the production system.
I am using DDM and CPYF with field testing. The problem is I am trying to copy 100k records from a file that has over 800 million records. CPYF does not do the selection on the source system and instead appears to copy all
800 million records to the test system where it checks the values and either writes the records or discards them. This takes forever to copy.
I have read rights to the file on the source system.
Is there another way to speed up the copy?
TIA
Darryl Freinkel
--
This is the Midrange Systems Technical Discussion (MIDRANGE-L) mailing list To post a message email: MIDRANGE-L@xxxxxxxxxxxx To subscribe, unsubscribe, or change list options,
visit:
http://lists.midrange.com/mailman/listinfo/midrange-l
or email: MIDRANGE-L-request@xxxxxxxxxxxx Before posting, please take a moment to review the archives at
http://archive.midrange.com/midrange-l.
Please contact support@xxxxxxxxxxxx for any subscription related questions.
Help support midrange.com by shopping at amazon.com with our affiliate link:
http://amzn.to/2dEadiD
############################################################## This correspondence is for the named person's use only. It may contain confidential or legally privileged information, or both. No confidentiality or privilege is waived or lost by any mistransmission. If you receive this correspondence in error, please immediately delete it from your system and notify the sender. You must not disclose, copy or rely on any part of this correspondence if you are not the intended recipient. Any views expressed in this message are those of the individual sender, except where the sender expressly, and with authority, states them to be the views of Equifax. If you need assistance, please contact Equifax :- Australia www.equifax.com.au/contact New Zealand www.equifax.co.nz/contact ##############################################################
midrange.com
