Best Way to find duplicate records in same file

[Mark Allen <mallen@xxxxxxxx>]

I need to add duplicate record checking in a file we received from a
switch.  (I'll just add it to the CL that already FIXES a bunch of stuff
in the file anyways) and was wondering what the best (i.e easy/fast) to
do it would be.  I've come up with:
 
1.  Run a query against the file, sorted by entire record, level break
on entire record, count.  Output Query results to file and then do cpyf.
2.  Build a file keyed on all 210 bytes, read original chain to new
file, if not found write it
3.  SQL ???  not done much with it but maybe it could do?
 
Mark Allen
IS Manager
Wilkes Telephone & Electric
11 W. Court Street
Washington, GA 30673
Phone: (706) 678-9565
Fax: (706) 678-1000