Duplicates in multiple tables

[MintonMagic]

Hi everyone,

A little stuck on this one.

I get a CSV Database of about 7500 products. I need to compare an old copy and a new copy of the database, and take out the duplicates in each database.

I have 2 tables old_db and new_db. I import the correct files, that works fine. How can I search through these tables records and find the duplicates and delete them?

I have tried several scripts and no of them work. I am open to any suggestions. thanks!

[efen]

Script (copied from a file submitted by comment)

pseudo code:

Sort records by the field [thisfield] that is the duplicate

Goto first record

Loop

If (thisfield = Get Nth Record(thisfield; Get (RecordNumber)-1)

Delete record

Goto previous record

End if

Goto next record [exit after last]

End loop