I have a file that I use as a reference or "lookup" file and need to update the data daily. This file contains approximately 20,000 records and 40 fields. Daily I will refresh this data by importing records from a .csv file. The import will update existing records and add new records. This action will be performed by a script and initiate via a button or menu option.

Here's my question....

What would be the fastest way to update my reference file? Importing from the .csv file seems to take an extraordinary long time. Would it be faster to covert the .csv file to a Filemaker db and then use the Filemaker file as the source?

Comments & recommendations appreciated.

I've had the idential situation. It was recommended that I first import into an FM file; suggesting that it was much faster than importing directly into my table. Why? My existing table had a lot of auto-enter calculations and a lot of relationships. When 'perform auto-enter' was requested, it took ages.

It proved TRUE in my situation - even though it meant importing twice, it was much faster! There is something about using an FM file which speeds it up substantially.

UPDATE: This was using vs. 7.0v2, I believe. I do NOT have speed comparisons using more recent versions. I would TEST IT. And then test it again!!

Edited August 22, 200718 yr by Guest
Added update

Thanks for the input. I agree testing is the best way. I was just curious if others had experience with this problem. When I get 9.0 Server going I am planning on experimenting with ESS and linking to the original non-FM database.

R