I created a file using version 9 in order to scrape the Custom Functions posted at Brian Dunning's site. My file uses source, content, scripts and custom functions.

 

I recently upgraded FileMaker Pro Advance to 13 and I want to migrate some of my older files to it, including this one, in order to improve some of them, and to take advantage of any new tools available for this purpose.

 

Is the process for scraping data off of the web still the same, or has this changed using newer tools?

 

TIA for your time, suggestions and information.

 

Kiele

Insert from URL is generally a much better way to go. I think we got that in version 12.

Hi Fitch, thanks for the reply.

 

I need to work some with the results, but it appears that it is what I need.

 

Thanks again,

 

Kiele

Hi all,

 

Am I doing it correctly, I seem to get the same content as when I use the Web Viewer method, only I'm not having to use the Web Viewer?

Correct, you don't need the webviewer to insert data into a field with InsertFromURL.

Hi Agnes, and thank you for your reply.

 

As I thought, no need for a Web Viewer,that's great.

 

Is there a better way then to parse out the data into their own fields? or do I need to set up some calculations?

 

Kiele

Nope, you still have to parse it.

 

If it's a "data" site, do they provide some kind of API, so you can get the data in a cleaner format?

I'm not sure quite what you mean, it is Brian Dunning's site, and here is an example of what I'm wanting to scrape.  http://www.briandunning.com/cf/1114

Brian Dunning's CF site is actually an easy one to parse, being very rigidly structured. I don't think you need an arsenal of "scripts and custom functions" for this - just a few Set Field[] steps using the Position() and Middle() functions to locate and extract the data. However, you do still have to parse it.

Hi comment, thank you for your relply.

 

It seems that this part of it hasn't changed then.

 

Thank you all for your help.

 

Kiele

Ah, I misunderstood your original post. So you're using a recursive custom function to parse a page that describes a recursive custom function. Nice!

Not a problem, I got the information I needed to move forward, starting with the "Insert from URL" suggestion.