docasar

UPDATE for NOVICE developers like myself: I finally found a solution, and apologise because I found that my first post wasn't completely right: 1) GetLayoutObjectAttribute ( "webviewer" ; "Content" ) on Filemaker Pro would actually get the modified DOM source code. 2) Since different webpages would run different scripts on Desktop version than on Mobile version (the one shown if using FILEMAKER GO), you can also get the DOM source code for the mobile version just by having an additional webviewer pointing to the mobile version of the url, normally if a web is: "htttps://www.name.com" for Desktop version, for mobile version it would likely be something like: "https://m.name.com". 3) If you need the source code pre-javascript altered, just use the script step "Insert from url". In my case I just solved it this way, I hope it helps anybody else that would be trying webscraping in the future. I needed this functionality in my development because I am trying to download the top 100 sold products for each category from a known Dropshiping site, for later review of the potential to add new products to our catalog. All this could be also done easier with the official site API, but I didnt have access to it yet. Since I couldnt found any other app or API that would retreive the DOM version of an url in bulk (only some chrome extensions that would do it but one by one by hand) I built this little tool to help me getting the HTML code with all information need for later webscrapping. I attached to this post the sample file, that can be used for similar purposes just by creating a script that would loop through all the product urls records. Again, thanks a lot for your time! Luis DOM_source.fmp12

I'm trying to insert the html code of a product page on a website for later Web Scraping Data. I am aware of the standard practice of using "Insert from URL" to get the source code, but I would only retrieve the content of the unmodified (pre-javascript altered) page, not the page after javascript has modified the DOM. Options I tried so far: 1) Make a webviewer from the url and use the GetLayoutObjectAttribute ( "webviewer" ; "Content" ) it shows the content of the unmodified (pre-javascript altered) page, not the page after javascript has modified the DOM on Filemaker Pro on mac. 2) As pointed from Tod on https://stackoverflow.com/questions/25561850/getlayoutobjectattributewebviewer-content-doesnt-reflect-javascript-dom/60683713#60683713 I created a new layout and run the same GetLayoutObjectAttribute ( "webviewer" ; "Content" ) on Filemaker GO on my iphone, doing that I did manage to grabe the post-javascript rendered source code. What I would ultimately like to achieve would be to get the same data but using Filemaker Pro instead of Filemaker GO, could someone point me on the right direction to whether this is possible at all? - What I would like to avoid is to have the script running and having a middle step with wait for 5 seconds to be sure that the webviewer loaded correctly all the javascript content, instead would like to get the FULL code (rendered DOM) using the "import from url" function. Thanks a lot for your help! Luis

Hello, I hope someone can bring light to the dark where I am at the moment with what seemed to be a simple script... So what I am trying to achieve is to print at once all open invoices from a current customer (in this case only 2 out of 3 invoices), so my script looks like this: Tables: ACT = Accounts INV= Invoices INL = Invoice Line Relationships: ACT (___ACT) = act_INV(__f_ACT) then I have from act_INV (___INV) = act_inv_INL (__f_INV) From Accounts Layout I have a portal that shows all invoices related to that account, and there I have placed a button with the follwoing script: Layout for the print: Print Unpaid invoice (based on act_inv_INL) Script: ---------------- Set variable $id = ACT::___ACT Set variable $status = "Open" Go to layout (act_INV) Enter Find Mode Set field: act_INV:: __f_ACT with $id Set field act_INV::status = $status Perform find (this will give me 2 found records on layout act_INV) Go to related record: act_inv_INL on layout Print Unpaid invoice and match all related records from found set. Enter Preview Print Setup ------------- And I can not pass from here, it will put together all lineitems under the same invoice and show only one invoice total, even though it show all line items from the two invoices. I have tried different relationships but I cant figure out what I am doing wrong ... Any lead would be really much appreciated, Thanks a lot...

Ok... After LOTS of testing I figure out how it should be done, so I am just updating my own post to share the info in case anyother "amateur" developer as myself would encouter similar challenge I just figure out how to pass that "-d" data with the XML code, what I did was: 1) Create variable ( $rawdata ; <?xml version="1.0" encoding="UTF-8"?> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="SeguimientoEnviosRequest.xsd"><Solicitante>1</Solicitante><Dato>xxxxxxxxxxxxxxxx</Dato> </SeguimientoEnviosRequest>) 2) I was using the lumifire example for CURL testing ( https://luminfire.com/2017/06/12/curling-filemaker-16/) and on the $options variable that is set on their script I just added an extra curl option as: " -d " & "\"" & Substitute ( $rawdata; "\""; "\\\"" ) & "\"" 3) FEEL THE JOY!!!!! when I get the XML info back Thanks a lot, Best regards!

Ok... After LOTS of testing I figure out how it should be done, so I am just updating my own post to share the info in case anyother "amateur" developer as myself would encouter similar challenge I just figure out how to pass that "-d" data with the XML code, what I did was: 1) Create variable ( $rawdata ; <?xml version="1.0" encoding="UTF-8"?> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="SeguimientoEnviosRequest.xsd"><Solicitante>1</Solicitante><Dato>xxxxxxxxxxxxxxxx</Dato> </SeguimientoEnviosRequest>) 2) I was using the lumifire example for CURL testing ( https://luminfire.com/2017/06/12/curling-filemaker-16/) and on the $options variable that is set on their script I just added an extra curl option as: " -d " & "\"" & Substitute ( $rawdata; "\""; "\\\"" ) & "\"" 3) FEEL THE JOY!!!!! when I get the XML info back Thanks a lot, Best regards!

Hi, I find my self hitting the wall, again and again, trying to make a POST call to an API using Insert from URL curl. When I try the code in POSTMAN it works very well, but trying to translate the curl options into Filemaker is where I fail. This is my POSTMAN code: curl -X POST \ https://www.correosexpress.com/wpsc/apiRestSeguimientoEnvios/rest/seguimientoEnvios \ -H 'user: username:passowrd' \ -H 'Content-Type: application/xml' \ -H 'Postman-Token: ff84b952-74c8-f06b-976d-f860d9d66de7' \ -d '<?xml version='\''1.0'\'' encoding='\''UTF-8'\''?><SeguimientoEnviosRequest xmlns:xsi='\''http://www.w3.org/2001/XMLSchema-instance'\'' xsi:noNamespaceSchemaLocation='\''SeguimientoEnviosRequest.xsd'\''><Solicitante>x</Solicitante><Dato>xxxxxxxxxxxxxxxxx</Dato> </SeguimientoEnviosRequest>' The yellow part is what I should put under "Body" and after in "raw" in POSTMAN and it is just that the one I can not figure out how to put it as a curl option for the Insert from URL... :(. I pass authorisation using username and password, but I get all the time the same error of missing "XML entry template" Any idea on how to overcome this error? is the XML entry template the headers that this api needs to have them custom? Thanks a lot!!!

This is how postmant shows the cURL code: curl -X POST \ https://www.correosexpress.com/wpsc/apiRestSeguimientoEnvios/rest/seguimientoEnvios \ -H 'Authorization: Basic Zmxhc2thOmlUZnl4' \ -H 'Cache-Control: no-cache' \ -H 'Content-Type: application/xml' \ -H 'Postman-Token: ff84b952-74c8-f06b-976d-f860d9d66de7' \ -d '<?xml version='\''1.0'\'' encoding='\''UTF-8'\''?><SeguimientoEnviosRequest xmlns:xsi='\''http://www.w3.org/2001/XMLSchema-instance'\'' xsi:noNamespaceSchemaLocation='\''SeguimientoEnviosRequest.xsd'\''><Solicitante>x</Solicitante><Dato>xxxxxxxxxxxxxxxxx</Dato> </SeguimientoEnviosRequest>' Any ideas how to translate that into FIlemaker curl options so it would work? Aparently that last part of the code "-d" is what is failing to send with POST on Filemaker Thanks a lot...

Hello, I am trying to connect to our current database with our shipping company so I can update the status of the delivered orders. To do that, I am currently using insert from URL and then parse the code to extract the info I need. However, I believe there should be a cleaner and safer way to do it using webservice. So I downloaded the documentation and looks very straightforward to set and I have been able to set up the POST and send it getting the data as XML using POSTMAN (as very well explained here: http://www.filemakerprogurus.com/filemaker-api-integration-salvatore-coleangelo/ ) and also in the great post by luminfire https://luminfire.com/2017/06/12/curling-filemaker-16/. However, when I try the same parameters on my script in filemaker, I get all the time an error saying that something like "Entry XML Schema/template it is not loaded correctly". Following the documentation of the API I see that on Postman I need to insert on the Body RAW some kind of code that looks like this: <?xml version='1.0' encoding='UTF-8'?> <SeguimientoEnviosRequest xmlns:xsi='http://www.w3.org/2001/XMLSchema-instance' xsi:noNamespaceSchemaLocation='SeguimientoEnviosRequest.xsd'> <Solicitante>x</Solicitante><Dato>xxxxxxxxxxxxxxxxx</Dato> </SeguimientoEnviosRequest> but I don't know which settings I have to do on my script to make the call work. Any suggestions as to where to put this info so the can be passed with the CURL? I am a bit desperate now because I see the amazing possibilities that the interaction with the web service may bring but I can find a way to make it work... Thanks a lot for your always invaluable support!!

Hi Lee, Many thanks for your reply I apologize if my question may lead to confusion... Exactly, I would like to download the Excel file from a webpage (insert from URL) and then use the Excel file to create or update new records. It is important that I a container is involved so it doesnt matter from which device the import is made (no path related recurring import). Does this make any sense? Thanks a lot!

Hi, I have a similar situation where I would like to use insert from URL to import an Excel file into a container and then once the Excel file is on my database use it as a source for updating records with the information that the excel file contains. Until now I could only use a file stored on my computer... any ideas if it is possible to set a content of a container field as the source for an import file? Many thanks!

Hi Ryan, Many thanks for your comment. Best regards, HI Bruce, Many thanks for your help! What I was doing was parsing that info from the headers directly. I will try what you and Ryan suggested. Best regards,

Hello, First of all, I am a newbie on Filemaker so still learning every day new techniques... I like to search in the forums to deal with the challenges I find but this one I am posting I couldn't find anything so I am starting a new topic just in case. I am trying to set a script to import data into our Filemaker DB from a Excel file. Normally we would download every day an excel file from our Courier company with all the tracking information and then import that info into our orders table. What I would like to set is a script that would run everynight and donwload the Excel file into a Container Field and then use that container as a source for a recurring Import. Does this make any sense? I would like to achieve is to not store any file outside of Filemaker. Is this possible? thanks a lot again for your time, Best regards,

Hello Bruce, I am sorry I am just getting back to you about your suggestion. Thanks a lot, it worked great! I have encountre the same problem with replyTo, any suggestion for that? Thanks a lot,

Hello, I am still very amateur on Filemaker so i hope my question does make any sense. I am trying to write a script that would basically import order information from an email and convert it, first in a new account (if the customer does not exist) and later create a Sale Order. So far, I have managed to do that, but the problem i find is when trying to convert the sale order into an invoice. Since this order comes from our webshop when we receive the email means it is paid, so my aim is that when creating the invoice from the Sale order, this would be marked as paid and set the amount due to zero. This would sound a very easy task, but since our solution incorporates a payments module to manage the payment of an invoice, when i try to incorporate the payment entry within my script, there is when all the trouble starts. For some reason, it gets lost in its way when runnig the script and returns a partial payment all the time. The weirdest thing is thet if I run the script on debug mode, then all works perfectly, so my guess is that the issue may be related to the speed of the script. So, is there any recomendation as for where to put a pause script step so the script will work also when run automatically? I have tried every possible combination of long script, shorter with other scripts inside, perform script on server... and all the time something is wrong ;( Thanks a lot for any insight thst would help us move forward, since we have been trying to solve this for a week already. Best Luis

Hello, I have been already half a day trying to find out how the 360work email EmailReadMessageValue function works. I have been able to download only the latest 3 days emails, but if any new email will come the EmailGet NExtMessage would be set as 0 and therefore "Halt the script" Moreover no email that I download comes with the messageID or UID. The first does not create the $variable because it is empty and the second gives only value "0". Everything else can be obtained from the keys. What could I be doing wrong so that the EmailReadMessageValue( "messageID" ) does not extract the messageID from the email??? I am desperate because I just cant figure out why this is not working, so any comment that would help see some light would be much appreciated, Thanks a lot in advance for any help you may provide. Luis