Jump to content

Recommended Posts

Hi all,

I have a idea to establish progressive backup on AWS S3 bucket.

 

Client has a 3GB database (on aws machine) , and I we already use progressive backup in every 5 minutes.

But, in case that main server crushes down, we have another, backup server, also AWS machine. Now, client wants that in trouble situation, save data as much as possible, and came up with this idea - progressive backup on AWS S3.

 

Is this possible? Does anyone tried this?

 

Thanks in advance,

Ve

 

Link to post
Share on other sites

https://www.soliantconsulting.com/blog/backups-to-the-cloud-with-aws/

Copying a backup to S3 is trivial, especially from an AWS machine itself.

But copying a progressive backup is tricky because the exact run time of a progressive backup is not set, it depends on when the machine was last restarted.  And you do not want to touch the progressive backups folder while a backup is in progress.  So your OS-level script that tries to grab the most recent progressive backup needs solid coding to check for a backup being in progress.

Link to post
Share on other sites

Thank you Wim for fast answer!

So I cannot somehow set the path for progressive backup folder on s3 directly.

I "only" need to have a good 'OS -level' script which will transform progressive backup folder to S3? 

 

Ve

Link to post
Share on other sites
28 minutes ago, Veselko said:

So I cannot somehow set the path for progressive backup folder on s3 directly.

No.

29 minutes ago, Veselko said:

I "only" need to have a good 'OS -level' script which will transform progressive backup folder to S3? 

Yes.  Obviously you have to factor in what frequency you want to do with.  If this is a single file that is 3GB and you want to copy it to S3 every 5 minutes, that could potentially affect the overall performance of your server.

Link to post
Share on other sites

Thanks!

 

One question more please. 

13 minutes ago, Wim Decorte said:

that could potentially affect the overall performance of your server.

You mean performance of windows server machine, not FMS. Is that correct?

 

Ve

Link to post
Share on other sites

The two cannot be separated.  Any server has 4 broad potential bottlenecks:

  1. processing power
  2. disk i/o
  3. memory
  4. network throughput

FMS, as a database server reading and writing and processing data is very sensitive to #1 and #2.

If you are going to have a separate process that reads 3GB of data every 5 minutes and pushes it across the network you are going to expend quite a bit of resources on #1, 2 and 4.  That will affect FMS.  To mitigate that you need to build in extra resources in those areas so that the effect is minimal. 

Things like: make sure the AWS instance does not have burstable processing or burstable disk i/o.  Go for higher-than-normal IOPS, pick an instance with more cores than you'd think you need for just FMS,...

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
  • Similar Content

    • By DataCruncher
      This is strange. 
      Two FMS18 servers on Mac. 
       
      Both run a similar database file I had synced with mirrorsync. One of the tables is not that important but slowed mirrorsync down, so I decided to not mirror that table between server 1 and server 2, but instead make server 2 an external data source to server 1. 
       
      I add server 2 as external data source to server 1. 
       
      Then, things start to get weird. The table I wanted from eh external source I deleted from server 1. Yet, when I add server 2 as external datasource, it defaults back to the local file? 
      I can tell that's what's happening according to two observations: server 2 has the table X; server 1 does not as I deleted it. 
      Also, the external data source management windows shows file:FILE.fmp12 instead of fmnet://server2.xyz.com/FILE.fmp12
       
      How on earth can that happen? Filemaker seems to connect to server 2 but then think it's the same as the local file and decide for me to take the file on server 1 instead of the file on server 2?
       
      Very strange!
       
      Thank you!
       
       
    • By Spidey
      Hi,
      I have two table: Invoice and Customer.  I like to have the total of all the invoice for a customer between certain date in the Customer portal that show all the customers, but I got a error when I try to debug..
      ExecuteSQL("SELECT SUM(I.TotalAmount) FROM Invoice I JOIN Customer C ON I._kf_CustomerID = C.__kp_CustomerID WHERE date(I.InvoiceDate) between date(C.SearchFromDate ) and   date(C.SearchToDate )" ; "" ; "" )
      I have an error and couldn't figure it out.  Thanks...
      KC


    • By Todd Dignan
      I have a client that has been using a send email script step  that brings up the outlook email client on the desktop.  This as worked for years no problem.  It has stopped work on 3 of 35 computers within the last two weeks.  I talked with there IT personal and they have assured me that no updates have happened.  The actual error is -
      Microsoft Office Outlook
      Either there is no default mail client or the current mail client cannot
      fulfill the messaging request.  Please run Microsoft Outlook and set it as
      the default mail client.
       
      I have double checked with system default  and Outlook's settings.  Both are set to default.
      The client is using the latest version of office 360's and the latest version of FileMaker 18 advance. Both 64bit.
      Any suggestions are welcome.


    • By tbcomputerguy
      I have an excel sheet that controls bills of ladings for a forestry company.  In the example you can see that there is lots going on with this Bill.  It has a payperiod, mill, truck that delivered it, etc.
      I would like setup a database to monitor this.  The fields CT1, CT2, Skid1, Skid2. PROC1, PROC2 are all contractor numbers.  There are 6 contactors.  The percentages in each line are the amount of the volume they performed  In the third line there is a value in CT1 only...they get 100% of the volume.  I can figure out most of this, but am stumped on how I can monitor when a contractor does multiple jobs..ie in line one, contractor 5, cuts and skids.  All 6 contractors could be involved in one BOL. Each one of these jobs, cutting, skidding and processing each has their own respective rate of pay as well.   I think i need a way to break down each line so that I can produce pay summaries for each of the contractors.  I had started this years ago, and thought I asked in a forum, but can't remember where.  Nonetheless, they stopped using multiple contractors per load...Now they have returned, so I am back at it.  So if this is a repost from years ago I apologize.  
      Thanks in Advance
      tbcomputerguy
       
       

    • By dancer5678
      I am using Filemaker Server 18 on Windows Server 2012 R2
      Been using it for years with no issues
      Currently when I log in to the console it is very sluggish.
      When I get to the Dashboard it shows No databases, then it auto refreshes and the database list appears.
      Within 15 seconds of scrolling the database list to open files the screen refreshes. This situations is happening over and over in a loop.
      Any Thoughts on what is causing this issue?
       
       
       
       
  • Who Viewed the Topic

    1 member has viewed this topic:
    innodat 

×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.