MicrostockGroup Sponsors


Author Topic: updraft  (Read 5520 times)

0 Members and 1 Guest are viewing this topic.

« on: September 05, 2013, 01:32 »
0
Just wanted to check I'm settting up updraftplus correctly. Tick plugins, uploads, any other directoies in wpcontent,  themes, core boxes including core and exclude "symbiostock_XML_Cache" is that correct?


quailrunphoto

« Reply #1 on: September 05, 2013, 02:41 »
0
That is the way mine is setup.  So I hope it is right for what I want to do.

But this is a very limited backup of your wp-content directory.  It is not a full backup of your site.

There are several threads going on right now about backup and what is the right thing to do.  Lots of good advise and some spirited discussions. ;D

« Reply #2 on: September 05, 2013, 07:13 »
0
No, it's not enough.
You should check "Any other directories ..." and then include the symbiostock_rf, symbiostock_ipn and symbiostock_network folders.

« Reply #3 on: September 05, 2013, 07:25 »
0
No, it's not enough.
You should check "Any other directories ..." and then include the symbiostock_rf, symbiostock_ipn and symbiostock_network folders.
Thanks

« Reply #4 on: September 05, 2013, 07:35 »
0
No, it's not enough.
You should check "Any other directories ..." and then include the symbiostock_rf, symbiostock_ipn and symbiostock_network folders.
Thanks

You're welcome. Give it a try and let us know if it works because I'm a little sceptical that Updraft will be able to handle a 10 to 12GB backup (like in your specific case).

« Reply #5 on: September 05, 2013, 07:38 »
0
No, it's not enough.
You should check "Any other directories ..." and then include the symbiostock_rf, symbiostock_ipn and symbiostock_network folders.
Thanks

You're welcome. Give it a try and let us know if it works because I'm a little sceptical that Updraft will be able to handle a 10 to 12GB backup (like in your specific case).

Actually, today i completed my SEO, and also contact a web design company to show me how to back it up properly. I just have a very uncomfortable feeling usibg these back up programs.

« Reply #6 on: September 05, 2013, 08:17 »
0
No, it's not enough.
You should check "Any other directories ..." and then include the symbiostock_rf, symbiostock_ipn and symbiostock_network folders.

Thanks


You're welcome. Give it a try and let us know if it works because I'm a little sceptical that Updraft will be able to handle a 10 to 12GB backup (like in your specific case).


Actually, today i completed my SEO, and also contact a web design company to show me how to back it up properly. I just have a very uncomfortable feeling usibg these back up programs.


Didn't you get this to work: http://picturebreeze.com/stock/photos/back-entire-symbiostock-website/ ?
Too complicated?
If you need more assitance, I'm glad when I can help out.

« Reply #7 on: September 05, 2013, 09:56 »
0
No, it's not enough.
You should check "Any other directories ..." and then include the symbiostock_rf, symbiostock_ipn and symbiostock_network folders.
Thanks

You're welcome. Give it a try and let us know if it works because I'm a little sceptical that Updraft will be able to handle a 10 to 12GB backup (like in your specific case).

You can also use the option to backup WP core and exclude the symbiostock cache (possibly also some WP directories you don't need).

Why the query about a large backup - it lets you specify the chunk size of each zip file. The default is 800 MB chunks and I found for me it worked much more smoothly with 400MB chunks

steheap

  • Author of best selling "Get Started in Stock"

« Reply #8 on: September 05, 2013, 10:05 »
0
I'm running my 10GB site now - it is taking a long time as you would expect! I didn't see the chunk size setting so I will see what happens!

Once this has run, I'm going to change my approach and backup the images semi manually to Google Drive as they don't change often (especially the old ones) and then use Updraft on the rest of the site. I think that will make it much faster and easier.

I'll write out some fuller guidelines on how to work this with Google Drive once I have worked it out!

Steve

« Reply #9 on: September 05, 2013, 10:25 »
0
I'm running my 10GB site now - it is taking a long time as you would expect! I didn't see the chunk size setting so I will see what happens!

Once this has run, I'm going to change my approach and backup the images semi manually to Google Drive as they don't change often (especially the old ones) and then use Updraft on the rest of the site. I think that will make it much faster and easier.

I'll write out some fuller guidelines on how to work this with Google Drive once I have worked it out!

Steve

You have to open the expert settings at the bottom to specify chunk size.

For the image backup, you might use the files generated by updraft - do a backup where you specify symbiostock_rf as an "other" directory - so you can chunk the zip files into manageable sizes. But don't leave it set that way for every day backups

steheap

  • Author of best selling "Get Started in Stock"

« Reply #10 on: September 05, 2013, 10:47 »
0
Quote
open the expert settings at the bottom to specify chunk size

Ahh - I see those now!

I still think I need a way to incrementally backup my image files - creating that one of backup of just the images would be fine, but when I add some more, my only choice is to do the complete backup again. I need to let this first manual backup complete before I can do anything though!

STeve

steheap

  • Author of best selling "Get Started in Stock"

« Reply #11 on: September 05, 2013, 15:49 »
0
Still running - started 9 hours ago and it is still creating the zip file in the background...

I don't think this is a daily task!

Steve

stockphoto-images.com

« Reply #12 on: September 05, 2013, 15:59 »
0
Am I correct, that since my Symbiostock/Wordpress installation is in my root folder that I have to purchase the $15 plugin for updraftplus to backup the Symbiostock folders?

steheap

  • Author of best selling "Get Started in Stock"

« Reply #13 on: September 05, 2013, 16:31 »
0
Yes, that is certainly my understanding. I bought the all in one package that removes ads, gives you tools to easily migrate your site, set the times of the backup etc.

However, I think I made an error in the way I'm doing this (and can't stop it). I should have excluded all my actual image files and made a copy of all of those to my Google Drive manually (my plan  is to use Backup Box). Then I would backup the rest of the folders and plugins daily, and just add incremental copies of my image files when I add some more.

I still think you need this extra add-in to pick up the rest of the Symbio folders though.

Steve

« Reply #14 on: September 05, 2013, 16:45 »
+2
Still running - started 9 hours ago and it is still creating the zip file in the background...

I don't think this is a daily task!

Steve

I found cutting the split size down (I did it the first time at the default of 800MB and I think the whole process took about 12 hours with all the process shutdowns creating the files and then the uploading/re-uploading) made a huge difference. It went a ton faster with 400MB chunks...

stockphoto-images.com

« Reply #15 on: September 05, 2013, 17:45 »
0
Yes, that is certainly my understanding. I bought the all in one package that removes ads, gives you tools to easily migrate your site, set the times of the backup etc.

However, I think I made an error in the way I'm doing this (and can't stop it). I should have excluded all my actual image files and made a copy of all of those to my Google Drive manually (my plan  is to use Backup Box). Then I would backup the rest of the folders and plugins daily, and just add incremental copies of my image files when I add some more.

I still think you need this extra add-in to pick up the rest of the Symbio folders though.

Steve
I will have to backup my rf folder (17 GB at the moment) separately and let the updraftplus do the rest I guess. I have to run a few test backup scenarios myself to see if it's worth it or if I can work with the tools provided by my web hosting company...

stockphoto-images.com

« Reply #16 on: September 05, 2013, 17:46 »
0
...It went a ton faster with 400MB chunks...
I gave you a heart for this. First hand information of a trusted source makes it all worthwhile reading these threads!!!

steheap

  • Author of best selling "Get Started in Stock"

« Reply #17 on: September 06, 2013, 08:50 »
0
Well, mine completed just before midnight after 15 hours for the 10GB website.

Now I have my website back, I will investigate the other approaches of copying the image files separately to Google Drive

Steve

« Reply #18 on: September 06, 2013, 09:33 »
0
I investigated updraft, but last night i downloaded the symbiostock_rf_content folder and it took less than an hour. 601 images, about 2 gb. My total site is about 3 gb. I think i will stay with this for awhile.

stockphoto-images.com

« Reply #19 on: September 06, 2013, 09:47 »
+1
Well, mine completed just before midnight after 15 hours for the 10GB website.

Now I have my website back, I will investigate the other approaches of copying the image files separately to Google Drive

Steve
Once you have successfully achieved that task, please write a tutorial or review in a separate thread for everyone to see. I'd greatly appreciate that!

stockphoto-images.com

« Reply #20 on: September 06, 2013, 09:49 »
0
I investigated updraft, but last night i downloaded the symbiostock_rf_content folder and it took less than an hour. 601 images, about 2 gb. My total site is about 3 gb. I think i will stay with this for awhile.
The download part the least of my worries (20GB Symbiostock site). The upload will be brutal.

I'm forced to work with a cloud solution of some sort - my ISP is going to knock on my door moving tens of GB in such a short period of time. I do have a monthly bandwidth limit as well... :(

ShazamImages

  • ShazamImages.com
« Reply #21 on: September 06, 2013, 09:52 »
+1
I investigated updraft, but last night i downloaded the symbiostock_rf_content folder and it took less than an hour. 601 images, about 2 gb. My total site is about 3 gb. I think i will stay with this for awhile.
The download part the least of my worries (20GB Symbiostock site). The upload will be brutal.

But it will be a lot less brutal than starting from scratch!  ;)

stockphoto-images.com

« Reply #22 on: September 06, 2013, 10:35 »
0
I investigated updraft, but last night i downloaded the symbiostock_rf_content folder and it took less than an hour. 601 images, about 2 gb. My total site is about 3 gb. I think i will stay with this for awhile.
The download part the least of my worries (20GB Symbiostock site). The upload will be brutal.

But it will be a lot less brutal than starting from scratch!  ;)
Ha, you got me :)

steheap

  • Author of best selling "Get Started in Stock"

« Reply #23 on: September 06, 2013, 15:55 »
+1
Quote
Once you have successfully achieved that task, please write a tutorial or review in a separate thread for everyone to see. I'd greatly appreciate that!


I've completed my initial tests and have now written my tutorial on my overall approach. I put it on my own site as it gets lost here.

http://www.backyardsilver.com/2013/09/backing-symbiostock-website/

Please comment where you think I have made a mistake! I'm still looking for a cost effective way of doing the final piece of ongoing maintenance - backing up the new images you have added to the site.

Steve

« Reply #24 on: September 06, 2013, 18:06 »
0
Thanks for that rundown - I've bookmarked that.

« Reply #25 on: September 06, 2013, 19:26 »
0
Quote
Please comment where you think I have made a mistake! I'm still looking for a cost effective way of doing the final piece of ongoing maintenance - backing up the new images you have added to the site.

Steve,
one possible way would be to have a special upload folder on the local computer, copy all newly processed images there, and upload them to the server from that folder. Once a month (or once a week or even after each processed batch, depending on your operating mode and backup tolerance), the upload folder would be backed up and then cleared to accept new images (alternatively copied or moved to a local archive).
 

steheap

  • Author of best selling "Get Started in Stock"

« Reply #26 on: September 06, 2013, 19:44 »
0
Les

Yes, that would work, but you are using your personal home bandwidth three times - once to upload, once to download in the new numbering plan, once to upload to Google drive. I am still investigating ways to go from the webserver to Google drive without having to pay for a service to do that! There is a service called Otixo that I'm looking at now!

Steve

stockphoto-images.com

« Reply #27 on: September 06, 2013, 20:24 »
0
Les

Yes, that would work, but you are using your personal home bandwidth three times - once to upload, once to download in the new numbering plan, once to upload to Google drive. I am still investigating ways to go from the webserver to Google drive without having to pay for a service to do that! There is a service called Otixo that I'm looking at now!

Steve
You're spot on! I was thinking exact the same thing, did some googling but got tired.

I'm specifically interested in finding a cloud service that accepts regular FTP connections. Once I find that, I can figure out the problem of transferring from my site straight through the backbone to the cloud storage.

« Reply #28 on: September 06, 2013, 21:56 »
0
Quote
Yes, that would work, but you are using your personal home bandwidth three times - once to upload, once to download in the new numbering plan, once to upload to Google drive. I am still investigating ways to go from the webserver to Google drive without having to pay for a service to do that! There is a service called Otixo that I'm looking at now!

You are right, I didn't think about files being renamed after the processing, and I also thought, that backup with processed files could be on a local disk drive.

HYPOTHETICALLY - if Leo could create a simple filename pair map consisting of the before- and after- filenames, such a map could be used by another reverse-naming utility to assign the "server filenames" to the original images on the local drive, and then we could have a full local mirror backup (which in case of emergency would still require an upload, but hopefully that would never happen, and if it ever happened, it would be still a manageable task, saving your bacon).

I find it fascinating witnessing the birth and growth of Symbiostock and contemplating all kinds of future features that we never imagined before. This is just the beginning of a new world.

 

quailrunphoto

« Reply #29 on: September 06, 2013, 22:43 »
0
Take a look at Cyberduck.  It has a lot of features.  I have not tried it but it may fit your needs.

http://cyberduck.ch/


« Reply #30 on: September 07, 2013, 00:59 »
0
Les

Yes, that would work, but you are using your personal home bandwidth three times - once to upload, once to download in the new numbering plan, once to upload to Google drive. I am still investigating ways to go from the webserver to Google drive without having to pay for a service to do that! There is a service called Otixo that I'm looking at now!

Steve

What if, instead of uploading and downloading the full sized images you uploaded, processed,, made a note of the numbers, then copied the files withhin your harddrive and renumbered them. Then you would save time and bandwith by just backingnup the rest of the site Iif you were doing it to home harddrives?

« Reply #31 on: September 07, 2013, 06:46 »
0
I like the idea of the local backup, too.
But manual filename recording and renaming is also costly in time and possibly error prone.

As I mentioned in the previous post, it would be nice to have a filename map with both the original file names and new names in the symbiostock-rf folder. Such a map could be easily generated as a byproduct in the process procedure, writing just one record with both filenames for each image to a sequential file.

steheap

  • Author of best selling "Get Started in Stock"

« Reply #32 on: September 07, 2013, 08:03 »
0
Quote
Take a look at Cyberduck.  It has a lot of features.  I have not tried it but it may fit your needs

I did - it used to support access to Google Drive, but it doesn't any longer.

On the broader question, my backup of all images finished OK and I still have 1GB of my free allowance left. It appears that the Mover.io site charges per GB - I think it is $1, but I haven't yet confirmed,

So my answer may be to just pay as I require the extra bandwidth - even if I double my site, it will just be a one off charge of $10 - not a subscription.

Steve


 

Sponsors

Mega Bundle of 5,900+ Professional Lightroom Presets

Microstock Poll Results

Sponsors