MicrostockGroup
Microstock Photography Forum - General => Symbiostock => Symbiostock - General => Topic started by: picture5469 on September 05, 2013, 01:32
-
Just wanted to check I'm settting up updraftplus correctly. Tick plugins, uploads, any other directoies in wpcontent, themes, core boxes including core and exclude "symbiostock_XML_Cache" is that correct?
-
That is the way mine is setup. So I hope it is right for what I want to do.
But this is a very limited backup of your wp-content directory. It is not a full backup of your site.
There are several threads going on right now about backup and what is the right thing to do. Lots of good advise and some spirited discussions. ;D
-
No, it's not enough.
You should check "Any other directories ..." and then include the symbiostock_rf, symbiostock_ipn and symbiostock_network folders.
-
No, it's not enough.
You should check "Any other directories ..." and then include the symbiostock_rf, symbiostock_ipn and symbiostock_network folders.
Thanks
-
No, it's not enough.
You should check "Any other directories ..." and then include the symbiostock_rf, symbiostock_ipn and symbiostock_network folders.
Thanks
You're welcome. Give it a try and let us know if it works because I'm a little sceptical that Updraft will be able to handle a 10 to 12GB backup (like in your specific case).
-
No, it's not enough.
You should check "Any other directories ..." and then include the symbiostock_rf, symbiostock_ipn and symbiostock_network folders.
Thanks
You're welcome. Give it a try and let us know if it works because I'm a little sceptical that Updraft will be able to handle a 10 to 12GB backup (like in your specific case).
Actually, today i completed my SEO, and also contact a web design company to show me how to back it up properly. I just have a very uncomfortable feeling usibg these back up programs.
-
No, it's not enough.
You should check "Any other directories ..." and then include the symbiostock_rf, symbiostock_ipn and symbiostock_network folders.
Thanks
You're welcome. Give it a try and let us know if it works because I'm a little sceptical that Updraft will be able to handle a 10 to 12GB backup (like in your specific case).
Actually, today i completed my SEO, and also contact a web design company to show me how to back it up properly. I just have a very uncomfortable feeling usibg these back up programs.
Didn't you get this to work: http://picturebreeze.com/stock/photos/back-entire-symbiostock-website/ (http://picturebreeze.com/stock/photos/back-entire-symbiostock-website/) ?
Too complicated?
If you need more assitance, I'm glad when I can help out.
-
No, it's not enough.
You should check "Any other directories ..." and then include the symbiostock_rf, symbiostock_ipn and symbiostock_network folders.
Thanks
You're welcome. Give it a try and let us know if it works because I'm a little sceptical that Updraft will be able to handle a 10 to 12GB backup (like in your specific case).
You can also use the option to backup WP core and exclude the symbiostock cache (possibly also some WP directories you don't need).
Why the query about a large backup - it lets you specify the chunk size of each zip file. The default is 800 MB chunks and I found for me it worked much more smoothly with 400MB chunks
-
I'm running my 10GB site now - it is taking a long time as you would expect! I didn't see the chunk size setting so I will see what happens!
Once this has run, I'm going to change my approach and backup the images semi manually to Google Drive as they don't change often (especially the old ones) and then use Updraft on the rest of the site. I think that will make it much faster and easier.
I'll write out some fuller guidelines on how to work this with Google Drive once I have worked it out!
Steve
-
I'm running my 10GB site now - it is taking a long time as you would expect! I didn't see the chunk size setting so I will see what happens!
Once this has run, I'm going to change my approach and backup the images semi manually to Google Drive as they don't change often (especially the old ones) and then use Updraft on the rest of the site. I think that will make it much faster and easier.
I'll write out some fuller guidelines on how to work this with Google Drive once I have worked it out!
Steve
You have to open the expert settings at the bottom to specify chunk size.
For the image backup, you might use the files generated by updraft - do a backup where you specify symbiostock_rf as an "other" directory - so you can chunk the zip files into manageable sizes. But don't leave it set that way for every day backups
-
open the expert settings at the bottom to specify chunk size
Ahh - I see those now!
I still think I need a way to incrementally backup my image files - creating that one of backup of just the images would be fine, but when I add some more, my only choice is to do the complete backup again. I need to let this first manual backup complete before I can do anything though!
STeve
-
Still running - started 9 hours ago and it is still creating the zip file in the background...
I don't think this is a daily task!
Steve
-
Am I correct, that since my Symbiostock/Wordpress installation is in my root folder that I have to purchase the $15 plugin for updraftplus to backup the Symbiostock folders?
-
Yes, that is certainly my understanding. I bought the all in one package that removes ads, gives you tools to easily migrate your site, set the times of the backup etc.
However, I think I made an error in the way I'm doing this (and can't stop it). I should have excluded all my actual image files and made a copy of all of those to my Google Drive manually (my plan is to use Backup Box). Then I would backup the rest of the folders and plugins daily, and just add incremental copies of my image files when I add some more.
I still think you need this extra add-in to pick up the rest of the Symbio folders though.
Steve
-
Still running - started 9 hours ago and it is still creating the zip file in the background...
I don't think this is a daily task!
Steve
I found cutting the split size down (I did it the first time at the default of 800MB and I think the whole process took about 12 hours with all the process shutdowns creating the files and then the uploading/re-uploading) made a huge difference. It went a ton faster with 400MB chunks...
-
Yes, that is certainly my understanding. I bought the all in one package that removes ads, gives you tools to easily migrate your site, set the times of the backup etc.
However, I think I made an error in the way I'm doing this (and can't stop it). I should have excluded all my actual image files and made a copy of all of those to my Google Drive manually (my plan is to use Backup Box). Then I would backup the rest of the folders and plugins daily, and just add incremental copies of my image files when I add some more.
I still think you need this extra add-in to pick up the rest of the Symbio folders though.
Steve
I will have to backup my rf folder (17 GB at the moment) separately and let the updraftplus do the rest I guess. I have to run a few test backup scenarios myself to see if it's worth it or if I can work with the tools provided by my web hosting company...
-
...It went a ton faster with 400MB chunks...
I gave you a heart for this. First hand information of a trusted source makes it all worthwhile reading these threads!!!
-
Well, mine completed just before midnight after 15 hours for the 10GB website.
Now I have my website back, I will investigate the other approaches of copying the image files separately to Google Drive
Steve
-
I investigated updraft, but last night i downloaded the symbiostock_rf_content folder and it took less than an hour. 601 images, about 2 gb. My total site is about 3 gb. I think i will stay with this for awhile.
-
Well, mine completed just before midnight after 15 hours for the 10GB website.
Now I have my website back, I will investigate the other approaches of copying the image files separately to Google Drive
Steve
Once you have successfully achieved that task, please write a tutorial or review in a separate thread for everyone to see. I'd greatly appreciate that!
-
I investigated updraft, but last night i downloaded the symbiostock_rf_content folder and it took less than an hour. 601 images, about 2 gb. My total site is about 3 gb. I think i will stay with this for awhile.
The download part the least of my worries (20GB Symbiostock site). The upload will be brutal.
I'm forced to work with a cloud solution of some sort - my ISP is going to knock on my door moving tens of GB in such a short period of time. I do have a monthly bandwidth limit as well... :(
-
I investigated updraft, but last night i downloaded the symbiostock_rf_content folder and it took less than an hour. 601 images, about 2 gb. My total site is about 3 gb. I think i will stay with this for awhile.
The download part the least of my worries (20GB Symbiostock site). The upload will be brutal.
But it will be a lot less brutal than starting from scratch! ;)
-
I investigated updraft, but last night i downloaded the symbiostock_rf_content folder and it took less than an hour. 601 images, about 2 gb. My total site is about 3 gb. I think i will stay with this for awhile.
The download part the least of my worries (20GB Symbiostock site). The upload will be brutal.
But it will be a lot less brutal than starting from scratch! ;)
Ha, you got me :)
-
Once you have successfully achieved that task, please write a tutorial or review in a separate thread for everyone to see. I'd greatly appreciate that!
I've completed my initial tests and have now written my tutorial on my overall approach. I put it on my own site as it gets lost here.
http://www.backyardsilver.com/2013/09/backing-symbiostock-website/ (http://www.backyardsilver.com/2013/09/backing-symbiostock-website/)
Please comment where you think I have made a mistake! I'm still looking for a cost effective way of doing the final piece of ongoing maintenance - backing up the new images you have added to the site.
Steve
-
Thanks for that rundown - I've bookmarked that.
-
Please comment where you think I have made a mistake! I'm still looking for a cost effective way of doing the final piece of ongoing maintenance - backing up the new images you have added to the site.
Steve,
one possible way would be to have a special upload folder on the local computer, copy all newly processed images there, and upload them to the server from that folder. Once a month (or once a week or even after each processed batch, depending on your operating mode and backup tolerance), the upload folder would be backed up and then cleared to accept new images (alternatively copied or moved to a local archive).
-
Les
Yes, that would work, but you are using your personal home bandwidth three times - once to upload, once to download in the new numbering plan, once to upload to Google drive. I am still investigating ways to go from the webserver to Google drive without having to pay for a service to do that! There is a service called Otixo that I'm looking at now!
Steve
-
Les
Yes, that would work, but you are using your personal home bandwidth three times - once to upload, once to download in the new numbering plan, once to upload to Google drive. I am still investigating ways to go from the webserver to Google drive without having to pay for a service to do that! There is a service called Otixo that I'm looking at now!
Steve
You're spot on! I was thinking exact the same thing, did some googling but got tired.
I'm specifically interested in finding a cloud service that accepts regular FTP connections. Once I find that, I can figure out the problem of transferring from my site straight through the backbone to the cloud storage.
-
Yes, that would work, but you are using your personal home bandwidth three times - once to upload, once to download in the new numbering plan, once to upload to Google drive. I am still investigating ways to go from the webserver to Google drive without having to pay for a service to do that! There is a service called Otixo that I'm looking at now!
You are right, I didn't think about files being renamed after the processing, and I also thought, that backup with processed files could be on a local disk drive.
HYPOTHETICALLY - if Leo could create a simple filename pair map consisting of the before- and after- filenames, such a map could be used by another reverse-naming utility to assign the "server filenames" to the original images on the local drive, and then we could have a full local mirror backup (which in case of emergency would still require an upload, but hopefully that would never happen, and if it ever happened, it would be still a manageable task, saving your bacon).
I find it fascinating witnessing the birth and growth of Symbiostock and contemplating all kinds of future features that we never imagined before. This is just the beginning of a new world.
-
Take a look at Cyberduck. It has a lot of features. I have not tried it but it may fit your needs.
http://cyberduck.ch/ (http://cyberduck.ch/)
-
Les
Yes, that would work, but you are using your personal home bandwidth three times - once to upload, once to download in the new numbering plan, once to upload to Google drive. I am still investigating ways to go from the webserver to Google drive without having to pay for a service to do that! There is a service called Otixo that I'm looking at now!
Steve
What if, instead of uploading and downloading the full sized images you uploaded, processed,, made a note of the numbers, then copied the files withhin your harddrive and renumbered them. Then you would save time and bandwith by just backingnup the rest of the site Iif you were doing it to home harddrives?
-
I like the idea of the local backup, too.
But manual filename recording and renaming is also costly in time and possibly error prone.
As I mentioned in the previous post, it would be nice to have a filename map with both the original file names and new names in the symbiostock-rf folder. Such a map could be easily generated as a byproduct in the process procedure, writing just one record with both filenames for each image to a sequential file.
-
Take a look at Cyberduck. It has a lot of features. I have not tried it but it may fit your needs
I did - it used to support access to Google Drive, but it doesn't any longer.
On the broader question, my backup of all images finished OK and I still have 1GB of my free allowance left. It appears that the Mover.io site charges per GB - I think it is $1, but I haven't yet confirmed,
So my answer may be to just pay as I require the extra bandwidth - even if I double my site, it will just be a one off charge of $10 - not a subscription.
Steve