Comments (16)
Very good point. I'd love for the backup to be able to occur to S3 without any local archiving being performed first, but that would break the way duplicity works, so local archiving is the way to go. Let me check for ways to archive things elsewhere. What location are you looking to use?
from raptor.
Working on it. Will be ready by tomorrow.
from raptor.
I don't mind massively, just so long as it is unique to Raptor so I can add mount point there. For it to be configurable would be ideal. It would also need to use somewhere other than /tmp for the temp files too, otherwise we may hit the same problem. Maybe /var/backup/ ?
from raptor.
It will be configurable. I've successfully moved the temp dir inside the backup dir, so that's also figured out. Testing out the latest commit now, will update you shortly.
from raptor.
Ok, go ahead and give it a try, I've had to edit about 100 lines in the code and only tested it once, since it's in beta anyway and won't be installed without the -be
arguments until we know it's stable. Let me know if this matches your needs exactly [pretty sure it does] and let me know how the install and backup scripts work out. Thanks!
from raptor.
Ok, just published a few fixes. If you've already tried try in the last hour please try again now. Thanks.
from raptor.
@xiano8494 published new version. You can install without -be
as normal and you will get the latest updates from the stable version. I've been running backups on /var/raptor/ on our openspace server for 2 days now and everything seems consistently good. Let me know!
from raptor.
I'm afraid there is still an issue, it would appear that the script still checks the OS disks available space, so although I have a large disk attached and have set the backup location to this disk, I still get a warning:
Starting raptor-backup script on 2018-04-08_11-52-06...
You have 0 local backups occupying 1 MB of space.
Estimated backup size [170499 MB] LARGER than available disk space [20067 MB].
from raptor.
@xiano8494 That's a lot of sites! ;]
Should be fixed in latest commit. Try installing the latest beta please.
Thanks!
from raptor.
It occurs to me that I also have to change the directory where restores are stored to avoid occupying that same space when backing up to S3 [as a test restore] or when actually performing a restore. Are you backing up to S3?
from raptor.
@xiano8494 fixed that too, restore-time temp data is now stored inside the backups directory too, something I thought that would break a bunch of stuff but no issues for now, but then again even with both a production server and a testing server I can't try out every possible combination of things on every commit, please try re-installing with beta mode on and let me know if everything works and please monitor the /root/openspace42/raptor
directory to ensure no "backups" or "restores" dirs are created and make sure that all dirs [archive, latest, restores, temp] are actually created on your external location. Also, if you'd like to share if you're using S3 that would help me understand what kinds of tests you're performing on your machine. Thanks for the help!
from raptor.
Also just tried every possible combination on both servers and everything seems to work both with default and custom location, but the custom location is just /var/raptor
and not an external disk, although it shouldn't matter. Hope we're good to go!
from raptor.
Great, I have installed with -be and it looks like backups are now running to the custom location. I will report back on whether everything ends up in the correct place.
I am using S3, so I will report any issues there as well.
from raptor.
And, as a side note, not a lot of sites, just big sites! Photography blogs, large amounts of high-resolution imagery! :)
from raptor.
@xiano8494 awesome! I'm happy someone is using raptor! If you know anyone please spread the word so that we can have several people beta testing and making sure our framework is always up to date and can serve other projects as well!
from raptor.
I'll close the issue for now, feel free to re-open with any issues. Thanks!
from raptor.
Related Issues (20)
- restore_type: unbound variable HOT 12
- Backup Compression HOT 5
- Testing restore from S3 failed HOT 19
- Backup script doesn't exit on failure HOT 4
- Space required calculation HOT 8
- Cannot connect to digitalocean object storage HOT 11
- Tiny typo HOT 1
- After full reinstall backup doesn't run at all HOT 4
- Add lockfile to avoid multiple concurrent backups
- Add ability to reconfigure without running full setup HOT 3
- Cloudflare intergration HOT 12
- bindfs depends on fuse HOT 2
- 18.04 LTS install HOT 3
- getting error mail HOT 1
- Subdomains problem HOT 4
- Trying to update raptor HOT 2
- Installation error on ubuntu 16.04 HOT 1
- Cannot install HOT 3
- Pwgen missing causes strange behaviours HOT 1
- Unable to download file, /tmp/eeupdate20180407-125625 HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from raptor.