Giter Club home page Giter Club logo

Comments (16)

nordurljosahvida avatar nordurljosahvida commented on June 2, 2024

Very good point. I'd love for the backup to be able to occur to S3 without any local archiving being performed first, but that would break the way duplicity works, so local archiving is the way to go. Let me check for ways to archive things elsewhere. What location are you looking to use?

from raptor.

nordurljosahvida avatar nordurljosahvida commented on June 2, 2024

Working on it. Will be ready by tomorrow.

from raptor.

xiano8494 avatar xiano8494 commented on June 2, 2024

I don't mind massively, just so long as it is unique to Raptor so I can add mount point there. For it to be configurable would be ideal. It would also need to use somewhere other than /tmp for the temp files too, otherwise we may hit the same problem. Maybe /var/backup/ ?

from raptor.

nordurljosahvida avatar nordurljosahvida commented on June 2, 2024

It will be configurable. I've successfully moved the temp dir inside the backup dir, so that's also figured out. Testing out the latest commit now, will update you shortly.

from raptor.

nordurljosahvida avatar nordurljosahvida commented on June 2, 2024

Ok, go ahead and give it a try, I've had to edit about 100 lines in the code and only tested it once, since it's in beta anyway and won't be installed without the -be arguments until we know it's stable. Let me know if this matches your needs exactly [pretty sure it does] and let me know how the install and backup scripts work out. Thanks!

from raptor.

nordurljosahvida avatar nordurljosahvida commented on June 2, 2024

Ok, just published a few fixes. If you've already tried try in the last hour please try again now. Thanks.

from raptor.

nordurljosahvida avatar nordurljosahvida commented on June 2, 2024

@xiano8494 published new version. You can install without -be as normal and you will get the latest updates from the stable version. I've been running backups on /var/raptor/ on our openspace server for 2 days now and everything seems consistently good. Let me know!

from raptor.

xiano8494 avatar xiano8494 commented on June 2, 2024

I'm afraid there is still an issue, it would appear that the script still checks the OS disks available space, so although I have a large disk attached and have set the backup location to this disk, I still get a warning:

Starting raptor-backup script on 2018-04-08_11-52-06...
You have 0 local backups occupying 1 MB of space.
Estimated backup size [170499 MB] LARGER than available disk space [20067 MB].

from raptor.

nordurljosahvida avatar nordurljosahvida commented on June 2, 2024

@xiano8494 That's a lot of sites! ;]
Should be fixed in latest commit. Try installing the latest beta please.
Thanks!

from raptor.

nordurljosahvida avatar nordurljosahvida commented on June 2, 2024

It occurs to me that I also have to change the directory where restores are stored to avoid occupying that same space when backing up to S3 [as a test restore] or when actually performing a restore. Are you backing up to S3?

from raptor.

nordurljosahvida avatar nordurljosahvida commented on June 2, 2024

@xiano8494 fixed that too, restore-time temp data is now stored inside the backups directory too, something I thought that would break a bunch of stuff but no issues for now, but then again even with both a production server and a testing server I can't try out every possible combination of things on every commit, please try re-installing with beta mode on and let me know if everything works and please monitor the /root/openspace42/raptor directory to ensure no "backups" or "restores" dirs are created and make sure that all dirs [archive, latest, restores, temp] are actually created on your external location. Also, if you'd like to share if you're using S3 that would help me understand what kinds of tests you're performing on your machine. Thanks for the help!

from raptor.

nordurljosahvida avatar nordurljosahvida commented on June 2, 2024

Also just tried every possible combination on both servers and everything seems to work both with default and custom location, but the custom location is just /var/raptor and not an external disk, although it shouldn't matter. Hope we're good to go!

from raptor.

xiano8494 avatar xiano8494 commented on June 2, 2024

Great, I have installed with -be and it looks like backups are now running to the custom location. I will report back on whether everything ends up in the correct place.
I am using S3, so I will report any issues there as well.

from raptor.

xiano8494 avatar xiano8494 commented on June 2, 2024

And, as a side note, not a lot of sites, just big sites! Photography blogs, large amounts of high-resolution imagery! :)

from raptor.

nordurljosahvida avatar nordurljosahvida commented on June 2, 2024

@xiano8494 awesome! I'm happy someone is using raptor! If you know anyone please spread the word so that we can have several people beta testing and making sure our framework is always up to date and can serve other projects as well!

from raptor.

nordurljosahvida avatar nordurljosahvida commented on June 2, 2024

I'll close the issue for now, feel free to re-open with any issues. Thanks!

from raptor.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.