Giter Club home page Giter Club logo

Comments (6)

mperham avatar mperham commented on August 19, 2024

Job attributes are documented here:

https://github.com/contribsys/faktory/wiki/The-Job-Payload

but we could definitely improve the docs around Faktory's job retry/error process.

  1. retry only applies to explicitly FAILed jobs.
  2. see the 'retry' option in the job payload.

from faktory.

mperham avatar mperham commented on August 19, 2024

Started this page: https://github.com/contribsys/faktory/wiki/Job-Errors

from faktory.

j-manu avatar j-manu commented on August 19, 2024

So there is currently no way to limit retrying of Non-ACKed jobs right? If a job doesn't complete within the reserve_for timeline faktory will enqueue it again and again? This can lead to a scenario where if there is a job which doesn't complete due some bug, all worker processes will eventually fetch that and get stuck processing that job.

from faktory.

mperham avatar mperham commented on August 19, 2024

If you are re-enqueuing quickly, every N seconds, as you want to do, yes, a poison pill can take down all your workers quickly. If you are reserving for 30 minutes by default, it's generally not a problem. Sidekiq does not limit either and no one's ever reported this as a problem.

from faktory.

j-manu avatar j-manu commented on August 19, 2024

Sidekiq retries only failed jobs. So a single job which never finishes doesn't take down all workers whereas it is a definite possibility in faktory. Does it matter whether it happens slowly with default limit of 30minutes or faster with a lower reserve_for?

Ideally I would like to have a new config (re-enqueue) to control how many times a job should be re-enqueued and a configurable lower reserve_for

from faktory.

mperham avatar mperham commented on August 19, 2024

from faktory.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.