Comments (7)
You cannot. The Mutate API provides the only options available today.
from faktory.
Thanks for the quick response @mperham . Do you have any recommendations for how to accomplish this today, or would this make a good feature request for future versions of Faktory Enterprise?
from faktory.
I think your best bet is to design your code to work within the current limitations. I wanted to limit the Mutate API to avoid race conditions with dead set processing and implement only features which scaled well with the size of the dead set.
You are welcome to put in a feature request, just please give specific details about your use case so I can better understand what you are trying to achieve and why it's not possible today.
from faktory.
Hey Mike, what is the best way to get you a feature request? The use case here is the same as the use case for the sidekiq feature.
from faktory.
Open an issue. I want to hear WHY you need the feature. “Just like Sidekiq” is not sufficient, Faktory is a different beast.
from faktory.
A different issue than this? The reason I opened this issue was to ask for this feature.
Why I need this feature:
On regular occasion we will end up with jobs in the dead queue in Faktory that usually hit a bug around some state in the application, for example a file was corrupted during download, or a customer provided input data in an unexpected format.
Before I can retry those jobs, I need to go and delete that corrupted file from blob storage, or manually transform the input data. I do not want to build this fix logic directly into the application code, as it is typically very one-off and I would want to know if this type of error ever happens again. I don't want my application code to have lots of exception handling for exceptions that I honestly never expect to happen again.
Once we have investigated the dead jobs and determined the fix, I want to be able to script the fix and apply it to all the jobs that died in a similar fashion. However in order to script the fixing of these cases and retry the jobs, I need programmatic access to the dead job queue including the ability to
- inspect the job arguments for each job
- read the exception message for the job.
- Mark the job for retry.
It would be sufficient if the faktory http server exposed a json API that provided the same data as the morgue page and an endpoint to "Retry Now" a job.
'Please let me know if you need more details or information about this use case, happy to share anything more that would be helpful.
from faktory.
It sounds like you're trying to bolt onto Faktory something that should be a workflow in your application. Faktory does not support payload mutation. You'd create a new job to reprocess the blob once your code is fixed.
from faktory.
Related Issues (20)
- Feature suggestion: Unwrap ActiveJob wrapped Job names in the WebUI HOT 6
- Handling server upgrades? HOT 4
- Custom data stripped on batch callbacks for trace metadata propagation HOT 1
- Feature Request: Unique jobs even after completion HOT 2
- Ent Faktory Batches Guarantees HOT 1
- Does Faktory have any notion of job cost? HOT 3
- Fail jobs immediately when worker crashes HOT 6
- Add direct TLS support HOT 2
- Publish enterprise release binary for Linux to aid in testing HOT 1
- Faktory Enterprise shutting down messages in the log file - no explanation as to why Faktory is shutting down.
- REST API for UI HOT 2
- [Feature Request] Include Redis RTT in statsd metrics that are emitted HOT 3
- [Feat Request] Improve the reliability of Faktory server when overloaded with connections HOT 1
- Support Env Var expansion in toml config files HOT 3
- Question: What is the unit of "time" for Ent Metrics HOT 6
- Crashlooping on start HOT 16
- deb packages for arm64 HOT 3
- bzip2 deprecated
- Faktory crashed with fatal error: concurrent map writes HOT 3
- Is it possible to run the faktory server in a HA setup HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from faktory.