badtuple / nomarch Goto Github PK

Problem

Currently when it starts up it will be receiving checkpoint calls from events in the middle of a pipeline therefore causing nomarch to believe they failed the pipeline.

Proposal

I propose adding an option to the config to allow the users to set a timer to ignoring failing events.

Other options could be:

• Ignore failling events during the first max_seconds_to_reach_end period
• Ingest only events that started at first required node for first n minutes/seconds