Comments (1)
Hi @nsulikowski ,
Punctuations are primarily meant to move time forward for the stream, whereas flushes output all possible output events as possible, yielding a lower latency for those events at the potential cost of lower throughput.
While the default behavior is to flush on punctuations/low watermarks (FlushPolicy.FlushOnPunctuation or PartitionedFlushPolicy.FlushOnLowWatermark), some consumers require more control over these two concepts. When another FlushPolicy is specified, the consumer would call Flush explicitly when a flush is desired (though this is optional).
E.g., a consumer may want very frequent punctuations to keep trill state to a minimum (allowing it to clean up any state associated with time before the punctuation), but may want to flush less frequently for greater throughput (vs. the lower latency with more frequent flushes). Or, a consumer may want to issue low watermarks to ensure that the time difference between a stream's partitions is kept to a reasonable limit, but may not want to sacrifice throughput to do so. Or, a consumer may want to flush very frequently to ensure minimal latency, but may not want to artificially move time forward to do so.
from trill.
Related Issues (20)
- Caching in non-library mode throws exception and question regarding performance tests
- Install trill on a Linux server?
- Output when SessionTimeoutWindow() ends HOT 11
- NullReferenceException in Columnar Mode HOT 4
- [QUESTION] Output count = 0 when the last event leaves snapshot window HOT 2
- Controlled flush on partitioned streams HOT 1
- Output on aggregations and partition reset
- ReflectionSchemaBuilder ignores knownTypes of the nested type
- Parsing query language to derive Trill operation HOT 1
- NullReferenceException when using checkpointing HOT 2
- Random splitter in a multicore setting
- Trill with Azure Storage Blob and Table HOT 1
- Ingress from Azure Event Hubs - how?
- NullReferenceException when running under net6.0 HOT 1
- Is Trill alive? HOT 10
- Enable .NET 7.0 support HOT 6
- Trillsx HOT 1
- Calling Connect() on a ConnectableStreamable without subscribers throw System.NullReferenceException
- This repo is missing important files HOT 1
- .NET 8 support
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from trill.