Comments (5)
chicco785
commented on May 28, 2024
we should not discard this values, we set them to null. I don’t understand why discarding especially the whole update.
actually this is a bug in my view. because it’s not up to ql to decide meaning of null.
… On 23 Nov 2018, at 11:56, Tomas ***@***.***> wrote:
Many times data injectors send a "null" "empty" value for some attributes.
At the moment QL is discarding received notifications with this kind of "null" input in any of the attributes, but we could implement something more flexible so as not to loose the rest of incoming valid data.
Define a policy for dealing with these cases.
from ngsi-timeseries-api.
taliaga
commented on May 28, 2024
It was decided to ignore those because to begin with it's not NGSI valid to say Text and then send null, and handling them in aggregation queries requires a careful definition of what's going to happen. So to me is more an important "unimplemented" feature than "bug" :)
from ngsi-timeseries-api.
chicco785
commented on May 28, 2024
it's a bug not a missing feature. missing feature is inability to perform aggregation if injected data contains null. discarding a whole notification payload because a single value (maybe not even relevant) is null, it's a bug and may be a serious usability issue.
- if you have data you cannot aggregate, you still have the data and you can work out something.
- if you lost data, because you didn't store it, it's lost.
beyond that, I suspect that aggregation queries inside databases already have ways to support NULL.
e.g. https://crate.io/docs/crate/reference/en/latest/general/builtins/aggregation.html
from ngsi-timeseries-api.
c0c0n3
commented on May 28, 2024
done, but needs reviewing. see PR #122.
from ngsi-timeseries-api.
c0c0n3
commented on May 28, 2024
closed by #122
from ngsi-timeseries-api.
Related Issues (20)
- Resolve TODO HOT 3
- Resolve TODO HOT 2
- call QL's version endpoint rather than sleeping.
- Fix broken image in README.md HOT 1
- TODO in utils.py
- Resolve TODO in sql_translator.py HOT 1
- Improve error handling
- Handle sql errors separately
- Can't run the tests locally HOT 5
- AssertionError in existing test HOT 1
- Resolve TODO in crate-exporter.py
- Resolve TODO for secondary DB HOT 3
- Improve WQ response stream format HOT 3
- Resolve TODO factor out
- Resolve TODO in sql_translator.py
- Problem to notify Quantunleap HOT 15
- API returns 404 when query produces empty result HOT 3
- Data loss when using Fiware Orion Broker, QuantumLeap and CrateDB HOT 13
- Incorrect notation of command in docker-compose-dev
- Reporting a vulnerability HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ngsi-timeseries-api.