Comments (5)
Hi Jonas,
To me it now seems that in the price query response, that hour was split to two data chunks and Arska could not get ,"undestand" price - so it was marked with missing (VARIABLE_LONG_UNKNOWN -2147483648) value.
Resetting made requery, but I do wonder why pressing the restart button didn't help.
Anyway, now in the latest version there is extra check if (current_price != VARIABLE_LONG_UNKNOWN) // do not write undefined values
preventing unspecified values written to influx. But I still have to check if there is something to do to make price processing itself more reliable.
Olli
from arska-node.
Hi Jonas,
Thanks for the comment! Did you used the latest code from devel-ui branch? I made some code cleanup with price data (from a array to more general timeSeries object). Main functionality looked good but I did not yet test changes in influx storage. This has not necessarily caused this, specially if the problem is only with one hour. Anyway the old code is still there and can be activated by changing row #define PRICE_SERIES_OLD_DEPRECATED -> #define PRICE_SERIES_OLD
.
Problem seem to be with related with ENTSO-E price query. Value -2147483648 (in this case divided with 1000 or so, but not exactly?) indicates missing value. I cannot repeat the problem with SE3 query, but if it has something to do with http 1.1 chunked data, it can happen randomly because chunk size varies.
So I had a quick look, but could to really repeat it yet. Anyway now these erroneous values (indicates missing values) should no be written to influx. I added a check to function update_prices_to_influx .
from arska-node.
Hello Olli,
It's an older 0.92.0-rc2, it was visible there in the dashboard also.
Never seen this behavior before.
But in an other esp32 with a newer 0.99.0-beta1.2662 ( on my desk for testing ) it looks normal so I guess it's somehow related to the older version, I´ll need to upgrade my older board I guess.
//Jonas
from arska-node.
Hello Olli,
I swapped between different price areas but no luck on SE3, still the same.
Trying restart from Admin page did not help.
Then I pushed the reset button on the esp32 and now everything is back to normal.
//Jonas
from arska-node.
Hello Olli,
great that you found a reason to why it happend!
Maybe you could let the Arska-node send another query for that specific hour that have unknown data, and then resend that hour to influxDB?
And first maybe just average the price between the hour before and after the unknown hour, that would be least bad and the channel rules would have something good enough to decide against.
//Jonas
from arska-node.
Related Issues (20)
- "p diff to avg 9h" were missing, solved HOT 1
- Calculate and store variables in individual arrays, to present in chart HOT 3
- Does not seem to update prices today for tomorrow HOT 2
- Something strange with "p diff" calculation HOT 2
- Internal LED as status of wifi HOT 2
- InfluxDB timestamp beginning of period HOT 3
- Variable "Hours until channel xx is on" HOT 1
- Variables looks shifted 1 hour forward but chart looks ok HOT 6
- Changes in Entso-E services affect price data updates of Arska - update required HOT 1
- Missing/delayed priceinfo from entso-e HOT 17
- Suggestion, p-ratio current vs next hour and p-ratio current vs previous hour HOT 2
- Suggestion, usage of Open-Meteo to collect weather forecast HOT 1
- Priceinfo issue, wrong response from entso-e? HOT 9
- Write to influxdb on change of channels HOT 2
- Large positive pricevalue SE3 2023-08-13 08:00 HOT 6
- "p ratio" handling with negative prices HOT 4
- RC1 channel rules for channel 6 does not save settings HOT 8
- Firmware ja Filesystem ei mätsää HOT 2
- Cannot update prices from Elering
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from arska-node.