lrydin / power-grid-frequency Goto Github PK

Here is the jekyll based theme in branch website.

I'd like to try to integrate a map from leaflet, which seems to have all the tools that we need.

The current configuration for jekyll uses a remote_theme, so we don't need the local css or html files.

For the coming update and further on, I was thinking we could add a link to each country/region wherein one can get access to more related data, especially generation. Most of the data should be available in the ENTSO-E transparency platform, but that does not cover it all.

We could add links to, e.g., TransNetBW in Germany, RTE in France, and also maybe a short description on how to get genration data from the ENTSOE Transparency platform for first-time users.

@schaefer-benjamin

Add licensing for:

• TSOs measurements
• Research project measurements
• Independent measurements

and ensure they are in

• Database

I've been chewing through OSF's API system and I think this might be the way to do to get the download scheme from their API sorted. Let's see if this is the way to go. For now I'll leave this issue here and we see if that makes sense

Adding 7 synchronous recordings from the Nordic Grid from 2013, provided by Luigi Vanfretti, Professor at RPI and head of @ALSETLab (@lvanfretti), stemming for the discontinued project STRONg²rid. The data are synchronous and over a period of ~3 days.

This needs to be added to:

• Map
• Database

and we need to ensure

• links to the project are detailed
• links to the authors are detailed
• licensing and referencing are detailed correctly

M. S. Almas, M. Baudette, L. Vanfretti, S. Løvlund,and J. O. Gjerde, Synchrophasor network, laboratory and software applications developed in the STRONg2rid project, in 2014 IEEE PES General Meeting | ConferenceExposition (2014) pp. 1–5.

After updating the chart, min-max values are behaving weird.

Remove feed and footer details, i.e., edit footer content and/or supersede css style. Add gitlub and osf link. Add as well a link to Contacts and maybe and imprint.

Data loading

• let the user choose from few different sample data

Statistics

• Mark the mean frequency
• Present standard deviation

@LRydin you said something about RMS and maxima-minima. Could you please elaborate here?

what else?

Two new recordings to include from the Power grid frequency data base

This includes an (almost) full year of 2020 taken in Tokyo, Japan, within the 50Hz Japanese Grid (Japan has several different operating grid, some at 50Hz, some at 60Hz).
This needs to be added to:

• Map
• Database

and we need to ensure

• links to the project are detailed (as previously)
• links to the authors are detailed (as previously)
• licensing and referencing are detailed correctly (as previously)

Add contact information

Small issues:

• The location for the Krakow measure is off, it is not pointing to Krakow.
• The recordings of the 2013 data in the Nordic Grid have the KIT logo on it when they should not.
• Add different sampling rates to the README.

[to be continued]

We still have to attend to a few things, regarding the tables:

• the years are not sorted
• the last month is always Oct, not Dec.
• (not yet ready) leave one last column left to include a "whole year download" [I will generate the data soon]
• place the JSON tables on the repo
• separate the table into three tables: Continental Europe, National Grid, Nordic Grid.

The last point being, to really have three files, so we can include text between the tables. These have different properties, the data, and it would be better to have the separated.

The idea here is to simply use OpenStreetMaps and some premade open source java system to have the front page just be an interactive map. I like this example https://leafletjs.com/examples/choropleth/.

We can mark as pins the places where the recording were take, time span, and resolution.

Register database on https://www.re3data.org/suggest

Adding 3 synchronous recordings from the Nordic Grid from 2020, provided by the Swedish TSO, upon personal request by me.
These comprise a full year of data, with 0.02 second resolution, from three locations in Sweden. Due to data protection policies, the exact locations of the recordings were not provided. These are simply: North Sweden, Mid Sweden, South Sweden.

This needs to be added to:

• Map
• Database

and we need to ensure

• links to the project are detailed
• links to the authors are detailed
• licensing and referencing are detailed correctly

Dear community,

I would kindly ask to incorporate our grid frequency data from our measurement campaign into your website.

The data is already published on osf.io (https://osf.io/jbk82/) and the measurement campaign is described in the wiki section.

Our measurement computer is connected to a regular power socket, i.e. measurement is conducted at the low-voltage level. Location of the measurement computer is: Nordstraße 2, 24937 Flensburg (Latitude: 54.791521 | Longitude: 9.438984).

Thanks everyone,
Henning

The ACES project as a new dataset of power-grid frequency produced by Andreas Thingvad, Lisa Calearo, and Mattia Marinelli. They have granted us the right to add it to the database

This includes an (almost) full year of 2020 taken in Tokyo, Japan, within the 50Hz Japanese Grid (Japan has several different operating grid, some at 50Hz, some at 60Hz).
This needs to be added to:

• Map
• Database

and we need to ensure

• links to the project are detailed
• links to the authors are detailed
• licensing and referencing are detailed correctly

The details are found here.

As part of the ACES project, we have contacted Andreas Thingvad and Mattia Marinelli to request adding their dataset to our database.

This includes an (almost) full year of 2018 taken in Zealand, Denmark, part of the Nordic Grid.
This needs to be added to:

• Map
• Database

and we need to ensure

• links to the project are detailed
• links to the authors are detailed
• licensing and referencing are detailed correctly

The details are found here.

I am planning to purchase a domain name for the power-grid frequency website, which, naturally, will be named: power-grid-frequecy.org. I will update this as the process progresses.

After contacting the OPSD - Open Power Systems Data they have added the Power-Grid Frequency Database to their related projects. We also requested to add a direct link on our database to theirs, so people can easily find one another.

Task:

• Add logo and link at the bottom of the intro page to OPSD

These ideas will be discussed in the meeting on 08.12.2023. After that, we will filter out the important ideas from where we can start the work.

• Registry of new website and database (if we go for internal DB of KIT)
• Do we want to keep data internally or can we use LSDF?
• Having an API that can be integrated with the code (Jupyter, Python) to access the dataset. It can be filtered out based on the country, and date. (We can add more points)
• Updating data: making the process of uploading and updating data dynamic.
• Having separate webpages according to their concepts (as currently database page has all the information, we can split that page into multiple pages). For navigation, floating section or breadcrumbs should be there.
• Automate the deployment process- whenever code is changed, and a release branch is created, it should trigger the deployment process (e.g., Azure pipeline). This deployment is not completed unless the authoritative person confirms the process.
• On map, we can change the colours and also add legend that explains he color distinctions.
• Adding filters on the map, like country, date, organizations which own measuring devices,
• Plot the frequency dataset and then add filters on that plot. like if we select country, then it should show the plot related to that specified country. Other filters can be date intervals, time intervals, regions, and organizations.
• If we want to compare different dataset on the plot, we can also do this.
• We can have a default plot whenever we render the page. This plot will show the most recently updated dataset.
• When we update the dataset, it should show either as an alert or as a sidebar events section. this is clickable and when we click on this alert, it will go to the database page.
• We can add Team' page.
• Just like an idea of adding items in the cart, we can add multiple datasets and then download it as zip file.

Hi LRydin, I am working on a project and I find your data to be very useful. However, if I see the frequency data, I see weird values like 25, -7 etc and nothing is around 50.

Am I missing something? Please guide. Thank you.