Identify outlier values in reported CEMS data about open-grid-emissions HOT 4 OPEN

This may be the source of spikiness in the output data (below), so may be a priority for V1.

Blue is our result, red is the raw 930 profile (after timestamp adjustment). Both show total generation in PJM. The spikes in the blue profile are due to spikes in CEMS data.

from open-grid-emissions.

Can you provide a little more context of what the above graph is showing?

from open-grid-emissions.

Added above.

Two possible approaches:

• Use some multiple of the IQR to filter spikes (following http://www.nature.com/articles/s41597-020-0483-x)
• Filter values above plant capacity

from open-grid-emissions.

This paper includes some possible approaches to identifying outlier data: https://pubs.acs.org/doi/10.1021/acs.est.9b04522

https://github.com/NREL/NaTGenPD

from open-grid-emissions.