Comments (2)
Hi! Dear authors,
I have a question about your reported results.
I have tested your OmniAnomaly model on the dataset MSL and I can get 89% Pot-F1 which is much closer to the result reported in your paper. But, when I set the model's anomaly score as random numbers from [0, 1], the pot-F1 can reach above 89.8833%. it is confusing since these random "anomaly scores" are not obtained from the model.
I think this issue should be caused by the point-adjust approach mentioned in your paper. Actually, I also try to evaluate a simple RNN with your codes and settings (same data and same evaluation), its best F1 can also be above 90%.
Can you help to explain my question? Many thanks.
Hi there, I was just wondering why this question was marked as close without receiving an answer? Did you happen to figure out whether there was an issue with the POT scores or if this is the expected behaviour?
from omnianomaly.
+?
Hi! Dear authors,
I have a question about your reported results.
I have tested your OmniAnomaly model on the dataset MSL and I can get 89% Pot-F1 which is much closer to the result reported in your paper. But, when I set the model's anomaly score as random numbers from [0, 1], the pot-F1 can reach above 89.8833%. it is confusing since these random "anomaly scores" are not obtained from the model.
I think this issue should be caused by the point-adjust approach mentioned in your paper. Actually, I also try to evaluate a simple RNN with your codes and settings (same data and same evaluation), its best F1 can also be above 90%.
Can you help to explain my question? Many thanks.Hi there, I was just wondering why this question was marked as close without receiving an answer? Did you happen to figure out whether there was an issue with the POT scores or if this is the expected behaviour?
from omnianomaly.
Related Issues (20)
- Fitting on two different Scaler
- Physical meaning of each column of the server machine dataset
- A simple Question about SMD Dataset HOT 2
- Training on other dataset HOT 4
- I meet some problems when i run 'python main.py' about "from tfsnippet.scaffold import VariableSaver" HOT 1
- Tensor had NaN values
- The code provide the reconstructed probability but how to get the reconstructed sequence
- Code doesn't run HOT 2
- Project fails to run on M1 mac processor
- Cannot install and run the code with tf2.9.3 HOT 4
- some questions about dataset
- A problem about timestep of SMD datasets
- This instruction fails on colab: pip install -r requirements.txt HOT 2
- Python version should >= 3.7 HOT 1
- How I run it using Nvidia cuda image
- libcublas.so.9.0: cannot open shared object file:No such file or directory. Failed to load the native tensorflow runtime. HOT 1
- Any repo with updated packages and python version? HOT 1
- Why is Best F1 search method not preferred over POT method?
- adjust_predicts in eval_method.py
- Questions about the SMD dataset
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from omnianomaly.