Comments (6)
@hover2pi @Johannes-Sahlmann Can I assign this one to you guys? It would be nice to ramp up a few people on database expertise on the team, so I was wondering if you could work together on this.
Here is what I am thinking: We can do this with the postgresql
database we already have (see database.txt
in the home directory on the admin account for credentials). We can use sqlalchemy
to construct ORMs to an anomalies
table in a module named database_interface.py
(akin to what I have for acsql).
Probably we will want a table for each instrument, since each instrument may have different anomalies to track.
Here are the columns that I have in mind:
1. Unique ID
2. filename (the full rootname of the image that was flagged)
3. flag_date (datetime in which the anomaly was flagged in the webapp)
4. <anomaly_name_1> (Boolean flag if the image has the given anomaly)
5. <anomaly_name_2>
...
N. <anomaly_name_n>
from jwql.
@bourque Do we have a running list of anomalies to track, from WFC3 or ACS perhaps? Obviously doesn't need to be exhaustive, just something to start with. Thanks!
from jwql.
@hover2pi Here are the current anomalies that WFC3 keeps track of. Of course, some of these wont make sense for any given JWST instrument, but perhaps a good start as you suggest.
Cosmic Ray Shower
Crosstalk
CTE Correction Error
Data transfer Error
Detector/Filter Ghost
Diamond Feature
Diffraction Spike
Dragon's Breath
Earth Limb
Excessive Saturation
Figure-8 Ghost
Filter Ghost
Fringing
Guidestar Failure
IR Banding
Persistence
Prominent Blobs
Satellite Trail
Scattered Light
Other
from jwql.
@hover2pi Also, I just checked and I am also having issues connecting to the database from our dev server. I think the DB server may be down. I'm going to send in a support ticket.
from jwql.
@hover2pi The database should be back up now. The problem was that the DB server was not started properly after the VM was rebooted.
You should be able to log in from the admin account on the development server. If you find this to be annoying and need/want to be able to log into your machine, let me know and we can probably set you up with an account.
from jwql.
@bourque Yup, it works now. Thanks!
from jwql.
Related Issues (20)
- Update dashboard to look at new anomaly db tables HOT 2
- Pipeline tasks are not aware of working/outputs distinction HOT 1
- Dark monitor attempts to use nonexistent "data_dir" attribute
- Improve performance of query page HOT 2
- Display information on missing exposures/observations
- Create Django models for the tables in JWQLDB HOT 1
- Migrate EDB monitors to django
- Remove existing SQL Alchemy code from JWQL
- Edit a sample monitor to query and update via the django models.
- Update Bad Pixel Monitor to Django
- Update claw monitor to use django tables
- Migrate dark monitor to django
- Migrate grating monitors to django HOT 1
- Migrate bias monitor to django
- Migrate TA monitors to django
- Update filesystem monitors to use django
- Update monitor_utils to use django models
- Update data_containers to use django
- Move github/readthedocs fence code to a single file, and use it by import
- Add historical data to the NIRCam Claw Monitor
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jwql.