Comments (9)
Implementation
- Give option to save orphaned exposures as a table.
from jwst.
Issues
- One association per exposure, or all exposures in a single association?
- Resolution: Will give the option to save the orphaned table.
- Type identifier of association. Proposed: orphaned
- Should not be an association, but will leave as a table.
from jwst.
One orphaned exposure per association.
I think the association type could still use entries from the existing list: image, spec, etc., depending on what type of exposure it is.
from jwst.
@hbushouse About the type: If an exposure matched one of the types, it would be in an association already. The only time there will be "orphaned" exposures are when an exposure does not match any of the types.
from jwst.
Do the "types" basically correspond to a given filter rule that's used to create groups of exposures to begin with? What I was referring to is if an orphaned exposures has exp_type 'NRC_IMAGE', then it gets an association type of 'image', or if its exp_type is 'MIR_MRS' or 'NRC_GRISM' (etc.) then it gets an association type of 'spec'.
from jwst.
RIght, types generally match the rules, but also types are to be used to determine the type of processing that should occur. So, if an exposure doesn't match a rule, it should probably not have a type that will trigger a Level3 process. Such orphaned exposures, presumably, do not get Level3 processes, so we need separate types to indicate them as such.
If an "orphaned" exposure should get some type of Level3 processing, then it should really have been in either an existing rule, or it should have a matching rule so that it does get processed.
from jwst.
Orphans will receive level-3 processing. They won't get combined with any other data, but they will at least go through drizzling as a singleton to produce a resampled/rectified product that has a level-3 source-based product name. The level-3 pipelines are/will be setup to correctly handle a single input exposure in this way.
from jwst.
Currently, there is nothing in any of the rules the force an association to contain more than one exposure. So, if there is an exposure that matches a rule and it is the only exposure that matches, the generator will still generate the association. If this covers what the "every exposure gets an association" requirement, then we're done. The situations you have been describing fall into this category.
However, if there are observing modes that produces singletons, single exposures, that should never associate with other exposures, then we will need to create rules for such singleton observing modes.
So, a final question is what to do with exposures that do not match anything, nor should match anything. Currently nothing is done with these, truly orphaned exposures. Should there be an association that contains these, or should they simply be ignored?
from jwst.
After discussion with @hbushouse, it has been determined that the situation is as described: basically allow associations with a single member to occur, which currently does.
There is not, as yet, any observing modes which require only a single exposure; that will be dealt with when the case arises.
On the issue of what to do with actual orphaned exposures: An option will be added to save the orphaned exposure table. This will not be an association, but a table, by default in ecsv format.
from jwst.
Related Issues (20)
- Error in ApCorr propagation to variances HOT 2
- Background error propagation in non-IFU background subtraction HOT 2
- Add group_id to Level 3 associations HOT 2
- Investigate refpix differences across systems
- Investigate coron3 differences across systems
- Nod Flux oversubtraction correction for NIRSpec Fixed-Slit and MOS point-source spectra
- Move NIRSpec FS point source position assignment out of wavecorr HOT 2
- Spec3 step mrs_imatch crashing HOT 1
- extract_1d SOSS ATOCA failures on saturated data HOT 3
- Remove drizpars handling from resample steps HOT 3
- Flux differences in stage 3 products when combining multiple grating/filters HOT 1
- Improve runtime of NSClean step HOT 3
- Modify NSClean behaviour for subarray data HOT 1
- Ensure NaN values are excluded from sum in spectral extraction
- Remove "R_DRZPAR" definition from datamodels schema HOT 1
- Improve NIRSpec spec2 runtime for BOTS/MOS HOT 12
- Update the JWST pipeline to accommodate the new likelihood algorithm in ramp fitting
- Error in NIRSpec spectral WCS with all-NaN input to resample
- Bug in extract1d._coalesce_bounds HOT 1
- extract1d._coalesce_bounds can return unexpected results HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jwst.