-
Notifications
You must be signed in to change notification settings - Fork 0
Description
Add functionality to automatically add new files to the reduce queue after ingest in the same way we add them to the export queue.
This would cover checkBiasOSCO, checkFlatCounts at least, eventually also single-frame calibrations like ARCs and GCAL FLATs that are not stacked.
Will need some kind of look-up table configuration.
In ingester, we should pass the filename, or maybe the diskfile id, to code from another module to handle this - the logic for this shouldn't live in ingester.py
The configuration will likely end up somewhat messy. Suggest a dictionary of header columns and values to match to identify if a rule applies, then you need to know what recipe to call, and potentially arguments to pass, so we end up with and identification dict and an an action dict for each rule. So the rule set could be a dict where the keys and the values are each themselves dicts. Or we could have a list of (identification, action) tuples. The latter seems less messy.