Skip to content

Automatic add to reducequeue in ingest #123

@phirstgemini

Description

@phirstgemini

Add functionality to automatically add new files to the reduce queue after ingest in the same way we add them to the export queue.
This would cover checkBiasOSCO, checkFlatCounts at least, eventually also single-frame calibrations like ARCs and GCAL FLATs that are not stacked.

Will need some kind of look-up table configuration.

In ingester, we should pass the filename, or maybe the diskfile id, to code from another module to handle this - the logic for this shouldn't live in ingester.py

The configuration will likely end up somewhat messy. Suggest a dictionary of header columns and values to match to identify if a rule applies, then you need to know what recipe to call, and potentially arguments to pass, so we end up with and identification dict and an an action dict for each rule. So the rule set could be a dict where the keys and the values are each themselves dicts. Or we could have a list of (identification, action) tuples. The latter seems less messy.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions