[WIP] Gaudi based miniDST workflow with EDM4hep output

[tmadlener]

BEGINRELEASENOTES

• Thank you for writing the text to appear in the release notes. It will show up
  exactly as it appears between the two bold lines
• ...

ENDRELEASENOTES

• Needs Additions to MiniDST.xml #151
• Needs Make it possible to keep or drop all collections of a given datatype key4hep/k4FWCore#362

Differences in LCIO output files from MarlinStdRecoMiniDST.xml and ILDMiniDST.py

• The ones processed via Marlin contain information about the used steering files, most importantly about the simulation, these are missing from the ones produced via Gaudi and the wrapper (see below)
• The output parameter minorThrustAxis of the ThrustProcessor sometimes appears with flipped sign. This can also happen with two consecutive runs of the Marlin version.

Differences between files

Diff of anajob outptus

$ diff -u <(anajob bbudsc_3evt_miniDST.slcio) <(anajob bbudsc_3evt_GaudiMiniDST.slcio)
--- /dev/fd/63	2025-11-20 10:53:48.085626192 +0100
+++ /dev/fd/62	2025-11-20 10:53:48.084626180 +0100
@@ -1,149 +1,10 @@
 anajob:  will open and read from files: 
 
-     bbudsc_3evt_miniDST.slcio     [ number of runs: 1, number of events: 3 ] 
+     bbudsc_3evt_GaudiMiniDST.slcio     [ number of runs: 0, number of events: 3 ] 
 
-  Run : 0 - ILD_l5_v02:  
- parameter CommandLine [string]: /home/madlener/work/.spack/spackages/skylake-ubuntu24.04-gcc13.3.0/dd4hep/master-lffulu/bin/ddsim --inputFiles Examples/bbudsc_3evt/bbudsc_3evt.stdhep --outputFile bbudsc_3evt_SIM.slcio --compactFile /home/madlener/work/.spack/spackages/skylake-ubuntu24.04-gcc13.3.0/k4geo/main-reo5ho/share/k4geo/ILD/compact/ILD_l5_v02/ILD_l5_v02.xml --steeringFile ddsim_steer.py, 
- parameter DD4HEPVersion [string]: v01-32, 
- parameter DateUTC [string]: 2025-11-20 09:40:26.677486 UTC, 
- parameter GEANT4Version [string]: $Name: geant4-11-03-patch-02 [MT]$, 
- parameter ILCSoft_location [string]: Unknown, 
- parameter LCIOFileName [string]: bbudsc_3evt_miniDST.slcio, 
- parameter SteeringFileContent [string]: ######################################################################\n#\n#  standard steering file for ILD simulation \n#  \n#\n#\n######################################################################\nfrom DDSim.DD4hepSimulation import DD4hepSimulation\nfrom g4units import m, mm, GeV, MeV, rad\nimport os\n\nSIM = DD4hepSimulation()\n\n## The compact XML file\nSIM.compactFile = ""\n## Lorentz boost for the crossing angle, in radian!\nSIM.crossingAngleBoost = 7.e-3*rad\nSIM.enableDetailedShowerMode = True\nSIM.enableG4GPS = False\nSIM.enableG4Gun = False\nSIM.enableGun = False\n## InputFiles for simulation .stdhep, .slcio, .HEPEvt, .hepevt, .hepmc, .pairs files are supported\nSIM.inputFiles = []\n## Macro file to execute for runType 'run' or 'vis'\nSIM.macroFile = ""\n## number of events to simulate, used in batch mode\nSIM.numberOfEvents = 3\n## Outputfile from the simulation,only lcio output is supported\nSIM.outputFile = "dummyOutput.slcio"\n## Physics list to use in simulation\nSIM.physicsList = None\n## Verbosity use integers from 1(most) to 7(least) verbose\n## or strings: VERBOSE, DEBUG, INFO, WARNING, ERROR, FATAL, ALWAYS\nSIM.printLevel = "INFO"\n## The type of action to do in this invocation\n## batch: just simulate some events, needs numberOfEvents, and input file or gun\n## vis: enable visualisation, run the macroFile if it is set\n## run: run the macroFile and exit\n## shell: enable interactive session\nSIM.runType = "batch"\n## Skip first N events when reading a file\nSIM.skipNEvents = 0\n## Steering file to change default behaviour\nSIM.steeringFile = None\n## FourVector of translation for the Smearing of the Vertex position: x y z t\nSIM.vertexOffset = [0.0, 0.0, 0.0, 0.0]\n## FourVector of the Sigma for the Smearing of the Vertex position: x y z t\nSIM.vertexSigma = [0.0, 0.0, 0.0, 0.0]\n\n\n################################################################################\n## Action holding sensitive detector actions\n##   The default tracker and calorimeter actions can be set with\n## \n##   >>> SIM = DD4hepSimulation()\n##   >>> SIM.action.tracker = ('Geant4TrackerWeightedAction', {'HitPositionCombination': 2, 'CollectSingleDeposits': False})\n##   >>> SIM.action.calo    = "Geant4CalorimeterAction"\n## \n##   for specific subdetectors specific sensitive detectors can be set based on pattern matching\n## \n##   >>> SIM = DD4hepSimulation()\n##   >>> SIM.action.mapActions['tpc'] = "TPCSDAction"\n## \n##   and additional parameters for the sensitive detectors can be set when the map is given a tuple\n## \n##   >>> SIM = DD4hepSimulation()\n##   >>> SIM.action.mapActions['ecal'] =( "CaloPreShowerSDAction", {"FirstLayerNumber": 1} )\n## \n##    \n################################################################################\n\n##  set the default calorimeter action \nSIM.action.calo = "Geant4ScintillatorCalorimeterAction"\n\n##  create a map of patterns and actions to be applied to sensitive detectors\n##         example: SIM.action.mapActions['tpc'] = "TPCSDAction" \nSIM.action.mapActions = {}\n\nSIM.action.mapActions['tpc'] = "TPCSDAction"\n\n##  set the default tracker action \nSIM.action.tracker = ('Geant4TrackerWeightedAction', {'HitPositionCombination': 2, 'CollectSingleDeposits': False})\n\n\n################################################################################\n## Configuration for the magnetic field (stepper) \n################################################################################\n## --- used in v01-19-05 :\nSIM.field.delta_chord = 1e-05\nSIM.field.delta_intersection = 1e-05\nSIM.field.delta_one_step = .5e-03*mm\nSIM.field.eps_max = 1e-04\nSIM.field.eps_min = 1e-05\nSIM.field.equation = "Mag_UsualEqRhs"\nSIM.field.largest_step = 10.*m\nSIM.field.min_chord_step = 1.e-2*mm\nSIM.field.stepper = "HelixSimpleRunge"\n\n## ---  default values in ddsim\n##SIM.field.delta_chord = 0.25\n##SIM.field.delta_intersection = 0.001\n##SIM.field.delta_one_step = 0.01\n##SIM.field.eps_max = 0.001\n##SIM.field.eps_min = 5e-05\n##SIM.field.equation = "Mag_UsualEqRhs"\n##SIM.field.largest_step = 10000.0\n##SIM.field.min_chord_step = 0.01\n##SIM.field.stepper = "G4ClassicalRK4"\n\n################################################################################\n## Configuration for sensitive detector filters\n## \n##   Set the default filter for tracker or caliromter\n##   >>> SIM.filter.tracker = "edep1kev"\n##   >>> SIM.filter.calo = ""\n## \n##   Assign a filter to a sensitive detector via pattern matching\n##   >>> SIM.filter.mapDetFilter['FTD'] = "edep1kev"\n## \n##   Or more than one filter:\n##   >>> SIM.filter.mapDetFilter['FTD'] = ["edep1kev", "geantino"]\n## \n##   Don't use the default filter or anything else:\n##   >>> SIM.filter.mapDetFilter['TPC'] = None ## or "" or []\n## \n##   Create a custom filter. The dictionary is used to instantiate the filter later on\n##   >>> SIM.filter.filters['edep3kev'] = dict(name="EnergyDepositMinimumCut/3keV", parameter={"Cut": 3.0*keV} )\n## \n##    \n################################################################################\n\n##  default filter for calorimeter sensitive detectors; this is applied if no other filter is used for a calorimeter \nSIM.filter.calo = "edep0"\n\n##  list of filter objects: map between name and parameter dictionary \nSIM.filter.filters = {'edep0': {'parameter': {'Cut': 0.0}, 'name': 'EnergyDepositMinimumCut/Cut0'}, 'geantino': {'parameter': {}, 'name': 'GeantinoRejectFilter/GeantinoRejector'}, 'edep1kev': {'parameter': {'Cut': 0.001}, 'name': 'EnergyDepositMinimumCut'}}\n\n##  a map between patterns and filter objects, using patterns to attach filters to sensitive detector \nSIM.filter.mapDetFilter = {}\n\nSIM.filter.mapDetFilter['TPC'] = None\n\n##  default filter for tracking sensitive detectors; this is applied if no other filter is used for a tracker\nSIM.filter.tracker = "edep1kev"\n\n\n################################################################################\n## Configuration for the GuineaPig InputFiles \n################################################################################\n\n## Set the number of pair particles to simulate per event.\n##     Only used if inputFile ends with ".pairs"\n##     If "-1" all particles will be simulated in a single event\n##     \nSIM.guineapig.particlesPerEvent = "-1"\n\n\n################################################################################\n## Configuration for the DDG4 ParticleGun \n################################################################################\n\n##  direction of the particle gun, 3 vector \nSIM.gun.direction = (0, 0, 1)\n\n## choose the distribution of the random direction for theta\n## \n##     Options for random distributions:\n## \n##     'uniform' is the default distribution, flat in theta\n##     'cos(theta)' is flat in cos(theta)\n##     'eta', or 'pseudorapidity' is flat in pseudorapity\n##     'ffbar' is distributed according to 1+cos^2(theta)\n## \n##     Setting a distribution will set isotrop = True\n##     \nSIM.gun.distribution = None\nSIM.gun.energy = 10000.0\n\n##  isotropic distribution for the particle gun\n## \n##     use the options phiMin, phiMax, thetaMin, and thetaMax to limit the range of randomly distributed directions\n##     if one of these options is not None the random distribution will be set to True and cannot be turned off!\n##     \nSIM.gun.isotrop = False\nSIM.gun.multiplicity = 1\nSIM.gun.particle = "mu-"\nSIM.gun.phiMax = None\n\n## Minimal azimuthal angle for random distribution\nSIM.gun.phiMin = None\n\n##  position of the particle gun, 3 vector \nSIM.gun.position = (0.0, 0.0, 0.0)\nSIM.gun.thetaMax = None\nSIM.gun.thetaMin = None\n\n\n################################################################################\n## Configuration for the output levels of DDG4 components \n################################################################################\n\n## Output level for input sources\nSIM.output.inputStage = 3\n\n## Output level for Geant4 kernel\nSIM.output.kernel = 3\n\n## Output level for ParticleHandler\nSIM.output.part = 3\n\n## Output level for Random Number Generator setup\nSIM.output.random = 6\n\n\n################################################################################\n## Configuration for the Particle Handler/ MCTruth treatment \n################################################################################\n\n## Enable lots of printout on simulated hits and MC-truth information\nSIM.part.enableDetailedHitsAndParticleInfo = False\n\n##  Keep all created particles \nSIM.part.keepAllParticles = False\n\n## Minimal distance between particle vertex and endpoint of parent after\n##     which the vertexIsNotEndpointOfParent flag is set\n##     \nSIM.part.minDistToParentVertex = 2.2e-14\n\n## MinimalKineticEnergy to store particles created in the tracking region\nSIM.part.minimalKineticEnergy = 1*MeV\n\n##  Printout at End of Tracking \nSIM.part.printEndTracking = False\n\n##  Printout at Start of Tracking \nSIM.part.printStartTracking = False\n\n## List of processes to save, on command line give as whitespace separated string in quotation marks\nSIM.part.saveProcesses = ['Decay']\n\n\n################################################################################\n## Configuration for the PhysicsList \n################################################################################\n# this needs to be set to False if any standard physics list is used:\nSIM.physics.decays = False\nSIM.physics.list = "QGSP_BERT" # "FTFP_BERT"\n\n##  location of particle.tbl file containing extra particles and their lifetime information\n##     \nSIM.physics.pdgfile = os.path.join( os.environ.get("DD4HEP"),  "DDG4/examples/particle.tbl")\n\n##  The global geant4 rangecut for secondary production\n## \n##     Default is 0.7 mm as is the case in geant4 10\n## \n##     To disable this plugin and be absolutely sure to use the Geant4 default range cut use "None"\n## \n##     Set printlevel to DEBUG to see a printout of all range cuts,\n##     but this only works if range cut is not "None"\n##     \nSIM.physics.rangecut =  0.1*mm\n\n\n################################################################################\n## Properties for the random number generator \n################################################################################\n\n## If True, calculate random seed for each event based on eventID and runID\n## allows reproducibility even when SkippingEvents\nSIM.random.enableEventSeed = False\nSIM.random.file = None\nSIM.random.luxury = 1\nSIM.random.replace_gRandom = True\nSIM.random.seed = None\nSIM.random.type = None\n\n, 
- parameter User [string]: madlener, 
- parameter WorkingDirectory [string]: /home/madlener/work/iLCSoft/ILDConfig/StandardConfig/production, 
- parameter _argv [string]: ['/home/madlener/work/.spack/spackages/skylake-ubuntu24.04-gcc13.3.0/dd4hep/master-lffulu/bin/ddsim', '--inputFiles', 'Examples/bbudsc_3evt/bbudsc_3evt.stdhep', '--outputFile', 'bbudsc_3evt_SIM.slcio', '--compactFile', '/home/madlener/work/.spack/spackages/skylake-ubuntu24.04-gcc13.3.0/k4geo/main-reo5ho/share/k4geo/ILD/compact/ILD_l5_v02/ILD_l5_v02.xml', '--steeringFile', 'ddsim_steer.py'], 
- parameter _dumpParameter [string]: False, 
- parameter _dumpSteeringFile [string]: False, 
- parameter _errorMessages [string]: [], 
- parameter _g4gps [string]: None, 
- parameter _g4gun [string]: None, 
- parameter action.calo [string]: Geant4ScintillatorCalorimeterAction, 
- parameter action.calorimeterSDTypes [string]: ['calorimeter'], 
- parameter action.event [string]: [], 
- parameter action.mapActions [string]: {'tpc': 'TPCSDAction'}, 
- parameter action.run [string]: [], 
- parameter action.stack [string]: [], 
- parameter action.step [string]: [], 
- parameter action.track [string]: [], 
- parameter action.tracker [string]: ('Geant4TrackerWeightedAction', {'HitPositionCombination': 2, 'CollectSingleDeposits': False}), 
- parameter action.trackerSDTypes [string]: ['tracker'], 
- parameter compactFile [string]: ['/home/madlener/work/.spack/spackages/skylake-ubuntu24.04-gcc13.3.0/k4geo/main-reo5ho/share/k4geo/ILD/compact/ILD_l5_v02/ILD_l5_v02.xml'], 
- parameter crossingAngleBoost [string]: 0.007, 
- parameter disableSignalHandler [string]: False, 
- parameter enableDetailedShowerMode [string]: True, 
- parameter enableG4GPS [string]: False, 
- parameter enableG4Gun [string]: False, 
- parameter enableGun [string]: False, 
- parameter field.delta_chord [string]: 1e-05, 
- parameter field.delta_intersection [string]: 1e-05, 
- parameter field.delta_one_step [string]: 0.0005, 
- parameter field.eps_max [string]: 0.0001, 
- parameter field.eps_min [string]: 1e-05, 
- parameter field.equation [string]: Mag_UsualEqRhs, 
- parameter field.largest_step [string]: 10000.0, 
- parameter field.min_chord_step [string]: 0.01, 
- parameter field.stepper [string]: HelixSimpleRunge, 
- parameter filter.calo [string]: edep0, 
- parameter filter.filters [string]: {'geantino': {'parameter': {}, 'name': 'GeantinoRejectFilter/GeantinoRejector'}, 'edep1kev': {'parameter': {'Cut': 0.001}, 'name': 'EnergyDepositMinimumCut'}, 'edep0': {'parameter': {'Cut': 0.0}, 'name': 'EnergyDepositMinimumCut/Cut0'}}, 
- parameter filter.mapDetFilter [string]: {'TPC': None}, 
- parameter filter.tracker [string]: edep1kev, 
- parameter geometry.dumpGDML [string]: , 
- parameter geometry.dumpHierarchy [string]: 0, 
- parameter geometry.enableDebugElements [string]: False, 
- parameter geometry.enableDebugMaterials [string]: False, 
- parameter geometry.enableDebugPlacements [string]: False, 
- parameter geometry.enableDebugReflections [string]: False, 
- parameter geometry.enableDebugRegions [string]: False, 
- parameter geometry.enableDebugShapes [string]: False, 
- parameter geometry.enableDebugSurfaces [string]: False, 
- parameter geometry.enableDebugVolumes [string]: False, 
- parameter geometry.enablePrintPlacements [string]: False, 
- parameter geometry.enablePrintSensitives [string]: False, 
- parameter geometry.regexSensitiveDetector [string]: {}, 
- parameter guineapig._parameters [string]: {'ParticlesPerEvent': '-1'}, 
- parameter guineapig.particlesPerEvent [string]: -1, 
- parameter gun.direction [string]: (0, 0, 1), 
- parameter gun.distribution [string]: None, 
- parameter gun.energy [string]: 10000.0, 
- parameter gun.etaMax [string]: None, 
- parameter gun.etaMin [string]: None, 
- parameter gun.isotrop [string]: False, 
- parameter gun.momentumMax [string]: 10000.0, 
- parameter gun.momentumMin [string]: 0.0, 
- parameter gun.multiplicity [string]: 1, 
- parameter gun.particle [string]: mu-, 
- parameter gun.phiMax [string]: None, 
- parameter gun.phiMin [string]: None, 
- parameter gun.position [string]: (0.0, 0.0, 0.0), 
- parameter gun.thetaMax [string]: None, 
- parameter gun.thetaMin [string]: None, 
- parameter hepmc3.Flow1 [string]: flow1, 
- parameter hepmc3.Flow2 [string]: flow2, 
- parameter hepmc3._parameters [string]: {'Flow1': 'flow1', 'Flow2': 'flow2'}, 
- parameter hepmc3.useHepMC3 [string]: True, 
- parameter inputConfig.userInputPlugin [string]: [], 
- parameter inputFiles [string]: ['Examples/bbudsc_3evt/bbudsc_3evt.stdhep'], 
- parameter lcgeo_location [string]: /home/madlener/work/.spack/spackages/skylake-ubuntu24.04-gcc13.3.0/k4geo/main-reo5ho/share/k4geo, 
- parameter lcio._parameters [string]: {'MCParticleCollectionName': 'MCParticle'}, 
- parameter lcio.mcParticleCollectionName [string]: MCParticle, 
- parameter macroFile [string]: , 
- parameter meta.eventNumberOffset [string]: 0, 
- parameter meta.eventParameters [string]: [], 
- parameter meta.runNumberOffset [string]: 0, 
- parameter meta.runParameters [string]: [], 
- parameter numberOfEvents [string]: 3, 
- parameter output.geometry [string]: 2, 
- parameter output.inputStage [string]: 3, 
- parameter output.kernel [string]: 3, 
- parameter output.part [string]: 3, 
- parameter output.physics [string]: 1, 
- parameter output.random [string]: 6, 
- parameter outputConfig.forceDD4HEP [string]: False, 
- parameter outputConfig.forceEDM4HEP [string]: False, 
- parameter outputConfig.forceLCIO [string]: False, 
- parameter outputConfig.userOutputPlugin [string]: None, 
- parameter outputFile [string]: bbudsc_3evt_SIM.slcio, 
- parameter part.enableDetailedHitsAndParticleInfo [string]: False, 
- parameter part.keepAllParticles [string]: False, 
- parameter part.minDistToParentVertex [string]: 2.2e-14, 
- parameter part.minimalKineticEnergy [string]: 1.0, 
- parameter part.printEndTracking [string]: False, 
- parameter part.printStartTracking [string]: False, 
- parameter part.saveProcesses [string]: ['Decay'], 
- parameter part.userParticleHandler [string]: Geant4TCUserParticleHandler, 
- parameter physics.ESeverity [string]: None, 
- parameter physics.ETolerance [string]: None, 
- parameter physics.alternativeDecayStatuses [string]: set(), 
- parameter physics.alternativeStableStatuses [string]: set(), 
- parameter physics.decays [string]: False, 
- parameter physics.list [string]: QGSP_BERT, 
- parameter physics.pdgfile [string]: /home/madlener/work/.spack/spackages/skylake-ubuntu24.04-gcc13.3.0/dd4hep/master-lffulu/examples/DDG4/examples/particle.tbl, 
- parameter physics.rangecut [string]: 0.1, 
- parameter physics.rejectPDGs [string]: {1, 2, 3, 4, 5, 6, 3201, 3203, 4101, 4103, 21, 23, 24, 5401, 25, 5403, 2203, 3101, 3103, 4403, 2101, 5301, 2103, 5303, 4301, 1103, 4303, 5201, 5203, 3303, 4201, 4203, 5101, 5103, 5503}, 
- parameter physics.zeroTimePDGs [string]: {17, 11, 13, 15}, 
- parameter physicsList [string]: None, 
- parameter printLevel [string]: 3, 
- parameter random.enableEventSeed [string]: False, 
- parameter random.file [string]: None, 
- parameter random.luxury [string]: 1, 
- parameter random.replace_gRandom [string]: True, 
- parameter random.seed [string]: 185788019, 
- parameter random.type [string]: None, 
- parameter runType [string]: batch, 
- parameter skipNEvents [string]: 0, 
- parameter steeringFile [string]: /home/madlener/work/iLCSoft/ILDConfig/StandardConfig/production/ddsim_steer.py, 
- parameter ui.commandsConfigure [string]: [], 
- parameter ui.commandsInitialize [string]: [], 
- parameter ui.commandsPostRun [string]: [], 
- parameter ui.commandsPreRun [string]: [], 
- parameter ui.commandsTerminate [string]: [], 
- parameter vertexOffset [string]: [0.0, 0.0, 0.0, 0.0], 
- parameter vertexSigma [string]: [0.0, 0.0, 0.0, 0.0], 
- --------------------------------------------------------------- 
 
  will reopen and read from files: 
-     bbudsc_3evt_miniDST.slcio
+     bbudsc_3evt_GaudiMiniDST.slcio
 ///////////////////////////////////
 EVENT: 0
 RUN: 0
@@ -236,4 +97,4 @@
 
 
   3 events read from files: 
-     bbudsc_3evt_miniDST.slcio
+     bbudsc_3evt_GaudiMiniDST.slcio