Experimentation ideas

[sudo-Boris]

• Remove gt_loss, i.e., only use decomposition loss (this loss already encompasses the information of the full reconstruction)
• 2 Stage training:
  • first only use gt_loss, then include decomposition loss.
  • first train autoencoder, remove unet upscaler, then train on entire decomposition loss.
• Implement lr warmup