Parameter settings

[ChenHuyoo]

Thank you for your work!
In the ACR module, why is iterations_per_epoch set to 20? Is this an empirical parameter, or should the number of iterations be calculated based on the size of the dataset and the number of training epochs?

[Tajamul21]

Thank you for your question!

The iterations_per_epoch parameter in the ACR module is set to 20 based on a heuristic approach. This value was chosen based on prior experimentation and empirical results, rather than being directly calculated from the dataset size or training epochs.

While it is common to calculate the number of iterations per epoch as the dataset size divided by the batch size (e.g., iterations_per_epoch = len(dataset) / batch_size), the choice of 20 in this case was driven by heuristic experimentation, which has shown to work well for typical scenarios. It's a practical starting point that can be adjusted depending on the specifics of your dataset, batch size, and training configuration.

Feel free to experiment with this value to better suit your particular setup, but 20 is a reasonable default based on previous work.

Let me know if you need more information!