Some parts of the model will need different amounts of LR. For example when performing decoder-encoder alignment, the Project would require a larger LR than the encoder and the decoder.