You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Oct 11, 2023. It is now read-only.
in tensorflow or torch, I have observed that the learning rate is usually one number like 0.001 or 0.01 etc. But in this tutorial I find that the learning rate for 16 classes is something like this
cntk_lr_per_image = [0.01] * 10 + [0.001] * 5 + [0.0001] which is array of 16 items which is equal to the number of classes. So if I have 80 classes to train should this array cntk_lr_per_image contain 80 learning rate ?
Something like this cntk_lr_per_image = [0.01] * 40 + [0.001] * 30 + [0.0001]*10 ?
I understand what learning rate is and how it impacts the overall learning of the model and there's no straight forward way to choose a learning rate but this tutorial uses an array of learning rates which is what confuses me.
Can you help me with understanding how learning rate us used in this example ?