How to implement a learning rate decay into the model?

Does anyone know how to implement a learning rate decay into the model? I’ve looked at a couple functions but it is unclear where I should be creating the supervisor.

Also, can anyone help point me to a way to unfreeze layers in a pretrained model?

Thanks!

1 Like