Builds and returns an optimizer for model_parameters. The type of the optimizer is determined by kwarg type, the remaining kwargs are passed to the optimizer.
Parameters
Name
Type
Description
Default
model_parameters
Iterable
iterable of parameters to optimize or dicts defining parameter groups
required
optimizer_kwargs
kwargs for optimizer; type needs to be one of [adagrad, adam, adamw, lbfgs, RMSprop, sgd], the remaining kwargs are used for specific optimizer kwargs, such as learning rate and momentum