Optimizers
==========

.. currentmodule:: optax

.. autosummary::
    adabelief
    adadelta
    adan
    adafactor
    adagrad
    adam
    adamw
    adamax
    adamaxw
    amsgrad
    fromage
    lamb
    lars
    lbfgs
    lion
    nadam
    nadamw
    noisy_sgd
    novograd
    optimistic_gradient_descent
    optimistic_adam
    polyak_sgd
    radam
    rmsprop
    sgd
    sign_sgd
    sm3
    yogi


AdaBelief
~~~~~~~~~
.. autofunction:: adabelief

AdaDelta
~~~~~~~~~
.. autofunction:: adadelta

Adan
~~~~
.. autofunction:: adan

AdaGrad
~~~~~~~
.. autofunction:: adagrad

AdaFactor
~~~~~~~~~
.. autofunction:: adafactor

Adam
~~~~
.. autofunction:: adam

Adamax
~~~~~~
.. autofunction:: adamax

AdamaxW
~~~~~~~
.. autofunction:: adamaxw

AdamW
~~~~~
.. autofunction:: adamw

AMSGrad
~~~~~~~
.. autofunction:: amsgrad

Fromage
~~~~~~~
.. autofunction:: fromage

Lamb
~~~~
.. autofunction:: lamb

Lars
~~~~
.. autofunction:: lars

LBFGS
~~~~~
.. autofunction:: lbfgs

Lion
~~~~
.. autofunction:: lion

Nadam
~~~~~
.. autofunction:: nadam

NadamW
~~~~~~
.. autofunction:: nadamw

Noisy SGD
~~~~~~~~~
.. autofunction:: noisy_sgd

Novograd
~~~~~~~~
.. autofunction:: novograd

Optimistic GD
~~~~~~~~~~~~~
.. autofunction:: optimistic_gradient_descent

Optimistic Adam
~~~~~~~~~~~~~~~
.. autofunction:: optimistic_adam

Polyak step-size SGD
~~~~~~~~~~~~~~~~~~~~
.. autofunction:: polyak_sgd

RAdam
~~~~~
.. autofunction:: radam

RMSProp
~~~~~~~
.. autofunction:: rmsprop

RProp
~~~~~
.. autofunction:: rprop

SGD
~~~
.. autofunction:: sgd

SignSGD
~~~~~~~
.. autofunction:: sign_sgd

SM3
~~~
.. autofunction:: sm3

Yogi
~~~~
.. autofunction:: yogi