Visualization
Rastrigin
AccSGD

AdaBelief

AdaBound

AdaDelta

AdaFactor

AdaGC

AdaHessian

Adai

Adalite

Adam

AdaMax

AdamG

AdamMini

AdaMod

AdamP

AdamS

AdamW

Adan

AdaNorm

AdaPNM

AdaShift

AdaSmooth

AdaTAM

AdEMAMix

ADOPT

AggMo

Aida

AliG

Amos

APOLLO

ApolloDQN

ASGD

AvaGrad

BSAM

CAME

DAdaptAdaGrad

DAdaptAdam

DAdaptAdan

DAdaptLion

DAdaptSGD

DiffGrad

EXAdam

FAdam

Fira

FOCUS

Fromage

FTRL

GaLore

Grams

Gravity

GrokFastAdamW

Kate

Kron

Lamb

LaProp

LARS

Lion

MADGRAD

MARS

MSVAG

Nero

NovoGrad

PAdam

PID

PNM

Prodigy

QHAdam

QHM

RACS

RAdam

Ranger

Ranger21

Ranger25

ScalableShampoo

ScheduleFreeAdamW

ScheduleFreeRAdam

ScheduleFreeSGD

SCION

SCIONLight

SGD

SGDP

SGDSaI

SGDW

Shampoo

SignSGD

SimplifiedAdEMAMix

SM3

SOAP

SophiaH

SPAM

SRMM

StableAdamW

StableSPAM

SWATS

TAM

Tiger

VSGD

Yogi

Rosenbrock
AccSGD

AdaBelief

AdaBound

AdaDelta

AdaFactor

AdaGC

AdaHessian

Adai

Adalite

Adam

AdaMax

AdamG

AdamMini

AdaMod

AdamP

AdamS

AdamW

Adan

AdaNorm

AdaPNM

AdaShift

AdaSmooth

AdaTAM

AdEMAMix

ADOPT

AggMo

Aida

AliG

Amos

APOLLO

ApolloDQN

ASGD

AvaGrad

BSAM

CAME

DAdaptAdaGrad

DAdaptAdam

DAdaptAdan

DAdaptLion

DAdaptSGD

DiffGrad

EXAdam

FAdam

Fira

FOCUS

Fromage

FTRL

GaLore

Grams

Gravity

GrokFastAdamW

Kate

Kron

Lamb

LaProp

LARS

Lion

MADGRAD

MARS

MSVAG

Nero

NovoGrad

PAdam

PID

PNM

Prodigy

QHAdam

QHM

RACS

RAdam

Ranger

Ranger21

Ranger25

ScalableShampoo

ScheduleFreeAdamW

ScheduleFreeRAdam

ScheduleFreeSGD

SCION

SCIONLight

SGD

SGDP

SGDSaI

SGDW

Shampoo

SignSGD

SimplifiedAdEMAMix

SM3

SOAP

SophiaH

SPAM

SRMM

StableAdamW

StableSPAM

SWATS

TAM

Tiger

VSGD

Yogi
