V2.12.0
Change Log
Feature
- Support
bitsandbytes
optimizer. (#211) * now, you can install withpip3 install pytorch-optimizer[bitsandbytes]
* supports 8 bnb optimizers. *bnb_adagrad8bit
,bnb_adam8bit
,bnb_adamw8bit
,bnb_lion8bit
,bnb_lamb8bit
,bnb_lars8bit
,bnb_rmsprop8bit
,bnb_sgd8bit
.
Docs
- Introduce
mkdocs
withmaterial
theme. (#204, #206) * documentation : https://pytorch-optimizers.readthedocs.io/en/latest/