V2.11.2

Change Log

Feature

• Implement DAdaptLion optimizer (#203)
  • Lion with D-Adaptation

Fix

• Fix Lookahead optimizer (#200, #201, #202)
  • When using PyTorch Lightning which expects your optimiser to be a subclass of Optimizer.
• Fix default rectify to False in AdaBelief optimizer (#203)

Test

• Add DynamicLossScaler test case

Docs

• Highlight the code blocks
• Fix pepy badges

Contributions

thanks to @georg-wolflein

Diff

2.11.1...2.11.2