arXiv (Cornell University)· 2017· Preprint

Decoupled Weight Decay Regularization

Ilya Loshchilov, Frank Hutter

Short summary

A new method decouples weight decay from gradient updates in adaptive optimization algorithms like Adam, improving generalization performance.

AI-generated from the title and abstract; the full text is not read.

TakeawaysIn the app

Key pointsIn the app

Ask the paperIn the app

Takeaways, key points and questions to the paper; new summaries every day for your field. Free.

Computational MechanicsEngineering