Yogi adds a tiny bit of compute per step and may need slightly more memory. In practice, it's negligible for most models.

Yogi won't replace Adam everywhere, but it's an excellent tool to keep in your optimizer toolbox – especially when gradients get wild.

Try it on your next unstable training run. You might be surprised. 🚀