ZeRO 2 Zero Redunduncy Optimizer (ZeRO): Paper Summary Sep 28, 2024 Distributed training technologies for Transformers: Overview Aug 30, 2024