Home
Categories
ZeRO Optimizer
Category
Cancel
ZeRO Optimizer
1
Zero Redunduncy Optimizer (ZeRO): Paper Summary
Sep 28, 2024
Trending Tags
llms
transformers
deep-learning
bert
pytorch
ZeRO
context parallelism
contiguity
ddp
distributed data parallel