Home
Categories
ZeRO Optimizer
Category
Cancel
ZeRO Optimizer
1
Zero Redunduncy Optimizer (ZeRO): Paper Summary
Sep 28, 2024
Trending Tags
llms
transformers
deep-learning
bert
ZeRO
context parallelism
ddp
distributed data parallel
DTensor
finetuning