Zhangzhe's Blog
The projection of my life.
Home
Tags
Categories
Search
0%
Data Parallelism
Tag
2024
08-21
ZeRO: Memory Optimizations Toward Training Trillion Parameter Models