Skip to content
Better HN
Top
New
Best
Ask
Show
Jobs
Search
⌘K
Speedup Megatron-LM from 10% to 30% with Zero Bubble Pipeline Parallelism
(opens in new tab)
(github.com)
4 points
yzh
2y ago
2 comments
Share
Speedup Megatron-LM from 10% to 30% with Zero Bubble Pipeline Parallelism | Better HN
2 comments
default
newest
oldest
ufotalent
2y ago
An interesting playground to understand the scheduler is here
https://huggingface.co/spaces/sail/zero-bubble-pipeline-para...
QPHutu
2y ago
Cool!
j
/
k
navigate · click thread line to collapse
