Skip to content
Better HN
Top
New
Best
Ask
Show
Jobs
Search
⌘K
Multi-GPU Inference with Accelerate | Better HN
Multi-GPU Inference with Accelerate
(opens in new tab)
(bengubler.com)
14 points
nebrelbug
2y ago
1 comments
Share
1 comments
default
newest
oldest
nebrelbug
OP
2y ago
Quick tutorial on how to use Accelerate to run inference on LLMs in parallel
j
/
k
navigate · click thread line to collapse