Distributed Deep Learning with Keras and Horovod (opens in new tab)

(medium.com)

16 pointsskun8y ago3 comments

3 comments

This is really nice. This code looks like it is single-cluster with multiple-GPU. Are there benchmarks on how Horovod work on multi-cluster multi-GPU setting?

nischalhp8y ago

In the next part of the blog series, we will showcase the performance across a multi-cluster of gpus.

nischalhp8y ago

Thanks for the share @skun. Author here, open to questions and feedback.

j / k navigate · click thread line to collapse

3 comments

rouse8y ago

This is really nice. This code looks like it is single-cluster with multiple-GPU. Are there benchmarks on how Horovod work on multi-cluster multi-GPU setting?

nischalhp8y ago

In the next part of the blog series, we will showcase the performance across a multi-cluster of gpus.

nischalhp8y ago

Thanks for the share @skun. Author here, open to questions and feedback.

j / k navigate · click thread line to collapse