undefined | Better HN

0 pointsYetAnotherNick4mo ago0 comments

Containers don't include drivers which is the primary reason for issues.

0 comments

Containers afair rely on the exact driver version matching between the host system and the container itself.

We were on AWS when we used this so setting up seemed easy enough - AWS gave you the driver, and a matching docker image was easy enough to find.

kcb4mo ago

That's not the case, CUDA containers user space does not have to match the host drivers CUDA capability. The container needs to be the same major version or lower. So a system with a CUDA 13 capable driver should be able to run all previous versions.

For some versions there's even sometimes compat layers built into the container to allow forward version compatibility.

j / k navigate · click thread line to collapse

0 comments

torginus4mo ago

Containers afair rely on the exact driver version matching between the host system and the container itself.

We were on AWS when we used this so setting up seemed easy enough - AWS gave you the driver, and a matching docker image was easy enough to find.

kcb4mo ago

For some versions there's even sometimes compat layers built into the container to allow forward version compatibility.

j / k navigate · click thread line to collapse