undefined | Better HN

0 pointsSV_BubbleTime1y ago0 comments

AMD’s is coming up in support for things like torch and xformers. But it isn’t there yet.

If you want for AI, your best bet is a used 3090 for $700-800. The ram is more important and that card is still faster than a 4070.

0 comments

codedokode1y ago

AMD has documentation for its assembly language as I remember. Or one needs more documentation to run AI?

SV_BubbleTimeOP1y ago

Isn’t a documentation issue.

The entire ecosystem is built around CUDA currently. There was someone implementing Cuda on AMD hardware but as I understand it, AMD shut that down.

There are two alternatives to CUDA for AMD right now, but I forget their names.

AMD has STRIX coming, which is a single board embedded ram machine, and is being targeted at AI loads with lots of low latency ram. So we’ll see what happens there.

j / k navigate · click thread line to collapse