A beginner's guide to deploying LLMs with AMD on Windows using PyTorch (opens in new tab)

I kind of feel the same way, but my take may not be quite as cynical. The way I see it, some companies just act really stupid, and there's a lot more room for forgiveness when you suspect incompetence than active disregard. There's a lot of talk about how amazing Lisa Su is as a leader, and while it's true that she has executed brilliantly on the goals she dictated for the company, the record will show that those goals were rather short-sighted in the long run.

It's been painfully obvious since at least 2018 that GPUs were going to explode in value as Nvidia developed an increasingly large monopoly on AI compute. In response to this, AMD put almost no-one on the driver stack. At the time, it was baffling. Now it's a near Blockbuster-level failure in corporate decision making. They reap what they sow.

But what will benefit the consumer in the long run is to break the monopoly. There are no real sides to take here other than "not Nvidia". If AMD provides a decent product, it makes sense to buy it to show that the support is there. It's not been sunshine and roses, but my recent experience with the 7900 XTX has been positive and substantially better than anything they had to offer in 2020. The fact that the AMD stack is still so weak is not a product of their lack of improvement, but rather how astonishingly far behind they were.

Having said that, the recent GPU prices from AMD have been baffling. If they don't improve, they'll continue to be in the dust.

AMD is bad, but still preferable to paying the Nvidia tax.

Hopefully Huawei will go global with their new chips soon, and we can all get cheap compute.

I haven't been following the market until recently, but isn't the AMD Ryzen Max AI a consumer friendly AI option? Is it just not serious enough relative to the Nvidia offerings?

Luckily you have NVIDIA to fall back on, with their affordable, consumer-focused LLM chips...

What do you think about: https://unlockgpu.com/? I put it on hold because the shareholder resolutions has to propose some concrete board level changes - and it seems (or seemed a few months ago) that AMD really started implementing such changes.

They love gamers, just not on GNu/Linux.

Playstation, XBox, Windows, gaming handhelds.

I mean I also want AMD to simply make the better video card. I'd give them advice if I could, but that ain't my field of expertise.

And the problem with this attitude is that it keeps driving people toward a greater evil like nvidia, intel or the chinese communist party.

AMD is the least evil option so far. We're all disappointed in them, but at least they still exist.

it's not only the support. they are unable to write good software.

period.

> Devs should punish companies that clearly don't give a shit about them.

Don't get involved in parasocial relationships with corporations - if they were human, they'd all be amoral psychopaths with a harrowing addiction to profits.

> When I see AMD, I think of a firm that heavily prioritized their B2B business over B2C

That's ironic to read as a gamer who saw Nvidia roll-over to scalpers and Bitcoin farms. Selling out to big tech would have been better, frankly - there's some hope of technical cooperation to improve the product. Then again, corporations are not our friends.

AMD will continue to have my custom as long as they have better bang-for-buck compared to Intel or Nvidia.

> I've had it with AMD, and would rather penalize them (even if it costs them pennies) out of principle.

strong jilted, jealous, lover vibes on this. just curious - how do you plan to carry out this revenge scheme on a multi-billion, multi-national, megacorp, other than angry posts on social media?

These instructions assume there is already a working OS where everything is supported.

Some of us consider modern IDEs and advanced debugging tools a much better support for development.

https://bitsavers.org/pdf/xerox/parc/techReports/CSL-89-4_UN...

Recently, I wanted to TTS a book with abogen. I main Windows and it does everything I want from it, mostly gaming and web dev. It didn't work with my 7900XTX because of Pytorch incompatibility. Even Zluda didn't help because it lacked a specific feature necessary for the app. I just want to use locally AI powered software. AMD/Windows combo sucks for this.