[1] https://www.reddit.com/r/Amd/comments/1gfr60l/ryzen_ai_300_t...
...buuuuut, to be fair, I don't either a) particularly care, or b) really have that much knowledge about the Ryzen AI 9 HX 37 CPU.
Anyone care to point me vaguely in the direction of something meaningful that would suggest that CPU based inference would, in general, be even remotely comparable to dedicated GPU performance for AI?
I remain pretty skeptical.
(That reddit thread kicks off with someone saying 'LLM isn't particularly compute intensive workload', which is obviously a) false, and b) gives me no confidence in their review. If LLMs were just memory intensive, we would all just be getting machines with more RAM and no one would be going crazy with 4 parallel 24GB GPUs just to eek out the performance for inference; they'd just slap a 64GB sim in their machine and be done with it).
LLM inference it is memory intensive, but it IS compute intensive too.
Being able to run on a CPU at 1 token per century is not what anyone wants.
> GPD Pocket 4 uses LPDDR5x memory with a speed of 7500MT/s, available in 16GB or 32GB or 64GB capacities. It can allocate up to 16GB of memory to the GPU, allowing AI applications that require large amounts of VRAM to perform optimally.
16gb can run a few LLM’s with decent token/s
Why does it support an RS232 port, especially on such a small form factor? Why does it focus so much on local LLM support? Why has it got such a high resolution display? Why has it got swappable ports?
Each one of those features makes sense in isolation for some market, but together I'm not sure there's anyone who's the target market for all of them, and because of that there are likely to be better options for each target market. Want to run an LLM? A Mac is going to do that much better with its unified memory and ML acceleration. Want to do sysadmin stuff plugged into an old switch? You probably already have an old Thinkpad for that. etc.
"Doomed to failure" was too strong in hindsight, it seems GPD have found their niche. It does however sound like it is quite a niche. This product does have a bunch of tradeoffs that work for that niche, but that make it unlikely to be suitable for a mainstream audience.
Yes, many people who buy laptops like this need a physical rs232 port and a kvm port.
Yes, you could buy an old thinkpad, and it won't fit in a pocket, you could buy sometehing small, and it'll be slow, or you could buy this and get both.
its a AI in your pocket, with an external gpu lol, isn't that ... every laptop lol
I own devices from GPD, and I have had two issues -- devices are simply not reliable, in just over a year the screen showed a green verticle line, and the display died a few months later. Secondly, the keyboard is simply unusable if you plan to program on it.
That's some dime-store psychology going there. Freaking hilarious.
