undefined | Better HN

0 pointsdylan6042y ago0 comments

> an unwinnable fight when you're selling to datacenter customers.

didn't Apple pretty much throw in the towel in this market simply by choice of form factor for their computers? The sheer desperation of their users wanting a device in this space is shown in the "creative" ways to mount their offerings in a rack.

all of the user friendly things they've done by shrinking the footprint, making them silent, etc are all things a data center does not care about. make it loud with fans to keep things cool so they can run at full load 24/7 without fear of melting down.

so from that lead alone, we can make the next assumption in that Apple doesn't care about vs CUDA. as long as they can show a chart in an over produced hype video for a new hardware announcement that has "arrows go up" as a theme, that is ALL they care about.

0 comments

smoldesu2y ago

I mostly agree, which is why I question their strategy of even "competing" at all. The existence of CoreML feels strictly obligatory, as if the existence of Pytorch and Tensorflow spurned FOMO from the C-suites. It's not terrible, but it's also pretty pointless when the competing libraries do more things, faster.

Users, developers, and probably Apple too would benefit from just using the prior art. I'd go as far as to argue Apple can't thread the AI needle without embracing community contributions. The field simply moves too fast to ship "AI Siri" and call it a day.

> The sheer desperation of their users wanting a device in this space is shown in the "creative" ways to mount their offerings in a rack.

Well you and I both know that nobody is doing that to beat AWS on hosting costs. It's a novelty, and the utility beyond that is restricted to the few processes that require MacOS in some arbitrary way. If we're being honest with ourselves, any muppet with a power drill and enough 1U rails can rackmount a Mac Mini.

dylan604OP2y ago

>I mostly agree, which is why I question their strategy of even "competing" at all.

If it makes their camera "smarter", it's a win. If they can make Siri do something more than "start a timer", then it's a win. If they can have images translate text more accurately, it's a win. There's a lot of things that an on device AI could help users without having to do all of the power hungry creation of a model or the fine tuning. They can do that in the mothership, and just push models on their device.

Not everyone needs to do AI the way you are trying to do it

smoldesu2y ago

I think that's a mistaken way of viewing it. Apple's failure in the gaming space is entirely a matter of policy; you look over at the Steam Deck and Valve is running Microsoft IP without paying for their runtime. Some people really do get their cake and eat it too.

Any of the aforementioned libraries could make their camera smarter or improve Siri/OCR marginally. The fact that Apple wasted their time reinventing the wheel is what bothers me, they're making a mistake by assuming that their internal library will inherently appeal to developers and compete with the SOTA.

The reason why I criticize them is because I legitimately believe Apple is one of the few companies capable of shipping hardware that competes with Nvidia. Apple is their only competitor at TSMC, it's entirely a battle of engineering wits between the two of them right now. Apple is going nowhere fast with CoreML and Accelerate framework, but they could absolutely cut Nvidia off at the pass by investing in the unified infrastructure that Intel and AMD refuse to. It also wouldn't harm the customer experience, leverages third-party contributions to advance their progress, and frees up resources to work on more important things. Just sayin'.

j / k navigate · click thread line to collapse

0 comments

smoldesu2y ago

> The sheer desperation of their users wanting a device in this space is shown in the "creative" ways to mount their offerings in a rack.

dylan604OP2y ago

>I mostly agree, which is why I question their strategy of even "competing" at all.

Not everyone needs to do AI the way you are trying to do it

smoldesu2y ago

j / k navigate · click thread line to collapse