Show HN: Llama2.c on a Commodore C64 (opens in new tab)

(github.com)

10 pointsAMICABoard1y ago7 comments

Warning: Inference takes ages.

Pics & Media: https://x.com/VulcanIgnis/status/1893420241310335329

7 comments

"How this works" - Slowly!

I was chatting with ChatGPT 4o the other day and I was asking it on "what steps/software/tools/etc. I need to set up my own LLM offline on a PC".

I suggested a few PCs I got, they were all super slow, but for the purpose I want it (numerical analysis) I can make it work. But even my stupid old PCs are times-infinity faster than this C64!!

AMICABoardOP1y ago

lol :)

desertkun1y ago

I once tried to slap TLS/SSL stack onto ZX Spectrum – so HTTPS connection on it worked, but it took solid two minutes to just load a certificate – sometimes you gotta do the "I made a screaming robot - why? - hmmmmmm...."

strangecasts1y ago

That rules, have you made a writeup of it anywhere?

1 more reply

AMICABoardOP1y ago

It had to be done :) If not us, who else would?

Cheyana1y ago

“No? Well, now you can!”

Lol, I’m stealin’ that.

AMICABoardOP1y ago

You can, it's a meme, I stole it from Karpathy :)

j / k navigate · click thread line to collapse

7 comments

HenryBemis1y ago

"How this works" - Slowly!

I was chatting with ChatGPT 4o the other day and I was asking it on "what steps/software/tools/etc. I need to set up my own LLM offline on a PC".

I suggested a few PCs I got, they were all super slow, but for the purpose I want it (numerical analysis) I can make it work. But even my stupid old PCs are times-infinity faster than this C64!!

AMICABoardOP1y ago

lol :)

desertkun1y ago

strangecasts1y ago

That rules, have you made a writeup of it anywhere?

1 more reply

AMICABoardOP1y ago

It had to be done :) If not us, who else would?

Cheyana1y ago

“No? Well, now you can!”

Lol, I’m stealin’ that.

AMICABoardOP1y ago

You can, it's a meme, I stole it from Karpathy :)

j / k navigate · click thread line to collapse