Show HN: An LLM chat app using Apple's FoundationModels (opens in new tab)

(apps.apple.com)

4 pointsalariccole6mo ago4 comments

Despite Apple’s fairly clear warnings that their 3B 4K model is not for use as a chat app, I had to try anyway. There’s definitely plenty of work to do but it’s starting to become useful.

Happy to answer any questions about limitations, what it’s good at, and how to coax it. The safety guardrails and forced disneyfication make this especially challenging.

4 comments

ndgold6mo ago

Thanks for your work, tried it, it works, it is mostly not useful for me, but I love where this is going and the experience is super streamlined

alariccoleOP6mo ago

Thanks for checking it out. Thinking to do a more file/notes focused version esp on mac because it’s blazing fast there.

bchris46mo ago

Interesting to get a vibe check on the Apple model via chat.

Any plans for RAG across Notes/Email/Calendar?

alariccoleOP6mo ago

Yeah, when I started I actually had no intention of doing a chat app, but it was a good way to learn how it works. Eventual goal with this is a sort of hybrid notes app. Not an llm bolted into Notes, either, but kind of a mix. Find myself using the llm app as a knowledge repo and it’s just not built for that. I’ll post a TestFlight link later if you want to try it out.

j / k navigate · click thread line to collapse

Show HN: An LLM chat app using Apple's FoundationModels (opens in new tab)

(apps.apple.com)

4 pointsalariccole6mo ago4 comments

Despite Apple’s fairly clear warnings that their 3B 4K model is not for use as a chat app, I had to try anyway. There’s definitely plenty of work to do but it’s starting to become useful.

Happy to answer any questions about limitations, what it’s good at, and how to coax it. The safety guardrails and forced disneyfication make this especially challenging.

4 comments

ndgold6mo ago

Thanks for your work, tried it, it works, it is mostly not useful for me, but I love where this is going and the experience is super streamlined

alariccoleOP6mo ago

Thanks for checking it out. Thinking to do a more file/notes focused version esp on mac because it’s blazing fast there.

bchris46mo ago

Interesting to get a vibe check on the Apple model via chat.

Any plans for RAG across Notes/Email/Calendar?

alariccoleOP6mo ago

j / k navigate · click thread line to collapse