Anyways, I've found it useful and I've been slowly adding features. And now happy to release it more widely. It has no signups and collects no identifying info (except a hash of your iMessage phone/email of course). It remembers your preferences and instructions, so it can give better assistance over time.
Under the hood, Olly uses SERP-powered answers, supports voice with Whisper, and image inputs via Llava4, and it has text reminders scheduled via BullMQ. It can also read and summarize documents, embedded on the fly via an in-memory HNSW DB. It uses some dumb routing to a variety of specialized image generation models hosted on Replicate (ftw).
I'm interested in getting feedback from the HN community, especially on the technical aspects and how it could be improved.
Check it out and let me know what you think!
