First on-device Vector database for mobile devices (opens in new tab)

Note that this is not just running a lib like HNSWlib or FAISS on top of database persistence. It's deeply integrated with database internals, which is also why in runs nicely with low-memory devices. The entire binary is like 3 MB, so leaves lots of resources to actual vector data and LLMs.

AMA...