Tools like DuckDB Wasm and data engineering platforms like Iceberg leverage Parquet’s built-in indexing to very efficiently query files over the network. But as I’ve been building data tools myself, the stack gets complicated fast, especially once you try to visualize or explore the data instead of just querying it. I’m intrigued by some of the modern tricks people are using to do more data engineering client-side.
With OPFS + Parquet + Wasm, the browser already has everything it needs to handle multi-GB LLM datasets client-side.
Is the world of data UIs evolving? Are there new data tools and best practices beyond notebooks and DuckDB?
