My friend Alexey (@shekhirin here) and I often make small projects analyzing our personal data. For example, we counted popularity of words over time in our Telegram group chats and analyzed browsing history to determine the most productive and unproductive time for each of us.
Most of the time, loading and formatting the data takes more time than actually finding insights. Consumer services provide a machine-readable data export to comply with GDPR. However, you still have to load into memory, extract relationships and otherwise prepare data before starting to look for insights.
So, we decided to build a tool unifying export formats by various services into a single SQL schema. The tool currently supports some parts of Google, Apple Health, Spotify, Telegram, RescueTime, Instagram, Twitter and Netflix exports.
Bionic is a CLI built with Go. Under the hood, it consists of modular “exporters”, each responsible to load data from a certain service export (for example, Google Takeout zip archive) to an SQLite database. You can share one SQLite database for all exports, making it a central hub for your personal data.
One cool outcome of a single database is that you can easily join multiple data exports and produce a report like “Songs I listen [Spotify] in different locations [Google Maps]”.
Would love to hear your feedback! Also, if the project interests you, consider contributing: for example, by developing new exporters or extending the existing ones (currently, Google exporter covers data only for 3 out of 20+ Google products). Alexey and I are available to help.
