Show HN: Delve, an open source (AGPL) enterprise-grade data analytics platform (opens in new tab)

(github.com)

21 pointsilovetux9mo ago19 comments

Hello, I am excited to announce the release of my project that I've been working on for quite a while. It has gone through many iterations. I believe that I now have a scalable platform that can efficiently ingest, search and report on large quantities of data.

If you are at a very large scale, there will need to be some work to streamline your database access, but it is very possible to build a flexible and robust solution.

Delve is built using Django, Django Rest Framework, webpack, JS and SCSS.

Delve can be extended with apps, which are actually specially built Django apps.

Delve has a unix-pipe-like search language that is powered by simple python scripts.

The Delve Web UI has support for showing data in tables, line charts and bar charts with more visualizations on the way.

I am excited to hear your feedback and suggestions.

I will be trying to monitor the comments and reply quickly.

19 comments

atombender9mo ago

Delve is the name of a popular debugger: https://github.com/go-delve/delve

ilovetuxOP9mo ago

Thank you. I appreciate you pointing this out.

It seems like Delve is a popular name for software, which makes sense.

I am officially looking for a new name for this software.

It used to be called Flashlight, as in "A portable tool to shine some light on your data", but I liked the name Delve and a naive google search didn't reveal any projects named delve.

As an aside, Delve is not only popular in software naming, but it also appears in the English language writing quite a lot.

arp2429mo ago

DelveDeep, DeepDelve, DataDelve, DelveData, DelveLight, FlashDelve, DelveFlash

atombender9mo ago

Wish I could help, but names are hard.

1 more reply

FuriouslyAdrift9mo ago

Up until fairly recently, Delve was a Microsoft product that profiled and analyzed corporate data... you might run into some confusion.

https://supersimple365.com/microsoft-is-killing-delve-here-a...

ilovetuxOP9mo ago

Thank you for letting me know. I did not know about the Delve MS product.

I just recently renamed from Flashlight to Delve.

I like the name and MS retired it, so I'm going to try to stick with it.

mdaniel9mo ago

Maybe it's an expected outcome in your system, but this is going to AttributeError if things don't go your way https://github.com/iLoveTux/delve/blob/v0.7.0-dev/src/home/e...

  AttributeError: 'NoneType' object has no attribute 'group'

tuyguntn9mo ago

Name might get punished by SEO engines soon. Because of "Let's delve into details"

ilovetuxOP9mo ago

Good point. because of this and a few other comments, I am planning on renaming the project soon.

Any ideas you would like to share?

chatmasta9mo ago

I like the name. If everyone renamed their product based on HN comments, the marketplace would look like the home directory of a mentally unstable data hoarder.

It does sound like there are some collisions but that doesn’t really matter unless your CLI name clashes, in which case you have many options for adjusting it. The domain name can have suffix or prefix or just “analytics.” And realistically people are going to google “delve analytics” if they can’t find it.

popalchemist9mo ago

Is the name a reference to LOTR or ChatGPT?

ilovetuxOP9mo ago

Neither. I'm using its English definition:

To research or make inquiries into something

vivzkestrel9mo ago

How does it compare to Plausible, Matomo and Umami

ilovetuxOP9mo ago

Thank you for the question.

Those platforms seem to be web analytics platforms, purpose built to track and analyze data from visitors to your web site.

Delve, on the other hand, concentrates on ingesting large quantities of structured, semi-structured and unstructured text based data. Think log files, csv, json, xml, item descriptions, etc.

The closest product to Delve would be something like Splunk or ELK.

I would say Delve is easier to get started with than Splunk or ELK, but actually offers more control since you can easily write your own search commands and field extractions. Also, role based access control is implemented to give fine-grained access to data.

Also configuration is all in one place, backend databases are configurable (sqlite, postgres, MySQL and any other database that works with the django ORM) and more.

Please let me know if you'd like any more details.

ernestbro9mo ago

Do you have a demo video?

ilovetuxOP9mo ago

I do have a video I made a while ago, but I dropped the ball on starting a youtube channel to publish it.

Any recommendations on where I can upload and share a video, preferably one that I could embed in my README.md?

mdaniel9mo ago

Depends on the size, but I have seen a non-trivial number of GitHub projects that reference an .mp4 served by raw.githubuserassets.com in their readme

I would suspect the cheapest way of doing that is to create an issue, drag the mp4 onto it, and then you have a stable reference to use from within the readme

popalchemist9mo ago

Just start the youtube.

j / k navigate · click thread line to collapse

Show HN: Delve, an open source (AGPL) enterprise-grade data analytics platform (opens in new tab)

(github.com)

21 pointsilovetux9mo ago19 comments

If you are at a very large scale, there will need to be some work to streamline your database access, but it is very possible to build a flexible and robust solution.

Delve is built using Django, Django Rest Framework, webpack, JS and SCSS.

Delve can be extended with apps, which are actually specially built Django apps.

Delve has a unix-pipe-like search language that is powered by simple python scripts.

The Delve Web UI has support for showing data in tables, line charts and bar charts with more visualizations on the way.

I am excited to hear your feedback and suggestions.

I will be trying to monitor the comments and reply quickly.

19 comments

atombender9mo ago

Delve is the name of a popular debugger: https://github.com/go-delve/delve

ilovetuxOP9mo ago

Thank you. I appreciate you pointing this out.

It seems like Delve is a popular name for software, which makes sense.

I am officially looking for a new name for this software.

It used to be called Flashlight, as in "A portable tool to shine some light on your data", but I liked the name Delve and a naive google search didn't reveal any projects named delve.

As an aside, Delve is not only popular in software naming, but it also appears in the English language writing quite a lot.

arp2429mo ago

DelveDeep, DeepDelve, DataDelve, DelveData, DelveLight, FlashDelve, DelveFlash

atombender9mo ago

Wish I could help, but names are hard.

1 more reply

FuriouslyAdrift9mo ago

Up until fairly recently, Delve was a Microsoft product that profiled and analyzed corporate data... you might run into some confusion.

https://supersimple365.com/microsoft-is-killing-delve-here-a...

ilovetuxOP9mo ago

Thank you for letting me know. I did not know about the Delve MS product.

I just recently renamed from Flashlight to Delve.

I like the name and MS retired it, so I'm going to try to stick with it.

mdaniel9mo ago

Maybe it's an expected outcome in your system, but this is going to AttributeError if things don't go your way https://github.com/iLoveTux/delve/blob/v0.7.0-dev/src/home/e...

  AttributeError: 'NoneType' object has no attribute 'group'

tuyguntn9mo ago

Name might get punished by SEO engines soon. Because of "Let's delve into details"

ilovetuxOP9mo ago

Good point. because of this and a few other comments, I am planning on renaming the project soon.

Any ideas you would like to share?

chatmasta9mo ago

I like the name. If everyone renamed their product based on HN comments, the marketplace would look like the home directory of a mentally unstable data hoarder.

popalchemist9mo ago

Is the name a reference to LOTR or ChatGPT?

ilovetuxOP9mo ago

Neither. I'm using its English definition:

To research or make inquiries into something

vivzkestrel9mo ago

How does it compare to Plausible, Matomo and Umami

ilovetuxOP9mo ago

Thank you for the question.

Those platforms seem to be web analytics platforms, purpose built to track and analyze data from visitors to your web site.

Delve, on the other hand, concentrates on ingesting large quantities of structured, semi-structured and unstructured text based data. Think log files, csv, json, xml, item descriptions, etc.

The closest product to Delve would be something like Splunk or ELK.

Also configuration is all in one place, backend databases are configurable (sqlite, postgres, MySQL and any other database that works with the django ORM) and more.

Please let me know if you'd like any more details.

ernestbro9mo ago

Do you have a demo video?

ilovetuxOP9mo ago

I do have a video I made a while ago, but I dropped the ball on starting a youtube channel to publish it.

Any recommendations on where I can upload and share a video, preferably one that I could embed in my README.md?

mdaniel9mo ago

Depends on the size, but I have seen a non-trivial number of GitHub projects that reference an .mp4 served by raw.githubuserassets.com in their readme

I would suspect the cheapest way of doing that is to create an issue, drag the mp4 onto it, and then you have a stable reference to use from within the readme

popalchemist9mo ago

Just start the youtube.

j / k navigate · click thread line to collapse