I am submitting this question to HN to perhaps collect more diverse perspectives than I could get from language models and search engines, given the audience here. I have tried to lean into using Visidata[2] a bit, but it has been a steep learning curve so far, and it hasn't exactly been easy to take visidata transformations and apply them to our python codebase.
1: https://devblogs.microsoft.com/python/data-wrangler-release/
2: https://www.visidata.org/
Am I chasing after a rainbow trying to provide a consistent DX here if I consider this to effectively be a solo project at this scale?
DuckDB seems like a promising contender here, but there is a whole new generation of tooling which has emerged to contend with all of the limitation of pandas.
Does anyone here have any positive stories of interacting with this tooling without effectively also signing up for huge maintenance efforts or a new expensive enterprise license? Open to any and all options that don't require my end users to move away from Python.