undefined | Better HN

0 pointsstingraycharles3y ago0 comments

But if you’re not storing data as JSON, can you really say you’re agile? /s

0 comments

Look, we'll just get it in this way for now, once it's live we'll have all the time we need to change the schema in the background

stingraycharlesOP3y ago

We don’t have a use case yet, but let’s just collect all the data and figure out what to do with it later!

It’s funny how these cliches repeat everywhere in the industry, and it’s almost impossible for people to figure this out beforehand. It seems like everyone needs to deal with data lakes (at scale) at least once in their life before they truly appreciate the costs of the flexibility they offer.

beckingz3y ago

The Data Exhaust approach is simultaneously bad and justifiable. You should measure what matters and think about what you want to measure and why before collecting data. On the other hand, collecting data in case what you want to measure changes later is a usually lowish cost way of maybe having the right data in advance later.

1 more reply

j / k navigate · click thread line to collapse