conqueso

Not a data engineer, but I’ve worked with Avro a tiny bit and it quickly became obvious that manually inspecting payloads would not be quick and easy w/o some custom tooling.I’m curious how DEs actually do this in the real world?

For instance, say you’ve got an Avro or Protobuf payload and you’re not sure which schema version it used, how do you inspect the actual record data? Do you just write a quick script? Use avro-tools/protoc? Does your team have internal tools for this?

I'm trying to determine if it'd be worth building a visual inspector where you could drop in the data + schema (or have it detected) and just browse the decoded fields. But maybe that’s not something people need often? Genuinely curious what the usual debugging workflow is. Any input from experienced DEs would be greatly appreciated!