"clearly don't want to be tracked" is probably relative.
To be honest I would totally be cool with letting podcast producers know when I play a thing and pausing and whatnot. I think it might be useful to them for improving things and making stuff be better cut.
The counterpoint is that this stuff would probably also be used for ads. But there's already ads in the podcasts? I'm pretty desensitized to targeted ads at this point...