The second is closer to reality , initially let pilots (lots of them) label flight events and after landing take all data and build the algorithm around their initial labels. The when there are more pilots let them label agree / disagree and relabel etc.
Another aspect is you have usually two iPads in the cockpit for captain and first officer so you can correlate and match what both accelerometers read.