This may be more legally grey than just piping through audio since you are actually producing a derivative work (even if it is mechanically produced), but the net effect would be awesome. You'd end up with better audio than any one person could record, and the more angles you get the higher quality you can make the audio.
Definitely a great idea and very well done for the first cut. You just need some Wilco on there.