Very nice. I wish we could see the actual UI to get a better sense of how it works - can you post a screenshot?
If you paired this with a Kinect or similar multi-camera system you could allow the other hand to interact with the the model/model elements (when not busy doing extravagant gestures of course). Pretty amazing no matter how you slice it, nice job!