On one had you work with them daily and you may know a few intelligent people whom you can have good conversations about.
But on the other hand they may start to suspect that you are working on your side project during business hours.
What are other pros and cons?