The clients can dynamically adjust their sending rate and resolution. It is pretty easy to downgrade your video when not talking. Its also possible to number and label the encrypted frames (I frames or B frames), allowing decimation for low bandwidth clients without recoding, which is expensive and slow.
There are also ways to send additive resolution streams -- a base stream and additional detail layers (multiresolution like JPEG2000).