Yep. The server provides signaling (who the peers are, what data is being requested/should be snet, etc) but you're absolutely correct: WebRTC primarily envisioned for high-bandwidth peer-to-peer suitable content such as video/audio/file-sharing.
People have tried using it for gaming (e.g. server is the master peer) but it's tenuous and folks should just stick to WS.