My video streaming wishlist for the next 3 to 5 years
1. WebTransport and WebCodec becomes the primary means for client to server real-time video delivery (e.g. compositing, off-device analysis)
2. No more vendor lockin with WebRTC (WHIP and WHEP might help here). Build a solution once on the client and if I don't like my provider just change the endpoint URL.
3. Google MediaPipe or a high level API on the browser to run AI models easily for audio / video. Right now it seems like most solutions for simple things like blurring are just minor abstractions on top of MediaStreamTrackProcessor.
4. Optimized headless browser for cloud rendering. Too many terrible solutions at the moment using CEF and chrome that then use ffmpeg or gstreamer, XVFB and pulseaudio.
5. Plug and play pipelines in the cloud for video processing (like zapier for video). I can plug in any processing I want in between the source and sink without a convulted mess of trying to push audio and video around to different apps either in network or across the internet.