Yep. Several months ago I was imagining this exact feature, and yet as I watched a video of it in use, I'm still in awe. It's incredible.
I think this could bring back Google Glass, actually. Imagine wearing them while cooking, and having ChatGPT give you active recipe instructions as well as real-time feedback. I could see that within the next 1-3 years.
Related, the iOS app has supported realtime conversations for months now, using Shortcuts app and the "Hey Siri <shortcut name>" trigger to initiate it. Mine is "Hey Siri, let's talk".
I think they're using Siri for dictation, though. Using Whisper, especially if they use speaker identification, is going to be great. But, a shortcut will still be required to get it going.