I can imagine conversing with a voice assistant if it could process complex language queries, rather than the current restricted tasks (e.g., setting alarms, playing music, checking the weather, turning on lights).
Research in this area is flourishing, so it is certain that LLMs will improve. The popularity of LLMs is partly due to the fact that it has become natural to interact with an "intelligent" computer program. ChatGPT makes this natural, and combining a smart speaker with LLMs would make it even more so.
Enabling a "closed" conversation mode initially, similar to what the free version of ChatGPT does, would be harmless unless people take language model-generated words as absolute truth. This mode could be used to learn new things while cooking and save long conversations to a notes app for later reference. Wouldn't this be an attractive feature for buyers?