Most big players in the LLM field are getting their training data by at-least shady, if not illegal measures.
And if they don't care about laws on one side, why should anyone believe that they care on the other?
Amazon already uses their customers privat data to train models [1].
[1] https://www.ftc.gov/business-guidance/blog/2023/06/hey-alexa...