My personal opinion is that transformer architectures are (by their nature) unsecure. When you pair those with "super duper extremely so-eager-to-help weights and autonomous access to private information - voila! Here we are.

What we need is a pairing for transformers and automation that works natively with them. We're in a post-rules-based world now, so it's going to be something new.