GPT-3 already seems capable of generating SVG. I prompted it with:

  <?xml version="1.0" encoding="UTF-8"?><svg xmlns="http://www.w3.org/2000/svg"

and it completed it to the following:

  <?xml version="1.0" encoding="UTF-8"?><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" viewBox="0 0 24 24" id="cloud-sun_svg__-SimpleVector-0"><defs><linearGradient spreadMethod="pad" x2="1" y2="1"><stop offset="0" stop-color="#fff" stop-opacity=".2"/><stop offset="1" stop-opacity=".2"/></linearGradient></defs><path d="M5.5 13.5A2.5 2.5 0 008 16h8a2.5 2.5 0 002.5-2.5S19.5 10 17.5 10H9c-2.5 0-4.5 2-4.5 4.5zM10 11h.5a.5.5 0 100-1h-2a.5.5 0 100 1H10zm2 3.5h2a.5.5 0 100-1h-2a.5.5 0 100 1zm-4 2H8a.5.5 0 100 1h2a.5.5 0 100-1zm-2-2H8a.5.5 0 100 1h2a.5.5 0 100-1z" fill="#000" fill-opacity=".3"/><circle cx="12" cy="19" r="2" fill="#fff"/><path d="M11.5 19h-2c0-1.5 1-2.5 2.5-2.5S14 15.5 14 17h.5a.5.5 0 100-1h-2a.5.5 0 100 1z" fill="#fff"/><path d="M10 13.5h2a.5.5 0 100-1h-2a.5.5 0 100 1z" fill="#fff"/><path fill="url(#cloud-sun_svg__-SimpleVector-0)" d="M16 6l-5 5 5 5v-7c1.5 0 3 1 3 3v2z"/><path fill="#fff" d="M12.5 17h2v2h-2z"/></svg>

which looks like this: https://i.imgur.com/sHpv4Ii.png