Just because it's on a keyserver doesn't mean it's trustworthy. Keyservers do no verification of any kind on the keys they host.
If you(r system) trust the certificate that https://updates.signal.org/ is using, you should be confident that you are getting the correct keys.
(You shouldn't trust a stranger on the internet, but I am getting the same keys when I download them.)