You might read
https://www.openwall.com/lists/oss-security/2024/03/29/4"However, building from source wouldn’t have protected you against this specific backdoor."
Depends on how exactly you build from source. A generic build was not the target. Andres Freund showed that the attack was targeted against a specific type of build system.