Potentially, yes.
Either way you're not comparing apples to apples using packages from a 3rd party repo built for a different system.
Newer processors have different instruction sets (AVX is a big one). You'd want to make sure you're not only compiling it on each different platform, but also using a new enough compiler to support the instruction sets.