Yes, it's a fundamental limitation. Changing colors means moving tiny bits of magnetic dust, and the amount of charge needed is based on where they currently are. This takes more calculation than just running electricity through a light, which can be done regardless of whether or not you were running electricity through it a moment ago. This extra calculation will always take more time, unless the simpler tech reaches a fundamental physical limit like how fast power can be cycled without something melting.