you pay taxes because you live in the EU, even if you leave it brifly..
On the other hand, i am a EU citizen that live abroad and i do not pay any taxes in EU.. Unless i am visiting when i have to pay sales and services taxes..
But i pay taxes in the country i live, and i have to do it even for income i earned abroad..
And sure, there are some countries that make you pay income taxes if you are a citizen even when you live and have income abroad, like the US, but one could argue that you still have access to government services even while living abroad and those are paid via taxes.
this does not change the fact EU laws stop applying when you leave and restart applying when you come back..