Personally I hate using Perl because there's a huge amount of syntax that is often context-sensitive. And CPAN modules often use inheritance when composition would be more appropriate, leading to situations where I have to totally re-implement something in order to slightly optimize it or change behavior.
That being said Perl was the first higher-level language I learned so it has a special place in my heart. And I learned to value a lot of the collection-processing capabilities of the language. But the fact that there's more than one way to do things creates a situation where understanding someone else's code requires you to know all the different ways to do something. And the only way to know how some stuff works is to read source code.