You might want to look at Carton and cpanfiles as a way of managing dependencies. You can also get really ancient stuff off BackPAN, should your dependencies disappear from CPAN proper.

https://metacpan.org/pod/Carton#Tracking-the-dependencies

http://backpan.perl.org/authors/id/