I have personally used Scrapy in the past, I find it to be a great tool.
Congratulations on your work!