Ask HN: Crawl HN Linked Articles

1 pointsagencies3y ago1 comments

How much does it cost to crawl all urls that are linked from hackernews submissions and comments? Ballpark at least 3.5 million story urls.

Several services would likely do this for several thousand dollars but I'm hoping for something cheaper.

1 comments

Try freelancing website you can get it done for far less.

j / k navigate · click thread line to collapse

1 pointsagencies3y ago1 comments

How much does it cost to crawl all urls that are linked from hackernews submissions and comments? Ballpark at least 3.5 million story urls.

Several services would likely do this for several thousand dollars but I'm hoping for something cheaper.

Try freelancing website you can get it done for far less.

j / k navigate · click thread line to collapse