undefined | Better HN

0 pointsbreck1y ago0 comments

I assume this is what wayback machine uses?

0 comments

Of course not. They have their own crawler (Heritrix, an open source Java crawler) and archive in WARC format. It‘s serious archiving, they want to preserve reply codes, HTTP headers etc.

j / k navigate · click thread line to collapse

0 pointsbreck1y ago0 comments

I assume this is what wayback machine uses?

0 comments

Tomte1y ago

Of course not. They have their own crawler (Heritrix, an open source Java crawler) and archive in WARC format. It‘s serious archiving, they want to preserve reply codes, HTTP headers etc.

j / k navigate · click thread line to collapse