undefined | Better HN

0 pointsdrdaeman7mo ago0 comments

It’s a marketing strategy that works here and now, but “never” is a very long time. What could be seen as pioneers claiming names today could be also seen as retrogressive stubbornness tomorrow and lose its marketing value.

0 comments

dotancohen7mo ago

There's a reason we still call the file robots.txt by that name, and not web-scraping.txt or search-engines.txt.

adobrawy7mo ago

Yea, the reason is RFC9309.

dotancohen7mo ago

That's actually a good point, but we have RFCs superceding RFCs all the time. My favorite RFC, 8601, superseded I think half a dozen other RFCs.

j / k navigate · click thread line to collapse

0 pointsdrdaeman7mo ago0 comments

0 comments

dotancohen7mo ago

There's a reason we still call the file robots.txt by that name, and not web-scraping.txt or search-engines.txt.

adobrawy7mo ago

Yea, the reason is RFC9309.

dotancohen7mo ago

That's actually a good point, but we have RFCs superceding RFCs all the time. My favorite RFC, 8601, superseded I think half a dozen other RFCs.

j / k navigate · click thread line to collapse