undefined | Better HN

0 pointsmimsee4y ago0 comments

Because wouldn't they have to keep adding new techniques to the list continuously when in the other case they can say in what format the content needs to be available in.

0 comments

pseudalopex4y ago

Indexable is open to interpretation. No disallow directives in robots.txt isn't.

j / k navigate · click thread line to collapse

0 pointsmimsee4y ago0 comments

Because wouldn't they have to keep adding new techniques to the list continuously when in the other case they can say in what format the content needs to be available in.

0 comments

pseudalopex4y ago

Indexable is open to interpretation. No disallow directives in robots.txt isn't.

j / k navigate · click thread line to collapse