undefined | Better HN

0 pointsreconnecting1mo ago0 comments

In tirreno (our product), we catch every resource request on the server side, including LLMs.txt and agents.md, to get the IP that requested it and the UA.

What I've seen from ASNs is that visits are coming from GOOGLE-CLOUD-PLATFORM (not from Google itself), and OVH. Based on UA, users are: WebPageTest, BuiltWith, and zero LLMs based on both ASN and UA.

1. https://github.com/tirrenotechnologies/tirreno

0 comments

GaggiX1mo ago

Openclaw agents use the same browser and ASN that me and you use, also the llms.txt (as shown) is displayed as a normal blog page so it can be discover by the agents without having to fetch /llms.txt at random.

reconnectingOP1mo ago

When I look at LLMs.txt, I see every request and there are no ASNs from residential networks or browsers UA.

GaggiX1mo ago

For the third time I'm telling you on Anna’s Archive they have displayed the llms.txt as a standard blog page, not hidden in /llms.txt, so that agents can notice it without having to fetch /llms.txt at random. That's why it's meant for openclaw agents and not openai/anthropic crawlers.

2 more replies

j / k navigate · click thread line to collapse

0 pointsreconnecting1mo ago0 comments

In tirreno (our product), we catch every resource request on the server side, including LLMs.txt and agents.md, to get the IP that requested it and the UA.

1. https://github.com/tirrenotechnologies/tirreno

0 comments

GaggiX1mo ago

reconnectingOP1mo ago

When I look at LLMs.txt, I see every request and there are no ASNs from residential networks or browsers UA.

GaggiX1mo ago

2 more replies

j / k navigate · click thread line to collapse