undefined | Better HN

0 pointswis1y ago0 comments

Why do LLMs understand markdown really well? (besides the simple, terse and readable syntax of markdown)

They say "LLMs are trained on the web", are the web pages converted from HTML into markdown before being fed into training?

0 comments

I think it says in the Anthropic docs they use markdown internally (I assume that means were trained on it to a significant extent).

I think Anthropic actually uses xml and OpenAI markdown.

They're trained on lots of code, and pretty much every public repo has markdown in it, even if it's just the README.

j / k navigate · click thread line to collapse

0 pointswis1y ago0 comments

Why do LLMs understand markdown really well? (besides the simple, terse and readable syntax of markdown)

They say "LLMs are trained on the web", are the web pages converted from HTML into markdown before being fed into training?

I think it says in the Anthropic docs they use markdown internally (I assume that means were trained on it to a significant extent).

I think Anthropic actually uses xml and OpenAI markdown.

They're trained on lots of code, and pretty much every public repo has markdown in it, even if it's just the README.

j / k navigate · click thread line to collapse