Open-source tool helps you convert PDF documents, web pages, etc., into Markdown (opens in new tab)

(github.com)

61 pointsMoon_Y1y ago3 comments

3 comments

Anyone know how this compares to GROBID [1]? I'm looking at alternatives to GROBID as I'm not super pleased with its outputs. GROBID has a lot of great features for journal papers (reference extraction / parsing), but I'm only interested in cleanly extracting the body. Also considering nougat [2] but I haven't tried it yet.

[1] https://github.com/kermitt2/grobid

[2] https://github.com/facebookresearch/nougat

xk_id1y ago

Right, I'm in a similar situation here. I'm trying to read journal papers in the terminal. Previously, I've considered using pdf2htmlEX[0] to generate a layout-preserving HTML5 + CSS version of the PDF; then rendering it in the terminal using browsh (unfortunately terminal browsers like w3m don't support HTML5 + CSS) [1]. Between nougat and MinerU, they seem like a better option.

[0] https://pdf2htmlex.github.io/pdf2htmlEX/ [1] https://www.brow.sh/

oliverkwebb1y ago

Nice tool, I've been using html2md[1] and such. It's written in python and in beta so it's probably not the best for processing static sites and such. But still useful

[1]: https://github.com/suntong/html2md

j / k navigate · click thread line to collapse