Skip to content
Better HN
Top
New
Best
Ask
Show
Jobs
Search
⌘K
Compressor "firn" improves ZSTD by 13% | Better HN
Compressor "firn" improves ZSTD by 13%
(opens in new tab)
(github.com)
3 points
seccode
1y ago
3 comments
Share
3 comments
default
newest
oldest
themerone
1y ago
This works by text substitution, I imagine that you could get similar or better gains using zstd custom dictionaries.
seccode
OP
1y ago
This is a direct comparison to zstd with a dictionary actually
seccode
OP
1y ago
Methodology for comparison: train zstd dictionary on enwik9. Then build my dictionary as most common words in enwik9. Mine does 13% better because of the way I discovered how you can generate dictionary replacement symbols
j
/
k
navigate · click thread line to collapse