undefined | Better HN

0 pointsdangoodmanUT2y ago0 comments

You defintiely can use S3 for appending to a WAL (I've done it), they have read-after-write consistency

0 comments

You're doing it for large OLAP writes. But as soon as you do OLTP or small writes it will become very slow & expensive.

How about using Kafka for the WAL? Anybody tried that?

LogDevice or apache bookeeper is better for distributed log.

j / k navigate · click thread line to collapse

0 pointsdangoodmanUT2y ago0 comments

You defintiely can use S3 for appending to a WAL (I've done it), they have read-after-write consistency

You're doing it for large OLAP writes. But as soon as you do OLTP or small writes it will become very slow & expensive.

How about using Kafka for the WAL? Anybody tried that?

LogDevice or apache bookeeper is better for distributed log.

j / k navigate · click thread line to collapse