Show HN: Jqueue: A job queue that runs on a single JSON file (opens in new tab)

(github.com)

2 pointsjeeybee1mo ago0 comments

I built a Python job queue that stores its entire state in one JSON file on S3, GCS, or your filesystem. No Redis, no RabbitMQ, no Postgres. Just object storage.

How it works

Read the JSON file, modify it in memory, write it back with compare-and-set. If two workers race, one wins. The loser retries with fresh state. No locks needed.

Inspired by; https://turbopuffer.com/blog/object-storage-queue

0 comments

No comments yet.

Show HN: Jqueue: A job queue that runs on a single JSON file (opens in new tab)

(github.com)

2 pointsjeeybee1mo ago0 comments

I built a Python job queue that stores its entire state in one JSON file on S3, GCS, or your filesystem. No Redis, no RabbitMQ, no Postgres. Just object storage.

How it works

Read the JSON file, modify it in memory, write it back with compare-and-set. If two workers race, one wins. The loser retries with fresh state. No locks needed.

Inspired by; https://turbopuffer.com/blog/object-storage-queue